Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

FLUXNET-CH4: a global, multi-ecosystem dataset and analysis of methane seasonality from freshwater wetlands

Methane (CH4) emissions from natural landscapes constitute roughly half of global CH4 contributions to the atmosphere, yet large uncertainties remain in the absolute magnitude and the seasonality of emission quantities and drivers. Eddy covariance (EC) measurements of CH4 flux are ideal for constraining ecosystem-scale CH4 emissions due to quasi-continuous and high-temporal-resolution CH4 flux measurements, coincident carbon dioxide, water, and energy flux measurements, lack of ecosystem disturbance, and increased availability of datasets over the last decade. Here, we (1) describe the newly published dataset, FLUXNET-CH4 Version 1.0, the first open-source global dataset of CH4 EC measurements (available at https://fluxnet.org/data/fluxnet-ch4-community-product/, last access: 7 April 2021). FLUXNET-CH4 includes half-hourly and daily gap-filled and non-gap-filled aggregated CH4 fluxes and meteorological data from 79 sites globally: 42 freshwater wetlands, 6 brackish and saline wetlands, 7 formerly drained ecosystems, 7 rice paddy sites, 2 lakes, and 15 uplands. Then, we (2) evaluate FLUXNET-CH4 representativeness for freshwater wetland coverage globally because the majority of sites in FLUXNET-CH4 Version 1.0 are freshwater wetlands which are a substantial source of total atmospheric CH4 emissions; and (3) we provide the first global estimates of the seasonal variability and seasonality predictors of freshwater wetland CH4 fluxes. Our representativeness analysis suggests that the freshwater wetland sites in the dataset cover global wetland bioclimatic attributes (encompassing energy, moisture, and vegetation-related parameters) in arctic, boreal, and temperate regions but only sparsely cover humid tropical regions. Seasonality metrics of wetland CH4 emissions vary considerably across latitudinal bands. In freshwater wetlands (except those between 20°S to 20°N) the spring onset of elevated CH4 emissions starts 3 d earlier, and the CH4 emission season lasts 4 d longer, for each degree Celsius increase in mean annual air temperature. On average, the spring onset of increasing CH4 emissions lags behind soil warming by 1 month, with very few sites experiencing increased CH4 emissions prior to the onset of soil warming. In contrast, roughly half of these sites experience the spring onset of rising CH4 emissions prior to the spring increase in gross primary productivity (GPP). The timing of peak summer CH4 emissions does not correlate with the timing for either peak summer temperature or peak GPP. Our results provide seasonality parameters for CH4 modeling and highlight seasonality metrics that cannot be predicted by temperature or GPP (i.e., seasonality of CH4 peak). FLUXNET-CH4 is a powerful new resource for diagnosing and understanding the role of terrestrial ecosystems and climate drivers in the global CH4 cycle, and future additions of sites in tropical ecosystems and site years of data collection will provide added value to this database. All seasonality parameters are available at https://doi.org/10.5281/zenodo.4672601 (Delwiche et al., 2021). Additionally, raw FLUXNET-CH4 data used to extract seasonality parameters can be downloaded from https://fluxnet.org/data/fluxnet-ch4-community-product/ (last access: 7 April 2021), and a complete list of the 79 individual site data DOIs is provided in Table 2 of this paper.

FLUXNET-CH4↗
NASA NTRSDate not supplied

Sampling Biases of Space-Based Observations of XCO 2 Associated With South American Biomass Burning Events

We examine time series of OCO-2 xCO2 observations from 2017-2020 coincident with other remotely sensed and in-situ observations to better understand external sampling effects associated with biomass burning events. The GES DISC will publish How-To documents as Jupyter Notebooks to describe how to aggregate OCO-2 Level 2 data and create similar time series.

Kristan Morgan↗
DOE OSTI2026

How does drought affect residential water demand and price elasticity?

Urban water scarcity is an important social and economic concern, particularly as the intensity, duration, and frequency of droughts is increasing in many regions. We consider whether drought induces changes to water demand and the price elasticity of demand for water that may last beyond a drought’s official end date. If drought shocks prompt long-term changes in water demand behavior, and these changes occur at broad geographic scale, they could have important implications for modeling adaptive responses to water scarcity. We assemble a novel dataset on residential water demand and pricing in the western United States to test empirically for effects of drought on water demand and price elasticity. We perform our analysis with aggregate quantity, price, and drought data, accounting for endogenous prices under increasing-block water tariffs and using both average and marginal water fees in estimating water demand functions. Results are consistent with the hypothesis that households may become less price-sensitive after exposure to drought. However, we find no systematic evidence of long-run, drought-related reductions in water demand, itself.

demand hardening↗
DOE OSTI2022

A multi-scale time-series dataset of anthropogenic heat from buildings in Los Angeles County

The dataset contains hourly Anthropogenic heat (AH) from buildings in Los Angeles County, based on weather data from 2018. The hourly AH is aggregated at three spatial resolutions: 450m x 450m grid, 12km x 12km grid, and census tract. The AH is broken down into three components: building envelope surface convection, heating, ventilation, and air conditioning (HVAC) system heat release, and zone exfiltration and exhaust air heat loss. The dataset is created with the physics-based EnergyPlus building energy models to calculate individual buildings' AH considering WRF-UCM simulated microclimate conditions. Please refer to the paper "A multi-scale time-series dataset of anthropogenic heat from buildings in Los Angeles County" for more information about the data generation workflow and the data validation procedure. The data set contains two folders: the "output_data" folder holds the simulation results (EP_output and EP_output_csv), building metadata (building_metadata.geojson and building_metadata.csv), aggregated heat emission and energy consumption time-series data (hourly_heat_energy), and geographical data (geo_data) associated with the GEOID referenced in heat and energy consumption data. The "input_data" folder contains the raw data used to generate files in the "output_data" folder as well as data sets used in the validation. The code repository (https://github.com/IMMM-SFA/xu_etal_2022_sdata) holds the processing scripts for data curation, validation, and visualization.

Energy↗
DOE OSTI2022

A Multi-Branch Decoder Network Approach to Adaptive Temporal Data Selection and Reconstruction for Big Scientific Simulation Data

A key challenge in scientific simulation is that the simulation outputs often require intensive I/O and storage space to store the results for effective post hoc analysis. This article focuses on a quality-aware adaptive temporal data selection and reconstruction problem where the goal is to adaptively select simulation data samples at certain key timesteps in situ and reconstruct the discarded samples with quality assurance during post hoc analysis. This problem is motivated by the limitation of current solutions that a significant amount of simulation data samples are either discarded or aggregated during the sampling process, leading to inaccurate modeling of the simulated phenomena. Two unique challenges exist: 1) the sampling decisions have to be made in situ and adapted to the dynamics of the complex scientific simulation data; 2) the reconstruction error must be strictly bounded to meet the application requirement. To address the above challenges, we develop DeepSample , an error-controlled convolutional neural network framework, that jointly integrates a set of coherent multi-branch deep decoders to effectively reconstruct the simulation data with rigorous quality assurance. The results on two real-world scientific simulation applications show that DeepSample significantly outperforms other state-of-the-art methods on both sampling efficiency and reconstructed simulation data quality.

Zhang, Yang↗
DOE OSTI2021

A Taxonomy for Classification and Comparison of Dataflows for GNN Accelerators

Recently, Graph Neural Networks (GNNs) have received a lot of interest because of their success in learning representations from graph structured data. However, GNNs exhibit different compute and memory characteristics compared to traditional Deep Neural Networks (DNNs). Graph convolutions require feature aggregations from neighboring nodes (known as the aggregation phase), which leads to highly irregular data accesses. GNNs also have a very regular compute phase that can be broken down to matrix multiplications (known as the combination phase). All recently proposed GNN accelerators utilize different dataflows and microarchitecture optimizations for these two phases. Different communication strategies between the two phases have been also used. However, as more custom GNN accelerators are proposed, the harder it is to qualitatively classify them and quantitatively contrast them. In this work, we present a taxonomy to describe several diverse dataflows for running GNN inference on accelerators. This provides a structured way to describe and compare the design-space of GNN accelerators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Differentially Private Adaptive Noise Injection (DP-ANI) v1.0

Location data is collected from users continuously to understand their mobility patterns. Releasing the user trajectories may compromise user privacy. Therefore, the general practice is to release aggregated location datasets. However, private information may still be inferred from an aggregated version of location trajectories. Differential privacy (DP) protects the query output against inference attacks regardless of background knowledge. This software implements a differential privacy-based privacy model that protects the user's origins and destinations from being inferred from aggregated mobility datasets. This is achieved by injecting Planar Laplace noise to the user origin and destination GPS points. The noisy GPS points are then transformed into a link representation using a link-matching algorithm. Finally, the link trajectories form an aggregated mobility network. The injected noise level is selected using the Sparse Vector Mechanism. This DP selection mechanism considers the link density of the location and the functional category of the localized links. Compared to the different baseline models, including a k-anonymity method, our differential privacy-based aggregation model offers query responses that are close to the raw data in terms of aggregate statistics at both the network and trajectory-levels with maximum 9% deviation from the baseline in terms of network length.

Peisert, Sean [Lawrence Berkeley National Laborato↗
NASA NTRS2003

The Data Acquisition and Controls Systems (DACS) of the E-Complex at the John C. Stennis Space Center, MS: A General Overview

The John C. Stennis Space Center (SSC) provides test operations services to a variety of customers including NASA, DoD, commercial enterprises, and others for the development of current next-generation rocket propulsion systems. Many of these test operations services are provided in the E-Complex series of test facilities. The E-Complex is composed of three active test stands (E1, E2, & E3), each with two or more test positions. Each test position is comprised of unique sets of data acquisition and controls hardware and software that record both facility and test article data and safely operate the test facility. The E-Complex data acquisition system (DAS) is actually composed of two separate systems, one for static data and the other for dynamic. The static DAS, otherwise known as the Low-Speed DAS (LSDAS), samples 16 bit data at 250 samples-per-second (SPS), although an aggregate sample rate of 200,000 SPS is possible. The dynamic data acquisition system, otherwise known as the high-speed DAS (HSDAS), samples 16 bit data at 100K SPS with a 45 KHz bandwidth.

Hughes, Mark S.↗
NASA NTRSDate not supplied

Transcriptomics-based Machine Learning (ML) Analysis Predicts Space-Exposed Murine Livers

NASA has employed high-throughput molecular assays to identify sub-cellular changes impacting human physiology during spaceflight. Machine learning (ML) methods hold the promise to improve our ability to identify important signals within highly dimensional molecular data. However, the inherent limitation of study subject numbers within a spaceflight mission minimizes the utility of ML approaches. To overcome the sample power limitations, data from multiple spaceflight missions must be aggregated while appropriately addressing intra- and inter-study variabilities. Here we describe an approach to log transform, scale and normalize data from six heterogeneous, mouse liver derived transcriptomics datasets (ntotal=137) which enabled ML-methods to perform well (AUC ≥ 0.87) in classifying spaceflown vs ground control animals rather than mission-of-origin. Concordance was found between liver-specific biological processes identified from harmonized ML-based analysis and study-by-study classical omics analysis. This work demonstrates the feasibility of applying ML methods on integrated, heterogeneous datasets of small sample size.

Machine Learning↗
DOE OSTI2024

LTE Electrolyzer Data Collection

The goal for NREL is to collect, develop and publish performance metrics relative to low temperature electrolyzer installations. This will be done through the development of: Secure storage solution to house the collection of data from multiple projects Standardization of data to be collected and analyzed. This will be done using data templates developed with the help of partners involved with electrolyzer installations. Analysis that produces metrics of interest for all stakeholders Aggregation of results from multiple projects to view industry progress as a whole Publication of aggregated results in the form of composite data products (CDPs) Collaboration with Idaho National Lab and their work with high temperature electrolyzer installations will enable efficient use of storage and analysis tools.

data↗
DOE OSTI2020

Amphiphile Organization in Organic Solutions: An Alternative Explanation for Small-Angle X-ray Scattering Features in Malonamide/Alkane Mixtures

In this work, the role of different intermolecular interactions in the aggregation of amphiphiles in an organic solvent is studied for systems of relevance to liquid-liquid extraction (LLE), a chemical process used to selectively recover metals from complex mixtures. Of specific interest is the role, or lack thereof, of hydrogen bonding, which is often assumed to be a main driver of the organic phase structural organization that has been linked to separation efficacy. Toward that end, a series of malonamide extractants in n-dodecane have been studied in the absence of any extracted aqueous solutes, including water. The series of extractants includes N,N'-dimethyl-N,N'-dibutyltetradecylmalonamide (DMDBTDMA), two of its homologs, and N,N'-dimethyl-N,N'-dioctylhexylethoxymalonamide (DMDOHEMA). This simplified model LLE system enables systematic investigation of the role of dipole-dipole and alkyl tail steric interactions in amphiphile aggregation. Small-angle X-ray scattering (SAXS) profiles computed from molecular dynamics trajectories are in good agreement with experimental SAXS data. Molecular dynamics simulations show that malonamide aggregation results from dipole-driven self-association and lacks characteristic aggregate sizes. Mid-q correlation peaks in the SAXS profiles emerge at high concentration for each malonamide. In those densely packed solutions, the correlation peaks are observed to result from alkyl tail-induced spacing between electron-rich polar head groups, with peak positions determined by the different alkyl tail lengths present in the malonamide molecule. This explanation of the SAXS correlation peaks contrasts with the prevailing literature, which attributes mesoscale features observed in small-angle scattering to the formation of microemulsions. Instead, this work finds that these features are present in the absence of water or any reverse micellar organization of the malonamides. As such, molecular-scale malonamide self-association and packing, rather than microemulsion-based colloidal-scale descriptions, is a more appropriate framework for these LLE systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRSDate not supplied

Historical Domestic Flights from 2016-2020 with Estimations of Greenhouse Gas Emissions by Aircraft Type

Data and analyses are presented on the utilization of aircraft fuel in the U.S. and the greenhouse gas emissions that they create. Aggregated commercial passenger and freight aviation flight data from 2016-2020 is captured from the Bureau of Transportation Statistics website is used to augment flight data from the Sherlock data warehouse at NASA Ames is used to determine the miles flown by major aircraft models. The corresponding fuel burn is estimated using the International Civilian Aviation Organization fuel burn tables and carbon dioxide emissions are calculated using a fuel-burn multiplicative factor. One key conclusion of this analysis is that long haul flights (i.e. >2485 statute miles) create a disproportionately large amount of carbon dioxide emissions in the U.S while short flights (i.e. < 311 statute miles) contribute less than five percent of the U.S. aviation-related carbon dioxide emission. Although these short-haul flights may not have a large impact on overall carbon dioxide emissions, they will be a critical entry point for the adoption of future, larger fuel-efficient novel vehicles and the impact to future airport and infrastructure requirements. The final paper will present some estimates of the impact of advanced technologies on fuel burn and CO₂ emissions in various scenarios.

Susie Go↗
NASA NTRS2012

Using NASA Environmental Data to Enhance Public Health Decision Making

The Universities Space Research Association at the NASA Marshall Space Flight Center is collaborating with the University of Alabama at Birmingham (UAB) School of Public Health and the Centers for Disease Control and Prevention (CDC) to address issues of environmental health and enhance public health decision making by utilizing NASA remotely sensed data and products. The objectives of this collaboration are to develop high-quality spatial data sets of environmental variables, and deliver the data sets and associated analyses to local, state and federal end-user groups. These data can be linked spatially and temporally to public health data, such as mortality and disease morbidity, for further analysis and decision making. Three daily environmental data sets have been developed for the conterminous U.S. on different spatial resolutions for the time period 2003-2008: (1) spatial surfaces of estimated fine particulate matter (PM2.5) exposures on a 10-km grid utilizing the US Environmental Protection Agency (EPA) ground observations and NASA s MODerate-resolution Imaging Spectroradiometer (MODIS) data; (2) a 1-km grid of Land Surface Temperature (LST) using MODIS data; and (3) a 12-km grid of daily Solar Insolation (SI) and maximum and minimum air temperature using the North American Land Data Assimilation System (NLDAS) forcing data. These environmental data sets will be linked with public health data from the UAB REasons for Geographic And Racial Differences in Stroke (REGARDS) national cohort study to determine whether exposures to these environmental risk factors are related to cognitive decline and other health outcomes. These environmental datasets and public health linkage analyses will be made available to public health professionals, researchers and the general public through the CDC Wide-ranging Online Data for Epidemiologic Research (WONDER) system and through peer reviewed publications. To date, two of the data sets have been released to the public in CDC WONDER, Daily Air Temperature and Heat Index for years 1979-2010, and Daily Fine Particulate Matter (PM2.5) air quality measures for years 2003-2008. These data in CDC WONDER can be aggregated to the county-level, state-level, or regional-level as per users need and downloaded in tabular, graphical, and map formats. The summary statistical output are available to web and app developers via the WONDER Application Programming Interface (API). The linkage of these data with the CDC WONDER system provides a significant addition to CDC WONDER, allowing public health researchers and policy makers to better include environmental exposure data in the context of other health data available in CDC WONDER online system. It also substantially expands public access to NASA environmental data, making their use by a wide range of decision makers feasible.

Al-Hamdan, Mohammad↗
NASA NTRS1994

A Cost and Performance System (CAPS) in a Federal agency

Cost and Performance System (CAPS) is an automated system used from the planning phase through implementation to analysis and documentation. Data is retrievable or available for analysis of cost versus performance anomalies. CAPS provides a uniform system across intra- and international elements. A common system is recommended throughout an entire cost or profit center. Data can be easily accumulated and aggregated into higher levels of tracking and reporting of cost and performance.The level and quality of performance or productivity is indicated in the CAPS model and its process. The CAPS model provides the necessary decision information and insight to the principal investigator/project engineer for a successful project management experience. CAPS provides all levels of management with the appropriate detailed level of data.

Huseonia, W. F.↗
NASA NTRS2008

Examination of Observation Impacts derived from OSEs and Adjoint Models

With the adjoint of a data assimilation system, the impact of any or all assimilated observations on measures of forecast skill can be estimated accurately and efficiently. The approach allows aggregation of results in terms of individual data types, channels or locations, all computed simultaneously. In this study, adjoint-based estimates of observation impact are compared with results from standard observing system experiments (OSEs) in the NASA Goddard Earth Observing System Model, Version 5 (GEOS-5) GEOS-5 system. The two approaches are shown to provide unique, but complimentary, information. Used together, they reveal both redundancies and dependencies between observing system impacts as observations are added or removed. Understanding these dependencies poses a major challenge for optimizing the use of the current observational network and defining requirements for future observing systems.

Gelaro, Ronald↗
DOE OSTI2024

SOMA: Observability, monitoring, and in situ analytics for exascale applications

With the rise of exascale systems and large, data-centric workflows, the need to observe and analyze high performance computing (HPC) applications during their execution is becoming increasingly important. HPC applications are typically not designed with online monitoring in mind, therefore, the observability challenge lies in being able to access and analyze interesting events with low overhead while seamlessly integrating such capabilities into existing and new applications. We explore how our service-based observation, monitoring, and analytics (SOMA) approach to collecting and aggregating both application-specific diagnostic data and performance data addresses these needs. Furthermore, we present our SOMA framework and demonstrate its viability with LULESH, a hydrodynamics proxy application. Then we focus on Astaroth, a multi-GPU library for stencil computations, highlighting the integration of the TAU and APEX performance tools and SOMA for application and performance data monitoring.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1992

Determination of monomer concentrations in crystallizing lysozyme solutions

We have developed a non-optical technique for the study of aggregation in lysozyme and other protein solutions. By monitoring the rate at which lysozyme traverses a semipermeable membrane it was possible to quantitate the degree of aggregation in supersaturated solutions. Using this technique, we have measured the concentration of monomers and larger aggregates in under- and oversaturated lysozyme solutions, and in the presence of crystals, at pH 4.0 and 3 percent NaCl (0.1M NaAc). Comparison of these concentration profiles with (110) face growth rate data supports the theory that tetragonal lysozyme crystals grow by addition of preformed aggregates and not by monomer addition. The data suggest that a considerable population of aggregates larger than dimers are present at lysozyme concentrations above 22 mg/ml. Determination of dimer concentrations, and equilibrium constants for subsequent aggregation levels, are currently underway.

Wilson, L. J.↗