SEARCH · Search NASA

Results for “Data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Decoding Ethiopian Abodes: Towards Classifying Buildings by Occupancy Type Using Footprint Morphology

Building occupancy classification plays a crucial role in urban planning, disaster management, and population modeling. Traditional methods often require extensive field surveys or detailed datasets, which can be time-consuming, expensive, and may yield incomplete or erroneous data. In this paper, we present a novel approach for classifying buildings as residential or non-residential using only building footprint data. By extracting geometric shape derivatives that characterize building morphology, we developed a high-accuracy classification model employing a combination of unsupervised and supervised learning methods. We utilized open-source data from Open Street Map, aggregating it to create binary labels for buildings based on their respective human use type. Our approach demonstrates the potential for scalability without the need for additional data sources other than building footprints and labels, offering a more efficient solution for building occupancy classification.

Adams, Daniel↗

DOE OSTI2020

The Manufacturing Data and Machine Learning Platform: Enabling Real-time Monitoring and Control of Scientific Experiments via IoT

IoT devices and sensor networks present new opportunities for measuring, monitoring, and guiding scientific experiments. Sensors, cameras, and instruments can be combined to provide previously unachievable insights into the state of ongoing experiments. However, IoT devices can vary greatly in the type, volume, and velocity of data they generate, making it challenging to fully realize this potential. Indeed, synergizing diverse IoT data streams in near-real time can require the use of machine learning (ML). In addition, new tools and technologies are required to facilitate the collection, aggregation, and manipulation of sensor data in order to simplify the application of ML models and in turn, fully realize the utility of IoT devices in laboratories. Here we will demonstrate how the use of the Argonne-developed Manufacturing Data and Machine Learning (MDML) platform can analyze and use IoT devices in a manufacturing experiment. MDML is designed to standardize the research and operational environment for advanced data analytics and AI-enabled automated process optimization by providing the infrastructure to integrate AI in cyber-physical systems for in situ analysis. We will show that MDML is capable of processing diverse IoT data streams, using multiple computing resources, and integrating ML models to guide an experiment.

Machine Learning↗

DOE OSTI2023

De-Risking Large-Scale PV Systems Through Data Analytics

Large-scale photovoltaic system performance analysis is being conducted within the US Department of Energy's-sponsored PV Fleet Performance Data Initiative. This collaboration with commercial PV system owners collects and evaluates PV field performance data, and provides reports on aggregated results. Drawing on over 2200 sites across the US and over 24,000 separate PV inverters we have collected in excess of 8.3 gigawatts (GW) of performance data, representing 6-7% of the entire US installed PV capacity. A mixture of utility-scale and large commercial systems are represented, averaging 4.1 megawatts (MW) in size and 5 years in age. Initial results show average system degradation rates at -0.75% / year, which is slightly higher than historically reported module-level values of -0.5%/year. We also found that the availability of systems averaged 97.7%, which is lower than the typical 99% uptime assumed by many project economic forecasts. Given these results, we compared monthly performance with expected production values, based on satellite weather data and a simple PVWatts performance model. We found that systems were performing within 10% of monthly expectation over 90% of the time, with a fleet average vs expected monthly value of 0.994. We also evaluated the impact of extreme weather events on system performance, and found a range of short-term and longer-term performance effects ranging from grid outage, system downtime, module damage and accelerated long-term degradation rate.

analysis↗

DOE OSTI2025

Short-Term Electric Load Forecasting for a Residential Household in Alaska

Accurate short-term load forecasting at a fine scale is essential for demand response programs, peak shaving, and load-shedding strategies [1]. While traditionally, only aggregate short-term consumption data was available, advanced metering infrastructure (AMI) now provides data at the individual consumer level [1]. There is increasing interest in utilizing this data for short-term load forecasting (from an hour to a few days) to optimize grid operations. Electricity consumption in individual households is highly influenced by residents’ personal behaviors [2]. As a result, unlike aggregate loads, electrical power usage in single households often shows significant volatility, making meter-level load forecasting for individual users particularly challenging [3], [4]. Deep learning methods, with their strong ability to model nonlinear data, have become popular for improving the accuracy of household electricity consumption forecasting [4]. Notably, the Long ShortTerm Memory (LSTM) has attracted significant attention [5], [6].

42 ENGINEERING↗

DOE OSTI2022

Storm and Annual Time Scale Hydrological Data for the Russian River Watershed 1996-2022

These files contains observed and simulated hydrological data (discharge, precipitation) that have been aggregated to the storm-event scale and to the annual time scale for the Russian River Watershed (RRW), California. Observed data are obtained from 12 different USGS hydrological stations located throughout the watershed, and discharge is simulated using the GR5H hourly hydrological model. Precipitation data are obtained from the NASA NLDAS NOAH Community Land Surface Model. All simulated and observed discharge are aggregated to the storm and annual time scales. We investigated changes in watershed hydrological conditions in the Russian River Watershed, a Mediterranean, drought prone, wildfire-adapted ecosystem, following eleven wildfires that occurred from 2017-2020. We ask two research questions: 1) How do interacting wildfire events, drought, and atmospheric rivers impact hydrological conditions of the watershed and in particular streamflow?, and 2) What percentage of new and/or cumulative wildfire disturbance is required to initiate hydrological change? We hypothesize that sub-watersheds of the RRW Mediterranean ecoregion have not burned beyond an intrinsic, and still unknown, threshold required to initiate change. Using a series of paired burned/unburned catchments nested within the larger watershed, we examined temporal and spatial patterns of pre-and-post wildfire water hydrology using a rainfall runoff hydrological model compared with data.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2016

Intro and Recent Advances: Remote Data Access via OPeNDAP Web Services

During the upcoming Summer 2016 meeting of the ESIP Federation (July 19-22), OpenDAP will hold a Developers and Users Workshop. While a broad set of topics will be covered, a key focus is capitalizing on recent EOSDIS-sponsored advances in Hyrax, OPeNDAPs own software for server-side realization of the DAP2 and DAP4 protocols. These Hyrax advances are as important to data users as to data providers, and the workshop will include hands-on experiences of value to both. Specifically, a balanced set of presentations and hands-on tutorials will address advances in1.server installation,2.server configuration,3.Hyrax aggregation capabilities,4.support for data-access from clients that are HTTP-based, JSON-based or OGC-compliant (especially WCS and WMS),5.support for DAP4,6.use and extension of server-side computational capabilities, and7.several performance-affecting matters. Topics 2 through 7 will be relevant to data consumers, data providers and notably, due to the open-source nature of all OPeNDAP software to developers wishing to extend Hyrax, to build compatible clients and servers, and/or to employ Hyrax as middleware that enables interoperability across a variety of end-user and source-data contexts. A session for contributed talks will elaborate the topics listed above and embrace additional ones.

hyrax↗

NASA NTRSDate not supplied

Aggregate Risk Tool for Human Space Flight

This project utilized Data fusion capabilities developed from the 2020-2022 Information Fusion (IFDA) IRAD to enhance functionality of a Human Spaceflight (HSF) Aggregate Risk Product developed by the JSC Flight Safety Office. The tool compiles and presents risk data from multiple Program and Commercial Provider vehicles to provide a holistic assessment of residual risk to Program Managers and Technical Authorities prior to HSF Launches. The aggregation or coupling of risks from multiple sources (Examples: PRA, variances, anomaly data bases, Program Risk Management data bases, technical review board minutes, Hazard Analysis, etc.) when analyzed, identify potential areas of elevated risk in components, systems or mission phases that would otherwise be undetected by nonintegrated program risk management tools and possesses.

Patrick Huckaby↗

NASA NTRS2022

Aggregate Risk Tool for Human Space Flight

This tool utilizes Data fusion capabilities developed from the 2020-2022 Information Fusion (IFDA) IRAD to enhance functionality of a Human Spaceflight (HSF) Aggregate Risk Product developed by the JSC Flight Safety Office. The tool compiles and present risk data from multiple Program and Commercial Provider sources to provide a holistic assessment for Program Managers and Technical Authorities to evaluate residual risk prior to HSF Launches. The aggregation, or coupling of risks from multiple sources (Ex: PRA, variances, anomaly data bases, CRM data, technical review board minutes, Hazard Analysis, etc.) identifies areas of elevated risk in components, systems or mission phases that would otherwise be undetected by non-integrated program risk management tools and possesses. Data is then displayed in an interactive user interface/dashboard that enables users to see potential areas of concern requiring more in-depth analysis.

Patrick M Huckaby↗

DOE OSTI2019

A Guideline for the Assessment of Uniaxial Creep and Creep-Fatigue Data and Models

Of primary concern to FE practitioners is a determination of which constitutive models are the “best”, capable of reproducing the mechanisms expected in an intended design accurately; as well as what experimental datasets are proper or “best” to use for fitting the constitutive parameters needed for the model(s) of interest. In addition, the inherent uncertainty in experiments and the repeatability and stability of extrapolations (for long-lived FE components) is a major concern. The goal of this project is to develop a guideline for the assessment of uniaxial creep and creep-fatigue data and models. The research objectives are RO1) develop an aggregated database of creep and creep-fatigue data for P91 steel and 316 stainless steel and perform a systematic assessment of the uncertainty and integrity of the datasets. RO2) employ the database to benchmark existing creep and creep-fatigue models to evaluate the model’s ability to predict standard and nonstandard boundary conditions.

20 FOSSIL-FUELED POWER PLANTS↗

NASA NTRS2014

Assessing the Ability of Instantaneous Aircraft and Sonde Measurements to Characterize Climatological Means and Long-Term Trends in Tropospheric Composition

Over four decades of measurements exist that sample the 3-D composition of reactive trace gases in the troposphere from approximately weekly ozone sondes, instrumentation on civil aircraft, and individual comprehensive aircraft field campaigns. An obstacle to using these data to evaluate coupled chemistry-climate models (CCMs)the models used to project future changes in atmospheric composition and climateis that exact space-time matching between model fields and observations cannot be done, as CCMs generate their own meteorology. Evaluation typically involves averaging over large spatiotemporal regions, which may not reflect a true average due to limited or biased sampling. This averaging approach generally loses information regarding specific processes. Here we aim to identify where discrete sampling may be indicative of long-term mean conditions, using the GEOS-Chem global chemical-transport model (CTM) driven by the MERRA reanalysis to reflect historical meteorology from 2003 to 2012 at 2o by 2.5o resolution. The model has been sampled at the time and location of every ozone sonde profile available from the Would Ozone and Ultraviolet Radiation Data Centre (WOUDC), along the flight tracks of the IAGOSMOZAICCARABIC civil aircraft campaigns, as well as those from over 20 individual field campaigns performed by NASA, NOAA, DOE, NSF, NERC (UK), and DLR (Germany) during the simulation period. Focusing on ozone, carbon monoxide and reactive nitrogen species, we assess where aggregates of the in situ data are representative of the decadal mean vertical, spatial and temporal distributions that would be appropriate for evaluating CCMs. Next, we identically sample a series of parallel sensitivity simulations in which individual emission sources (e.g., lightning, biogenic VOCs, wildfires, US anthropogenic) have been removed one by one, to assess where and when the aggregated observations may offer constraints on these processes within CCMs. Lastly, we show results of an additional 31-year simulation from 1980-2010 of GEOS-Chem driven by the MACCity emissions inventory and MERRA reanalysis at 4o by 5o. We sample the model at every WOUDC sonde and flight track from MOZAIC and NASA field campaigns to evaluate which aggregate observations are statistically reflective of long-term trends over the period.

Atmospheric composition↗

NASA NTRS1977

Investigations of spectral separability of small grains, early season wheat detection, and multicrop inventory planning

The author has identified the following significant results. LANDSAT data from seven 5 by 6 segments having crop type information were analyzed to determine the potential for spectral separation of spring wheat from other small grains as an alternative to the primary LACIE procedure for estimating spring wheat acreage. Within segment field-center, classification accuracies for spring wheat vs. barley tended to be best in mid-July when crop color changes were in progress. When correlations were made for differences in atmospheric haze, data from several segments could be aggregated, and results that approached within segment accuracies were obtained for selected dates. LACIE field measurement spectral reflectance data provided information on both wheat development patterns and the importance of various agronomic factors on wheat reflectance, the most important being availability of soil moisture. To investigate early season detection for winter wheat, reflectance of developing wheat patterns was simulated through reflectance modeling and was analyzed along with field measured reflectance from a Kansas site. The green component development of the wheat field was analyzed as a function of data throughout the season. A selected threshold was not crossed by all fields until mid-April. These reflectance data were shown to be consistent actual LANDSAT data.

Nalepka, R. F.↗

NASA NTRS2001

NASA's Information Power Grid: Large Scale Distributed Computing and Data Management

Large-scale science and engineering are done through the interaction of people, heterogeneous computing resources, information systems, and instruments, all of which are geographically and organizationally dispersed. The overall motivation for Grids is to facilitate the routine interactions of these resources in order to support large-scale science and engineering. Multi-disciplinary simulations provide a good example of a class of applications that are very likely to require aggregation of widely distributed computing, data, and intellectual resources. Such simulations - e.g. whole system aircraft simulation and whole system living cell simulation - require integrating applications and data that are developed by different teams of researchers frequently in different locations. The research team's are the only ones that have the expertise to maintain and improve the simulation code and/or the body of experimental data that drives the simulations. This results in an inherently distributed computing and data management environment.

Johnston, William E.↗

DOE OSTI2023

Assessing individual movement, habitat use, and behavior of non-breeding marine birds in relation to prey availability in the US Atlantic

Resource availability is a key factor driving marine bird movements and distributions, but direct information on prey availability is difficult to obtain at relevant scales. We present novel methods for describing multi-scale trophic associations, combining movement analyses of marine birds with estimates of forage fish surface aggregations from digital aerial survey data and species occupancy from bottom trawl survey data. We analyzed satellite telemetry data from northern gannets Morus bassanus , red-throated loons Gavia stellata , and long-tailed ducks Clangula hyemalis in the US Atlantic during the non-breeding period. Using discrete-time hidden Markov models to distinguish area-restricted (i.e. putative foraging) from transit movements, we examined how environmental factors influence movement, and how forage fish species distributions and surface aggregations influence habitat use by gannets and loons that have greater dietary reliance. Our results suggest that chlorophyll a concentration significantly affected movement behavior across species, highlighting the importance of higher-productivity areas around estuaries during colder months when regional productivity is low. Though variable across species and seasons, spatial cross-correlation analysis revealed that herring species (Family Clupeidae), including Atlantic menhaden Brevoortia tyrannus , may be important resources; it also showed positive spatial correlations with forage fish aggregations. This suggests that prey patch dynamics and factors driving aggregation formation may be as important as species composition. However, spatial patterns were generally low (<0.3), suggesting a mismatch in spatiotemporal resolution, exemplifying the challenges in quantifying trophic relationships in marine systems. Disentangling predator-prey relationships is critical to understanding the mechanisms driving marine bird behavior in rapidly changing marine systems.

Environmental Sciences & Ecology↗

NASA NTRS1994

The effects of temperature and NaCl concentration on tetragonal lysozyme face growth rates

Measurements were made of the (110) and (101) face growth rates of the tetragonal form of hen egg white lysozyme at 0.1M sodium acetate buffer, pH 4.0, from 4 to 22 C and with 3.0%, 5.0%, and 7.0% NaCl used as the precipitating salt. The data were collected at supersaturation ratios ranging from approximately 4 to approximately 63. Both decreasing temperature and increasing salt concentrations shifted plots of the growth rate versus C/C(sat) to the right, i.e. higher supersaturations were required for comparable growth rates. The observed trends in the growth data are counter to those expected from the solubility data. If tetragonal lysozyme crystal growth is by addition of ordered aggregates from the solution, then the observed growth data could be explained as a result of the effects of lowered temperature and increased salt concentration on the kinetics and equilibrium processes governing protein-protein interactions in solution. The data indicate that temperature would be a more tractable means of controlling the growth rate for tetragonal lysozyme crystals contrary to the usual practice in, e.g., vapor diffusion protein crystal growth, where both the precipitant and protein concentrations are simultaneously increased. However, the available range for control is dependent upon the protein concentration, with the greatest growth rate control being at the lower concentration.

Forsythe, Elizabeth↗

DOE OSTI2024

A consistent dataset for the net income distribution for 190 countries and aggregated to 32 geographical regions from 1958 to 2015

Abstract. Data on income distributions within and across countries are becoming increasingly important for informing analysis of income inequality and understanding the distributional consequences of climate change. While datasets on income distribution collected from household surveys are available for multiple countries, these datasets often do not represent the same concept of inequality (or income concept) and therefore make comparisons across countries, over time and across datasets difficult. Here, we present a consistent dataset of income distributions across 190 countries from 1958 to 2015 measured in terms of net income. We complement the observed values in this dataset with values imputed from a summary measure of the income distribution, specifically the Gini coefficient. For the imputation, we use a recently developed nonparametric principal-component-based approach that shows an excellent fit to data on income distributions compared to other approaches. We also present another version of this dataset aggregated from the country level to 32 geographical regions. Our dataset is developed for the purpose of calibrating models such as integrated human–Earth system models with detailed data on income distributions. This dataset will enable more robust analysis of income distribution at multiple scales. The latest version of our data are available on Zenodo: https://doi.org/10.5281/zenodo.7093997 (Narayan et al., 2022b).

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1996

Packaging and distributing ecological data from multisite studies

Studies of global change and other regional issues depend on ecological data collected at multiple study areas or sites. An information system model is proposed for compiling diverse data from dispersed sources so that the data are consistent, complete, and readily available. The model includes investigators who collect and analyze field measurements, science teams that synthesize data, a project information system that collates data, a data archive center that distributes data to secondary users, and a master data directory that provides broader searching opportunities. Special attention to format consistency is required, such as units of measure, spatial coordinates, dates, and notation for missing values. Often data may need to be enhanced by estimating missing values, aggregating to common temporal units, or adding other related data such as climatic and soils data. Full documentation, an efficient data distribution mechanism, and an equitable way to acknowledge the original source of data are also required.

Information Systems↗

NASA NTRS2012

Contribution of National near Real Time MODIS Forest Maximum Percentage NDVI Change Products to the U.S. ForWarn System

This presentation reviews the development, integration, and testing of Near Real Time (NRT) MODIS forest % maximum NDVI change products resident to the USDA Forest Service (USFS) ForWarn System. ForWarn is an Early Warning System (EWS) tool for detection and tracking of regionally evident forest change, which includes the U.S. Forest Change Assessment Viewer (FCAV) (a publically available on-line geospatial data viewer for visualizing and assessing the context of this apparent forest change). NASA Stennis Space Center (SSC) is working collaboratively with the USFS, ORNL, and USGS to contribute MODIS forest change products to ForWarn. These change products compare current NDVI derived from expedited eMODIS data, to historical NDVI products derived from MODIS MOD13 data. A new suite of forest change products are computed every 8 days and posted to the ForWarn system; this includes three different forest change products computed using three different historical baselines: 1) previous year; 2) previous three years; and 3) all previous years in the MODIS record going back to 2000. The change product inputs are maximum value NDVI that are composited across a 24 day interval and refreshed every 8 days so that resulting images for the conterminous U.S. are predominantly cloud-free yet still retain temporally relevant fresh information on changes in forest canopy greenness. These forest change products are computed at the native nominal resolution of the input reflectance bands at 231.66 meters, which equates to approx 5.4 hectares or 13.3 acres per pixel. The Time Series Product Tool, a MATLAB-based software package developed at NASA SSC, is used to temporally process, fuse, reduce noise, interpolate data voids, and re-aggregate the historical NDVI into 24 day composites, and then custom MATLAB scripts are used to temporally process the eMODIS NDVIs so that they are in synch with the historical NDVI products. Prior to posting, an in-house snow mask classification product is computed for the current compositing period and integrated into the change images to account for snow related NDVI drops. The supplemental snow classification product was needed because other available QA cloud/snow mask typically underestimates snow cover. MODIS true and false color composites were also computed from eMODIS reflectance data and the true color RGBs are also posted on ForWarn?s FCAV; this data is used for assessing apparent occasional quality issues on the change products due to residual unmasked cloud cover. New forest change products are posted with typical latencies of 1-2 days after the last input eMODIS data collection date for a given 24 day compositing period.

Spruce, Joseph P.↗

DOE OSTI2023

Development of a Benchmark Eddy Flux Evapotranspiration Dataset for Evaluation of Satellite-Driven Evapotranspiration Models Over the CONUS

A large sample of ground-based evapotranspiration (ET) measurements made in the United States, primarily from eddy covariance systems, were post-processed to produce a benchmark ET dataset. The dataset was produced primarily to support the intercomparison and evaluation of the OpenET satellite-based remote sensing ET (RSET) models and could also be used to evaluate ET data from other models and approaches. OpenET is a web-based service that makes field-delineated and pixel-level ET estimates from well-established RSET models readily available to water managers, agricultural producers, and the public. The benchmark dataset is composed of flux and meteorological data from a variety of providers covering native vegetation and agricultural settings. Flux footprint predictions were developed for each station and included static flux footprints developed based on average wind direction and speed, as well as dynamic hourly footprints that were generated with a physically based model of upwind source area. The two footprint prediction methods were rigorously compared to evaluate their relative spatial coverage. Data from all sources were post-processed in a consistent and reproducible manner including data handling, gap-filling, temporal aggregation, and energy balance closure correction. The resulting dataset included 243,048 daily and 5,284 monthly ET values from 194 stations, with all data falling between 1995 and 2021. We assessed average daily energy imbalance using 172 flux sites with a total of 193,021 days of data, finding that overall turbulent fluxes were understated by about 12% on average relative to available energy. Multiple linear regression analyses indicated that daily average latent energy flux may be typically understated slightly more than sensible heat flux. This dataset was developed to provide a consistent reference to support evaluation of RSET data being developed for a wide range of applications related to water accounting and water resources management at field to watershed scales.

54 ENVIRONMENTAL SCIENCES↗