Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

A lightweight I/O scheme to facilitate spatial and temporal queries of scientific data analytics

In the era of petascale computing, more scientific applications are being deployed on leadership scale computing platforms to enhance the scientific productivity. Many I/O techniques have been designed to address the growing I/O bottleneck on large-scale systems by handling massive scientific data in a holistic manner. While such techniques have been leveraged in a wide range of applications, they have not been shown as adequate for many mission critical applications, particularly in data postprocessing stage. One of the examples is that some scientific applications generate datasets composed of a vast amount of small data elements that are organized along many spatial and temporal dimensions but require sophisticated data analytics on one or more dimensions. Including such dimensional knowledge into data organization can be beneficial to the efficiency of data post-processing, which is often missing from exiting I/O techniques. In this study, we propose a novel I/O scheme named STAR (Spatial and Temporal AggRegation) to enable high performance data queries for scientific analytics. STAR is able to dive into the massive data, identify the spatial and temporal relationships among data variables, and accordingly organize them into an optimized multi-dimensional data structure before storing to the storage. This technique not only facilitates the common access patterns of data analytics, but also further reduces the application turnaround time. In particular, STAR is able to enable efficient data queries along the time dimension, a practice common in scientific analytics but not yet supported by existing I/O techniques. In our case study with a critical climate modeling application GEOS-5, the experimental results on Jaguar supercomputer demonstrate an improvement up to 73 times for the read performance compared to the original I/O method.

Tian, Yuan↗

Proximity Portability and in Transit , M-to-N Data Partitioning and Movement in SENSEI [Book Chapter]

In high-performance parallel in situ processing, the term in transit processing refers to those configurations where data must move from a producer to a consumer that runs on separate resources. In the context of parallel and distributed computing on an HPC platform one of the central challenges is to determine a mapping of data from producer ranks to consumer ranks. This problem is complicated by the heterogeneity that arises in producer-consumer pairs, such as when producer and consumer codes have different levels of concurrency, different scaling characteristics, or different data models. The resulting mapping and movement of data from M producer to N consumer ranks can have a significant impact on aggregate application performance, particularly when the data consumer requires only a subset of the overall data for its task. This chapter focuses on the design considerations that underlie SENSEI’s implementation to this challenging problem. These design considerations extend the core SENSEI architecture and include ideas like the need to accommodate flexibility in the choice of different partitioning methods, the ability for a data consumer to request and receive only the subset of data needed for its particular operation, and the ability to leverage any of several different data transport tools. The idea of proximity portability, being able to use different data transport methods as part of an in transit workflow, is illustrated through the use of three different transport layers where switching from one transport tool to another is accomplished with only a configuration file change. Here, the chapter also includes a performance analysis summary showing the performance gains that are possible in terms of multiple metrics, such as memory footprint, time to solution, and amount of data moved, when using optimized partitioners in an in transit setting, gains that are made possible by the implementation shaped by specific design considerations.

Bethel, E. Wes↗

Subtle Effects of Aliphatic Alcohol Structure on Water Extraction and Solute Aggregation in Biphasic Water/ n -Dodecane

Organic phase aggregation behavior of 1-octanol and its structural isomer, 2-ethylhexanol, in a biphasic n-dodecane water system is studied with a combination of physical measurement, small-angle X-ray scattering (SAXS), and atomistic molecular dynamic simulations. Physical properties of the organic phases are probed following their mixing and equilibration with immiscible water phases. Studies reveal that the interfacial tension decreases as a function of increasing alcohol concentration over the solubility range of the alcohol with no evidence for a critical aggregate concentration (cac). An uptake of water into the organic phases is quantified, as a function of alcohol content, by Karl Fischer titrations. The extraction of water into dodecane was further assessed as a function of alcohol concentration via the slope-analysis method sometimes employed in chemical separations. This provides a qualitative understanding of solute (water/alcohol) aggregation in the organic phase. The physical results are supported by analyses of SAXS data that reveals an emergence of aggregates in n-dodecane at elevated alcohol concentrations. The observed aggregate structure is dependent on the alcohol tail group geometry, consistent with surfactant packing parameter. The formation of these aggregates is discussed at a molecular level, where alcohol-alcohol and alcohol-water H-bonding interactions likely dominate the occurrence and morphology of the aggregates.

Knight, Andrew W.↗

A numerical study of soot aggregate formation in a laminar coflow diffusion flame

Soot aggregate formation in a two-dimensional laminar coflow ethylene/air diffusion flame is studied with a pyrene-based soot model, a detailed sectional aerosol dynamics model, and a detailed radiation model. The chemical kinetic mechanism describes polycyclic aromatic hydrocarbon formation up to pyrene, the dimerization of which is assumed to lead to soot nucleation. The growth and oxidation of soot particles are characterized by the HACA surface mechanism and pyrene-soot surface condensation. The mass range of the solid soot phase is divided into thirty-five discrete sections and two equations are solved in each section to model the formation of the fractal-like soot aggregates. The coagulation model is improved by implementing the aggregate coagulation efficiency. Several physical processes that may cause sub-unitary aggregate coagulation efficiency are discussed. Their effects on aggregate structure are numerically investigated. The average number of primary soot particles per soot aggregate n{sub p} is found to be a strong function of the aggregate coagulation efficiency. Compared to the available experimental data, n{sub p} is well reproduced with a constant 20% aggregate coagulation efficiency. The predicted axial velocity, OH mole fraction, and C{sub 2}H{sub 2} mole fraction are validated against experimental data in the literature. Reasonable agreements are obtained. Finally, a sensitivity study of the effects of particle coalescence on soot volume fraction and soot aggregate nanostructure is conducted using a coalescence cutoff diameter method. (author)

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Decoding Ethiopian Abodes: Towards Classifying Buildings by Occupancy Type Using Footprint Morphology

Building occupancy classification plays a crucial role in urban planning, disaster management, and population modeling. Traditional methods often require extensive field surveys or detailed datasets, which can be time-consuming, expensive, and may yield incomplete or erroneous data. In this paper, we present a novel approach for classifying buildings as residential or non-residential using only building footprint data. By extracting geometric shape derivatives that characterize building morphology, we developed a high-accuracy classification model employing a combination of unsupervised and supervised learning methods. We utilized open-source data from Open Street Map, aggregating it to create binary labels for buildings based on their respective human use type. Our approach demonstrates the potential for scalability without the need for additional data sources other than building footprints and labels, offering a more efficient solution for building occupancy classification.

Adams, Daniel↗

The Manufacturing Data and Machine Learning Platform: Enabling Real-time Monitoring and Control of Scientific Experiments via IoT

IoT devices and sensor networks present new opportunities for measuring, monitoring, and guiding scientific experiments. Sensors, cameras, and instruments can be combined to provide previously unachievable insights into the state of ongoing experiments. However, IoT devices can vary greatly in the type, volume, and velocity of data they generate, making it challenging to fully realize this potential. Indeed, synergizing diverse IoT data streams in near-real time can require the use of machine learning (ML). In addition, new tools and technologies are required to facilitate the collection, aggregation, and manipulation of sensor data in order to simplify the application of ML models and in turn, fully realize the utility of IoT devices in laboratories. Here we will demonstrate how the use of the Argonne-developed Manufacturing Data and Machine Learning (MDML) platform can analyze and use IoT devices in a manufacturing experiment. MDML is designed to standardize the research and operational environment for advanced data analytics and AI-enabled automated process optimization by providing the infrastructure to integrate AI in cyber-physical systems for in situ analysis. We will show that MDML is capable of processing diverse IoT data streams, using multiple computing resources, and integrating ML models to guide an experiment.

Machine Learning↗

Comparing Convective Self‐Aggregation in Idealized Models to Observed Moist Static Energy Variability Near the Equator

Abstract Idealized convection‐permitting simulations of radiative‐convective equilibrium have become a popular tool for understanding the physical processes leading to horizontal variability of tropical water vapor and rainfall. However, the applicability of idealized simulations to nature is still unclear given that important processes are typically neglected, such as lateral water vapor advection by extratropical intrusions, or interactive ocean coupling. Here, we exploit spectral analysis to compactly summarize the multiscale processes supporting convective aggregation. By applying this framework to high‐resolution reanalysis data and satellite observations in addition to idealized simulations, we compare convective‐aggregation processes across horizontal scales and data sets. The results affirm the validity of the radiative‐convective equilibrium simulations as an analogy to the real world. Column moist static energy tendencies share similar signs and scale selectivity in convection‐permitting models and observations: Radiation increases variance at wavelengths above 1,000 km, while advection damps variance across wavelengths, and surface fluxes mostly reduce variance between 1,000 and 10,000 km.

Beucler, Tom↗

De-Risking Large-Scale PV Systems Through Data Analytics

Large-scale photovoltaic system performance analysis is being conducted within the US Department of Energy's-sponsored PV Fleet Performance Data Initiative. This collaboration with commercial PV system owners collects and evaluates PV field performance data, and provides reports on aggregated results. Drawing on over 2200 sites across the US and over 24,000 separate PV inverters we have collected in excess of 8.3 gigawatts (GW) of performance data, representing 6-7% of the entire US installed PV capacity. A mixture of utility-scale and large commercial systems are represented, averaging 4.1 megawatts (MW) in size and 5 years in age. Initial results show average system degradation rates at -0.75% / year, which is slightly higher than historically reported module-level values of -0.5%/year. We also found that the availability of systems averaged 97.7%, which is lower than the typical 99% uptime assumed by many project economic forecasts. Given these results, we compared monthly performance with expected production values, based on satellite weather data and a simple PVWatts performance model. We found that systems were performing within 10% of monthly expectation over 90% of the time, with a fleet average vs expected monthly value of 0.994. We also evaluated the impact of extreme weather events on system performance, and found a range of short-term and longer-term performance effects ranging from grid outage, system downtime, module damage and accelerated long-term degradation rate.

analysis↗

Short-Term Electric Load Forecasting for a Residential Household in Alaska

Accurate short-term load forecasting at a fine scale is essential for demand response programs, peak shaving, and load-shedding strategies [1]. While traditionally, only aggregate short-term consumption data was available, advanced metering infrastructure (AMI) now provides data at the individual consumer level [1]. There is increasing interest in utilizing this data for short-term load forecasting (from an hour to a few days) to optimize grid operations. Electricity consumption in individual households is highly influenced by residents’ personal behaviors [2]. As a result, unlike aggregate loads, electrical power usage in single households often shows significant volatility, making meter-level load forecasting for individual users particularly challenging [3], [4]. Deep learning methods, with their strong ability to model nonlinear data, have become popular for improving the accuracy of household electricity consumption forecasting [4]. Notably, the Long ShortTerm Memory (LSTM) has attracted significant attention [5], [6].

42 ENGINEERING↗

Ion aggregation in high salt solutions: Ion network versus ion cluster

The critical aggregation phenomena are ubiquitous in many self-assembling systems. Ions in high salt solutions could also spontaneously form larger ion aggregates, but their effects on hydrogen-bond structures in water have long been controversial. Here, carrying out molecular dynamics (MD) simulation studies of high salt solutions and comparing the MD simulation results with infrared absorption and pump-probe spectroscopy of O–D stretch mode of HDO in highly concentrated salt solutions and {sup 13}C-NMR chemical shift of S{sup 13}CN{sup −} in KSCN solutions, we find evidence on the onset of ion aggregate and large-scale ion-ion network formation that concomitantly breaks water hydrogen-bond structure in certain salt solutions. Despite that these experimental results cannot provide direct evidence on the three-dimensional morphological structures of ion aggregates, they serve as reference data for verifying MD simulation methods. The MD results suggest that disrupted water hydrogen-bond network is intricately intertwined with ion-ion network. This further shows morphological variation of ion aggregate structures from ion cluster to ion network in high salt solutions that are interrelated to the onset of macroscopic aggregate formation and the water hydrogen-bond structure making and breaking processes induced by Hofmeister ions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Argonne Geothermal Geochemical Database v2.0

A database of geochemical data from potential geothermal sources aggregated from multiple sources as of March 2010. The database contains fields for the location, depth, temperature, pH, total dissolved solids concentration, chemical composition, and date of sampling. A separate tab contains data on non-condensible gas compositions. The database contains records for over 50,000 wells, although many entries are incomplete. Current versions of source documentation are listed in the dataset.

15 GEOTHERMAL ENERGY↗

Storm and Annual Time Scale Hydrological Data for the Russian River Watershed 1996-2022

These files contains observed and simulated hydrological data (discharge, precipitation) that have been aggregated to the storm-event scale and to the annual time scale for the Russian River Watershed (RRW), California. Observed data are obtained from 12 different USGS hydrological stations located throughout the watershed, and discharge is simulated using the GR5H hourly hydrological model. Precipitation data are obtained from the NASA NLDAS NOAH Community Land Surface Model. All simulated and observed discharge are aggregated to the storm and annual time scales. We investigated changes in watershed hydrological conditions in the Russian River Watershed, a Mediterranean, drought prone, wildfire-adapted ecosystem, following eleven wildfires that occurred from 2017-2020. We ask two research questions: 1) How do interacting wildfire events, drought, and atmospheric rivers impact hydrological conditions of the watershed and in particular streamflow?, and 2) What percentage of new and/or cumulative wildfire disturbance is required to initiate hydrological change? We hypothesize that sub-watersheds of the RRW Mediterranean ecoregion have not burned beyond an intrinsic, and still unknown, threshold required to initiate change. Using a series of paired burned/unburned catchments nested within the larger watershed, we examined temporal and spatial patterns of pre-and-post wildfire water hydrology using a rainfall runoff hydrological model compared with data.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning-Based Anomaly Detection for Load Forecasting Under Cyberattacks

Accurate load forecasting can create both economic and reliability benefits for power system operators. However, the cyberattack on load forecasting may mislead operators to make unsuitable operational decisions for the electricity delivery. To effectively and accurately detect these cyberattacks, this paper develops a machine learning-based anomaly detection (MLAD) methodology. First, load forecasts provided by neural networks are used to reconstruct the benchmark and scaling data by using the k-means clustering. Second, the cyberattack template is estimated by the naive Bayes classification based on the cumulative distribution function and statistical features of the scaling data. Finally, the dynamic programming is utilized to calculate both the occurrence and parameter of one cyberattack on load forecasting data. Here, a widely used symbolic aggregation approximation method is compared with the developed MLAD method. Numerical simulations on the publicly load data show that the MLAD method can effectively detect cyberattacks for load forecasting data with relatively high accuracy. Also, the robustness of MLAD is verified by thousands of attack scenarios based on Monte Carlo simulation.

97 MATHEMATICS AND COMPUTING↗

The Demand-Side Grid (dsgrid) Model

This presentation gives a high-level overview of the recently published demand-side grid (dsgrid) model documentation. The general modeling philosophy and technical approach of dsgrid is described, as is an initial data set covering 2012 contiguous United States (CONUS) electricity demand. The initial data set describes about 80% of electrical load at an hourly level by county, subsector and end use. Coarser models and data sets are used to describe the remainder. Model residuals are calculated at different levels of aggregation by leveraging historical electricity sector data and a model of 2012 distributed generation. Overall, the dsgrid model has been developed to support analysis of future load scenarios, including interactive effects between energy efficiency, electrification, demand response, renewable energy, battery energy (or other forms of) storage, and future grid conditions broadly construed. Planned future work includes the development of future load scenarios and physically realistic estimates of the flexible load resource.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

The Building ENergy Demand (BEND) Model: A Comprehensive Composite Building Energy Modeling Framework

The Building ENergy Demand (BEND) model was developed at Pacific Northwest National Laboratory (PNNL) to simulate climate-dependent hourly building energy demand with the ability to disaggregate down to or aggregate up to any geographic area of interest, including counties, states, electric utility service territories, and census regions. The BEND modeling framework is designed to study the effects of climate change, economics, technology advancement, and various mitigation policies on aggregate building energy demand. To make the process computationally feasible, BEND reduces granularity in building characteristics and weather forcing while maintaining enough detail to minimize systematic differences (biases) between BEND results and data from the Energy Information Administration (EIA). Based on the Commercial Building Energy Consumption Survey (CBECS) and Residential Energy Consumption Survey (RECS) databases, BEND establishes a set of representative buildings with predefined sets of building types, sizes, and vintages. These representative buildings are defined for each of the four U.S. census regions and the five climate zones used by the EIA for building surveys (hereafter “EIA climate zones”). BEND’s representative buildings are based on a statistical analysis of the CBECS and RECS databases that infers detailed parameters such as construction type, thermal properties, internal loads, equipment and mechanical systems, and operation schedules from the high-level descriptors in those databases (building type, vintage, size, and location). The representative buildings are simplified and consolidated into a set of prototype buildings for the purpose of simulating building energy demand. Combining the prototype buildings with weather files from selected locations and years, BEND creates a set of simulation-ready building models to be run using the EnergyPlus simulation engine (EnergyPlus). The base spatial unit of each BEND simulation is a subregion that is the intersection of an International Energy Conservation Code climate zone, a census region, and an EIA climate zone; analysis for each spatial unit is influenced by the weather file BEND selects to represent the climate-similar area. The major simulation outputs of interest to BEND are hourly energy consumption values for each simulated year, possibly for multiple fuel types. Based on building-stock weights derived from the CBECS/RECS data, the hourly output streams are aggregated to a single, 8760-hour load profile for each of the major building categories—residential and commercial—with the possibility of segregating by fuel types. To correct for biases inherent in the use of a limited suite of representative buildings, BEND is calibrated against observational targets of total annual building energy consumption and hourly load profiles (including peak demand) obtained for the decision-relevant geographic scales of interest (e.g., total electric load data for individual balancing authorities available from EIA). Based on available data such as population distribution, BEND is able to aggregate both up and down scales, allowing the study of building energy demand over a range of spatial scales (e.g., states or counties within the Western Electricity Coordinating Council, Eastern Interconnection, or the entire U.S.) and/or subsets of building types (e.g., office buildings with particular size ranges).

24 POWER TRANSMISSION AND DISTRIBUTION↗

Distributed Energy Resources Customer Adoption Model - Graphical User Interface, Version 2.1.8

The DER-CAM Graphical User Interface has been redesigned to consist of a dynamic tree structure on the left side of the application window to allow users to quickly navigate between different data categories and views. Views can either be tables with model parameters and input data, the optimization results, or a graphical interface to draw circuit topology and visualize investment results. The model parameters and input data consist of tables where values are assigned to specific keys. The aggregation of all model parameters and input data amounts to the data required to build a DER-CAM model, and is passed to the GAMS solver when users initiate the DER-CAM optimization process. Passing data to the GAMS solver relies on the use of a Java server that handles DER-CAM requests, queuing, and results delivery. This component of the DER-CAM GUI can be deployed either locally or remotely, and constitutes an intermediate step between the user data input and manipulation, and the execution of a DER-CAM optimization in the GAMS engine. The results view shows the results of the DER-CAM optimization and distinguishes between a single and a multi-objective process. The single optimization runs the DER-CAM optimization once and presents the results as a combination of summary charts and hourly dispatch profiles. The multi-objective optimization process consists of a sequence of runs initiated by the GUI, including: 1) CO2 minimization, 2) cost minimization, 3) a user defined number of points in-between objectives 1) and 2). The multi-objective results view includes both access to the detailed results of each point generated by the process as well as the generation of a Pareto Frontier graph to illustrate the trade-off between objectives. DER-CAM GUI 2.1.8 also introduces the ability to graphically generate circuit topologies, enabling support to DER-CAM 5.0.0. This feature consists of: 1) The drawing area, where users can manually create nodes and define their properties (e.g. point of common coupling, slack bus, load) and connect them through edges representing either power lines, transformers, or heat pipes, all with user defined characteristics (e.g., length, ampacity, inductance, or heat loss); 2) The tables, which display the user-defined topology in the final numerical form that will be passed to the DER-CAM optimization. Finally, the DER-CAM GUI is also deployed with a database schema that allows users to provide different energy load profiles, solar irradiance profiles, and tariff data, that can be stored locally and later used in any DER-CAM model. However, no real data will be delivered with this version.

Ewald, Friedrich↗

Small angle x-ray scattering study of the aggregation of gold nanoparticles during formation at the toluene-water interface

We report the results of an in situ small-angle x-ray scattering (SAXS) study of the aggregation of gold nanoparticles formed by an interfacial reaction at the toluene-water interface. The SAXS data provide a direct evidence for aggregate formation of nanoparticles having 1.3 nm gold core and an organic shell that gives a core-core separation of about 2.5 nm. Furthermore, the nanoparticles do not occupy all the cites of 13-member cluster. This occupancy decreases with reaction time and indicate reorganization of the clusters that generates planner disklike structures. A gradual increase in fractal dimension from 1.82 to 2.05 also indicate compactification of cluster aggregation with reaction time, the final exponent being close to 2 expected for disklike aggregates.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

A Guideline for the Assessment of Uniaxial Creep and Creep-Fatigue Data and Models

Of primary concern to FE practitioners is a determination of which constitutive models are the “best”, capable of reproducing the mechanisms expected in an intended design accurately; as well as what experimental datasets are proper or “best” to use for fitting the constitutive parameters needed for the model(s) of interest. In addition, the inherent uncertainty in experiments and the repeatability and stability of extrapolations (for long-lived FE components) is a major concern. The goal of this project is to develop a guideline for the assessment of uniaxial creep and creep-fatigue data and models. The research objectives are RO1) develop an aggregated database of creep and creep-fatigue data for P91 steel and 316 stainless steel and perform a systematic assessment of the uncertainty and integrity of the datasets. RO2) employ the database to benchmark existing creep and creep-fatigue models to evaluate the model’s ability to predict standard and nonstandard boundary conditions.

20 FOSSIL-FUELED POWER PLANTS↗