Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Argonne Geothermal Geochemical Database v2.0

A database of geochemical data from potential geothermal sources aggregated from multiple sources as of March 2010. The database contains fields for the location, depth, temperature, pH, total dissolved solids concentration, chemical composition, and date of sampling. A separate tab contains data on non-condensible gas compositions. The database contains records for over 50,000 wells, although many entries are incomplete. Current versions of source documentation are listed in the dataset.

15 GEOTHERMAL ENERGY↗

Storm and Annual Time Scale Hydrological Data for the Russian River Watershed 1996-2022

These files contains observed and simulated hydrological data (discharge, precipitation) that have been aggregated to the storm-event scale and to the annual time scale for the Russian River Watershed (RRW), California. Observed data are obtained from 12 different USGS hydrological stations located throughout the watershed, and discharge is simulated using the GR5H hourly hydrological model. Precipitation data are obtained from the NASA NLDAS NOAH Community Land Surface Model. All simulated and observed discharge are aggregated to the storm and annual time scales. We investigated changes in watershed hydrological conditions in the Russian River Watershed, a Mediterranean, drought prone, wildfire-adapted ecosystem, following eleven wildfires that occurred from 2017-2020. We ask two research questions: 1) How do interacting wildfire events, drought, and atmospheric rivers impact hydrological conditions of the watershed and in particular streamflow?, and 2) What percentage of new and/or cumulative wildfire disturbance is required to initiate hydrological change? We hypothesize that sub-watersheds of the RRW Mediterranean ecoregion have not burned beyond an intrinsic, and still unknown, threshold required to initiate change. Using a series of paired burned/unburned catchments nested within the larger watershed, we examined temporal and spatial patterns of pre-and-post wildfire water hydrology using a rainfall runoff hydrological model compared with data.

54 ENVIRONMENTAL SCIENCES↗

Intro and Recent Advances: Remote Data Access via OPeNDAP Web Services

During the upcoming Summer 2016 meeting of the ESIP Federation (July 19-22), OpenDAP will hold a Developers and Users Workshop. While a broad set of topics will be covered, a key focus is capitalizing on recent EOSDIS-sponsored advances in Hyrax, OPeNDAPs own software for server-side realization of the DAP2 and DAP4 protocols. These Hyrax advances are as important to data users as to data providers, and the workshop will include hands-on experiences of value to both. Specifically, a balanced set of presentations and hands-on tutorials will address advances in1.server installation,2.server configuration,3.Hyrax aggregation capabilities,4.support for data-access from clients that are HTTP-based, JSON-based or OGC-compliant (especially WCS and WMS),5.support for DAP4,6.use and extension of server-side computational capabilities, and7.several performance-affecting matters. Topics 2 through 7 will be relevant to data consumers, data providers and notably, due to the open-source nature of all OPeNDAP software to developers wishing to extend Hyrax, to build compatible clients and servers, and/or to employ Hyrax as middleware that enables interoperability across a variety of end-user and source-data contexts. A session for contributed talks will elaborate the topics listed above and embrace additional ones.

hyrax↗

Machine Learning-Based Anomaly Detection for Load Forecasting Under Cyberattacks

Accurate load forecasting can create both economic and reliability benefits for power system operators. However, the cyberattack on load forecasting may mislead operators to make unsuitable operational decisions for the electricity delivery. To effectively and accurately detect these cyberattacks, this paper develops a machine learning-based anomaly detection (MLAD) methodology. First, load forecasts provided by neural networks are used to reconstruct the benchmark and scaling data by using the k-means clustering. Second, the cyberattack template is estimated by the naive Bayes classification based on the cumulative distribution function and statistical features of the scaling data. Finally, the dynamic programming is utilized to calculate both the occurrence and parameter of one cyberattack on load forecasting data. Here, a widely used symbolic aggregation approximation method is compared with the developed MLAD method. Numerical simulations on the publicly load data show that the MLAD method can effectively detect cyberattacks for load forecasting data with relatively high accuracy. Also, the robustness of MLAD is verified by thousands of attack scenarios based on Monte Carlo simulation.

97 MATHEMATICS AND COMPUTING↗

The Demand-Side Grid (dsgrid) Model

This presentation gives a high-level overview of the recently published demand-side grid (dsgrid) model documentation. The general modeling philosophy and technical approach of dsgrid is described, as is an initial data set covering 2012 contiguous United States (CONUS) electricity demand. The initial data set describes about 80% of electrical load at an hourly level by county, subsector and end use. Coarser models and data sets are used to describe the remainder. Model residuals are calculated at different levels of aggregation by leveraging historical electricity sector data and a model of 2012 distributed generation. Overall, the dsgrid model has been developed to support analysis of future load scenarios, including interactive effects between energy efficiency, electrification, demand response, renewable energy, battery energy (or other forms of) storage, and future grid conditions broadly construed. Planned future work includes the development of future load scenarios and physically realistic estimates of the flexible load resource.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

The Building ENergy Demand (BEND) Model: A Comprehensive Composite Building Energy Modeling Framework

The Building ENergy Demand (BEND) model was developed at Pacific Northwest National Laboratory (PNNL) to simulate climate-dependent hourly building energy demand with the ability to disaggregate down to or aggregate up to any geographic area of interest, including counties, states, electric utility service territories, and census regions. The BEND modeling framework is designed to study the effects of climate change, economics, technology advancement, and various mitigation policies on aggregate building energy demand. To make the process computationally feasible, BEND reduces granularity in building characteristics and weather forcing while maintaining enough detail to minimize systematic differences (biases) between BEND results and data from the Energy Information Administration (EIA). Based on the Commercial Building Energy Consumption Survey (CBECS) and Residential Energy Consumption Survey (RECS) databases, BEND establishes a set of representative buildings with predefined sets of building types, sizes, and vintages. These representative buildings are defined for each of the four U.S. census regions and the five climate zones used by the EIA for building surveys (hereafter “EIA climate zones”). BEND’s representative buildings are based on a statistical analysis of the CBECS and RECS databases that infers detailed parameters such as construction type, thermal properties, internal loads, equipment and mechanical systems, and operation schedules from the high-level descriptors in those databases (building type, vintage, size, and location). The representative buildings are simplified and consolidated into a set of prototype buildings for the purpose of simulating building energy demand. Combining the prototype buildings with weather files from selected locations and years, BEND creates a set of simulation-ready building models to be run using the EnergyPlus simulation engine (EnergyPlus). The base spatial unit of each BEND simulation is a subregion that is the intersection of an International Energy Conservation Code climate zone, a census region, and an EIA climate zone; analysis for each spatial unit is influenced by the weather file BEND selects to represent the climate-similar area. The major simulation outputs of interest to BEND are hourly energy consumption values for each simulated year, possibly for multiple fuel types. Based on building-stock weights derived from the CBECS/RECS data, the hourly output streams are aggregated to a single, 8760-hour load profile for each of the major building categories—residential and commercial—with the possibility of segregating by fuel types. To correct for biases inherent in the use of a limited suite of representative buildings, BEND is calibrated against observational targets of total annual building energy consumption and hourly load profiles (including peak demand) obtained for the decision-relevant geographic scales of interest (e.g., total electric load data for individual balancing authorities available from EIA). Based on available data such as population distribution, BEND is able to aggregate both up and down scales, allowing the study of building energy demand over a range of spatial scales (e.g., states or counties within the Western Electricity Coordinating Council, Eastern Interconnection, or the entire U.S.) and/or subsets of building types (e.g., office buildings with particular size ranges).

24 POWER TRANSMISSION AND DISTRIBUTION↗

Aggregate Risk Tool for Human Space Flight

This project utilized Data fusion capabilities developed from the 2020-2022 Information Fusion (IFDA) IRAD to enhance functionality of a Human Spaceflight (HSF) Aggregate Risk Product developed by the JSC Flight Safety Office. The tool compiles and presents risk data from multiple Program and Commercial Provider vehicles to provide a holistic assessment of residual risk to Program Managers and Technical Authorities prior to HSF Launches. The aggregation or coupling of risks from multiple sources (Examples: PRA, variances, anomaly data bases, Program Risk Management data bases, technical review board minutes, Hazard Analysis, etc.) when analyzed, identify potential areas of elevated risk in components, systems or mission phases that would otherwise be undetected by nonintegrated program risk management tools and possesses.

Patrick Huckaby↗

Aggregate Risk Tool for Human Space Flight

This tool utilizes Data fusion capabilities developed from the 2020-2022 Information Fusion (IFDA) IRAD to enhance functionality of a Human Spaceflight (HSF) Aggregate Risk Product developed by the JSC Flight Safety Office. The tool compiles and present risk data from multiple Program and Commercial Provider sources to provide a holistic assessment for Program Managers and Technical Authorities to evaluate residual risk prior to HSF Launches. The aggregation, or coupling of risks from multiple sources (Ex: PRA, variances, anomaly data bases, CRM data, technical review board minutes, Hazard Analysis, etc.) identifies areas of elevated risk in components, systems or mission phases that would otherwise be undetected by non-integrated program risk management tools and possesses. Data is then displayed in an interactive user interface/dashboard that enables users to see potential areas of concern requiring more in-depth analysis.

Patrick M Huckaby↗

Distributed Energy Resources Customer Adoption Model - Graphical User Interface, Version 2.1.8

The DER-CAM Graphical User Interface has been redesigned to consist of a dynamic tree structure on the left side of the application window to allow users to quickly navigate between different data categories and views. Views can either be tables with model parameters and input data, the optimization results, or a graphical interface to draw circuit topology and visualize investment results. The model parameters and input data consist of tables where values are assigned to specific keys. The aggregation of all model parameters and input data amounts to the data required to build a DER-CAM model, and is passed to the GAMS solver when users initiate the DER-CAM optimization process. Passing data to the GAMS solver relies on the use of a Java server that handles DER-CAM requests, queuing, and results delivery. This component of the DER-CAM GUI can be deployed either locally or remotely, and constitutes an intermediate step between the user data input and manipulation, and the execution of a DER-CAM optimization in the GAMS engine. The results view shows the results of the DER-CAM optimization and distinguishes between a single and a multi-objective process. The single optimization runs the DER-CAM optimization once and presents the results as a combination of summary charts and hourly dispatch profiles. The multi-objective optimization process consists of a sequence of runs initiated by the GUI, including: 1) CO2 minimization, 2) cost minimization, 3) a user defined number of points in-between objectives 1) and 2). The multi-objective results view includes both access to the detailed results of each point generated by the process as well as the generation of a Pareto Frontier graph to illustrate the trade-off between objectives. DER-CAM GUI 2.1.8 also introduces the ability to graphically generate circuit topologies, enabling support to DER-CAM 5.0.0. This feature consists of: 1) The drawing area, where users can manually create nodes and define their properties (e.g. point of common coupling, slack bus, load) and connect them through edges representing either power lines, transformers, or heat pipes, all with user defined characteristics (e.g., length, ampacity, inductance, or heat loss); 2) The tables, which display the user-defined topology in the final numerical form that will be passed to the DER-CAM optimization. Finally, the DER-CAM GUI is also deployed with a database schema that allows users to provide different energy load profiles, solar irradiance profiles, and tariff data, that can be stored locally and later used in any DER-CAM model. However, no real data will be delivered with this version.

Ewald, Friedrich↗

Small angle x-ray scattering study of the aggregation of gold nanoparticles during formation at the toluene-water interface

We report the results of an in situ small-angle x-ray scattering (SAXS) study of the aggregation of gold nanoparticles formed by an interfacial reaction at the toluene-water interface. The SAXS data provide a direct evidence for aggregate formation of nanoparticles having 1.3 nm gold core and an organic shell that gives a core-core separation of about 2.5 nm. Furthermore, the nanoparticles do not occupy all the cites of 13-member cluster. This occupancy decreases with reaction time and indicate reorganization of the clusters that generates planner disklike structures. A gradual increase in fractal dimension from 1.82 to 2.05 also indicate compactification of cluster aggregation with reaction time, the final exponent being close to 2 expected for disklike aggregates.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

A Guideline for the Assessment of Uniaxial Creep and Creep-Fatigue Data and Models

Of primary concern to FE practitioners is a determination of which constitutive models are the “best”, capable of reproducing the mechanisms expected in an intended design accurately; as well as what experimental datasets are proper or “best” to use for fitting the constitutive parameters needed for the model(s) of interest. In addition, the inherent uncertainty in experiments and the repeatability and stability of extrapolations (for long-lived FE components) is a major concern. The goal of this project is to develop a guideline for the assessment of uniaxial creep and creep-fatigue data and models. The research objectives are RO1) develop an aggregated database of creep and creep-fatigue data for P91 steel and 316 stainless steel and perform a systematic assessment of the uncertainty and integrity of the datasets. RO2) employ the database to benchmark existing creep and creep-fatigue models to evaluate the model’s ability to predict standard and nonstandard boundary conditions.

20 FOSSIL-FUELED POWER PLANTS↗

Assessing the Ability of Instantaneous Aircraft and Sonde Measurements to Characterize Climatological Means and Long-Term Trends in Tropospheric Composition

Over four decades of measurements exist that sample the 3-D composition of reactive trace gases in the troposphere from approximately weekly ozone sondes, instrumentation on civil aircraft, and individual comprehensive aircraft field campaigns. An obstacle to using these data to evaluate coupled chemistry-climate models (CCMs)the models used to project future changes in atmospheric composition and climateis that exact space-time matching between model fields and observations cannot be done, as CCMs generate their own meteorology. Evaluation typically involves averaging over large spatiotemporal regions, which may not reflect a true average due to limited or biased sampling. This averaging approach generally loses information regarding specific processes. Here we aim to identify where discrete sampling may be indicative of long-term mean conditions, using the GEOS-Chem global chemical-transport model (CTM) driven by the MERRA reanalysis to reflect historical meteorology from 2003 to 2012 at 2o by 2.5o resolution. The model has been sampled at the time and location of every ozone sonde profile available from the Would Ozone and Ultraviolet Radiation Data Centre (WOUDC), along the flight tracks of the IAGOSMOZAICCARABIC civil aircraft campaigns, as well as those from over 20 individual field campaigns performed by NASA, NOAA, DOE, NSF, NERC (UK), and DLR (Germany) during the simulation period. Focusing on ozone, carbon monoxide and reactive nitrogen species, we assess where aggregates of the in situ data are representative of the decadal mean vertical, spatial and temporal distributions that would be appropriate for evaluating CCMs. Next, we identically sample a series of parallel sensitivity simulations in which individual emission sources (e.g., lightning, biogenic VOCs, wildfires, US anthropogenic) have been removed one by one, to assess where and when the aggregated observations may offer constraints on these processes within CCMs. Lastly, we show results of an additional 31-year simulation from 1980-2010 of GEOS-Chem driven by the MACCity emissions inventory and MERRA reanalysis at 4o by 5o. We sample the model at every WOUDC sonde and flight track from MOZAIC and NASA field campaigns to evaluate which aggregate observations are statistically reflective of long-term trends over the period.

Atmospheric composition↗

Equilibrium structure of ferrofluid aggregates

We study the equilibrium structure of large but finite aggregates of magnetic dipoles, representing a colloidal suspension of magnetite particles in a ferrofluid. With increasing system size, the structural motif evolves from chains and rings to multi-chain and multi-ring assemblies. Very large systems form single- and multi-wall coils, tubes and scrolls. These structural changes result from a competition between various energy terms, which can be approximated analytically within a continuum model. We also study the effect of external parameters such as magnetic field on the relative stability of these structures. Our results may give insight into experimental data obtained during solidification of ferrofluid aggregates at temperatures where thermal fluctuations become negligible in comparison to inter-particle interactions. These data may also help to experimentally control the aggregation of magnetic particles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

TU-FG-209-08: Distribution of the Deviation Index (DI) in Digital Radiography Practices Across the United States

Purpose: To characterize the distribution of the deviation index (DI) in digital radiography practices across the United States. Methods: DI data was obtained from 10 collaborating institutions in the United States between 2012 and 2015. Each institution complied with the requirements of the Institutional Review Board at their site. DI data from radiographs of the body parts chest, abdomen, pelvis and extremity were analyzed for anteroposterior, posteroanterior, lateral, and decubitus views. The DI data was analyzed both in aggregate and stratified by exposure control method, image receptor technology, patient age, and participating site for each body part and view. The number of exposures with DI falling within previously published control limits for DI and descriptive statistics were calculated. Results: DI data from 505,930 radiographic exposures was analyzed. The number of exposures with DI falling within published control limits for DI varied from 10 to 20% for adult patients and 10 to 23% for pediatric patients for different body parts and views. Mean DI values averaged over other parameters for radiographs of the abdomen, chest, pelvis, and extremities ranged from 0.3 to 1.0, −0.6 to 0.5, 0.8, and −0.9 to 0.5 for the different adult views and ranged from −1.6 to −0.1, −0.3 to 0.5, −0.1, −0.2 to 1.4 for the different pediatric views, respectively (DI data was solicited only for anteroposterior view of pelvis). Standard deviation values of DI from individual sites ranged from 1.3 to 3.6 and 1.3 to 3.0 for the different adult and pediatric views, respectively. Also of interest was that target exposure indicators varied by up to a factor of 6 between sites for certain body parts and views. Conclusion: Previously published DI control limits do not reflect the state of clinical practice in digital radiography. Mean DI and target exposure indicators are targets for quality improvement efforts in radiography.

60 APPLIED LIFE SCIENCES↗

OVIS 3.2 user's guide.

This document describes how to obtain, install, use, and enjoy a better life with OVIS version 3.2. The OVIS project targets scalable, real-time analysis of very large data sets. We characterize the behaviors of elements and aggregations of elements (e.g., across space and time) in data sets in order to detect meaningful conditions and anomalous behaviors. We are particularly interested in determining anomalous behaviors that can be used as advance indicators of significant events of which notification can be made or upon which action can be taken or invoked. The OVIS open source tool (BSD license) is available for download at ovis.ca.sandia.gov. While we intend for it to support a variety of application domains, the OVIS tool was initially developed for, and continues to be primarily tuned for, the investigation of High Performance Compute (HPC) cluster system health. In this application it is intended to be both a system administrator tool for monitoring and a system engineer tool for exploring the system state in depth. OVIS 3.2 provides a variety of statistical tools for examining the behavior of elements in a cluster (e.g., nodes, racks) and associated resources (e.g., storage appliances and network switches). It provides an interactive 3-D physical view in which the cluster elements can be colored by raw or derived element values (e.g., temperatures, memory errors). The visual display allows the user to easily determine abnormal or outlier behaviors. Additionally, it provides search capabilities for certain scheduler logs. The OVIS capabilities were designed to be highly interactive - for example, the job search may drive an analysis which in turn may drive the user generation of a derived value which would then be examined on the physical display. The OVIS project envisions the capabilities of its tools applied to compute cluster monitoring. In the future, integration with the scheduler or resource manager will be included in a release to enable intelligent resource utilization. For example, nodes that are deemed less healthy (i.e., nodes that exhibit outlier behavior with respect to some set of variables shown to be correlated with future failure) can be discovered and assigned to shorter duration or less important jobs. Further, HPC applications with fault-tolerant capabilities would respond to changes in resource health and other OVIS notifications as needed, rather than undertaking preventative measures (e.g. checkpointing) at regular intervals unnecessarily.

97 MATHEMATICS AND COMPUTING↗

OVIS 2.0 user%3CU%2B2019%3Es guide.

This document describes how to obtain, install, use, and enjoy a better life with OVIS version 2.0. The OVIS project targets scalable, real-time analysis of very large data sets. We characterize the behaviors of elements and aggregations of elements (e.g., across space and time) in data sets in order to detect anomalous behaviors. We are particularly interested in determining anomalous behaviors that can be used as advance indicators of significant events of which notification can be made or upon which action can be taken or invoked. The OVIS open source tool (BSD license) is available for download at ovis.ca.sandia.gov. While we intend for it to support a variety of application domains, the OVIS tool was initially developed for, and continues to be primarily tuned for, the investigation of High Performance Compute (HPC) cluster system health. In this application it is intended to be both a system administrator tool for monitoring and a system engineer tool for exploring the system state in depth. OVIS 2.0 provides a variety of statistical tools for examining the behavior of elements in a cluster (e.g., nodes, racks) and associated resources (e.g., storage appliances and network switches). It calculates and reports model values and outliers relative to those models. Additionally, it provides an interactive 3D physical view in which the cluster elements can be colored by raw element values (e.g., temperatures, memory errors) or by the comparison of those values to a given model. The analysis tools and the visual display allow the user to easily determine abnormal or outlier behaviors. The OVIS project envisions the OVIS tool, when applied to compute cluster monitoring, to be used in conjunction with the scheduler or resource manager in order to enable intelligent resource utilization. For example, nodes that are deemed less healthy, that is, nodes that exhibit outlier behavior in some variable, or set of variables, that has shown to be correlated with future failure, can be discovered and assigned to shorter duration or less important jobs. Further, applications with fault-tolerant capabilities can invoke those mechanisms on demand, based upon notification of a node exhibiting impending failure conditions, rather than performing such mechanisms (e.g. checkpointing) at regular intervals unnecessarily.

99 GENERAL AND MISCELLANEOUS↗

Mastering Uncertainty and Risk at Multiple Time Scales in the Future Electrical Grid

Today's electrical grids enjoy a relatively clean separation of spatio-temporal scales yielding a compartmentalization of grid design, optimization, control and risk assessment allowing for the use of conventional mathematical tools within each area. In contrast, the future grid will incorporate time-intermittent renewable generation, operate via faster electrical markets, and tap the latent control capability at finer grid modeling scales; creating a fundamentally new set of couplings across spatiotemporal scales and requiring revolutionary advances in mathematics techniques to bridge these scales. One example is found in decade-scale grid expansion planning in which today's algorithms assume accurate load forecasts and well-controlled generation. Incorporating intermittent renewable generation creates fluctuating network flows at the hourly time scale, inherently linking the ability of a transmission line to deliver electrical power to hourly operational decisions. New operations-based planning algorithms are required, creating new mathematical challenges. Spatio-temporal scales are also crossed when the future grid's minute-scale fluctuations in network flows (due to intermittent generation) create a disordered state upon which second-scale transient grid dynamics propagate effectively invalidating today's on-line dynamic stability analyses. Addressing this challenge requires new on-line algorithms that use large data streams from new grid sensing technologies to physically aggregate across many spatial scales to create responsive, data-driven dynamic models. Here, we sketch the mathematical foundations of these problems and potential solutions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Investigations of spectral separability of small grains, early season wheat detection, and multicrop inventory planning

The author has identified the following significant results. LANDSAT data from seven 5 by 6 segments having crop type information were analyzed to determine the potential for spectral separation of spring wheat from other small grains as an alternative to the primary LACIE procedure for estimating spring wheat acreage. Within segment field-center, classification accuracies for spring wheat vs. barley tended to be best in mid-July when crop color changes were in progress. When correlations were made for differences in atmospheric haze, data from several segments could be aggregated, and results that approached within segment accuracies were obtained for selected dates. LACIE field measurement spectral reflectance data provided information on both wheat development patterns and the importance of various agronomic factors on wheat reflectance, the most important being availability of soil moisture. To investigate early season detection for winter wheat, reflectance of developing wheat patterns was simulated through reflectance modeling and was analyzed along with field measured reflectance from a Kansas site. The green component development of the wheat field was analyzed as a function of data throughout the season. A selected threshold was not crossed by all fields until mid-April. These reflectance data were shown to be consistent actual LANDSAT data.

Nalepka, R. F.↗