SEARCH · Search NASA

Results for “Multiple data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Machine Learning Digital Twin for Lithium Ion Battery State of Health Predictions

A digital twin system has been established to model the long term degradation of the state of health of lithium ion batteries. Two data streams result from the computational model of the system and from the physical experiment measurements. A machine learning pipeline has been developed at the nexus of these data streams. Leveraging the unique data sources in multiple transfer learning approaches has lead to the development of multiple cell specific machine learning digital twins. Our discussion on this first of its kind technology will cover challenges in data ingestion, scalability, architecture and orchestration, and research findings.

25 - ENERGY STORAGE↗

DOE OSTI2022

Are Terrestrial Biosphere Models Fit for Simulating the Global Land Carbon Sink?

The Global Carbon Project estimates that the terrestrial biosphere has absorbed about one-third of anthropogenic CO 2 emissions during the 1959–2019 period. This sink-estimate is produced by an ensemble of terrestrial biosphere models and is consistent with the land uptake inferred from the residual of emissions and ocean uptake. The purpose of our study is to understand how well terrestrial biosphere models reproduce the processes that drive the terrestrial carbon sink. One challenge is to decide what level of agreement between model output and observation-based reference data is adequate considering that reference data are prone to uncertainties. To define such a level of agreement, we compute benchmark scores that quantify the similarity between independently derived reference data sets using multiple statistical metrics. Models are considered to perform well if their model scores reach benchmark scores. Our results show that reference data can differ considerably, causing benchmark scores to be low. Model scores are often of similar magnitude as benchmark scores, implying that model performance is reasonable given how different reference data are. While model performance is encouraging, ample potential for improvements remains, including a reduction in a positive leaf area index bias, improved representations of processes that govern soil organic carbon in high latitudes, and an assessment of causes that drive the inter-model spread of gross primary productivity in boreal regions and humid tropics. The success of future model development will increasingly depend on our capacity to reduce and account for observational uncertainties.

58 GEOSCIENCES↗

DOE OSTI2025

Optimizing Management of Persistent Data Structures in High-Performance Analytics

Large-scale data analytics workflows ingest massive input data into various data structures, including graphs and key-value datastores. These data structures undergo multiple transformations and computations and are typically reused in incremental and iterative analytics workflows. Persisting in-memory views of these data structures enables reusing them beyond the scope of a single program run while avoiding repetitive raw data ingestion overheads. Memory-mapped I/O enables persisting in-memory data structures without data serialization and deserialization overheads. However, memory-mapped I/O lacks the key feature of persisting consistent snapshots of these data structures for incremental ingestion and processing. The obstacles to efficient virtual memory snapshots using memory-mapped I/O include background writebacks outside the application’s control, and the significantly high storage footprint of such snapshots. To address these limitations, we present Privateer, a memory and storage management tool that enables storage-efficient virtual memory snapshotting while also optimizing snapshot I/O performance. Here, we integrated Privateer into Metall, a state-of-the-art persistent memory allocator for C++, and the Lightning Memory-Mapped Database (LMDB), a widely-used key-value datastore in data analytics and machine learning. Privateer optimized application performance by 1.22× when storing data structure snapshots to node-local storage, and up to 16.7× when storing snapshots to a parallel file system. Privateer also optimizes storage efficiency of incremental data structure snapshots by up to 11× using data deduplication and compression.

Computer science↗

DOE OSTI2021

Error-controlled, progressive, and adaptable retrieval of scientific data with multilevel decomposition

Extreme-scale simulations and high-resolution instruments have been generating an increasing amount of data, which poses significant challenges to not only data storage during the run, but also post-processing where data will be repeatedly retrieved and analyzed for a long period of time. The challenges in satisfying a wide range of post-hoc analysis needs while minimizing the I/O overhead caused by inappropriate and/or excessive data retrieval should never be left unmanaged. In this paper, we propose a data refactoring, compressing, and retrieval framework capable of 1) fine-grained data refactoring with regard to precision; 2) incrementally retrieving and recomposing the data in terms of various error bounds; and 3) adaptively retrieving data in multi-precision and multi-resolution with respect to different analysis. With the progressive data re-composition and the adaptable retrieval algorithms, our framework significantly reduces the amount of data retrieved when multiple incremental precision are requested and/or the downstream analysis time when coarse resolution is used. Experiments show that the amount of data retrieved under the same progressively requested error bound using our framework is 64% less than that using state-of-the-art single-error-bounded approaches. Parallel experiments with up to 1, 024 cores and ~ 600 GB data in total show that our approach yields 1.36× and 2.52× performance over existing approaches in writing to and reading from persistent storage systems, respectively.

Liang, Xin↗

DOE OSTI2018

SolarView: Georgia Solar Adoption in Context

The local-national gap is a problem currently plaguing the adoption of emerging technologies targeted at resolving energy transition issues that are characterized by disparities in the adoption of innovations and policies on a local level in response to national policy implementation. These disparities reflect a complex system of technical, economic, social, political, and ecological factors linked to the perceptions held by communities and how they see energy development and national/global policy goals. This dataset is an attempt to bridge the local-national gap regarding solar PV adoption in the State of Georgia (U.S.) by aggregating variables from seven different publicly-available sources. The objective of this activity was to design a resource that would help researchers interested in the context underlying solar adoption on the local scale of governance (e.g., the county level). The SolarView database includes information necessary for informing policy-making activities such as solar installation information, a historical county zip code directory, county-level census data, housing value indexes, renewable energy incentive totals, PV rooftop suitability percentages, and utility rates. As this is a database from multiple sources, incomplete data entries are noted.

14 SOLAR ENERGY↗

NASA NTRS1987

New methods and results for quantification of lightning-aircraft electrodynamics

The NASA F-106 collected data on the rates of change of electromagnetic parameters on the aircraft surface during over 700 direct lightning strikes while penetrating thunderstorms at altitudes from 15,000 t0 40,000 ft (4,570 to 12,190 m). These in situ measurements provided the basis for the first statistical quantification of the lightning electromagnetic threat to aircraft appropriate for determining indirect lightning effects on aircraft. These data are used to update previous lightning criteria and standards developed over the years from ground-based measurements. The proposed standards will be the first which reflect actual aircraft responses measured at flight altitudes. Nonparametric maximum likelihood estimates of the distribution of the peak electromagnetic rates of change for consideration in the new standards are obtained based on peak recorder data for multiple-strike flights. The linear and nonlinear modeling techniques developed provide means to interpret and understand the direct-strike electromagnetic data acquired on the F-106. The reasonable results obtained with the models, compared with measured responses, provide increased confidence that the models may be credibly applied to other aircraft.

Pitts, Felix L.↗

DOE OSTI2021

Review of Release Behavior of Hydrogen & Natural Gas Blends from Pipelines

Hydrogen can be used to reduce carbon emissions by blending into other gaseous energy carriers, such as natural gas. However, hydrogen blending into natural gas has important implications for safety which need to be evaluated. Hydrogen has different physical properties than natural gas, and these properties affect safety evaluations concerning a leak of the blended gas. The intent of this report is to begin to investigate the safety implications of blending hydrogen into the natural gas infrastructure with respect to a leak event from a pipeline. A literature review was conducted to identify existing data that will better inform future hazard and risk assessments for hydrogen/natural gas blends. Metrics with safety implications such as heat flux and dispersion behavior may be affected by the overall blend ratio of the mixture. Of the literature reviewed, there was no directly observed separation of the hydrogen from the natural gas or methane blend. No literature was identified that experimentally examined unconfined releases such as concentration fields or concentration at specific distances. Computational efforts have predicted concentration fields by modified versions of existing engineering models, but the validation of these models is limited by the unavailability of literature data. There are multiple literature sources that measured flame lengths and heat flux values, which are both relevant metrics to risk and hazard assessments. These data can be more directly compared to the outputs of existing engineering models for validation.

03 NATURAL GAS↗

DOE OSTI2024

Offline Power Systems Applications Enabled by Phasor Measurement Units: Technical Assistance to the Power Sectors of Southeast Asia

This report provides a brief overview of several offline (non-real-time) applications facilitated by high-resolution time-synchronized measurements recorded by phasor measurement units (PMUs). The high reporting rate and time-synchronization of PMU records provide a detailed view of power system dynamics, enabling electric utilities to obtain a better understanding of their systems. In this report, the following applications have been reviewed: Power plant model validation, System model validation, Ringdown oscillation analysis, Frequency response analysis, Postmortem analysis of disturbance events Along with a brief technical background of the applications above, applicable North American Electric Reliability Corporation (NERC) standards have been discussed, and examples of implementation in North American organizations have been provided. Implementing several of the discussed applications may need a preliminary stage of data gathering from multiple entities, and several frameworks and process flows have been formulated by organizations around the world for this purpose. However, the data-gathering stage has not been considered in the scope of the present report.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Generic and ML Workloads in an HPC Datacenter: Node Energy, Job Failures, and Node-Job Analysis

HPC datacenters offer a backbone to the modern digital society. Increasingly, they run Machine Learning (ML) jobs next to generic, compute-intensive workloads, supporting science, business, and other decision-making processes. However, understanding how ML jobs impact the operation of HPC datacenters, relative to generic jobs, remains desirable but understudied. In this work, we leverage long-term operational data, collected from a national-scale production HPC datacenter, and statistically compare how ML and generic jobs can impact the performance, failures, resource utilization, and energy consumption of HPC datacenters. Our study provides key insights, e.g., ML-related power usage causes GPU nodes to run into temperature limitations, median/mean runtime and failure rates are higher for ML jobs than for generic jobs, both ML and generic jobs exhibit highly variable arrival processes and resource demands, significant amounts of energy are spent on unsuccessfully terminating jobs, and concurrent jobs tend to terminate in the same state. We open-source our cleaned-up data traces on Zenodo (https://doi. org/10.5281/zenodo.13685426), and provide our analysis toolkit as software hosted on GitHub (https://github.com/atlarge-research/2024-icpads-hpc-workload-characterization). This study offers multiple benefits for data center administrators, who can improve operational efficiency, and for researchers, who can further improve system designs, scheduling techniques, etc.

crossanalysis↗

DOE OSTI2021

Model America - data and models of every U.S. building

The 5-year goal of the 'Model America' concept was to generate a model of every building in the United States. This data repository delivers on that goal. Oak Ridge National Laboratory (ORNL) has developed the Automatic Building Energy Modeling (AutoBEM) software suite to process multiple types of data, extract building-specific descriptors, generate building energy models, and simulate them on High Performance Computing (HPC) resources. For more information, see AutoBEM-related publications (bit.ly/AutoBEM). There were 125,714,640 buildings detected in the United States and this dataset contains 122,930,327 (97.8%) buildings which resulted in a successful simulation. Future, annual updates have been proposed that may include additional buildings, data improvements, or other algorithmic enhancements. This dataset of 122.9 million buildings includes: Models (state_county.zip) - OpenStudio (v3.1.0) and EnergyPlus (v9.4) building energy models. Please note that the download requires the free Globus Connect Personal (https://www.globus.org/globus-connect-personal); Each model has approximately 3,000 building input descriptors that can be extracted. Please see the EnergyPlus(v9.4) 2,784-page Input/Output Reference Guide (https://energyplus.net/sites/all/modules/custom/nrel_custom/pdfs/pdfs_v9.4.0/InputOutputReference.pdf) for everything that can be retrieved or simulated from these models. These models were derived from the following metadata, which is not included in this dataset: 1. ID - unique building ID 2. County - county name 3. State - state name 4. CZ - ASHRAE Climate Zone designation 5. Clim_Zone - text label of climate zone 6. est_year - estimated year of construction 7. est_commercial - estimated building type (0=residential, 1=commercial) 8. Centroid - building center location in latitude/longitude (from Footprint2D) 9. Footprint2D - building polygon of 2D footprint (lat1/lon1_lat2/lon2_...) 10. Height - building height (meters) 11. Area2D - footprint area (ft2) 12. BuildingType - DOE prototype building designation (IECC=residential) as implemented by OpenStudio-standards 13. WWR_surfaces - percent of each facade (pair of points from Footprint2D) covered by fenestration/windows (average 14.5% for residential, 40% for commercial buildings) 14. NumFloors - number of floors (above-grade) 15. Area - estimate of total conditioned floor area (ft2) 16. Standard - building vintage. These models are made free and openly available in hopes of stimulating any simulation-informed use case. Data is provided as-is with no warranties, express or implied, regarding fitness for a particular purpose. We wish to thank our sponsors which include Oak Ridge National Laboratory (ORNL) Laboratory Directed Research and Development (LDRD), U.S. Dept. of Energy's (DOE) Building Technologies Office (BTO), Office of Electricity (OE), Biological and Environmental Research (BER), and National Nuclear Security Administration (NNSA). This research used resources of the Argonne Leadership Computing Facility, which is a DOE Office of Science User Facility supported under Contract DE-AC02-06CH11357. Please cite as: New, Joshua R., Adams, Mark, Bass, Brett, Berres, Anne, and Clinton, Nicholas (2021). 'Model America - data and models of every U.S. building. [Data set].' Constellation, doi.ccs.ornl.gov/ui/doi/339, April 14, 2021

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2016

Prospects of the ICESat-2 Laser Altimetry Mission for Savanna Ecosystem Structural Studies Based on Airborne Simulation Data

The next planned spaceborne lidar mission is the Ice, Cloud and land Elevation Satellite 2 (ICESat-2), which will use the Advanced Topographic Laser Altimeter System (ATLAS) sensor, a photon counting technique. To pre-validate the capability of this mission for studying three dimensional vegetation structure in savannas, we assessed the potential of the measurement approach to estimate canopy height in an oak savanna landscape. We used data from the Multiple Altimeter Beam Experimental Lidar (MABEL), an airborne photon counting lidar sensor developed by NASA's Goddard Space Flight Center. ATLAS-like data was generated using the MATLAS simulator, which adjusts MABEL data's detected number of signal and noise photons to that expected from the ATLAS instrument. Transects flown over the Tejon ranch conservancy in Kern County, California, USA were used for this work. For each transect we chose to use data from the near infrared channel that had the highest number of photons. We segmented each transect into 50 m, 25 m and 14 m long blocks and aggregated the photons in each block into a histogram based on their elevation values. We then used an automated algorithm to identify cut off points where the cumulative density of photons from the highest elevation indicates the presence of the canopy top and likewise where such cumulative density from the lowest elevation indicates the mean terrain elevation. MABEL derived height metrics were moderately correlated to discrete return lidar (DRL) derived height metrics r(sub 2) and RMSE values ranging from 0.60 to 0.73 and 2.9 m to 4.4 m respectively) but MATLAS simulation resulted in more modest correlations with DRL indices r(sub 2) ranging from 0.5 to 0.64 and RMSE from 3.6 m to 4.6 m). Simulations also indicated that the expected number of signal photons from ATLAS will be substantially lower, a situation that reduces canopy height estimation precision especially in areas of low density vegetation cover. On the basis of the simulated data, there is reason to believe that the ability of ICESat-2 to estimate height in savannas will be comparable to the original ICESat mission although the respective sensors have different measurement principles.

Gwenzi, David↗

NASA NTRS1992

Performance assessment in complex individual and team tasks

Described here is an eclectic, performance based approach to assessing cognitive performance from multiple perspectives. The experience gained from assessing the effects of antihistamines and scenario difficulty on C (exp 2) decision making performance in Airborne Warning and Control Systems (AWACS) weapons director (WD) teams can serve as a model for realistic simulations in space operations. Emphasis is placed on the flexibility of measurement, hierarchical organization of measurement levels, data collection from multiple perspectives, and the difficulty of managing large amounts of data.

Eddy, Douglas R.↗

DOE OSTI2022

Deep learning-based spatio-temporal estimate of greenhouse gas emissions using satellite data

Accurate estimation of greenhouse gases (GHGs) emissions is very important for developing mitigation strategies to climate change by controlling and reducing GHG emissions. This project aims to develop multiple deep learning approaches to estimate anthropogenic greenhouse gas emissions using multiple types of satellite data. NO2 concentration is chosen as an example of GHGs to evaluate the proposed approach. Two sentinel satellites (sentinel-2 and sentinel-5P) provide multiscale observations of GHGs from 10-60m resolution (sentinel-2) to ~kilometer scale resolution (sentinel-5P). Among multiple deep learning (DL) architectures evaluated, two best DL models demonstrate that key features of spatio-temporal satellite data and additional information (e.g., observation times and/or coordinates of ground stations) can be extracted using convolutional neural networks and feed forward neural networks, respectively. In particular, irregular time series data from different NO 2 observation stations limit the flexibility of long short-term memory architecture, requiring zero-padding to fill in missing data. However, deep neural operator (DNO) architecture can stack time-series data as input, providing the flexibility of input structure without zero-padding. As a result, the DNO outperformed other deep learning architectures to account for time-varying features. Overall, temporal patterns with smooth seasonal variations were predicted very well, while frequent fluctuation patterns were not predicted well. In addition, uncertainty quantification using conformal inference method is performed to account for prediction ranges. Overall, this research will lead to a new groundwork for estimating greenhouse gas concentrations using multiple satellite data to enhance our capability of tracking the cause of climate change and developing mitigation strategies.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1981

Survey of Federal, National, and International standards applicable to the NASA applications data services

An applications data service (ADS) was developed to meet the challenges in the data access and integration. The ADS provides a common service to locate and access applications data electronically and integrate the cross correlative data sets required by multiple users. Its catalog and network services increase data visibility as well as provide the data in a more rapid manner and a usable form.

Kuch, T.↗

NASA NTRS1984

Correlation of microwave sensor returns with soil moisture

Microwave sensor soil data were collected by aircraft over agricultural croplands. Multiple incident angle scatterometer data (13.3, 4.75, 1.6 and 0.4 GHz), passive radiometer data (L and C-band), and soil moisture ground truth measurements were collected coincidentally. Each sensor and angle of incidence was linearly analyzed against the measured soil moisture. For bare agricultural soils, the optimal single sensor for soil moisture preduction is the L-band passive radiometer. The effects of vegetation and differing surface roughness prove significant. When both bare and vegetated surfaces were studied, the masking due to the vegetation renders the single sensor approach ineffective in soil moisture prediction. Multisensor techniques are necessary to remotely measure soil moisture when a priori knowledge of vegetation is not available.

Taube, D. W.↗

NASA NTRS1992

Variability of geophysical parameters from aircraft radiance measurements for FIFE

Airborne multispectral images were gathered on two days during the First ISLCP Field Experiment (FIFE) to study the time and space variability of remotely sensed geophysical parameters over the study region. The data sets comprised multiple overflights covering approximately a 60-min period during late morning on 04 June 1987 and shortly after dark on the subsequent day. Image data from each overpass were calibrated and earth-located, with regard to each other, utilizing aircraft INS parameters and ground control points.

Jedlovec, Gary J.↗

NASA NTRSDate not supplied

A Dynamic PCA and Machine Learning Tool for Automated Identification of Solar Wind Disturbances Impacting Earth’s Magnetosphere

Earth’s magnetosphere is continuously impacted by solar wind and interplanetary magnetic field (IMF) disturbances, such as shocks, discontinuities, magnetic clouds and more. Understanding how such disturbances propagate from the Sun and what is their impact on the different magnetospheric domains is key to understanding and forecasting energy transfer from the solar wind to Earth. The large number of overlapping solar wind and magnetospheric missions carrying magnetometers and the recent advances in communications and data storage technologies have enabled an unprecedented quantity of high-fidelity magnetic field data captured by in-situ spacecraft to be available at the click of a button. However, this massive quantity of available data can prove unwieldy for researchers, limiting the identification of interesting phenomena and disturbances to a relatively small percentage of the total dataset. Several techniques have been previously developed for automated identification of specific types of magnetic anomalies, but these methods are typically mission-specific and can be difficult to generalize. We present initial results for a generic method of automated anomaly detection in magnetic field measurements based on dimensionality reduction and unsupervised clustering via machine learning. The benefit of our technique is its high degree of generalizability and flexibility which make it a most useful data survey tool for a wide range of magnetic field datasets. This method can also be applied simultaneously to other observed time-series properties like plasma density, pressure, and velocity for more accurate event identification. Additionally, the application of this method to data captured by multiple spacecraft enables the simultaneous identification of disturbances and the determination of their propagation characteristics. Initial evaluation of this technique has been performed using data from Magnetospheric MultiScale (MMS) and THEMIS-ARTEMIS missions, providing a testbed scenario for the future Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) platform instruments that will measure solar wind and IMF properties from lunar orbit onboard the Gateway station.

Miguel Martinez-Ledesma↗

NASA NTRSDate not supplied

A Dynamic PCA and Machine Learning Tool for Automated Identification of Solar Wind Disturbances Impacting Earth’s Magnetosphere

Miguel Martinez-Ledesma↗