Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Report on Mowry Shale Thermal Maturity Mapping in the Powder River Basin, Wyoming

The Enhanced Oil Recovery Institute (EORI) has completed a map of thermal maturity of the Mowry Shale in the Powder River Basin (PRB). Thermal maturity, the degree to which the total organic carbon in a formation has been transformed from kerogen to producible hydrocarbons due to heat and pressure, is an important measure for not just the quality of a source rock, but also helps for delineating areas more favorable for unconventional drilling. There is a dearth of published Mowry maturity maps available for the PRB and this publication endeavors to provide a detailed map based on a large, public data set covering the Wyoming portion of the PRB. Additional data, currently held confidential by operators in the basin, would be of benefit to future iterations of this map.

58 GEOSCIENCES↗
DOE OSTI2021

Added value for integrated marine energy data systems

Launched in 2019, the Portal and Repository for Information on Marine Renewable Energy (PRIMRE) provides centralized access, standardization, community building, and integration of United States (U.S.) databases, tools and codes, and other resources that cover a range of marine energy information. The PRIMRE universe contains a series of Knowledge Hubs that represent data and information on testing of marine energy devices (MHKDR); environmental effects (Tethys); engineering and technical papers (Tethys Engineering); descriptions of marine energy companies and technologies (Marine Energy Projects Database); codes and models (Marine Energy Software); and guidance on testing and measurements (Telesto). Content is added to PRIMRE by applying a set of Guidelines and Best Practices (PRIMRE Guidelines). An aggregate search across the PRIMRE site enables users to find data and information from all the PRIMRE Knowledge Hubs simultaneously, using a single entry-point (PRIMRE Search). In addition to providing access to a range of data and information on marine energy development, testing, and effects, PRIMRE allows for the development of value added products and processes that will help move the marine energy industry forward. The PRIMRE team has recently launched two key initiatives in the U.S.—Signature Projects and Lessons Learned. Outputs and outcomes from these two initiatives will be highlighted in this paper. The Signature Projects initiative is intended to bring focus to a selection of ongoing and completed marine energy projects funded by the U.S. Department of Energy’s Water Power Technologies Office (WPTO), and to inform the marine energy community of what investigations have been undertaken, what tools are available, and where gaps in information persist. Each Signature Project tags papers, reports, and data from large marine energy research projects, providing easy access and attention to all the output and associated products from each project. The Lessons Learned initiative is intended to ensure that hard-won achievements are recognized and available for those who come later, that missteps and unfortunate outcomes can be prevented in future, and that efficiencies and effective shortcuts can be publicized and used as the marine energy industry moves forward. This initiative builds off the Knowledge Hubs and reaches out to members of the marine energy community, particularly technology developers and researchers, to integrate experience in the development, deployment, assessment, success, and challenges while creating this new industry and field of study.

Copping, Andrea E.↗
DOE OSTI2021

Added value for integrated marine energy data systems

Launched in 2019, the Portal and Repository for Information on Marine Renewable Energy (PRIMRE) provides centralized access, standardization, community building, and integration of United States (U.S.) databases, tools and codes, and other resources that cover a range of marine energy information. The PRIMRE universe contains a series of Knowledge Hubs that represent data and information on testing of marine energy devices (MHKDR); environmental effects (Tethys); engineering and technical papers (Tethys Engineering); descriptions of marine energy companies and technologies (Marine Energy Projects Database); codes and models (Marine Energy Software); and guidance on testing and measurements (Telesto). Content is added to PRIMRE by applying a set of Guidelines and Best Practices (PRIMRE Guidelines). An aggregate search across the PRIMRE site enables users to find data and information from all the PRIMRE Knowledge Hubs simultaneously, using a single entry-point (PRIMRE Search). In addition to providing access to a range of data and information on marine energy development, testing, and effects, PRIMRE allows for the development of value added products and processes that will help move the marine energy industry forward. The PRIMRE team has recently launched two key initiatives in the U.S.—Signature Projects and Lessons Learned. Outputs and outcomes from these two initiatives will be highlighted in this paper. The Signature Projects initiative is intended to bring focus to a selection of ongoing and completed marine energy projects funded by the U.S. Department of Energy’s Water Power Technologies Office (WPTO), and to inform the marine energy community of what investigations have been undertaken, what tools are available, and where gaps in information persist. Each Signature Project tags papers, reports, and data from large marine energy research projects, providing easy access and attention to all the output and associated products from each project. The Lessons Learned initiative is intended to ensure that hard-won achievements are recognized and available for those who come later, that missteps and unfortunate outcomes can be prevented in future, and that efficiencies and effective shortcuts can be publicized and used as the marine energy industry moves forward. This initiative builds off the Knowledge Hubs and reaches out to members of the marine energy community, particularly technology developers and researchers, to integrate experience in the development, deployment, assessment, success, and challenges while creating this new industry and field of study.

Copping, Andrea E.↗
DOE OSTI2022

Precision QCD, Hadronic Structure & Forward QCD, Heavy Ions: Report of Energy Frontier Topical Groups 5, 6, 7 submitted to Snowmass 2021

This report was prepared on behalf of three Energy Frontier Topical Groups of the Snowmass 2021 Community Planning Exercise. It summarizes the status and implications of studies of strong interactions in high-energy experiments and QCD theory. We emphasize the rich landscape and broad impact of these studies in the decade ahead. Hadronic interactions play a central role in the high-luminosity Large Hadron Collider (LHC) physics program, and strong synergies exist between the (HL-)LHC and planned or proposed experiments at the U.S. Electron-Ion Collider, CERN forward physics experiments, high-intensity facilities, and future TeV-range lepton and hadron colliders. Prospects for precision determinations of the strong coupling and a variety of nonperturbative distribution and fragmentation functions are examined. We also review the potential of envisioned tests of new dynamical regimes of QCD in high-energy and high-density scattering processes with nucleon, ion, and photon initial states. The important role of the high-energy heavy-ion program in studies of nuclear structure and the nuclear medium, and its connections with QCD involving nucleons are summarized. We address ongoing and future theoretical advancements in multi-loop QCD computations, lattice QCD, jet substructure, and event generators. Cross-cutting connections between experimental measurements, theoretical predictions, large-scale data analysis, and high-performance computing are emphasized.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Consideration of Non-Ideal Detonation Regimes Influenced by Wave Modes in a Water-Cooled Rotating Detonation Engine Using OH Chemiluminescence

Within this study, the presence and proportion of ideal and non-ideal combustion regimes is compared across a variety of process conditions and wave modes. Large-scale data analysis seeks to summarize proportional heat release associated with commensal, parasitic, and detonative combustion averaged across individual traces of OH* chemiluminescent data acquired at the detonation plane. Means of regime partitioning based on the anatomy of the time-resolved OH* signal are proposed to ensure consistent analysis throughout the current and future studies concerning combustion regimes.

Johnson, Kristyn↗
DOE OSTI2023

Machine Learning Prediction of Fracture Toughness in Hydrogen-charged Stainless Steels

Austenitic stainless steels are structural materials utilized in tritium gas pressure boundaries since they are resistant to hydrogen isotope embrittlement [1-3]. However, exposure to tritium over long periods of time leads to tritium uptake which decays to result in helium ingrowth. This helium ingrowth results in further embrittlement effects which are synergistic with that from the hydrogen isotope [4]. Therefore, it is important for tritium facilities to understand the material limitations of stainless steel in this environment. The Savannah River National Laboratory (SRNL) has available a large experimental data set of austenitic stainless steels which have been exposed to tritium environments for various lengths of time. With the availability of this data set, machine learning (ML) algorithms provide an opportunity to model the embrittlement of stainless steel due to the algorithm’s ability to identify patterns in data sets that are difficult and costly to identify in other manners [5]. Ultimately, the amount and quality of the available data is one defining force in the ability of a ML model to accurately predict the desired outputs. The models developed herein will illustrate the ability for the various algorithms to predict the change in fracture toughness in stainless steels due to hydrogen-isotope embrittlement.

Hoar, Eric T.↗
DOE OSTI2023

Status of DUNE Offline Computing

We summarize the status of Deep Underground Neutrino Experiment (DUNE) Offline Software and Computing program. We describe plans for the computing infrastructure needed to acquire, catalog, reconstruct, simulate and analyze the data from the DUNE experiment and its prototypes in pursuit of the experiment's physics goals of precision measurements of neutrino oscillation parameters, detection of astrophysical neutrinos, measurement of neutrino interaction properties and searches for physics beyond the Standard Model. In contrast to traditional HEP computational problems, DUNE's Liquid Argon Time Projection Chamber data consist of simple but very large (many GB) data objects which share many characteristics with astrophysical images. We have successfully reconstructed and simulated data from 4% prototype detector runs at CERN. The data volume from the full DUNE detector, when it starts commissioning late in this decade will present memory management challenges in conventional processing but significant opportunities to use advances in machine learning and pattern recognition as a frontier user of High Performance Computing facilities capable of massively parallel processing. Our goal is to develop infrastructure resources that are flexible and accessible enough to support creative software solutions as HEP computing evolves.

43 PARTICLE ACCELERATORS↗
DOE OSTI2021

Coordinating an operational data distribution network for CMIP6 data

The distribution of data contributed to the Coupled Model Intercomparison Project Phase 6 (CMIP6) is via the Earth System Grid Federation (ESGF). The ESGF is a network of internationally distributed sites that together work as a federated data archive. Data records from climate modelling institutes are published to the ESGF and then shared around the world. It is anticipated that CMIP6 will produce approximately 20 PB of data to be published and distributed via the ESGF. In addition to this large volume of data a number of value-added CMIP6 services are required to interact with the ESGF; for example the citation and errata services both interact with the ESGF but are not a core part of its infrastructure. With a number of interacting services and a large volume of data anticipated for CMIP6, the CMIP Data Node Operations Team (CDNOT) was formed. The CDNOT coordinated and implemented a series of CMIP6 preparation data challenges to test all the interacting components in the ESGF CMIP6 software ecosystem. This ensured that when CMIP6 data were released they could be reliably distributed.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

Assessing Spatial Representativeness of Global Flux Tower Eddy-Covariance Measurements Using Data from FLUXNET2015

Large datasets of carbon dioxide, energy, and water fluxes were measured with the eddy-covariance (EC) technique, such as FLUXNET2015. These datasets are widely used to validate remote-sensing products and benchmark models. One of the major challenges in utilizing EC-flux data is determining the spatial extent to which measurements taken at individual EC towers reflect model-grid or remote sensing pixels. To minimize the potential biases caused by the footprint-to-target area mismatch, it is important to use flux datasets with awareness of the footprint. This study analyze the spatial representativeness of global EC measurements based on the open-source FLUXNET2015 data, using the published flux footprint model (SAFE-f). The calculated annual cumulative footprint climatology (ACFC) was overlaid on land cover and vegetation index maps to create a spatial representativeness dataset of global flux towers. The dataset includes the following components: (1) the ACFC contour (ACFCC) data and areas representing 50%, 60%, 70%, and 80% ACFCC of each site, (2) the proportion of each land cover type weighted by the 80% ACFC (ACFCW), (3) the semivariogram calculated using Normalized Difference Vegetation Index (NDVI) considering the 80% ACFCW, and (4) the sensor location bias (SLB) between the 80% ACFCW and designated areas (e.g. 80% ACFCC and window sizes) proxied by NDVI. Finally, we conducted a comprehensive evaluation of the representativeness of each site from three aspects: (1) the underlying surface cover, (2) the semivariogram, and (3) the SLB between 80% ACFCW and 80% ACFCC, and categorized them into 3 levels. The goal of creating this dataset is to provide data quality guidance for international researchers to effectively utilize the FLUXNET2015 dataset in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Synthetic Data Generation Using Machine Learning

Robust machine learning techniques for image analysis require a substantial amount of data to yield confident results. In the nuclear domain, data scarcity is a substantial challenge because there are so few facilities worldwide. This research focuses on being able alleviate the data scarcity problem by generating synthetic data to bridge the gap between large and small datasets. This work achieves that goal using a Generative Adversarial Network (GAN) architectural approach, by training a model on real-world data and expands that small dataset through synthetic data amendments. Model performance is impacted by the size of the real-world dataset and the number of training epochs utilized. This means that 1) It is important to develop your GAN to be optimized with the specific data type, and 2) approaches taken when training the GAN should be specialized to encompass important aspects of the dataset that it is generating. By taking a step to improve dataset sizes in this way, the gap between models trained by parties with significant amount of data and those without access to large data, closes, allowing for robust analyses of satellite imagery for nuclear domain applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Carbon flux estimates are sensitive to data source: a comparison of field and lab temperature sensitivity data

Abstract A large literature exists on mechanisms driving soil production of the greenhouse gases CO 2 and CH 4 . Although it is common knowledge that measurements obtained through field studies vs. laboratory incubations can diverge because of the vastly different conditions of these environments, few studies have systematically examined these patterns. These data are used to parameterize and benchmark ecosystem- to global-scale models, which are then susceptible to the biases of the source data. Here, we examine how greenhouse gas measurements may be influenced by whether the measurement/incubation was conducted in the field vs. laboratory, focusing on CO 2 and CH 4 measurements. We use Q 10 of greenhouse gas flux (temperature sensitivity) for our analyses because this metric is commonly used in biological and Earth system sciences and is an important parameter in many modeling frameworks. We predicted that laboratory measurements would be less variable, but also less representative of true field conditions. However, there was greater variability in the Q 10 values calculated from lab-based measurements of CO 2 fluxes, because lab experiments explore extremes rarely seen in situ , and reflect the physical and chemical disturbances occurring during sampling, transport, and incubation. Overall, respiration Q 10 values were significantly greater in laboratory incubations (mean = 4.19) than field measurements (mean = 3.05), with strong influences of incubation temperature and climate region/biome. However, this was in part because field measurements typically represent total respiration (Rs), whereas lab incubations typically represent heterotrophic respiration (Rh), making direct comparisons difficult to interpret. Focusing only on Rh-derived Q 10 , these values showed almost identical distributions across laboratory ( n = 1110) and field ( n = 581) experiments, providing strong support for using the former as an experimental proxy for the latter, although we caution that geographic biases in the extant data make this conclusion tentative. Due to a smaller sample size of CH 4 Q 10 data, we were unable to perform a comparable robust analysis, but we expect similar interactions with soil temperature, moisture, and environmental/climatic variables. Our results here suggest the need for more concerted efforts to document and standardize these data, including sample and site metadata.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Multiresolution classification of turbulence features in image data through machine learning

During large-scale simulations, intermediate data products such as image databases have become popular due to their low relative storage cost and fast in-situ analysis. Serving as a form of data reduction, these image databases have become more acceptable to perform data analysis on. In this work, we present an image-space detection and classification system for extracting vortices at multiple scales through wavelet-based filtering. A custom image-space descriptor is used to encode a large variety of vortex-types and a machine learning system is trained for fast classification of vortex regions. By combining a radial-based histogram descriptor, a bag of visual words feature descriptor, and a support vector machine, our results show that we are able to detect and classify vortex features at various sizes at multiple scales. Once trained, our framework enables the fast extraction of vortices on new, unknown image datasets for flow analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Star–Galaxy Image Separation with Computationally Efficient Gaussian Process Classification

Abstract We introduce a novel method for discerning optical telescope images of stars from those of galaxies using Gaussian processes (GPs). Although applications of GPs often struggle in high-dimensional data modalities such as optical image classification, we show that a low-dimensional embedding of images into a metric space defined by the principal components of the data suffices to produce high-quality predictions from real large-scale survey data. We develop a novel method of GP classification hyperparameter training that scales approximately linearly in the number of image observations, which allows for application of GP models to large-size Hyper Suprime-Cam Subaru Strategic Program data. In our experiments, we evaluate the performance of a principal component analysis embedded GP predictive model against other machine-learning algorithms, including a convolutional neural network and an image photometric morphology discriminator. Our analysis shows that our methods compare favorably with current methods in optical image classification while producing posterior distributions from the GP regression that can be used to quantify object classification uncertainty. We further describe how classification uncertainty can be used to efficiently parse large-scale survey imaging data to produce high-confidence object catalogs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗
DOE OSTI2025

Extraction and Analysis of Time Series Data from Building Automation Systems Using Large Language Models

Semantic schemas like Haystack 4, Brick and ASHRAE standard 223 enable the structured, standardized, and machine-readable representation of building data, facilitating interoperability, data integration, and advanced analytics. However, extracting information from these models requires specialized expertise in SPARQL and other programming languages, skills that are not commonly found among building professionals. Recent advancements in Large Language Models (LLMs), such as ChatGPT, enable the construction of queries using natural language, making it easier for individuals to interact with these systems in a manner that resembles everyday speech. However, these methods have not yet been tested on building semantic ontologies. This paper introduces a novel workflow and tool for enabling users to ask questions about a specific building's data, using natural language and receive answers automatically generated by GPT-4o. Our approach integrates semantic ontologies with advanced LLM capabilities to automate three critical steps: (1) generating SPARQL queries to retrieve time series references from ontological models, (2) extracting the corresponding time series data from the Building Automation System, and (3) performing computations and visualizations tailored to the user's query. The proposed method simplifies access to BAS data, allowing both domain experts and non-specialists to conduct sophisticated analyses without needing extensive technical knowledge of semantic web technologies. By demonstrating this pipeline, we facilitate more accessible and scalable data-driven decision-making in building operations and management.

Mulayim, Ozan Baris↗
DOE OSTI2025

2025 Large Load Literature Review

This literature review catalogs more than 90 publications focused on large loads, and groups the documents and resources thematically into 12 categories, (listed below). The 2026 Large Load Literature Review and Data Sources summary reports are available here: https://emp.lbl.gov/publications/2026-large-load-literature-review -Load forecasting -Data sources -Reliability and resource adequacy -Large load interconnection -Demand flexibility -Generation -Co-location -Data center location/infrastructure -Large load tariffs -Policy options -Maps and tools -Design and operations

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Fast 2D Bicephalous Convolutional Autoencoder for Compressing 3D Time Projection Chamber Data

High-energy large-scale particle colliders produce data at high speed in the order of 1 terabytes per second in nuclear physics and petabytes per second in high energy physics. Developing real-time data compression algorithms to reduce such data at high throughput to fit permanent storage has drawn increasing attention. Specifically, at the newly constructed sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC), a time projection chamber is used as the main tracking detector, which records particle trajectories in a volume of three-dimensional (3D) cylinder. The resulting data are usually very sparse with occupancy around 10.8%. Such sparsity presents a challenge to conventional learning-free lossy compression algorithms, such as SZ, ZFP, and MGARD. The 3D convolutional neural network (CNN)-based approach, Bicephalous Convolutional Autoencoder (BCAE), outperforms traditional methods both in compression rate and reconstruction accuracy. BCAE can also utilize the computation power of graphical processing units suitable for deployment in a modern heterogeneous highperformance computing environment. This work introduces two BCAE variants: BCAE++ and BCAE-2D. BCAE++ achieves a 15% better compression ratio and a 77% better reconstruction accuracy measured in mean absolute error compared with BCAE. BCAE-2D treats the radial direction as the channel dimension of an image, resulting in a 3× speedup in compression throughput. In addition, we demonstrate an unbalanced autoencoder with a larger decoder can improve reconstruction accuracy without significantly sacrificing throughput. Lastly, we observe both the BCAE++ and BCAE-2D can benefit more from using half-precision mode in throughput (76 - 79% increase) without loss in reconstruction accuracy. The source code and links to data and pretrained models can be found at https://github.com/BNL-DAQ-LDRD/NeuralCompression_v2

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗