SEARCH · Search NASA

Results for “Benchmark dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Observational benchmarks inform representation of soil organic carbon dynamics in land surface models

Abstract. Representing soil organic carbon (SOC) dynamics in Earth system models (ESMs) is a key source of uncertainty in predicting carbon–climate feedbacks. Machine learning models can help identify dominant environmental controllers and establish their functional relationships with SOC stocks. The resulting knowledge can be integrated into ESMs to reduce uncertainty and improve predictions of SOC dynamics over space and time. In this study, we used a large number of SOC field observations (n=54 000), geospatial datasets of environmental factors (n=46), and two machine learning approaches (namely random forest, RF, and generalized additive modeling, GAM) to (1) identify dominant environmental controllers of global and biome-specific SOC stocks, (2) derive functional relationships between environmental controllers and SOC stocks, and (3) compare the identified environmental controllers and predictive relationships with those in models used in Phase 6 of the Coupled Model Intercomparison Project (CMIP6). Our results showed that the diurnal temperature, drought index, cation exchange capacity, and precipitation were important observed environmental predictors of global SOC stocks. While the RF model identified 14 environmental factors that describe climatic, vegetation, and edaphic conditions as important predictors of global SOC stocks (R2=0.61, RMSE = 0.46 kg m−2), current ESMs oversimplify the relationships between environmental factors and SOC, with precipitation, temperature, and net primary productivity explaining > 96 % of the variability in ESM-modeled SOC stocks. Further, our study revealed notable disparities among the functional relationships between environmental factors and SOC stocks simulated by ESMs compared with observed relationships. To improve SOC representations in ESMs, it is imperative to incorporate additional environmental controls, such as the cation exchange capacity, and refine the functional relationships to align more closely with observations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Harnessing interpretable and unsupervised machine learning to address big data from modern X-ray diffraction

The information content of crystalline materials becomes astronomical when collective electronic behavior and their fluctuations are taken into account. In the past decade, improvements in source brightness and detector technology at modern X-ray facilities have allowed a dramatically increased fraction of this information to be captured. Now, the primary challenge is to understand and discover scientific principles from big datasets when a comprehensive analysis is beyond human reach. We report the development of an unsupervised machine learning approach, X-ray diffraction (XRD) temperature clustering (X-TEC), that can automatically extract charge density wave order parameters and detect intraunit cell ordering and its fluctuations from a series of high-volume X-ray diffraction measurements taken at multiple temperatures. We benchmark X-TEC with diffraction data on a quasi-skutterudite family of materials, (Ca x Sr 1–x ) 3 Rh 4 Sn 13 , where a quantum critical point is observed as a function of Ca concentration. We apply X-TEC to XRD data on the pyrochlore metal, Cd 2 Re 2 O 7 , to investigate its two much-debated structural phase transitions and uncover the Goldstone mode accompanying them. We demonstrate how unprecedented atomic-scale knowledge can be gained when human researchers connect the X-TEC results to physical principles. Specifically, we extract from the X-TEC–revealed selection rules that the Cd and Re displacements are approximately equal in amplitude but out of phase. This discovery reveals a previously unknown involvement of 5d 2 Re, supporting the idea of an electronic origin to the structural order. Our approach can radically transform XRD experiments by allowing in operando data analysis and enabling researchers to refine experiments by discovering interesting regions of phase space on the fly.

36 MATERIALS SCIENCE↗

DOE OSTI2023

DIPS-Plus: The enhanced database of interacting protein structures for interface prediction

Abstract In this work, we expand on a dataset recently introduced for protein interface prediction (PIP), the Database of Interacting Protein Structures (DIPS), to present DIPS-Plus, an enhanced, feature-rich dataset of 42,112 complexes for machine learning of protein interfaces. While the original DIPS dataset contains only the Cartesian coordinates for atoms contained in the protein complex along with their types, DIPS-Plus contains multiple residue-level features including surface proximities, half-sphere amino acid compositions, and new profile hidden Markov model (HMM)-based sequence features for each amino acid, providing researchers a curated feature bank for training protein interface prediction methods. We demonstrate through rigorous benchmarks that training an existing state-of-the-art (SOTA) model for PIP on DIPS-Plus yields new SOTA results, surpassing the performance of some of the latest models trained on residue-level and atom-level encodings of protein complexes to date.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Fast jet tagging with MLP-Mixers on FPGAs

We explore the innovative use of MLP-Mixer models for real-time jet tagging and establish their feasibility on resource-constrained hardware like FPGAs. MLP-Mixers excel in processing sequences of jet constituents, achieving state-of-the-art performance on datasets mimicking Large Hadron Collider conditions. By using advanced optimization techniques such as High-Granularity Quantization and Distributed Arithmetic, we achieve unprecedented efficiency. These models match or surpass the accuracy of previous architectures, reduce hardware resource usage by up to 97%, double the throughput, and half the latency. Additionally, non-permutation-invariant architectures enable smart feature prioritization and efficient FPGA deployment, setting a new benchmark for machine learning in real-time data processing at particle colliders.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2026

A reproducible study design for the MIMIC-IV in-hospital mortality task

Open, tabular electronic health record (EHR) datasets such as MIMIC-III and MIMIC-IV have become critical resources for developing machine learning (ML) models addressing clinical prediction tasks, including hospital readmission, length of stay, and in-hospital mortality (IHM). While MIMIC-III has benefited from well-established preprocessing pipelines and standardized feature sets, MIMIC-IV remains comparatively challenging to work with because there are no standardized benchmarks to support reproducibility and comparability across studies. To address this limitation, we present a rigorously curated MIMIC-IV custom feature set optimized for IHM prediction, constructed through a reproducible preprocessing pipeline and feature selection strategy.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2000

Benchmark Active Controls Technology (BACT) Wing CFD Results

The Benchmark Active Controls Technology (BACT) wing test (see chapter 8E) provides data for the validation of aerodynamic, aeroelastic, and active aeroelastic control simulation codes. These data provide a rich database for development and validation of computational aeroelastic and aeroservoelastic methods. In this vein, high-level viscous CFD analyses of the BACT wing have been performed for a subset of the test conditions available in the dataset. The computations presented in this section investigate the aerodynamic characteristics of the rigid clean wing configuration as well as simulations of the wing with a static and oscillating aileron and spoiler deflection. Two computational aeroelasticity codes extensively used at NASA Langley Research Center are implemented in this simulation. They are the ENS3DAE and CFL3DAE computational aeroelasticity programs. Both of these methods solve the three-dimensional compressible Navier-Stokes equations for both rigid and flexible vehicles, but they use significantly different approaches to the solution 6f the aerodynamic equations of motion. Detailed descriptions of both methods are presented in the following section.

Schuster, David M.↗

DOE OSTI2021

Search for dark matter produced in association with a Standard Model Higgs boson decaying into b -quarks using the full Run 2 dataset from the ATLAS detector

The production of dark matter in association with Higgs bosons is predicted in several extensions of the Standard Model. An exploration of such scenarios is presented, considering final states with missing transverse momentum and b-tagged jets consistent with a Higgs boson. The analysis uses proton-proton collision data at a centre-of-mass energy of 13 TeV recorded by the ATLAS experiment at the LHC during Run 2, amounting to an integrated luminosity of 139 fb -1 . The analysis, when compared with previous searches, benefits from a larger dataset, but also has further improvements providing sensitivity to a wider spectrum of signal scenarios. These improvements include both an optimised event selection and advances in the object identification, such as the use of the likelihood-based significance of the missing transverse momentum and variable-radius track-jets. No significant deviation from Standard Model expectations is observed. Limits are set, at 95% confidence level, in two benchmark models with two Higgs doublets extended by either a heavy vector boson Z' or a pseudoscalar singlet a and which both provide a dark matter candidate χ. In the case of the two-Higgs-doublet model with an additional vector boson Z', the observed limits extend up to a Z' mass of 3 TeV for a mass of 100 GeV for the dark matter candidate. The two-Higgs-doublet model with a dark matter particle mass of 10 GeV and an additional pseudoscalar a is excluded for masses of the a up to 520 GeV and 240 GeV for tan β = 1 and tan β = 10 respectively. Limits on the visible cross-sections are set and range from to 0.05 fb to 3.26 fb, depending on the missing transverse momentum and b-quark jet multiplicity requirements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS2024

Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applications

This technical report presents Prithvi-EO-2.0, a new geospatial foundation model that offers significant improvements over its predecessor, Prithvi-EO-1.0. Trained on 4.2M global time series samples from NASA’s Harmonized Landsat and Sentinel-2 data archive at 30m resolution, the new 300M and 600M parameter models incorporate temporal and location embeddings for enhanced performance across various geospatial tasks. Through extensive benchmarking with GEOBench, the 600M version outperforms the previous Prithvi-EO model by 8% across a range of tasks. It also outperforms six other geospatial foundation models when benchmarked on remote sensing tasks from different domains and resolutions (i.e. from 0.1m to 15m). The results demonstrate the versatility of the model in both classical earth observation and high-resolution applications. Early involvement of end-users and subject matter experts (SMEs) are among the key factors that contributed to the project’s success. In particular, SME involvement allowed for constant feedback on model and dataset design, as well as successful customization for diverse SME-led applications in disaster response, land use and crop mapping, and ecosystem dynamics monitoring. Prithvi-EO-2.0 is available on Hugging Face and IBM terratorch, with additional resources on GitHub. The project exemplifies the Trusted Open Science approach embraced by all involved organizations.

Daniela Szwarcman↗

DOE OSTI2024

Search for heavy Majorana neutrinos in e ± e ± and e ± μ ± final states via WW scattering in pp collisions at s = 13 TeV with the ATLAS detector

A search for heavy Majorana neutrinos in scattering of same-sign W boson pairs in proton–proton collisions at $\sqrt{s}$ = 13 TeV at the LHC is reported. The dataset used corresponds to an integrated luminosity of 140 fb -1 , collected with the ATLAS detector during 2015–2018. The search is performed in final states including a same-sign ee or eμ pair and at least two jets with large invariant mass and a large rapidity difference. No significant excess of events with respect to the Standard Model background predictions is observed. The results are interpreted in a benchmark scenario of the Phenomenological Type-I Seesaw model. New constraints are set on the values of the |V eN | 2 and |V eN V$^{*}_{μN}$| parameters for heavy Majorana neutrino masses between 50 GeV and 20 TeV, where V ℓN is the matrix element describing the mixing of the heavy Majorana neutrino mass eigenstate with the Standard Model neutrino of flavour ℓ = e,μ. The sensitivity to the Weinberg operator is investigated and constraints on the effective ee and eμ Majorana neutrino masses are reported. The statistical combination of the ee and eμ channels with the previously published μμ channel is performed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

Evaluating Production Implications of Pressure Maintenance in Unconventional Oil and Gas Wells using a Machine Learning Modeling Approach: Case Study in the Permian Basin

This study implements the proprietary machine learning-based model (model) developed under the 2022 study titled “Evaluating the Impact of Proprietary Oil & Gas Data on Machine Learning Model Performance Using a Quasi-Experimental Analytical Approach” for forecasting unconventional oil and gas production using well data from the Permian Basin. The model, developed using an exclusive dataset that includes time series production data from an operator in the Permian Basin, is designed to jointly predict daily oil, gas, and water production for horizontal wells as a function of bottomhole pressure drawdown, spatial placement across the study domain, and well-completion attributes. In this study, the model was explicitly applied to explore its utility to evaluate the impact of varying drawdown strategies on the production forecast of a well in the Permian Basin dataset. Managing pressure drawdown has been identified as a way to improve estimated ultimate recovery (EUR) from unconventional shale wells due to the stress-dependent nature of fractures in shale reservoirs. Research has shown that applying a lower pressure drawdown helps to maintain the reservoir conductivity, resulting in higher productivity over the life of a well. Historic bottomhole pressure data from the well over time was used as a benchmark from which to set more and less aggressive pressure decline rates as bounding modeling cases. All pressure decline rates/strategies were forecasted over 5 years, and the model was used to generate oil, water, and gas prediction over the same timeframe. This report presents the results from the production forecast and discusses potential operational and economic implications, with contrasting perspectives between well productivity and profitability given typical oil and gas economics and the volatility in the oil and gas market.

02 PETROLEUM↗

DOE OSTI2026

Comparative Evaluation of Spectral Methods for Robust Reactor Noise Estimation

Reactor noise analysis provides a noninvasive means to determine neutron kinetic parameters from stochastic fluctuations in detector signals. However, standard cross-power spectral density (CPSD) analyses can be sensitive to numerical processing choices, which may introduce processing-dependent systematic shifts in estimates of the prompt neutron decay constant (α) and limit reproducibility. This study uses a hybrid multitaper–Welch spectral estimator to analyze subcritical noise measurements from a fast-spectrum critical assembly. The decay constant α was extracted using three frequency-domain methods: the CPSD, the magnitude-squared coherence (MSC), and the generalized magnitude-squared coherence (GMSC). These coherence-based estimators normalize detector auto-spectral structure and are expected to reduce the sensitivity of fitted α values to processing parameters. A Sobol global sensitivity analysis identified which numerical inputs most strongly influence the fitted values of α. All estimators produced a linear dependence of α on inverse count rate, with delayed-critical extrapolations near 1.7 × 10 4 s −1 , in agreement within 8% of MCNP6.3 KOPTS benchmark calculations. Sensitivity results show that while the CPSD depends on both time-bin width and taper selection, the MSC and GMSC are dominated by time-bin width alone, indicating reduced parameter coupling and greater robustness to processing variability. These findings demonstrate the feasibility and practical value of coherence-based spectral estimators for extracting α from reactor noise and support their broader application to multi-detector and irregular datasets in subcritical system characterization.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2022

Distributionally Robust Decision Making Leveraging Conditional Distributions

Distributionally robust optimization (DRO) is a powerful tool for decision making under uncertainty. It is particularly appealing because of its ability to leverage existing data. However, many practical problems call for decision-making with some auxiliary information, and DRO in the context of conditional distributions is not straightforward. We propose a conditional kernel distributionally robust optimization (CKDRO) method that enables robust decision making under conditional distributions through kernel DRO and the conditional mean operator in the reproducing kernel Hilbert space (RKHS). In particular, we consider problems where there is a correlation between the unknown variable y and an auxiliary observable variable x. Given past data of the two variables and a queried auxiliary variable, CKDRO represents the conditional distribution P(y|x) as the conditional mean operator in the RKHS space and quantifies the ambiguity set in the RKHS as well, which depends on the size of the dataset as well as the query point. To justify the use of RKHS, we demonstrate that the ambiguity set defined in RKHS can be viewed as a ball under a metric that is similar to the Wasserstein metric. The DRO is then dualized and solved via a finite dimensional convex program. The proposed CKDRO approach is applied to a generation scheduling problem and shows that the result of CKDRO is superior to common benchmarks in terms of quality and robustness.

Chen, Yuxiao↗

DOE OSTI2025

Deployment of neural-network-based neutron microscopic cross sections in the Griffin reactor physics application

The capability to utilize neural networks to predict macroscopic and microscopic cross section parametric spaces has been developed for the Griffin reactor physics application. The LibTorch interface enables Griffin's MOOSE-based materials to interact with LibTorch-trained models, allowing for the evaluation of complex macroscopic or microscopic cross section spaces, which are then used to evaluate the neutronic properties of the Griffin finite element model. This study benchmarks traditional ISOXML-formatted tabulation libraries against neural network-based models for 279 nuclides on 20,160 grid points for zero-dimensional and two-dimensional reactor models. Benchmark metrics include the fundamental mode eigenvalue, fission and absorption rates, and various temperature coefficients of reactivity (isothermal, fuel, and moderator). From the perspective of storage space, the complete set of LibTorch models uses 11 MB on disk, compared to the 10 GB for the ISOXML multigroup library that covers the same grid space. For the two-dimensional performance case considered in Griffin, the Torch model uses 97% less RAM than the reference ISOXML dataset while runtime increases by a factor of 3 when using the LibTorch model compared to the ISOXML dataset with multi-linear interpolation. The LibTorch model consistently yields errors within 0.01% for most analyzed quantities except for the temperature coefficients of reactivity where the maximum discrepancies are up to 0.3 $\frac{pcm}{K}$. Due to the neural network attempting to best predict quantities with no regard for a positive or negative bias for any given quantity, predictions may experience random fluctuations, resulting in both positive and negative errors. Future work will entail both depletion and coupled transient analysis to determine the predictive capabilities of Griffin with neural network-based cross sections.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2021

The NIH Somatic Cell Genome Editing program

The move from reading to writing the human genome offers new opportunities to improve human health. The United States National Institutes of Health (NIH) Somatic Cell Genome Editing (SCGE) Consortium aims to accelerate the development of safer and more-effective methods to edit the genomes of disease-relevant somatic cells in patients, even in tissues that are difficult to reach. Here we discuss the consortium’s plans to develop and benchmark approaches to induce and measure genome modifications, and to define downstream functional consequences of genome editing within human cells. Central to this effort is a rigorous and innovative approach that requires validation of the technology through third-party testing in small and large animals. New genome editors, delivery technologies and methods for tracking edited cells in vivo, as well as newly developed animal models and human biological systems, will be assembled—along with validated datasets—into an SCGE Toolkit, which will be disseminated widely to the biomedical research community. We visualize this toolkit—and the knowledge generated by its applications—as a means to accelerate the clinical development of new therapies for a wide range of conditions.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Data-Driven and Multiscale Modeling of DNA-Templated Dye Aggregates

Dye aggregates are of interest for excitonic applications, including biomedical imaging, organic photovoltaics, and quantum information systems. Dyes with large transition dipole moments (μ) are necessary to optimize coupling within dye aggregates. Extinction coefficients (ε) can be used to determine the μ of dyes, and so dyes with a large ε (>150,000 M –1 cm –1 ) should be engineered or identified. However, dye properties leading to a large ε are not fully understood, and low-throughput methods of dye screening, such as experimental measurements or density functional theory (DFT) calculations, can be time-consuming. In order to screen large datasets of molecules for desirable properties (i.e., large ε and μ), a computational workflow was established using machine learning (ML), DFT, time-dependent (TD-) DFT, and molecular dynamics (MD). ML models were developed through training and validation on a dataset of 8802 dyes using structural features. A Classifier was developed with an accuracy of 97% and a Regressor was constructed with an R2 of above 0.9, comparing between experiment and ML prediction. Using the Regressor, the ε values of over 18,000 dyes were predicted. The top 100 dyes were further screened using DFT and TD-DFT to identify 15 dyes with a μ relative to a reference dye, pentamethine indocyanine dye Cy5. Two benchmark MD simulations were performed on Cy5 and Cy5.5 dimers, and it was found that MD could accurately capture experimental results. The results of this study exhibit that our computational workflow for identifying dyes with a large μ for excitonic applications is effective and can be used as a tool to develop new dyes for excitonic applications.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2022

DGPS measurements of solifluction and hillslopes creep at the Teller 47 field site from 2017-2022, Seward Peninsula, AK

DGPS measurements of benchmarks locations were collected during the 2017, 2018, 2019, 2021 and 2022 summers at the NGEE Arctic Teller-47 solifluction site on the Seward Peninsula, Alaska. Benchmarks were installed in 2017 on several solifluction lobes and hillslope locations and re surveyed in 2018 and 2019 with a Trimble R10 DGPS instrument. In 2018, coincident with a UAS-based laser altimetry collection campaign, more ground control targets were installed and subsequently remeasured in 2019. Additional ground control targets were installed in 2021. Points were corrected using NOAA’s Online Positioning User Software (OPUS) and Trimble Business Center (TBC) software. An update to this dataset was made in July 2024, adding new data from 2021 and 2022. The dataset now contains ten total *.csv files: five are data files plus one file-level metadata and five data dictionaries, two *.jpg, four shape file folders, two *.kml, one archive folder of raw data, and one *.pdf. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Universal machine learning framework for defect predictions in zinc blende semiconductors

Our article introduces a universal predictive framework for point defect formation energies and charge transition levels in a wide chemical space of zinc blende semiconductors and possible impurity atoms selected from across the periodic table. This framework was developed by leveraging high-throughput quantum mechanical simulations benchmarked using some experimental data from the literature, as well as machine learning (ML)-based regressions techniques that map unique materials descriptors to computed defect properties and yield optimized and generalizable models. Furthermore, the power and utility of these models is revealed through quick predictions for thousands of new defects and screening of low-energy impurities, which may tune the equilibrium conductivity in the semiconductor. This work presents, to our knowledge, the largest density functional theory (DFT) dataset of defect properties in semiconductors and the largest DFT+ML-based screening of point defects in semiconductors to date.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Metagenome-assembled-genomes recovered from the Arctic drift expedition MOSAiC

The Multidisciplinary Observatory for Study of the Arctic Climate (MOSAiC) expedition consisted of a year-long drifting survey of the Central Arctic Ocean. The ecosystems component of MOSAiC included the sampling of molecular data, with metagenomes collected from a diverse range of environments. The generation of metagenome-assembled-genomes (MAGs) from metagenomes are a starting point for genome-resolved analyses. This dataset presents a catalogue of MAGs recovered from a set of 73 samples from MOSAiC, including 2407 prokaryotic and 56 eukaryotic MAGs, as well as annotations of a near complete eukaryotic MAG using the Joint Genome Institute (JGI) annotation pipeline. The metagenomic samples are from the surface ocean, chlorophyll maximum, mesopelagic and bathypelagic, within leads and under-ice ocean, as well as melt ponds, ice ridges, and first- and second-year sea ice. This set of MAGs can be used to benchmark microbial biodiversity in the Central Arctic Ocean, compare individual strains across space and time, and to study changes in Arctic microbial communities from the winter to summer, at a genomic level.

59 BASIC BIOLOGICAL SCIENCES↗