Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Many-Body Effects in Aqueous Systems: Synergies Between Interaction Analysis Techniques and Force Field Development

Interaction analysis techniques, including the many-body expansion (MBE), symmetry-adapted perturbation theory, and energy decomposition analysis, allow for an intuitive understanding of complex molecular interactions. We review these methods by first providing a historical context for the study of many-body interactions and discussing how nonadditivities emerge from Hamiltonians containing strictly pairwise-additive interactions. We then elaborate on the synergy between these interaction analysis techniques and the development of advanced force fields aimed at accurately reproducing the Born–Oppenheimer potential energy surface. In particular, we focus on ab initio–based force fields that aim to explicitly reproduce many-body terms and are fitted to high-level electronic structure results. These force fields generally incorporate many-body effects through ( a) parameterization of distributed multipoles, ( b) explicit fitting of the MBE, ( c) inclusion of many-atom features in a neural network, and ( d) coarse-graining of many-body terms into an effective two-body term. We also discuss the emerging use of the MBE to improve the accuracy and speed of ab initio molecular dynamics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

vvtools v. 1.0

Vvtools is a suite of testing tools, with a focus on reproducible verification and validation. They are written in pure Python, and contain a test harness and an automated process management tool. Users of vvtools can develop suites of verification and validation tests and run them on small to large high performance computing resources in an automated and reproducible way. The test harness enables complex processes to be performed in each test and even supports a one-level parent/child dependency between tests. It includes a built in capability to manage workloads requiring multiple processors and platforms that use batch queueing systems.

Drake, RichardR.↗
DOE OSTI2021

Learning Universal Authorship Representations

This code contains all the utilities required to reproduce the results of our EMNLP 2021 paper "Learning Universal Authorship Representations". It contains the utilities required for download the datasets, training our model, and performing all evaluations necessary for reproducing the results in the paper. Here's the abstract of our work: Determining whether two documents were composed by the same author, also known as authorship verification, has traditionally been tackled using statistical methods. Recently, authorship representations learned using neural networks have been found to outperform alternatives, particularly in large-scale settings involving hundreds of thousands of authors. But do such representations learned in a particular domain transfer to other domains? Or are these representations inherently entangled with domain-specific features? To study these questions, we conduct the first large-scale study of cross-domain transfer for authorship verification considering zero-shot transfers involving three disparate domains: Amazon reviews, fanfiction short stories, and Reddit comments. We find that although a surprising degree of transfer is possible between certain do- mains, it is not so successful between others. We examine properties of these domains that influence generalization and propose simple but effective methods to improve transfer.

Rivera Soto, RafaelA↗
DOE OSTI2022

EDD Basic Stats and Graphs Notebook analysis (EDD BSG Notebook) v1.0

This jupyter notebook calculates basic statistics (e.g., mean, standard deviation, coefficient of variation) and simple graphs (e.g., bar graphs, line plots) for data from the Experiment Data Depot (EDD) to provide rapid and reproducible assessment of data quality to aid research efforts across the JBEI and ABF projects. It rapidly and reproducibly calculates basic statistical values for data stored in the EDD which aids researchers and strengthens comparisons across different experiments and projects.

Petzold, ChristopherJ↗
DOE OSTI2024

Code for BALDR Study 07.04

SAND2024-11256O The Code for BALDR Study 07.04 software reproduces results from the BALDR study concerning "Multilabel Proportion Prediction and Out-of-Distribution Detection on Gamma Spectra of Short-Lived Fission Products." This code can reproduce a scientific study following the step numbers present in the file names. The scientific study uses synthetic and measured data to find the best model for the radioisotope proportion estimation task of interest and generates results. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Morrow, Tyler↗
DOE OSTI2025

OLCF Test Harness

Acceptance and regression testing of a High Performance Computing (HPC) system requires an automated and reproducible framework and tool for running and logging results. Manually running tests across a system is labor intensive and prone to reproducibility errors. The OLCF Test Harness (OTH) provides a framework in which to document required tests for a HPC system. The OTH then provides tools to execute and log results of these tests in an automated fashion.

Dietz, Dan [Oak Ridge National Laboratory (ORNL), ↗
DOE OSTI2025

Real-Twin

Real-Twin is a unified, model-agnostic scenario generation tool designed to streamline and standardize the evaluation of emerging mobility technologies. It provides an end-to-end framework that includes robust workflows, integrated tools, and comprehensive metrics to generate, calibrate, and benchmark microscopic traffic simulation scenarios across multiple platforms. Key Features of Real-Twin include: - Unified Scenario Generation: generate transferable, simulation-ready scenarios from heterogeneous data sources using a consistent workflow. - Automated Calibration Workflow: bridges simulation and real-world data, minimizing manual effort and making traffic simulation more accessible to researchers and engineers. - Model-Agnostic Compatibility: supports SUMO, VISSIM, and AIMSUN for cross-platform scenario generation and benchmarking. Enables reliable comparisons and reproducibility across different simulation tools. - Consistent Scenarios across Different Simulators: generate comparable simulation scenarios across different microscopic traffic simulators, providing users the ability to conduct benchmarking and cross-validation that are crucial for ensuring the reliability and reproducibility of simulation results. - Emerging Technology Support: includes a scenario database and pipeline for studying autonomous vehicles (AVs), with planned extensions to CAVs, EVs, and other advanced technologies.

Wang, Chieh (Ross) [Oak Ridge National Laboratory ↗
DOE OSTI2025

UBW (USLCI-Brightway2) [SWR-25-169]

Life cycle inventory (LCI) data are critical for robust life cycle assessment (LCA), yet many widely used datasets such as the U.S. Life Cycle Inventory (USLCI) are not natively compatible with advanced modeling frameworks like Brightway2. This work presents an automated pipeline to transform USLCI data into a fully functional Brightway2 project. The workflow performs systematic data cleaning, resolves duplicate process and exchange identifiers, and applies allocation to multi-output processes. Technosphere and biosphere flows are harmonized through unit conversions and a bridge mapping to the biosphere3 database, with comprehensive logging of missing flows and cutoff issues. The resulting Brightway2 database is validated using matrix diagnostics to ensure consistency of the technosphere, and is benchmarked via life cycle impact assessment (LCIA) methods such as ReCiPe and IPCC GWP. Outputs include reproducible CSV exports of corrected processes, elementary flows, characterization factors, and LCIA results, alongside backup utilities for project sharing. This pipeline lowers barriers for integrating USLCI data into open-source LCA workflows, enabling reproducible, validated LCA inventories within the Brightway 2 framework.

Ghosh, Tapajyoti [National Laboratory of the Rocki↗
DOE OSTI2025

ATcT — Active Thermochemical Tables Python Interface

SF-25-140 atct is a lightweight, Python client for the ATcT v1 API that enables programmatic access to high-accuracy thermochemical data and turnkey reaction-enthalpy analysis. The package implements full v1 endpoint coverage (species lookup by ATcT ID, name, formula, SMILES, InChI, CAS RN; covariance queries; health checks) with robust error handling, retries, and environment-based configuration for local/production endpoints. Beyond data retrieval, atct provides rigorously implemented reaction calculators that propagate uncertainties via either (i) a conventional independent-errors method (0 K or 298.15 K) or (ii) covariance-aware propagation using provided covariances at 298.15 K. Typed data classes ensure transparent, reproducible data structures and carry ATcT Thermochemical Network (TN) version identifiers for provenance. Dual import paths and comprehensive examples facilitate integration into research pipelines, enabling reproducible thermochemical calculations, automated validation, and downstream method development.

Bross, DavidHamilton [Argonne National Laboratory ↗
DOE OSTI2026

TEMPEST

This repository solves the problem of driver identification through vehicular and biometric data. Through an embedding-based approach and a novel loss function, we're able to distinguish between different drivers' behaviors. This also provides preprocessing for reproducibility of results.The code preprocesses vehicular data, trains neural networks, and outputs predictions.This code introduces a novel embedding-based neural network with a 91% rank-1 accuracy, as well as all code to reproduce training and results.

Musgrove, Kyle↗
DOE OSTI2017

Use of Cloud Radar Doppler Spectra to Evaluate Stratocumulus Drizzle Size Distributions in Large-Eddy Simulations with Size-Resolved Microphysics

Abstract A case study of persistent stratocumulus over the Azores is simulated using two independent large-eddy simulation (LES) models with bin microphysics, and forward-simulated cloud radar Doppler moments and spectra are compared with observations. Neither model is able to reproduce the monotonic increase of downward mean Doppler velocity with increasing reflectivity that is observed under a variety of conditions, but for differing reasons. To a varying degree, both models also exhibit a tendency to produce too many of the largest droplets, leading to excessive skewness in Doppler velocity distributions, especially below cloud base. Excessive skewness appears to be associated with an insufficiently sharp reduction in droplet number concentration at diameters larger than ~200 μm, where a pronounced shoulder is found for in situ observations and a sharp reduction in reflectivity size distribution is associated with relatively narrow observed Doppler spectra. Effectively using LES with bin microphysics to study drizzle formation and evolution in cloud Doppler radar data evidently requires reducing numerical diffusivity in the treatment of the stochastic collection equation; if that is accomplished sufficiently to reproduce typical spectra, progress toward understanding drizzle processes is likely.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Evaluating the performance of WRF urban schemes and PBL schemes over Dallas-Fort Worth during a dry summer and a wet summer

This study evaluated the Weather Research and Forecasting (WRF) model sensitivity to different planetary boundary layer (PBL) schemes (the YSU and MYJ schemes) and urban schemes including the bulk scheme (BULK), single-layer urban canopy model (UCM), multi-layer building environment parameterization (BEP) model, and multi-layer building energy model (BEM). Daily reinitialization simulations were conducted over Dallas-Fort Worth during a dry summer month (July 2011) and a wet summer month (July 2015) with weaker (stronger) daytime (nocturnal) UHI in 2011 than 2015. All urban schemes overestimated the urban daytime 2m temperature in both summers, but BEP and BEM still reproduced the daytime urban cool island in dry summer. All urban schemes reproduced the nocturnal urban heat island, with BEP producing the weakest one due to its unrealistic urban cooling. BULK and UCM overestimated the urban canopy wind speed, while BEP and BEM underestimated it. The urban schemes showed prominent impact on daytime PBL profiles. UCM+MYJ showed a superior performance than other configurations. The relatively large (small) aspect ratio between building height and road width in UCM (BEM) was responsible for the overprediction (underprediction) of urban canopy temperature. The relatively low (high) building height in UCM (BEM) was responsible for the overprediction (underprediction) of urban canopy wind speed. Improving urban schemes and providing realistic urban parameters were critical for improving urban canopy simulation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Differential credibility assessment for statistical downscaling

Climate science is increasingly using (i) ensembles of climate projections from multiple models derived using different assumptions and/or scenarios and (ii) process-oriented diagnostics of model fidelity. Efforts to assign differential credibility to projections and/or models are also rapidly advancing. A framework to quantify and depict the credibility of statistically downscaled model output is presented and demonstrated. Here, the approach employs transfer functions in the form of robust and resilient generalized linear models applied to downscale daily minimum and maximum temperature anomalies at 10 locations using predictors drawn from ERA-Interim reanalysis and two global climate models (GCM; GFDL-ESM2M and MPI-ESM-LR). The downscaled time series are used to derive several impact relevant CLIMDEX temperature indices that are assigned credibility based on (1) the reproduction of relevant large-scale predictors by the GCMs (i.e. fraction of regression beta-weights derived from predictors that are well-reproduced) and (2) the degree of variance in the observations reproduced in the downscaled series following application of a new variance inflation technique. Credibility of the downscaled predictands varies across locations, between the two GCM and is generally higher for minimum temperature than maximum temperature. The differential credibility assessment framework demonstrated here is easy to use and flexible. It can be applied as is to inform decision makers regarding projection confidence, and/or extended to include other components of the transfer functions, and/or used to weight members of a statistically downscaled ensemble.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluation of the Near-Surface Variables in the HRRR Weather Model Using Observations from the ARM SGP Site

Abstract The performance of version 4 of the NOAA High-Resolution Rapid Refresh (HRRR) numerical weather prediction model for near-surface variables, including wind, humidity, temperature, surface latent and sensible fluxes, and longwave and shortwave radiative fluxes, is examined over the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) region. The study evaluated the model’s bias and bias-corrected mean absolute error relative to the observations on different time scales. Forecasts of near-surface geophysical variables at five SGP sites (HRRR at 3-km scale) were found to agree well with observations, but some consistent observation–forecast differences also occurred. Sensible and latent heat fluxes are the most challenging variables to be reproduced. The diurnal cycle is the main temporal scale affecting observation–forecast differences of the near-surface variables, and almost all of the variables showed different biases throughout the diurnal cycle. Results show that the overestimation of downward shortwave and the underestimation of downward longwave radiative flux are the two major biases found in this study. The timing and magnitude of downward longwave flux, wind speed, and sensible and latent heat fluxes are also different with contributions from model representations, data assimilation limitations, and differences in scales between HRRR and SGP sites. The positive bias in downward shortwave and negative bias in longwave radiation suggests that the model is underestimating cloud fraction in the study domain. The study concludes by showing a brief comparison with version 3 of the HRRR and shows that version 4 has better performance in almost all near-surface variables. Significance Statement A correct representation of the near-surface variables is important for numerical weather prediction models. This study investigates the capability of the latest NOAA High-Resolution Rapid Refresh (HRRRv4) model in simulating the near-surface variables by comparing against the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) in situ observations. Among others, we find that the surface heat fluxes, such as sensible and latent heat fluxes, are the most difficult variables to be reproduced. This study also shows that the diurnal cycle has the dominant impact on the model’s performance, which means the majority of the outputted near-surface variables have the strong diurnal cycle in their bias errors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Large-Eddy Simulation of Shallow Cumulus over Land: A Composite Case Based on ARM Long-Term Observations at Its Southern Great Plains Site

Based on long-term observations by the Atmospheric Radiation Measurement program at its Southern Great Plains site, a new composite case of continental shallow cumulus (ShCu) convection is constructed for large-eddy simulations (LES) and single-column models. The case represents a typical daytime nonprecipitating ShCu whose formation and dissipation are driven by the local atmospheric conditions and land surface forcing and are not influenced by synoptic weather events. The case includes early morning initial profiles of temperature and moisture with a residual layer; diurnally varying sensible and latent heat fluxes, which represent a domain average over different land surface types; simplified large-scale horizontal advective tendencies and subsidence; and horizontal winds with prevailing direction and average speed. Observed composite cloud statistics are provided for model evaluation. The observed diurnal cycle is well reproduced by LES; however, the cloud amount, liquid water path, and shortwave radiative effect are generally underestimated. LES are compared between simulations with an all-or-nothing bulk microphysics and a spectral bin microphysics. The latter shows improved agreement with observations in the total cloud cover and the amount of clouds with depths greater than 300 m. When compared with radar retrievals of in-cloud air motion, LES produce comparable downdraft vertical velocities, but a larger updraft area, velocity, and updraft mass flux. Both observations and LES show a significantly larger in-cloud downdraft fraction and downdraft mass flux than marine ShCu.

58 GEOSCIENCES↗
DOE OSTI2024

Monsoonal MCS Initiation, Rainfall, and Diurnal Gravity Waves over the Bay of Bengal: Observation and a Linear Model

Abstract Previous observational studies have indicated that mesoscale convective systems (MCSs) contribute the majority of precipitation over the Bay of Bengal (BoB) during the summer monsoon season, yet their initiation and propagation remain incompletely understood. To fill this knowledge gap, we conducted a comprehensive study using a combination of 20-yr satellite observations, MCS tracking, reanalysis data, and a theoretical linear model. Satellite observations reveal clear diurnal propagation signals of MCS initiation frequency and rainfall from the west coast of the BoB toward the central BoB, with the MCS rainfall propagating slightly slower than the MCS initiation frequency. Global reanalysis data indicate a strong association between the offshore-propagating MCS initiation frequency/rainfall and diurnal low-level wind perturbations, implying the potential role of gravity waves. To verify the hypothesis, we developed a 2D linear model that can be driven by realistic meteorological fields from reanalysis. The linear model realistically reproduces the characteristics of offshore-propagating diurnal wind perturbations. The wind perturbations, as well as the offshore propagation signals of MCS initiation frequency and rainfall, are associated with diurnal gravity waves emitted from the coastal regions, which in turn are caused by the diurnal land–sea thermal contrast. The ambient wind speed and vertical wind shear play crucial roles in modulating the timing, propagation, and amplitude of diurnal gravity waves. Using the linear model and satellite observations, we further show that the stronger monsoonal flows lead to faster offshore propagation of diurnal gravity waves, which subsequently control the offshore propagation signals of MCS initiation and rainfall. Significance Statement Rainfall over the Bay of Bengal (BoB) is primarily contributed by large and organized rainfall systems in the summer monsoon season. During this season, these systems are commonly observed over the east coast of India around midnight, the western BoB in the morning, and the central BoB in the afternoon. This eastward rainfall propagation is confirmed by observations, reanalysis data, and a theoretical model to have a strong association with atmospheric diurnal gravity waves. These waves are caused by land–sea thermal contrast and can trigger rainfall systems over the offshore regions. We also found that the diurnal gravity waves, as well as their triggered rainfall systems, can be greatly modulated by the large-scale monsoonal flows. All the above findings improve our understanding of diurnal rainfall cycle over the BoB and may contribute to the future improvement of rainfall forecast over the region.

Meteorology & Atmospheric Sciences↗
DOE OSTI2024

The Dual Nature of Entrainment-Mixing Signatures Revealed through Large-Eddy Simulations of a Convection-Cloud Chamber

Abstract Entrainment of subsaturated air into a cloud can influence its optical and microphysical properties in various ways, depending on the droplet evaporation and turbulent mixing time scales. Previous experiments in the Pi convection-cloud chamber have revealed that, given a fixed entrained air property, the mixing of entrained subsaturated air results in complete evaporation of some cloud droplets, with the rest remaining unchanged. This is a signature of inhomogeneous mixing. While comparing the results of entrainment with varying air properties, the mixing signature appears as if the subsaturated air is well mixed with the cloud to evenly reduce the droplets’ size. In other words, taken together, the experiments appear to have the signature of homogeneous mixing. To explore these results in a greater depth, we conduct large-eddy simulations combined with a bin microphysics scheme. Our results reproduce the similar signatures of inhomogeneous and homogeneous mixing, implying that LES can resolve the inhomogeneous mixing when the grid spacing is smaller than the entrained air parcel. Additionally, we observe that increasing the aerosol injection rate enhances the signature of inhomogeneous mixing, while coarser grid spacing diminishes it. Finally, the change in wall fluxes in response to various entrained air properties confirms that the homogeneous signature seen in the analysis of an ensemble of simulations is the result of various equilibrium states. This further strengthens the suggestion that the homogeneous mixing signature found in aircraft observations near the cloud top may result from combining entrainment events of different intensities, possibly caused by various-sized eddies. Significance Statement Large-eddy simulation and size-resolved microphysics can resolve time scales for turbulent mixing and evaporation and, therefore, are well suited for reproducing, extending, and interpreting the entrainment experiment in the Pi convection-cloud chamber. Our simulation results confirm (i) the inhomogeneous mixing signature for an individual entrainment event and (ii) the appearance of homogeneous mixing in an ensemble of entrainment episodes. Furthermore, we demonstrate that the inhomogeneous mixing signature is more pronounced in a polluted cloud, but coarser grid spacing in simulations may compromise the accuracy of this signature. Last, the homogeneous mixing signature results from various equilibrium states established for different entrainment intensities and adjusted wall fluxes, which are challenging to measure experimentally but can be easily analyzed in the simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

A Conceptual Model for the Response of Tropical Rainfall to Orbital Variations

Tropical rainfall to first order responds to variations in Earth’s orbit through shifts of the intertropical convergence zone (ITCZ) and changes in zonally averaged rainfall intensity. Here, a conceptual model is developed that represents both processes and their response to orbital insolation variations. The model predicts the seasonal evolution of tropical rainfall between 30°S and 30°N. Insolation variations impact seasonal rainfall in two different ways: thermodynamically, leading to variations in rainfall intensity through modulation of the water vapor content of the atmosphere; and dynamically, leading to shifts of the ITCZ through modulation of the global atmospheric energy budget. Thermodynamic and dynamic effects act together to shape the annual-mean response of tropical rainfall to changes in Earth’s orbit. The model successfully reproduces changes in annual-mean rainfall inferred from paleo-proxies across several glacial–interglacial cycles. It illuminates how orbital precession and variations of Earth’s obliquity affect tropical rainfall in distinct ways near the equator and farther away from it, with spectral signatures of precession and obliquity variations that shift with latitude. It also provides explanations for the observed different phasings of rainfall minima and maxima near the equator and away from it. For example, the model reproduces a phase shift of ~10 ka between rainfall records from caves in northern Borneo (4°N) and from China (approximately 30°N). Finally, the model suggests that such phase shifts arise through a different weighting of ITCZ shifts and variations in rainfall intensity, thus providing insight into the mechanisms that drive tropical rainfall changes on orbital time scales.

54 ENVIRONMENTAL SCIENCES↗