Search NASA⌕ Search

SEARCH · Search NASA

Results for “reproducibility of results”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Experimental Benchmarking for High-Reproducibility, Cross-Institutional Evaluation of Iron Redox Electrochemistry

We present a practical case study standardizing experimental protocols between collaborators with the goal of understanding ferrous iron (Fe 2+ ) chemistry and improving the iron deposition reaction for energy-efficient, electrochemical iron production. The study of iron reactions can be difficult, as aqueous iron electrolytes exhibit complex behaviors that can lead to differing interpretation of ostensibly similar experiments. The question we want to answer: are we studying the same chemistry? Our protocols address inherent challenges such as the tendency for Fe 2+ to spontaneously oxidize to ferric iron (Fe 3+ ) and the production of hydrogen at the potentials of interest. Our standardized protocol, executed by four collaborators in different labs and institutions, yields high-reproducibility results, and identified glassy carbon electrode surface quality and Fe 3+ impurities in the salt as key factors with outsized effects on cyclic voltammetry measurements. The process of developing the protocols helped to troubleshoot underlying issues that created poorer reversibility and reproducibility. This study highlights the fact that even nominally straightforward electrochemical systems can yield vastly different outcomes due to small differences in experimental preparation and serves as a useful example for creating transparent and achievable standards for the generation of reliable datasets that can be widely used and shared.

Ketter, Benjamin [Argonne National Laboratory (ANL↗
DOE OSTI2025

SCALE Input and Result Files Supporting SCALE Inventory and Reactivity Analysis of the gFHR

This dataset contains input and result files of computational simulations with the SCALE code system. The simulations cover radionuclide inventory and reactivity analyses of a fluoride salt-cooled high temperature pebble-bed reactor (PB-FHR), specifically the generic FHR benchmark. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Best practices for photovoltaic performance loss rate calculations

Abstract The performance loss rate (PLR) is a vital parameter for the time-dependent assessment of photovoltaic (PV) system performance and health state. Although this metric can be calculated in a relatively straightforward manner, it is challenging to achieve accurate and reproducible results with low uncertainty. Furthermore, the temporal evolution of PV system performance is usually nonlinear, but in many cases a linear evaluation is preferred as it simplifies the assessment and it is easier to evaluate. As such, the search for a robust and reproducible calculation methodology providing reliable linear PLR values across different types of systems and conditions has been the focus of many research activities in recent years. In this paper, the determination of PV system PLR using different pipelines and approaches is critically evaluated and recommendations for best practices are given. As nonlinear PLR assessments are fairly new, there is no consent on how to calculate reliable values. Several promising nonlinear approaches have been developed recently and are presented as tools to evaluate the PV system performance in great detail. Furthermore, challenges are discussed with respect to the PLR calculation but also opportunities for differentiating individual performance losses from a generic PLR value having the potential of enabling actionable insights for maintenance.

14 SOLAR ENERGY↗
DOE OSTI2024

Effect of detachment on Magnum-PSI ELM-like pulses: direct observations and qualitative results

Abstract Conditions similar to those at the end of the divertor leg in a tokamak were replicated in the linear plasma machine Magnum-PSI. The neutral pressure in the target chamber is then increased to cause the target to transition from an attached to a detached state. Superimposed to this steady state regime, edge localised mode (ELM)-like pulses are reproduced, resulting in a sudden increase in plasma temperature and density, such that the heat flux increases transiently by half an order of magnitude. Visible light emission, target thermography, and Thomson scattering are used to demonstrate that the higher the neutral pressure the more energy is removed from the ELM-like pulse in the volume. If the neutral pressure is sufficiently high, the ELM-like pulse can be prevented from affecting the target and the plasma energy is fully dissipated in the volume instead (ID 4 in table 1). The visible light images allow the division of the ELM-plasma interaction process of ELM energy dissipation into 3 ‘stages’ ranging from no dissipation to full dissipation (the target plasma is detached). In the second publication related to this study, spectroscopic data is analysed with a Bayesian approach, to acquire insights into the significance of molecular processes in dissipating the plasma energy and particles.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

SCALE Input and Result Files Supporting SCALE Inventory and Reactivity Analysis as Part of the Hermes 2021 PSAR Review

This dataset contains input and result files of computational simulations with the SCALE code system. The simulations cover radionuclide inventory and reactivity analyses of a fluoride salt-cooled high temperature pebble-bed reactor (PB-FHR), specifically the Hermes low-power PB-FHR demonstration reactor. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

equilibrium core↗
DOE OSTI2020

The LPM effect in sequential bremsstrahlung: nearly complete results for QCD

The splitting processes of bremsstrahlung and pair production in a medium are coherent over large distances in the very high energy limit, which leads to a suppression known as the Landau-Pomeranchuk-Migdal (LPM) effect. We continue study of the case when the coherence lengths of two consecutive splitting processes overlap (which is important for understanding corrections to standard treatments of the LPM effect in QCD), avoiding soft-emission approximations. Previous work has computed overlap effects for double splitting g → gg → ggg. To make use of those results, one also needs calculations of related virtual loop corrections to single splitting g → gg in order to cancel severe (power-law) infrared (IR) divergences. This paper provides calculations of nearly all such processes involving gluons and discusses how to organize the results to demonstrate the cancellation. In the soft emission limit, our results reproduce the known double-log behavior of earlier authors who worked in leading-log approximation. We also present a first (albeit numerical and not yet analytic) investigation of sub-leading, single IR logarithms. Ultraviolet divergences appearing in our calculations correctly renormalize the coupling αs in the usual LPM result for leading-order g → gg.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Deep potential molecular dynamics simulations of low-temperature plasma-surface interactions

Machine learning approaches to potential generation for molecular dynamics (MD) simulations of low-temperature plasma-surface interactions could greatly extend the range of chemical systems that can be modeled. Empirical potentials are difficult to generalize to complex combinations of multiple elements with interactions that might include covalent, ionic, and metallic bonds. This work demonstrates that a specific machine learning approach, Deep Potential Molecular Dynamics (DeepMD), can generate potentials that provide a good model of plasma etching in the Si-Cl-Ar system. Comparisons are made between MD results using DeepMD models and empirical potentials, as well as experimental measurements. Pure Si properties predicted by the DeepMD model are in reasonable agreement with experimental results. Simulations of Si bombardment by Ar + ions demonstrate the ability of the DeepMD method to predict sputtering yields as well as the depth of the amorphous-crystalline interface. Etch yields as a function of flux ratio and ion energy for simultaneous Cl 2 and Ar + impacts are in good agreement with previous simulation results and experiment. Predictions of etch yields and etch products during plasma-assisted atomic layer etching of Si-Cl 2 -Ar are shown to be in good agreement with MD predictions using empirical potentials and with experiment. Finally, good agreement was also seen with measurements for the spontaneous etching of Si by Cl atoms at 300 K. Further, the demonstration that DeepMD can reproduce results from MD simulations using empirical potentials is a necessary condition to future efforts to extend the method to a much wider range of systems for which empirical potentials may be difficult or impossible to obtain.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger↗
DOE OSTI2023

Modeling the Photoelectrochemical Evolution of Lead-Based, Mixed-Halide Perovskites Due to Photosegregation

Lead-based, mixed-halide perovskites such as methylammonium lead iodide-bromide [MAPb(I 1-x Br x ) 3 ] undergo anion photosegregation under illumination. This is observed as low band gap photoluminescence from photogenerated iodine-rich domains due to favorable band offsets that induce carrier funneling into them. Unfortunately, theoretical rationalizations of mixed-halide photosegregation are complicated by biases inherent to photoluminescence-based observations. Recent compositionally-weighted X-ray diffraction (XRD) measurements now reveal broad distributions of photosegregated stoichiometries not captured by existing photosegregation models. To better bridge experiment and theory, we perform kinetic Monte Carlo (KMC) simulations of photosegregation within the context of a band gap-based thermodynamic model, which has previously accounted for numerous experimental observations. Our KMC simulations are modified to consider high carrier density Fermi-Dirac statistics that result from carrier funneling and accumulation within photosegregated I-rich domains. Obtained KMC results reproduce broad x terminal distributions seen experimentally and illustrate how they are characterized by a central, heavily I-enriched stoichiometry. I-rich domain “drifting” during photosegregation rationalizes the long photosegregation timescales seen experimentally with drifting simultaneously producing a wake of variable stoichiometry I-rich inclusions that form the lion’s share of stoichiometric heterogeneities seen in compositionally-weighted XRD measurements. These simulations and accompanying rationalizations further reveal a general criterion for realizing favorable free energies to induce demixing. Central to the criterion is the statistical occupation of low gap inclusions in the parent alloy by excitations. Furthermore, the resulting model thus provides a general framework for conceptualizing mixed-halide perovskite light and temperature sensitivities, mediated by photocarriers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Stochastic modal velocity field in rough-wall turbulence

Stochastically generated instantaneous velocity profiles are used to reproduce the outer region of rough-wall turbulent boundary layers in a range of Reynolds numbers extending from the wind tunnel to field conditions. Each profile consists in a sequence of steps, defined by the modal velocities and representing uniform momentum zones (UMZs), separated by velocity jumps representing the internal shear layers. Height-dependent UMZ is described by a minimal set of attributes: thickness, mid-height elevation, and streamwise (modal) and vertical velocities. These are informed by experimental observations and reproducing the statistical behaviour of rough-wall turbulence and attached eddy scaling, consistent with the corresponding experimental datasets. Sets of independently generated profiles are reorganized in the streamwise direction to form a spatially consistent modal velocity field, starting from any randomly selected profile. The operation allows one to stretch or compress the velocity field in space, increases the size of the domain and adjusts the size of the largest emerging structures to the Reynolds number of the simulated flow. By imposing the autocorrelation function of the modal velocity field to be anchored on the experimental measurements, we obtain a physically based spatial resolution, which is employed in the computation of the velocity spectrum, and second-order structure functions. The results reproduce the Kolmogorov inertial range extending from the UMZ and their attached-eddy vertical organization to the very-large-scale motions (VLSMs) introduced with the reordering process. The dynamic role of VLSM is confirmed in the –u'w' co-spectra and in their vertical derivative, representing a scale-dependent pressure gradient contribution.

42 ENGINEERING↗
DOE OSTI2025

Operator origin of anomalous dimensions in de Sitter space

The late-time limit of the power spectrum for heavy (principal series) fields in de Sitter (dS) space yields a series of polynomial terms with complex scaling dimensions. Such scaling behavior is expected to result from an associated operator with a complex dimension. In a free theory, these complex dimensions are known to match the constraints imposed by unitarity on the space of states. Yet, perturbative corrections to the scaling behavior of operators are naively inconsistent with unitary evolution of the quantum fields in dS space. This paper demonstrates how to compute one-loop corrections to the scaling dimensions that appear in the two-point function from the field theory description in terms of local operators. We first show how to evaluate these anomalous dimensions using Mellin space, which has the feature that it naturally accommodates a scaleless regulator. We then explore the consequences for the soft de Sitter effective theory (SdSET) description that emerges in the long wavelength limit. Carefully matching between the UV and SdSET descriptions requires the introduction of novel nondynamical “operators” in the effective theory. This is not only necessary to reproduce results extracted from the Källén-Lehmann representation (that use the space of unitary states directly), but it is also required by general arguments that invoke positivity. Published by the American Physical Society 2025

Cohen, Timothy↗
DOE OSTI2025

Application of pH-dependent environmental protection agency test method 1313 to low-activity nuclear waste glass

Here, in this study, we present results of a room temperature, pH-dependent leach test established by United States Environmental Protection Agency (EPA) Leaching Environmental Assessment Framework (LEAF) (EPA Method 1313 and further abbreviated EPA 1313) to study the alteration behavior of low-activity nuclear waste (LAW) glasses. Implementation of EPA 1313, which is closer to LAW disposal temperatures, could allow for more flexibility in the formulation of Hanford LAW glasses, specifically in terms of increased waste loading. A set of 48 LAW glasses were selected to test with EPA 1313. Briefly, the test method consists of adding glass to a number of solutions at different initial pH values and at a fixed mass-to-solution-volume ratio. The glass is then allowed to corrode for two days and the final solution pH and concentration of different glass elements in solution is measured. The test was modified from the published procedure to constrain particle size to provide more reproducible results, reduce the studied pH range to a more applicable range, and to reduce solution volume to reduce costs associated with material preparation. Compositional modeling was used to predict the measured elemental releases at various pH. The model predictions improved in tests where there was a relatively small difference between initial and final solution pH indicating that pH controls would result in better predictive models.

Accelerated aging↗
DOE OSTI2021

A multi-phase-field model of topological pattern formation during electrochemical dealloying of binary alloys

Porous metal structures produced by electrochemical dealloying have been extensively studied for use in various applications that require high surface areas. A new comprehensive multi-phase-field (MPF) model is proposed to study topological porous patterns formed by spontaneously etching a bulk binary alloy that involves electrochemical reactions, bulk and surface diffusion, ion transport, applied electrode potential, and charge conservation. The governing equations for the alloy-porous cluster-electrolyte system account for a generalized Butler-Volmer electrochemical reaction and are in accordance with the classical nucleation theory. Based on a quantitative examination of the effects of electrode potential and precursor composition, the simulation results reproduce typical phenomena including passive surface dealloying, active porosity evolution, critical potential, and characteristic length scale in two-dimension (2-D) and three-dimension (3-D). To consider more complicated dealloying systems, the evolutions of a bimodal porous metal structure, nanocomposite, and nested porous network with a structured hierarchy are investigated. Finally, the proposed model can be a useful tool for understanding and predicting the morphology evolution of diverse porous structures during electrochemical dealloying.

Hierarchical porous structure↗
DOE OSTI2020

Computational Experiment Design for Operations Model Simulation

Computer simulations that demonstrate the value of novel approaches are crucial to developing more flexible and robust power systems operations with high penetrations of renewable energy at multiple geographic and temporal scales. However, optimization-based simulations that depend on forecast data often face challenges in evaluating performance, reproducing results, and testing under realistic simulation scenarios. In this paper, we develop scientific computing best-practices for the validation and reproduction of power systems operational models. We then employ two case studies to demonstrate the proposed validation and reproduction framework.

MATHEMATICS AND COMPUTING,POWER TRANSMISSION AND D↗
DOE OSTI2025

Machine Learning-Accelerated First-Principles Molecular Dynamics Explains Anomalous Lattice Thermal Expansion in BaZr 0.78 Y 0.22 O 3-δ

Fuel cells are a vital clean energy technology that converts chemical energy directly into electricity with high efficiency, making them a cornerstone of a sustainable energy future. Herein we investigate the thermal and chemical lattice expansion behavior of hydrated BaZr 0.78 Y 0.22 O 3-δ using machine learning-accelerated ab initio molecular dynamics simulations. Here, our results reproduce the experimentally observed non-monotonic and anomalous temperature dependence of lattice expansion, which we attribute to the competing effects of thermal expansion and dehydration—two mechanisms that influence the lattice expansion in opposite directions. The importance of this work lies in its detailed demonstration of how advanced computational techniques can accurately capture complex environmental effects, providing a valuable framework for modeling similar phenomena in a variety of material systems and applications.

Proton conducting fuel cell↗
DOE OSTI2022

Constrained model calibration of grain structure dependent spall dynamics in shock-loaded tantalum

Here, we perform a gas gun experiment by shock loading tantalum samples of varying grain structures to assess the suitability of a numerical model for simulating spall behavior. The observed differences in spall strength, as well spallation and re-compression history, are not captured in uncalibrated hydrodynamic simulations. An optimization is performed on the Johnson spall model to determine the best parameters that fit the observed trends. Linear stability analysis is employed to motivate bounds on those parameters. Herein, optimized simulations agree well with the experimental results, reproducing pullback depth and recompression timescales across the different samples tested. Further, the observed pullback time of the single crystal sample was found to imply, via the stability analysis, a percolation threshold in good agreement with the theoretical value for a body centered cubic lattice. Therefore, the combined linear stability and percolation analysis shows promise and may be applied to other materials with diverse microstructures. Collectively, the findings demonstrate that the model is suitable for reproducing spall-induced free surface behavior across various microstructures, but also points to caution in using model coefficients for uncalibrated microstructures.

58 GEOSCIENCES↗
DOE OSTI2023

Flexible, integrated modeling of tokamak stability, transport, equilibrium, and pedestal physics

The STEP (Stability, Transport, Equilibrium, and Pedestal) integrated-modeling tool has been developed in OMFIT to predict stable, tokamak equilibria self-consistently with core-transport and pedestal calculations. STEP couples theory-based codes to integrate a variety of physics, including magnetohydrodynamic stability, transport, equilibrium, pedestal formation, and current-drive, heating, and fueling. The input/output of each code is interfaced with a centralized ITER-Integrated Modelling & Analysis Suite data structure, allowing codes to be run in any order and enabling open-loop, feedback, and optimization workflows. This paradigm simplifies the integration of new codes, making STEP highly extensible. STEP has been verified against a published benchmark of six different integrated models. Core-pedestal calculations with STEP have been successfully validated against individual DIII-D H-mode discharges and across more than 500 discharges of the H98,y2 database, with a mean error in confinement time from experiment less than 19%. STEP has also reproduced results in less conventional DIII-D scenarios, including negative-central-shear and negative-triangularity plasmas. Predictive STEP modeling has been used to assess performance in several tokamak reactors. Simulations of a high-field, large-aspect-ratio reactor show significantly lower fusion power than predicted by a zero-dimensional study, demonstrating the limitations of scaling-law extrapolations. STEP predictions have found promising scenarios for an EXhaust and Confinement Integration Tokamak Experiment, including a high-pressure, 80%-bootstrap-fraction plasma. ITER modeling with STEP has shown that pellet fueling enhances fusion gain in both the baseline and advanced-inductive scenarios. Finally, STEP predictions for the SPARC baseline scenario are in good agreement with published results from the physics basis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Back-to-back dijet production in DIS at arbitrary Bjorken x: TMD gluon distributions to twist-3 accuracy

We derive the gluon transverse-momentum-dependent (TMD) operator structure of back-to-back\\\\r\\\\nquark–antiquark dijet production in deep inelastic scattering at arbitrary Bjorken-x to twist-3 ac\\\\r\\\\ncuracy. Working at leading order in the strong coupling and in the kinematic regime where the\\\\r\\\\ntransverse momentum imbalance of the jets is much smaller than their individual transverse mo\\\\r\\\\nmenta, we perform a systematic gradient expansion of the quark propagator in a background gluon\\\\r\\\\nfield. This expansion organizes multiple interactions with the target in terms of longitudinal Wilson\\\\r\\\\nlines and gauge-invariant field-strength insertions, yielding a TMD description valid beyond the\\\\r\\\\nstrict high-energy eikonal (x → 0) approximation. We obtain explicit cross sections for longitudi\\\\r\\\\nnally and transversely polarized virtual photons, identifying all contributing gluon TMD operators\\\\r\\\\nup to twist-3, including structures involving F+−, Fij, and three-gluon correlators. The full lon\\\\r\\\\ngitudinal phase eixP+z− associated with Bjorken-x is retained throughout. In the small-x limit,\\\\r\\\\nour results reproduce the known sub-eikonal expressions obtained in the Color Glass Condensate\\\\r\\\\nframework, establishing a direct connection between the general-x TMD expansion and high-energy\\\\r\\\\nfactorization. We further reduce the operator basis using equations of motion, minimizing the num\\\\r\\\\nber of independent nonperturbative matrix elements entering the cross section. This work provides\\\\r\\\\na systematic foundation for extending TMD analyses of dijet production beyond leading twist, es\\\\r\\\\ntablishing a unified operator framework valid at arbitrary Bjorken-x that smoothly interpolates\\\\r\\\\nbetween moderate- and small-x descriptions of gluon TMDs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗