Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Demonstration of the Reproducibility Challenges in the Sintering Behavior of Lithium‐Stuffed Garnets in Scaling up Synthesis

Lithium-stuffed garnets, such as Li 7 La 3 Zr 2 O 12 (LLZO), are promising candidates for next-generation solid-state batteries because of their high room-temperature ionic conductivity and chemical stability against lithium metal anodes, which are crucial for achieving higher energy density. However, realizing LLZO's potential in practical devices requires synthesis methods that can be scaled reliably to large batch sizes for manufacturing. Herein, we investigate the sintering reproducibility of LLZO synthesized at larger scales using ultrasonic spray pyrolysis, a cost-effective and scalable synthesis route. Two 100 g batches of Al-doped LLZO are prepared and their sintering behavior is examined in detail. Both Al-LLZO batches contain over 90 wt.% cubic-phase LLZO, and both batches exhibit room temperature conductivities greater than 1 × 10 −4 S cm −1 at a relative density above 0.8. However, variations in secondary phases and subtle differences in Al content lead to significant differences in densification and microstructure. These results demonstrate that LLZO's sintering behavior is highly sensitive to small changes in secondary phases and Al content, creating reproducibility challenges when moving from laboratory- to manufacturing-scale synthesis.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Sensitivity Analysis of Material Model Parameters to Reproduce Crushing of Composite Tubes

The ability to predict the behavior of composite structures under impact conditions is an important challenge for engineering analysis since it requires modeling beyond the elasticity and into failure initiation and propagation. Crushing of laminate composites is the result of a combination of several and complex failure mechanisms, which are not always possible to reproduce together in a single finite element analysis (FEA). In this paper, models based on lamina-level failure criteria have been used to predict the onset of damage; once failure initiates, the mechanisms of failure propagation require reducing the material properties using several degradation schemes. Among the composite material models available in LS-DYNA, MAT-ENHANCED-COMPOSITE-DAMAGE (MAT-54) has been chosen for modeling the axial crushing of composite tubes with various resistant sections and wall slope, given the reduced experimental input parameters to insert into the card definition. Comparison with experimental data shows that such material model is able to successfully reproduce the crushing behavior, even if the numerical results are strictly correlated with some model parameters which cannot be measured experimentally or are purely mathematical expedients. Therefore, extensive calibration of these parameters by trial-and-error is necessary to achieve successful simulation results. Once done it for a structure made of the same composite material, it is possible to adopt the same card configuration for all the other cases, obtaining good agreement between numerical and experimental results. After, the attempt to model the same geometries using the MAT-LAMINATED-COMPOSITE-FABRIC (MAT-58) card with the same parameter values previously calibrated has been done obtaining results comparable with the experimental data.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Large-Area Graphene Films as Target Surfaces for Highly Reproducible Matrix-Assisted Laser Desorption Ionization Suitable for Quantitative Mass Spectrometry

Due to the known sweet-spot issues that intrinsically arise from inhomogeneous formation of matrix-analyte crystals utilized as samples in matrix-assisted laser desorption ionization (MALDI) mass spectrometry, its reproducibility and thus its applications for quantification have been somewhat limited. In this paper, we report a simple strategy to improve the uniformity of matrix-analyte crystal spots, which we realized by adapting large-area graphene films, i.e., non-inert, interacting surfaces, as target surfaces. In this example, the graphitic surfaces of the graphene films interact with excess matrix molecules during the sample drying process, which induces spontaneous formation of optically uniform MALDI sample crystal layers on the film surfaces. Further, mass spectrometric imaging reveals that the visible uniformity is indeed accompanied by reproducible MALDI ionization over an entire sample spot, which greatly suppresses the appearance of sweet spots. The results of this study confirm that the proposed method achieves good linear responses of ion intensity to the analyte concentration (R{sup 2} > 0.99) with small relative standard deviations (σ < 10%), which is a range applicable for quantitative measurements using MALDI mass spectrometry. .

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2023

Reproducible benchmark for the SNAP 8 experimental reactor at dry conditions

Here, this work provides fully reproducible benchmark models of the Systems for Nuclear Auxiliary Power (SNAP) 8 Experimental Reactor. Validation benchmarks of the criticality configuration experiments under dry conditions with no coolant are presented. In addition, relevant reactivity worth experiments, and measurement of power distributions are validated and presented here. Discrepancies between modeled and experimental results are at most 110 pcm for fuel and poison worths, and critical configurations that do not manipulate control elements are within 50 pcm. Larger discrepancies found in reflector element worth experiments are due to experimental methodology which was noted as being simplified due to limited calculational capabilities at the time, while discrepancy in the control element manipulated critical configuration is due the absence of structural components for modeling simplification. Power distributions closely follow what was observed in experiment with expected peaking in reflecting elements. All models are well documented with cited references describing and justifying assumptions, simplifications, and adjustments to reproduce the models with any nuclear safety codes; model inputs and outputs are stored in the snapReactors GitHub repository.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

Reproducible benchmark for the SNAP 8 experimental reactor at operating conditions

This work presents fully reproducible multiphysics benchmark models of the Systems for Nuclear Auxiliary Power (SNAP) 8 Experimental Reactor at operating conditions with coolant flow. Wet experiment (with coolant, at power) validation benchmarks are presented using both deterministic (Serpent-Griffin) and Monte-Carlo (OpenMC-Cardinal) multiphysics frameworks coupled with thermal-hydraulic solvers in MOOSE. Reactivity coefficient measurements including fuel temperature, isothermal temperature, and power coefficients show good agreement with experiments, with discrepancies within experimental uncertainty. Reactivity worth experiments for coolant, samarium, and xenon poisoning are reproduced with differences under 200 pcm. Comparison between Serpent-Griffin and OpenMC-Cardinal frameworks reveal multiphysics coupling introduces positive reactivity effects (100-200 pcm) compared to uniform temperature and density fields at nominal operating conditions. Comparison between Serpent-Griffin and reference Serpent solution shows that power distributions maintain consistent radial and axial peaking behavior. All models, assumptions, thermophysical and thermomechanical properties, and material definitions are thoroughly documented with cited references; model inputs and model generating scripts are stored in the snapReactors GitHub repository.

SNAP↗
DOE OSTI2017

Closed-channel culture system for efficient and reproducible differentiation of human pluripotent stem cells into islet cells

Human pluripotent stem cells (hPSCs) are thought to be a promising cell-source solution for regenerative medicine due to their indefinite proliferative potential and ability to differentiate to functional somatic cells. However, issues remain with regard to achieving reproducible differentiation of cells with the required functionality for realizing human transplantation therapies and with regard to reducing the potential for bacterial or fungal contamination. To meet these needs, we have developed a closed-channel culture device and corresponding control system. Uniformly-sized spheroidal hPSCs aggregates were formed inside wells within a closed-channel and maintained continuously throughout the culture process. Functional islet-like endocrine cell aggregates were reproducibly induced following a 30-day differentiation protocol. Our system shows an easily scalable, novel method for inducing PSC differentiation with both purity and functionality. - Highlights: • A simple, closed-channel-based, semi-automatic culture system is proposed. • Uniform cell aggregate formation and culture is realized in microwell structure. • Functional islet cells are successfully induced following 30-plus-day protocol. • System requires no daily medium replacement and reduces contamination risk.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

How should reproducibility be approached in plastic recycling?

With the growing importance of developing new and improved methodologies for plastic recycling, conducting reproducible research and ensuring that results are transferable across labs are increasingly important. This Voices article reflects on how academia and industry view the path forward for strengthening reproducibility to advance science and enable a circular plastics economy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Repeatability and Reproducibility of Radiomic Features: A Systematic Review

An ever-growing number of predictive models used to inform clinical decision making have included quantitative, computer-extracted imaging biomarkers, or “radiomic features.” Broadly generalizable validity of radiomics-assisted models may be impeded by concerns about reproducibility. We offer a qualitative synthesis of 41 studies that specifically investigated the repeatability and reproducibility of radiomic features, derived from a systematic review of published peer-reviewed literature.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

Transfer learning as a method to reproduce high-fidelity non-local thermodynamic equilibrium opacities in simulations

Simulations of high-energy density physics often need non-local thermodynamic equilibrium opacity data. These data, however, are expensive to produce at relatively low fidelity. It is even more so at high fidelity such that the opacity calculations can contribute 95 % of the total computation time. This proportion can even reach large proportions. Neural networks can be used to replace the standard calculations of low-fidelity data, and the neural networks can be trained to reproduce artificial, high-fidelity opacity spectra. In this work, it is demonstrated that a novel neural network architecture trained to reproduce high-fidelity krypton spectra through transfer learning can be used in simulations. Further, it is demonstrated that this can be done while achieving a relative per cent error of the peak radiative temperature of the hohlraum of approximately 1 % to 4 % while achieving a 19.4 $\times$ speed up.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2017

Is the Supporting Information the Venue for Reproducibility and Transparency?

Making research data, software, and data processing tools readily available to the public could significantly enhance the impact of scientific publications. Openness and transparency could address reproducibility concerns and accelerate scientific progress.(1, 2) While archives and repositories would be preferable for securing data in the long term, the Supporting Information (SI) already allocates significant space to provide auxiliary files, links, and essential information needed to make scientific findings immediately reproducible as well as data processing protocols and numerical procedures executable. Furthermore, the SI document could ensure that data that might not fit in the tight confines of a journal article lives online even when laboratories move on to other projects, close, and lose track of their data.

Rudshteyn, Benjamin↗
DOE OSTI2016

Effects of thermochemical treatment on CuSbS 2 photovoltaic absorber quality and solar cell reproducibility

CuSbS 2 is a promising nontoxic and earth-abundant photovoltaic absorber that is chemically simpler than the widely studied Cu 2 ZnSnS 4 . However, CuSbS 2 photovoltaic (PV) devices currently have relatively low efficiency and poor reproducibility, often due to suboptimal material quality and insufficient optoelectronic properties. To address these issues, here we develop a thermochemical treatment (TT) for CuSbS 2 thin films, which consists of annealing in Sb 2 S 3 vapor followed by a selective KOH surface chemical etch. The annealed CuSbS 2 films show improved structural quality and optoelectronic properties, such as stronger band-edge photoluminescence and longer photoexcited carrier lifetime. These improvements also lead to more reproducible CuSbS 2 PV devices, with performance currently limited by a large cliff-type interface band offset with CdS contact. Altogether, these results point to the potential avenues to further increase the performance of CuSbS 2 thin film solar cell, and the findings can be transferred to other thin film photovoltaic technologies.

14 SOLAR ENERGY↗
DOE OSTI2026

Molecular Additive Engineering for Process-Humidity Robustness and Reproducible Fabrication of Perovskite Solar Cells and Modules

The commercialization of perovskite solar cells (PSCs) faces significant challenges due to their sensitivity to environmental humidity, which compromises film crystallization and device stability. Here, we introduce diphenylvinylphosphine (DPVP) as a Lewis base additive that enhances the performance and reproducibility of PSCs fabricated under ambient-air conditions. DPVP suppresses moisture-induced defect formation and stabilizes crystallization within realistic process-humidity ranges (20–40% relative humidity) commonly encountered in laboratory and pilot-scale manufacturing environments. It improves film uniformity, reduces trap densities, and yields highly reproducible device performance, enabling champion PCEs of 24.2% in small-area devices and 20.5% in blade-coated 12 cm 2 mini-modules. Furthermore, DPVP-assisted modules exhibit enhanced stability, retaining over 85% of their initial efficiency after 900 h of maximum power point tracking (MPPT) at 65 °C. This study demonstrates a humidity-resilient and scalable additive strategy for ambient-air perovskite photovoltaic manufacturing.

defect passivation↗
DOE OSTI2025

Reproducibility of Radiokrypton in Deep Desert Aquifers: Insights from a Decade of Research

Great technical advances have been achieved since the first atom-trap trace analysis (ATTA) -based radiokrypton application in Egypt, where 1 Myr old groundwater was discovered. Beyond advances in ATTA measurement capabilities, including reduction in sample size, analysis duration, and analytical uncertainty, major progress has been achieved over the past two decades in the sample collection and preparation techniques. These advances paved the expansion of ATTA-based noble gas applications to many other aquifers worldwide, illuminating the nature and flow pattern of deep groundwater systems. While the potential of this new analytical technique for old groundwater dating is well recognized, another important aspect yet to be examined is the reproducibility of radiokrypton in aquifers over time, i.e., how representative is a discrete groundwater sample, collected at a specific time and location, for the natural groundwater system? The likelihood of a negative answer is increased by flow-field disturbance in aquifers following massive groundwater abstraction. Here, in this work, we present repeated 81 Kr sampling and measurements in twenty-one sites over Israel, mostly of deep (up to 1 km) wells tapping confined aquifers in the arid to hyperarid Negev desert. The results demonstrate that radiokrypton measurements are indeed reproducible, even in cases where samples were collected as long as nine years apart and from highly productive (∼1 Mm 3 /yr order) pumping wells. Furthermore, many of the repeated measurements in this study (17 out of the 21 sites) were conducted with different ATTA Instruments in two different laboratories using slightly different sampling, preparation, and analysis techniques, yet with an overall good agreement. The consistency in the ATTA-based 81 Kr-dating results over time highlights the robustness of this state-of-the-art technique as a tool to unravel groundwater flow patterns and encourages further applications to many other yet-to-be-explored deep aquifers.

atom-trap trace analysis↗
DOE OSTI2024

Increasing the Reproducibility and Replicability of Supervised AI/ML in the Earth Systems Science by Leveraging Social Science Methods

Artificial intelligence (AI) and machine learning (ML) pose a challenge for achieving science that is both reproducible and replicable. The challenge is compounded in supervised models that depend on manually labeled training data, as they introduce additional decision-making and processes that require thorough documentation and reporting. We address these limitations by providing an approach to hand labeling training data for supervised ML that integrates quantitative content analysis (QCA)—a method from social science research. The QCA approach provides a rigorous and well-documented hand labeling procedure to improve the replicability and reproducibility of supervised ML applications in Earth systems science (ESS), as well as the ability to evaluate them. Specifically, the approach requires (a) the articulation and documentation of the exact decision-making process used for assigning hand labels in a “codebook” and (b) an empirical evaluation of the reliability” of the hand labelers. In this paper, we outline the contributions of QCA to the field, along with an overview of the general approach. We then provide a case study to further demonstrate how this framework has and can be applied when developing supervised ML models for applications in ESS. With this approach, we provide an actionable path forward for addressing ethical considerations and goals outlined by recent AGU work on ML ethics in ESS.

58 GEOSCIENCES↗
DOE OSTI2024

fluxfinder: An R Package for Reproducible Calculation and Initial Processing of Greenhouse Gas Fluxes From Static Chamber Measurements

Fluxes of greenhouse gases are a critical component of the earth's natural climate, but anthropogenic emissions have created an imbalance and resulted in global climate change. Quantifying the emission of these gases is vital to our understanding of their sources and sinks, both natural and anthropogenic. The static chamber method, in which a system of interest is enclosed, and gas concentrations are measured over time, is widely used to estimate fluxes of greenhouse gases. With the development of instruments such as infrared gas analyzers (IRGAs) supporting high-frequency concentration data, there is a growing need for open-source workflows to calculate fluxes. Here we present fluxfinder, an R package designed to support reproducible calculations and processing of greenhouse gas fluxes measured with the static chamber method. The package includes raw data file parsing from widely used IRGAs, metadata matching, unit conversion, flux estimations, and initial quality assurance/quality control (QA/QC). Diagnostic graphical plots provide a transparent way to differentiate between measurement issues and nonlinear behavior. The package is also designed to be easily integrated with the gasfluxes package for further fitting of nonlinear concentration-time models, allowing alternative or additional flux QA/QC. The fluxfinder package offers a flexible workflow that is easily adaptable to promote open and reproducible greenhouse gas flux estimations.

Wilson, Stephanie J.↗
DOE OSTI2026

Frequency reproducibility of solid-state thorium-229 nuclear clocks

Solid-state thorium-229 ( 229 Th) nuclear clocks are set to provide new opportunities for precision metrology and fundamental physics. Taking advantage of inherent low sensitivity of a nuclear transition to its environment, orders of magnitude more emitters can be hosted in a solid-state crystal compared with current optical lattice atomic clocks. Furthermore, solid-state systems needing only simple thermal control are key to the development of field-deployable compact clocks. Here we explore and characterize the frequency reproducibility of the 229 Th:CaF 2 nuclear clock transition, a key performance metric for all clocks. We measure the transition linewidth and centre frequency as a function of the doping concentration, temperature and time. We report the concentration-dependent inhomogeneous linewidth of the nuclear transition, limited by the intrinsic host crystal properties. We determine an optimal working temperature for the 229 Th:CaF 2 nuclear clock at 196(5) K, at which the first-order thermal sensitivity vanishes. This would enable in situ temperature co-sensing using different quadrupole-split lines, reducing the temperature-induced systematic shift below the 10 −18 fractional frequency uncertainty level. At 195 K, the reproducibility of the nuclear transition frequency is 220 Hz (fractionally 1.1 × 10 −13 ) for two differently doped 229 Th:CaF 2 crystals over 7 months. Furthermore, these results form the foundation for understanding, controlling and harnessing the coherent nuclear excitation of 229 Th in solid-state hosts and for their applications in constraining temporal variations of fundamental constants.

Atomic and molecular physics↗
DOE OSTI2025

Evaluating the factors influencing accuracy, interpretability, and reproducibility in the use of machine learning classifiers in biology to enable standardization

The complexity and variability of biological data has promoted the increased use of machine learning methods to understand processes and predict outcomes. These same features complicate reliable, reproducible, interpretable, and responsible use of such methods, resulting in questionable relevance of the derived. outcomes. Here we systematically explore challenges associated with applying machine learning to predict and understand biological processes using a well- characterized in vitro experimental system. We evaluated factors that vary while applying machine learning classifers: (1) type of biochemical signature (transcripts vs. proteins), (2) data curation methods (pre- and post-processing), and (3) choice of machine learning classifier. Using accuracy, generalizability, interpretability, and reproducibility as metrics, we found that the above factors significantly mod- ulate outcomes even within a simple model system. Our results caution against the unregulated use of machine learning methods in the biological sciences, and strongly advocate the need for data standards and validation tool-kits for such studies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2014

An open science resource for establishing reliability and reproducibility in functional connectomics

Efforts to identify meaningful functional imaging-based biomarkers are limited by the ability to reliably characterize inter-individual differences in human brain function. Although a growing number of connectomics-based measures are reported to have moderate to high test-retest reliability, the variability in data acquisition, experimental designs, and analytic methods precludes the ability to generalize results. The Consortium for Reliability and Reproducibility (CoRR) is working to address this challenge and establish test-retest reliability as a minimum standard for methods development in functional connectomics. Specifically, CoRR has aggregated 1,629 typical individuals’ resting state fMRI (rfMRI) data (5,093 rfMRI scans) from 18 international sites, and is openly sharing them via the International Data-sharing Neuroimaging Initiative (INDI). To allow researchers to generate various estimates of reliability and reproducibility, a variety of data acquisition procedures and experimental designs are included. Similarly, to enable users to assess the impact of commonly encountered artifacts (for example, motion) on characterizations of inter-individual variation, datasets of varying quality are included.

60 APPLIED LIFE SCIENCES↗