Search NASA⌕ Search

SEARCH · Search NASA

Results for “reproducibility of results”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Achieving Highly Reproducible Results in Graphite-based Li-ion Full Coin Cells

Electrode materials, cathodes or anodes, are mostly evaluated in half coin cells where lithium (Li) metal is used. However, due to the instability nature of Li metal, the cycling performances of the half cells is more likely reflecting Li anode stability instead of the coupled electrodes, questioning the conclusions. Full coin cells utilizing graphite as the anode effectively assesses materials. But the key factors of preparing full coin cells with reproducible performances have rarely been discussed and overlooked leading to many inconsistent results. This work discusses the scientific gap between cell preparation and observed electrochemical performances to unveil the key parameters for achieving consistent and reliable results in full coin cells, critical for effective evaluation of any new materials tested under relevant conditions. The knowledge from this work is broadly applicable in other full cells systems such as Si-based full cells or Na-ion batteries.

Hu, Jiangtao↗
DOE OSTI2022

Reproduced Computational Results Report for “Ginkgo: A Modern Linear Operator Algebra Framework for High Performance Computing”

The article titled “Ginkgo: A Modern Linear Operator Algebra Framework for High Performance Computing” by Anzt et al. presents a modern, linear operator centric, C++ library for sparse linear algebra. Experimental results in the article demonstrate that Ginkgo is a flexible and user-friendly framework capable of achieving high-performance on state-of-the-art GPU architectures. In this report, the Ginkgo library is installed and a subset of the experimental results are reproduced. Specifically, the experiment that shows the achieved memory bandwidth of the Ginkgo Krylov linear solvers on NVIDIA A100 and AMD MI100 GPUs is redone and the results are compared to what presented in the published article. Upon completion of the comparison, the published results are deemed reproducible.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Hydropower Capacity Factor Trends & Analytics for the United States

This data repository contains all code, input data, and data generated for Turner et al. (2024)—“Hydropower capacity factors trending down in the United States”. File descriptions: – hydro-cf-trends-inputs.zip: Full set of input data used in this study, organized for direct entry into “/data” directory of hydro-cf-trends data processing pipeline. – hydro-cf-trends.zip: Full data processing pipeline, coded using the R {targets} framework. This is a snapshot release (v1.0) of the code repository stored at https://code.ornl.gov/turnersw/hydro-cf-trends/. – hydro-cf-trends-results.zip: Provides all dam level results required to reproduce results and graphics in Turner et al. (2024). Dams are identified by the “complxID” (root of the hydropower plant ID in the Existing Hydropower Assets Database, inherited from HILARRI). Results include: • dam_CF_trends.csv: Table of long-term trends in annualized capacity factors for 610 dams and modeled annualized capacity factors for 362 modeled dams (naturalized and assimilated flows). • dam_annualized_CF_gen.csv: Annualized time series of the following variables for each of 610 hydropower dams with nameplate > 5MW – Reported nameplate capacity (MW) – Implied maximum annual generation (MWh) – Reported net generation (MWh) – Computed annual capacity factor – Modeled annual capacity factor (362 modeled plants only)

13 HYDRO ENERGY↗
DOE OSTI2025

SCALE Non-LWR Models for NRC Volume 3

This dataset contains input and result files of computational simulations with the SCALE code system. The simulations cover radionuclide inventory and reactivity analyses of various advanced reactors. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

SCALE Non-LWR Models for NRC Volume 5

This dataset contains input and result files of computational simulations with the SCALE code system. The simulations cover radionuclide inventory generation, criticality calculations, and dose rate/shielding analyses of various advanced reactors. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2026

SCALE HTR-PROTEUS Benchmark Model

This dataset contains input and result files of computational simulations of HTR-PROTEUS benchmark with the latest version of SCALE code system. The simulations cover criticality control rod worth calculations as well as sensitivity analysis and uncertainty quantification. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

An open-source high-content analysis workflow for CFTR function measurements using the forskolin-induced swelling assay

Abstract Motivation The forskolin-induced swelling (FIS) assay has become the preferential assay to predict the efficacy of approved and investigational CFTR-modulating drugs for individuals with cystic fibrosis (CF). Currently, no standardized quantification method of FIS data exists thereby hampering inter-laboratory reproducibility. Results We developed a complete open-source workflow for standardized high-content analysis of CFTR function measurements in intestinal organoids using raw microscopy images as input. The workflow includes tools for (i) file and metadata handling; (ii) image quantification and (iii) statistical analysis. Our workflow reproduced results generated by published proprietary analysis protocols and enables standardized CFTR function measurements in CF organoids. Availability and implementation All workflow components are open-source and freely available: the htmrenamer R package for file handling https://github.com/hmbotelho/htmrenamer; CellProfiler and ImageJ analysis scripts/pipelines https://github.com/hmbotelho/FIS_image_analysis; the Organoid Analyst application for statistical analysis https://github.com/hmbotelho/organoid_analyst; detailed usage instructions and a demonstration dataset https://github.com/hmbotelho/FIS_analysis. Distributed under GPL v3.0. Supplementary information Supplementary data are available at Bioinformatics online.

Hagemeijer, Marne C.↗
DOE OSTI2020

Accelerated Aging Humidity Chamber for Nuclear Grade HEPA Filter Media

A unique accelerated aging humidity chamber for simulating the natural aging process of nuclear grade high efficiency particulate air (HEPA) filter media is being designed, implemented, and tested. The nuclear industry currently lacks information regarding the shelf life and service life of HEPA filter media. The Department of Energy recommends disposing of HEPA filters 10 years after the manufacture date for filters operated under dry conditions. Studies have shown the tensile strength and water repellency of HEPA filter media diminish with age. The chamber's principal function is to sustain an elevated relative humidity condition for an extended duration specified by the Arrhenius aging model. To accomplish this, various design parameters were established: (1) consistently achieve uniform humidity conditions within the chamber to equally expose media sheets, (2) ensure the chamber is sufficiently sealed to mitigate the uncontrolled infiltration of air, (3) confidently secure the media sheets to avert the introduction of unnecessary stressing/creasing, (4) fabricate the chamber from clear polycarbonate material to allow inspection of the media sheets, (5) provide a safe and ergonomic design for personnel, (6) ensure the chamber design is replicable and relatively easy to fabricate/assemble. A humidity source, fan, PID controller, humidity and temperature transmitters, and data loggers are required for proper operation and control of the chamber. The humidity source must accommodate target values up to 95% relative humidity throughout the chamber. The three humidity and temperature transmitters are strategically spaced throughout the chamber to ensure uniform conditions. The 10 cubic feet per minute (CFM) fan selected intends to accomplish the desired air change rate inside the chamber of approximately 20 air changes per hour (ACH). The 2 plenums on the upper and lower portions of the chamber utilize a perforated design to uniformly distribute air, promote air mixing, and control the air velocity entering the chamber. Industrial blueprint hanging clamps are being retrofitted to be seated within the chamber drawers and firmly secure the nuclear grade filter media. The aged media will be evaluated using autopsy methodology, and the results obtained intend to help clarify the useful life of nuclear grade HEPA filters. Nuclear grade high efficiency particulate air (HEPA) filters are defined as disposable, extended-media, dry-type filters with a rigid casing enclosing the full depth of the pleats and have a minimum particle removal efficiency of 99.97%. [1] - HEPA filters are constantly exposed to stressors and subsequently have been shown to degrade as the filter ages. Properties such as tensile strength and water repellency, along with others, are negatively impacted. [2] - Due to the scarcity of naturally aged HEPA filters available, it is crucial to develop accelerated aging methods which effectively mimic the natural degradation effects. - After accelerated aging, the filters are subject to testing in the Axial Flow Large Scale Test Stand (ALSTS) and other analysis techniques such as the same qualification tests performed directly after being manufactured. - Quality data is necessary for future decisions regarding the lifetime of nuclear grade HEPA filters. - The objective is to develop a prototype accelerated aging humidity chamber for nuclear grade HEPA filter media. The chamber should expose the media to commonly occurring stressors to expedite the degradation process caused by aging. PID yields reliable and reproducible results: - CFD model correlates well with actual performance; - Further analysis is needed to complete characterization; - Future work for the chamber is still to be completed. The data shown in Figure 5 and Table 1 indicate the system is functioning as designed. As can be determined from the system response evaluation in Table 1, the PID controller is yielding reliable and reproducible results at each set point. As the set point increases, the time constant and 20% settling time increase accordingly. From the results in Table 1, it stands to reason that the CFD model correlates well with the actual performance of the system. Each system response parameter for the 90%RH* CFD model is slightly lower than the parameters collected from the physical model tested at an equivalent set point. This is to be expected considering the inlet in the CFD model is a constant supply of water vapor, whereas the physical model uses a PID controller to monitor the amount of water vapor needed and reacts accordingly. More analysis is still to be done on the prototype chamber. A pressure test will be conducted in order to determine the hourly leak rate of the chamber. This test will involve constant air flow into the chamber until the desired pressure is reached. A uniformity test will also be conducted in order to ensure each filter medium is being exposed to equivalent relative humidity levels. This test will involve an array of humidity meters strategically oriented inside the chamber to record any possible gradients. Future work for the chamber includes dehumidification abilities, tests while fully loaded with filters, and temperature control. Once completed, the autopsy team at Institute of Clean Energy Technology will conduct necessary accelerated aging studies as needed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Emulation of radiation transport in 3D stochastic media using 1D planar Monte Carlo stochastic media radiation transport algorithms

A subset of stochastic media radiation transport problems involves those in which radiation is incident on a thin slab of stochastic material. Particle tracking in 3D for such problems is expensive, and 1D planar models lack accuracy because they only allow the material to change in one dimension. Therefore, we propose dimensional emulation, which through a slight modification allows existing 1D planar geometry stochastic media radiation transport models to reproduce results from the equivalent 3D models by allowing the material to change in all three dimensions, reproducing the fidelity of the 3D model for the low computational cost of the 1D planar model. In this work, we apply dimensional emulation to three Monte Carlo stochastic media radiation transport models: Chord Length Sampling (CLS), the Local Realization Preserving method (LRP), and a variant of Conditional Point Sampling (CoPS). For a common Markovian benchmark set, the 3D emulation variants of these algorithms are numerically verified to reproduce the results of the 3D variants within statistics while running 1.3 to 2 times faster in the implementation within Sandia National Laboratories open-source research code PlaybookMC. The 3D emulation variants are also shown to yield a 72%–92% reduction in error for the thin slab problems in comparison to the 1D benchmark. As a result, the 3D emulation variant of CLS and CoPS-1 are shown to reproduce 3D CLS results that were used to approximate results for a 3D spherical inclusion geometry benchmark set.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

A multimodal and integrated approach to interrogate human kidney biopsies with rigor and reproducibility: guidelines from the Kidney Precision Medicine Project

Comprehensive and spatially mapped molecular atlases of organs at a cellular level are a critical resource to gain insights into pathogenic mechanisms and personalized therapies for diseases. The Kidney Precision Medicine Project (KPMP) is an endeavor to generate three-dimensional (3-D) molecular atlases of healthy and diseased kidney biopsies by using multiple state-of-the-art omics and imaging technologies across several institutions. Obtaining rigorous and reproducible results from disparate methods and at different sites to interrogate biomolecules at a single-cell level or in 3-D space is a significant challenge that can be a futile exercise if not well controlled. Here we describe a “follow the tissue” pipeline for generating a reliable and authentic single-cell/region 3-D molecular atlas of human adult kidney. Our approach emphasizes quality assurance, quality control, validation, and harmonization across different omics and imaging technologies from sample procurement, processing, storage, shipping to data generation, analysis, and sharing. We established benchmarks for quality control, rigor, reproducibility, and feasibility across multiple technologies through a pilot experiment using common source tissue that was processed and analyzed at different institutions and different technologies. A peer review system was established to critically review quality control measures and the reproducibility of data generated by each technology before their being approved to interrogate clinical biopsy specimens. The process established economizes the use of valuable biopsy tissue for multiomics and imaging analysis with stringent quality control to ensure rigor and reproducibility of results and serves as a model for precision medicine projects across laboratories, institutions and consortia.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

A Phenomenological Model for Cavitation

A phenomenological model of cavitation is presented, based on observations that both large relative negative pressures and large negative time derivatives of pressure are required for cavitation onset. We simulated two cavitation experiments to generate cavitation scaling parameters for relative pressure drop and rate of pressure drop. Our results show the model, while simple, is effective at reproducing results from laboratory experiments of cavitation. The parameters were then used in conjunction with a human surrogate computational model to predict, at any position within the head, the probability of intracranial cavitation caused by exposure to a blast event. The results suggest that the magnitude of blast overpressure observed in field data is sufficient to cause intracranial cavitation. Our analysis indicates that the helmeted head, when compared to the unhelmeted head configuration, results in a decrease but not elimination of cavitation exposure. When density functions of cavitation probability versus cumulative brain volume are combined with an injury severity model, the results show helmet efficacy at low and moderate risk levels. However, the convergence of unhelmeted and helmeted probability density functions at high-to-excessive risk thresholds indicates the helmet offers diminishing protection at elevated exposure levels, relative to the unhelmeted baseline. Future investigation and collaboration with neuroscience subject matter experts are needed to contextualize the current computational results. While the present work contributes specific and quantified predictions of intracranial cavitation location and severity, more research is required to apply our results to clinical settings with population-based brain injury subjects and controls. The relationship between our intracranial cavitation predictions with their anticipated clinical sequelae remains a topic in need of exploration.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Entropy-driven Optimal Sub-sampling of Fluid Dynamics for Developing Machine-learned Surrogates

Optimal sub-sampling of large datasets from fluid dynamics simulations is essential for training reduced-order machine learned models. A method using Shannon entropy was developed to weight flow features according to their level of information content, such that the most informative features can be extracted and used for training a surrogate model. The method is demonstrated in the canonical flow over a cylinder problem simulated with OpenFOAM. Both time-independent predictions and temporal forecasting were investigated as well as two types of prediction targets: local per-grid-point predictions and global per-time-step predictions. When tested on training a surrogate model, results indicate that our entropy-based sampling method typically outperforms random sampling and yields more reproducible results in less iterations. Finally, the method was used to train a surrogate model for modeling turbulence in magnetohydrodynamic flows, which revealed various challenges and opportunities for future research.

Brewer, Wes↗
DOE OSTI2026

DEM Modeling and Validation of Pebble Bed Packing Using Chrono::GPU

Accurate prediction of pebble packing structure is important for pebble bed reactors because the spatial distribution of void fraction directly affects coolant flow, pressure drop, heat transfer, and neutronic behavior. However, experimentally validated DEM studies that directly evaluate local void-fraction structure in reactor-relevant pebble beds remain limited. In this work, the pebble bed experiment conducted at Missouri University of Science and Technology is simulated using the graphics processing unit (GPU)-based discrete element method (DEM) code Chrono::GPU. The study focuses on evaluating the ability of Chrono::GPU to reproduce the packing arrangement and void-fraction distribution of a randomly packed spherical pebble bed. The DEM results are first verified against established radial void-fraction correlations, including the Mueller and Vortmeyer-Schuster models, to assess the predicted bulk porosity, near-wall behavior, and oscillatory packing structure. The simulation is then verified against reference DEM data and validated against gamma-ray computed tomography (CT) experimental data at three axial locations. The Chrono::GPU results reproduce the main features of the experimental packing, including the high void fraction near the wall, the first near-wall trough, and the damped oscillatory radial profile caused by wall-induced ordering. Quantitative comparison with DEM data and the CT-based radial profiles shows good agreement, with mean absolute errors on the order of 0.07 and root-mean-square errors below 0.09 for the averaged profiles. These results demonstrate that Chrono::GPU can accurately capture the void-fraction structure of spherical pebble beds and provides a reliable DEM framework for future pebble bed reactor packing, recycling, and thermal-hydraulic studies.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Pulse shaping in strong-field ionization: Theory and experiments

Intense ultrafast pulses cause dissociative ionization and shaping the pulses may allow control of both electronic and nuclear dynamics that determine ion yields. We report on a combined experimental and theoretical effort to determine how shaped laser pulses affect tunnel ionization, the process that precedes many strong-field phenomena. We carried out experiments on Ar, N 2 , H 2 O, and O 2 using a phase-step function of amplitude 3/4π that is scanned across the spectrum of the pulse. In addition, we changed the amount of chirp in the pulses. Semiclassical as well as fully quantum mechanical time-dependent Schrödinger equation calculations are found to be in excellent agreement with experimental results. We find that precise knowledge of the field parameters in the time and frequency domains is essential to afford reproducible results and quantitative theory and experiment comparisons.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2024

Code for BALDR Study 07.04

SAND2024-11256O The Code for BALDR Study 07.04 software reproduces results from the BALDR study concerning "Multilabel Proportion Prediction and Out-of-Distribution Detection on Gamma Spectra of Short-Lived Fission Products." This code can reproduce a scientific study following the step numbers present in the file names. The scientific study uses synthetic and measured data to find the best model for the radioisotope proportion estimation task of interest and generates results. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Morrow, Tyler↗
DOE OSTI2023

Code for BALDR Study 07.05 v.1.0.0

SAND2024-01293O The Code for BALDR Study 07.05 software reproduces results from the BALDR study concerning "A Semi-Supervised Learning Method to Produce Explainable Radioisotope Proportion Estimates for NaI-based Synthetic and Measured Gamma Spectra." The code for BALDR Study 07.05 can reproduce a scientific study following the step numbers within the file names. Using synthetic and measured data to find the best model for the radioisotope proportion estimation task of interest, the study generated results for inclusion in a paper. The high-level methods involved are neural networks, semi-supervised learning, and out-of-distribution detection. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Morrow, Tyler↗
DOE OSTI2024

The Dual Nature of Entrainment-Mixing Signatures Revealed through Large-Eddy Simulations of a Convection-Cloud Chamber

Abstract Entrainment of subsaturated air into a cloud can influence its optical and microphysical properties in various ways, depending on the droplet evaporation and turbulent mixing time scales. Previous experiments in the Pi convection-cloud chamber have revealed that, given a fixed entrained air property, the mixing of entrained subsaturated air results in complete evaporation of some cloud droplets, with the rest remaining unchanged. This is a signature of inhomogeneous mixing. While comparing the results of entrainment with varying air properties, the mixing signature appears as if the subsaturated air is well mixed with the cloud to evenly reduce the droplets’ size. In other words, taken together, the experiments appear to have the signature of homogeneous mixing. To explore these results in a greater depth, we conduct large-eddy simulations combined with a bin microphysics scheme. Our results reproduce the similar signatures of inhomogeneous and homogeneous mixing, implying that LES can resolve the inhomogeneous mixing when the grid spacing is smaller than the entrained air parcel. Additionally, we observe that increasing the aerosol injection rate enhances the signature of inhomogeneous mixing, while coarser grid spacing diminishes it. Finally, the change in wall fluxes in response to various entrained air properties confirms that the homogeneous signature seen in the analysis of an ensemble of simulations is the result of various equilibrium states. This further strengthens the suggestion that the homogeneous mixing signature found in aircraft observations near the cloud top may result from combining entrainment events of different intensities, possibly caused by various-sized eddies. Significance Statement Large-eddy simulation and size-resolved microphysics can resolve time scales for turbulent mixing and evaporation and, therefore, are well suited for reproducing, extending, and interpreting the entrainment experiment in the Pi convection-cloud chamber. Our simulation results confirm (i) the inhomogeneous mixing signature for an individual entrainment event and (ii) the appearance of homogeneous mixing in an ensemble of entrainment episodes. Furthermore, we demonstrate that the inhomogeneous mixing signature is more pronounced in a polluted cloud, but coarser grid spacing in simulations may compromise the accuracy of this signature. Last, the homogeneous mixing signature results from various equilibrium states established for different entrainment intensities and adjusted wall fluxes, which are challenging to measure experimentally but can be easily analyzed in the simulations.

54 ENVIRONMENTAL SCIENCES↗