Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Modeling of a Four-Stage Linear Ionization Cooling Channel for a Muon Collider in G4Beamline

A previous study of an eight-stage rectilinear ionization cooling channel in the ICOOL software demonstrated a five-order-of-magnitude reduction in a muon beam’s 6D emittance. In this study, we look to compare the ways ICOOL and Muons, Inc.’s g4Beamline software model ionization cooling by comparing their modeling of the first four stages to this optimized cooling channel constructed in ICOOL. We begin by identifying the parameters used to construct the optimized ionization cooling channel in ICOOL. We then reconstruct this beam in g4Beamline with identical parameter specifications and simulate the cooling of an identical input beam. Finally, we compare the two simulations based on their beam transmission, longitudinal emittance, and transverse emittance along the channel length. Through this process, we demonstrate that G4Beamline accurately reproduces transverse cooling results but predicts systematically different longitudinal emittance evolution while maintaining similar overall cooling performance, reproducing a 97.9% reduction in 6D emittance over four stages.

Keeler, Dominic [Purdue U., West Lafayette] (ORCID↗
DOE OSTI2020

Emergent Degradation Phenomena Demonstrated on Resilient, Flexible, and Scalable Integrated Photoelectrochemical Cells

Photoelectrochemical (PEC) water splitting provides a pathway to generate sustainable clean fuels using the two most abundant resources on Earth: sunlight and water. Currently, most of the successful models of PEC cells are still fabricated on small scales near 1 cm 2 , which largely limits the mass deployment of solar-fuel production. Here, the scale-up to 8 cm 2 of an integrated PEC (IPEC) device is demonstrated and its performance compared to a 1 cm 2 IPEC cell, using state-of-the-art iridium and platinum catalysts with III–V photoabsorbers. The initial photocurrents at 1 sun are 8 and 7 mA cm -2 with degradation rates of 0.60 and 0.47 mA cm -2 day -1 , during unbiased operation for the 1 and 8 cm 2 devices, respectively. Additionally, evaluating under outdoor and indoor conditions at two U.S. National Laboratories reveals similar results, evidencing the reproducibility of this design's performance. Furthermore, the emerging degradation mechanisms during scale-up are investigated and the knowledge gained from this work will provide feedback to the broader community, since PEC device durability is a limiting factor in its potential future deployment.

25 ENERGY STORAGE↗
DOE OSTI2020

Water Splitting: Emergent Degradation Phenomena Demonstrated on Resilient, Flexible, and Scalable Integrated Photoelectrochemical Cells (Adv. Energy Mater. 48/2020)

We report Photoelectrochemical (PEC) water splitting provides a pathway to generate sustainable clean fuels using the two most abundant resources on Earth: sunlight and water. Currently, most of the successful models of PEC cells are still fabricated on small scales near 1 cm 2 , which largely limits the mass deployment of solar-fuel production. Here, the scale-up to 8 cm 2 of an integrated PEC (IPEC) device is demonstrated and its performance compared to a 1 cm 2 IPEC cell, using state-of-the-art iridium and platinum catalysts with III-V photoabsorbers. The initial photocurrents at 1 sun were 8 and 7 mA cm -2 with degradation rates of 0.60 and 0.47 mA cm -2 day -1 , during unbiased operation for the 1 and 8 cm 2 devices, respectively. Evaluating under outdoor and indoor conditions at two US National Laboratories revealed similar results, evidencing the reproducibility of this design’s performance. Furthermore, the emerging degradation mechanisms during scale-up are investigated and the knowledge gained from this work will provide feedback to the broader community, since PEC device durability is a limiting factor in its potential future deployment.

25 ENERGY STORAGE↗
DOE OSTI2021

A variational multiscale immersed meshfree method for heterogeneous materials

Abstract We introduce an immersed meshfree formulation for modeling heterogeneous materials with flexible non-body-fitted discretizations, approximations, and quadrature rules. The interfacial compatibility condition is imposed by a volumetric constraint, which avoids a tedious contour integral for complex material geometry. The proposed immersed approach is formulated under a variational multiscale based formulation, termed the variational multiscale immersed method (VMIM). Under this framework, the solution approximation on either the foreground or the background can be decoupled into coarse-scale and fine-scale in the variational equations, where the fine-scale approximation represents a correction to the residual of the coarse-scale equations. The resulting fine-scale solution leads to a residual-based stabilization in the VMIM discrete equations. The employment of reproducing kernel (RK) approximation for the coarse- and fine-scale variables allows arbitrary order of continuity in the approximation, which is particularly advantageous for modeling heterogeneous materials. The effectiveness of VMIM is demonstrated with several numerical examples, showing accuracy, stability, and discretization efficiency of the proposed method.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Validating automated resonance evaluation with synthetic data

The integrity and precision of nuclear data are crucial for a broad spectrum of applications, from national security and nuclear reactor design to medical diagnostics, where the associated uncertainties can significantly impact outcomes. A substantial portion of uncertainty in nuclear data originates from the subjective biases in the evaluation process, a crucial phase in the nuclear data production pipeline. Recent advancements indicate that automation of certain routines can mitigate these biases, thereby standardizing the evaluation process and enhancing reproducibility. This research aims to provide a methodology, framework, and metrics for the validation of automated nuclear data evaluation software leveraging high-quality synthetic data that closely mimic real experimental observables. An introduced error metric provides a scale and intuitive measure of the evaluation quality by quantifying the estimate’s accuracy and performance across the specified energy range. Synthetic data provides access to experimental observables and underlying resonance parameters, enabling comparison of different evaluations. The methodology is demonstrated using Ta-181 isotope data in the resolved resonance region. The Automated Resonance Identification Subroutine (ARIS), which operates without prior resonance information, was used to test and showcase the framework’s capabilities utilizing the proposed error metrics. The results demonstrate the effectiveness of the proposed approach and framework for optimizing software parameters and testing hypotheses through “what-if” controlled experiments, such as modifying assumptions about experimental conditions or average resonance parameters.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Improving the performance of PM6 donor polymer by random ternary copolymerization of BDD and DTBT segments

Developing high-performance wide bandgap polymer donors to match the rapidly growing non-fullerene small molecule acceptors (NF-SMAs) is of great importance to further improve the photovoltaic performances of organic solar cells (OSCs). PM6 and D18 are two leading wide bandgap donor polymers, but their performances are highly sensitive to the molecular weights, which have distinct impact on the morphology and thereby the charge generation and recombination processes. Here, in this work, we reported the random ternary copolymerization of PM6 and D18 segments to develop random terpolymers with finely tuned photoelectronic properties and optimized blend morphology for high-performance OSCs. The resulting random terpolymers (PMD-5, PMD-10, PMD-15 and PMD-20) exhibited finely tuned absorptions, energy levels and blend morphology. The optimal morphology of PMD-15:L8-BO contributed to the fast exciton diffusion and dissociation, efficient charge extraction with suppressed recombination. Thus, the power conversion efficiency was improved from 17.22% of the control PM6 devices and 17.47% of the control D18 devices to 18.12% of PMD-15 based devices, which is the top performance of random terpolymers. Moreover, the PMD-15 exhibited much higher batch-to-batch reproducibility at a broad molecular weight range than that of PM6 and D18, showing promising for practical applications.

36 MATERIALS SCIENCE↗
DOE OSTI2018

A close look onto structural models and primary ligands of metallo-β-lactamases

β-Lactamases are hydrolytic enzymes capable of opening the β-lactam ring of antibiotics such as penicillin, thus endowing the bacteria that produce them with antibiotic resistance. Of particular medical concern are metallo-β-lactamases (MBLs), with an active site built around coordinated Zn cations. MBLs are pan-reactive enzymes that can break down almost all classes of β-lactams, including such last-resort antibiotics as carbapenems. They are not only broad-spectrum-reactive but are often plasmid-borne (e.g., the New Delhi enzyme, NDM), and can spread horizontally even among unrelated bacteria. Acquired MBLs are encoded by mobile genetic elements, which often include other resistance genes, making the microbiological situation particularly alarming. There is an urgent need to develop MBL inhibitors in order to rescue our antibiotic armory. A number of such efforts have been undertaken, most notably using the 3D structures of various MBLs as drug-design targets. Structure-guided drug discovery depends on the quality of the structures that are collected in the Protein Data Bank (PDB) and on the consistency of the information in dedicated β-lactamase databases. Here, we conducted a careful review of the crystal structures of class B β-lactamases, concluding that the quality of these structures varies widely, especially in the regions where small molecules interact with the macromolecules. In a number of examples the interpretation of the bound ligands (e.g., inhibitors, substrate/product analogs) is doubtful or even incorrect, and it appears that in some cases the modeling of ligands was not supported by electron density. For ten MBL structures, alternative interpretations of the original diffraction data could be proposed and the new models have been deposited in the PDB. In four cases, these models, prepared jointly with the authors of the original depositions, superseded the previous deposits. This review emphasizes the importance of critical assessment of structural models describing key drug design targets at the level of the raw experimental data. Since the structures reviewed here are the basis for ongoing design of new MBL inhibitors, it is important to identify and correct the problems with ambiguous crystallographic interpretations, thus enhancing reproducibility in this highly medically relevant area.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Liouville operators over the Hardy space

The role of Liouville operators in the study of dynamical systems through the use of occupation measures has been an active area of research in control theory over the past decade. This article investigates Liouville operators over the Hardy space, which encode complex ordinary differential equations in an operator over a reproducing kernel Hilbert space.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A publicly available PyTorch-$\mathrm{ABAQUS}$ $\mathrm{UMAT}$ deep-learning framework for level-set plasticity

Here this paper introduces a publicly available PyTorch-ABAQUS deep-learning framework of a family of plasticity models where the yield surface is implicitly represented by a scalar-valued function. In particular, our focus is to introduce a practical framework that can be deployed for engineering analysis that employs a user-defined material subroutine (UMAT/VUMAT) for ABAQUS, which is written in FORTRAN. To accomplish this task while leveraging the back-propagation learning algorithm to speed up the neural-network training, we introduce an interface code where the weights and biases of the trained neural networks obtained via the PyTorch library can be automatically converted into a generic FORTRAN code that can be a part of the UMAT/VUMAT algorithm. To enable third-party validation, we purposely make all the data sets, source code used to train the neural-network-based constitutive models, and the trained models available in a public repository. Furthermore, the practicality of the workflow is then further tested on a dataset for anisotropic yield function to showcase the extensibility of the proposed framework. A number of representative numerical experiments are used to examine the accuracy, robustness and reproducibility of the results generated by the neural network models.

36 MATERIALS SCIENCE↗
DOE OSTI2017

Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale

A strict throughput requirement has placed a cap on the degree to which we can depend on the execution of single, long, fine spatial grid simulations to explore global atmospheric climate behavior. Alternatively, running an ensemble of short simulations is computationally more efficient. We test the null hypothesis that the climate statistics of a full-complexity atmospheric model derived from an ensemble of independent short simulation is equivalent to that from an equilibrated long simulation. The climate of short simulation ensembles is statistically distinguishable from that of a long simulation in terms of the distribution of global annual means, largely due to the presence of low-frequency atmospheric intrinsic variability in the long simulation. We also find that model climate statistics of the simulation ensemble are sensitive to the choice of compiler optimizations. While some answer-changing optimization choices do not effect the climate state in terms of mean, variability and extremes, aggressive optimizations can result in significantly different climate states.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Proliferation of Faulty Materials Data Analysis in the Literature

As a group of subject matter experts in X-ray photoelectron spectroscopy (XPS), we write this letter to raise awareness of the epidemic of poor and incorrect materials data analysis in the Literature. This is a chronic and growing problem with very undesirable consequences. This issue may contribute to what has been identified as a “reproducibility crisis”1,2 that was the subject of a recent U.S. National Academies study. We are using XPS as one example of what we observe to be a systemic issue.

36 MATERIALS SCIENCE↗
DOE OSTI2019

P-Mart: Interactive Analysis of Ion Abundance Global Proteomics Data

The use of mass-spectrometry-based techniques for global protein profiling of biomedical or environmental experiments has become a major focus in research centered on biomarker discovery; however, one of the most important issues recently highlighted in the new era of omics data generation is the ability to perform analyses in a robust and reproducible manner. This has been hypothesized to be one of the issues hindering the ability of clinical proteomics to successfully identify clinical diagnostic and prognostic biomarkers of disease. P-Mart (https://pmart.labworks.org) is an interactive web-based software environment that enables domain scientists to perform quality-control processing, statistics, and exploration of large-complex proteomics data sets without requiring statistical programming. P-Mart is developed in a manner that allows researchers to perform analyses via a series of modules, explore the results using interactive visualization, and finalize the analyses with a collection of output files documenting all stages of the analysis and a report to allow reproduction of the analysis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Snakes on a Spaceship—An Overview of Python in Heliophysics

Computational analysis has become ubiquitous within the heliophysics community. However, community standards for peer review of codes and analysis have lagged behind these developments. This absence has contributed to the reproducibility crisis, where inadequate analysis descriptions and loss of scientific data have made scientific studies difficult or impossible to replicate. The heliophysics community has responded to this challenge by expressing a desire for a more open, collaborative set of analysis tools. Here, this article summarizes the current state of these efforts and presents an overview of many of the existing Python heliophysics tools. It also outlines the challenges facing community members who are working toward the goal of an open, collaborative, Python heliophysics toolkit and presents guidelines that can ease the transition from individualistic data analysis practices to an accountable, communalistic environment.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Deep transfer operator learning for partial differential equations under conditional shift

Transfer learning enables the transfer of knowledge gained while learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labelling, potential computational power limitations and dataset distribution mismatches. Here, we propose a new transfer learning framework for task-specific learning (functional regression in partial differential equations) under conditional shift based on the deep operator network (DeepONet). Task-specific operator learning is accomplished by fine-tuning task-specific layers of the target DeepONet using a hybrid loss function that allows for the matching of individual target samples while also preserving the global properties of the conditional distribution of the target data. Inspired by conditional embedding operator theory, we minimize the statistical distance between labelled target data and the surrogate prediction on unlabelled target data by embedding conditional distributions onto a reproducing kernel Hilbert space. We demonstrate the advantages of our approach for various transfer learning scenarios involving nonlinear partial differential equations under diverse conditions due to shifts in the geometric domain and model dynamics. Our transfer learning framework enables fast and efficient learning of heterogeneous tasks despite considerable differences between the source and target domains.

42 ENGINEERING↗
DOE OSTI2024

Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations

One of the most promising applications of machine learning in computational physics is to accelerate the solution of partial differential equations (PDEs). The key objective of machine-learning-based PDE solvers is to output a sufficiently accurate solution faster than standard numerical methods, which are used as a baseline comparison. Here, we first perform a systematic review of the ML-for-PDE-solving literature. Out of all of the articles that report using ML to solve a fluid-related PDE and claim to outperform a standard numerical method, we determine that 79% (60/76) make a comparison with a weak baseline. Second, we find evidence that reporting biases are widespread, especially outcome reporting and publication biases. We conclude that ML-for-PDE-solving research is overoptimistic: weak baselines lead to overly positive results, while reporting biases lead to under-reporting of negative results. To a large extent, these issues seem to be caused by factors similar to those of past reproducibility crises: researcher degrees of freedom and a bias towards positive results. We call for bottom-up cultural changes to minimize biased reporting as well as top-down structural reforms to reduce perverse incentives for doing so.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A case study: Comparing testers for means and variances in a balanced incomplete block design

In this article, we present a gauge R & R study that is different from the standard setup in several ways. A balanced incomplete block design (BIBD) was used to collect the data because the measurement is destructive. Besides addressing reproducibility, differences in repeatability (i.e., tester variances) were also of interest. Here we use Bayesian methods to analyze the study data to address whether the three tester means and variances are similar. We also consider what happens if the BIBD structure of the data and possibly different tester variances are ignored in analyzing the study data.

42 ENGINEERING↗
DOE OSTI2024

Recommendations for harmonized reporting of radiation Dosimetry by adoption of Compatibility in Irradiation Research Protocols Expert Roundtable (CIRPER)

Here, in radiobiology, radiation physics, and related areas, there is growing interest in transitioning from cesium-based irradiators to X-ray technologies. Therefore, it makes it imperative for reproducibility purposes, for researchers to provide specifications regarding device parameters, machine calibration details, and experimental setup when innovative X-ray technology is being employed. Several groups have already identified a glaring lack in completeness of critical information on experimental setups, equipment, and physical parameters in published radiation biology studies. The Alternative Technologies Meta Study Report by Brookhaven National Laboratory (BNL) examined 456 manuscripts published between 2017-2021. Only 64 of the reviewed studies (14.0%) consistently reported methods that could allow for replication of their studies. However, 85% provided information on the manufacturer, the irradiator model and the absorbed radiation dose. Approximately 66% provided information on the energy spectra and the dose rate, but only one third disclosed the filter used. Less than 15% of the reviewed studies reported information on calibration and field geometry, specifically field size and distance from source, which are critical parameters in determining the absorbed radiation dose.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2021

The case for free and open source software in research and scholarship

Free and open source software (FOSS) is any computer program released under a licence that grants users rights to run the program for any purpose, to study it, to modify it, and to redistribute it in original or modified form. Here, our aim is to explore the intersection between FOSS and computational reproducibility. We begin by situating FOSS in relation to other ‘open’ initiatives, and specifically open science, open research, and open scholarship. In this context, we argue that anyone who actively contributes to the research process today is a computational researcher, in that they use computers to manage and store information. We then provide a primer to FOSS suitable for anyone concerned with research quality and sustainability—including researchers in any field, as well as support staff, administrators, publishers, funders, and so on. Next, we illustrate how the notions introduced in the primer apply to resources for scientific computing, with reference to the GNU Scientific Library as a case study. We conclude by discussing why the common interpretation of ‘open source’ as ‘open code’ is misplaced, and we use this example to articulate the role of FOSS in research and scholarship today.

97 MATHEMATICS AND COMPUTING↗