Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Interlaboratory Study: Testing Reproducibility of Solid Biofuels Component Identification Using Reflected Light Microscopy

Considering global market trends and concerns about climate change and sustainability, increased biomass use for energy is expected to continue. As more diverse materials are being utilized to manufacture solid biomass fuels, it is critical to implement quality assessment methods to analyze these fuels thoroughly. One such method is reflected light microscopy (RLM), which has the potential to complement and enhance current standard testing, leading to improving fuel quality assessment and, ultimately, preventing avoidable air pollution. An interlaboratory study (ILS) was conducted to test the reproducibility of biomass fuels component identification using a reflected light microscopy technique. The exercise was conducted on thirty photomicrographs showing biomass and various undesired components (like plastics or mineral matter), which were purposely added (by the ILS organizers) to contaminate wood pellets and charcoal-based grilling fuels. Forty-six participants had various levels of difficulty identifying the marked components, and as a result, the percentage of correct answers ranged from 52.2 to 94.4%. Among the most difficult components to distinguish were petroleum products and inorganic matter. Various reasons led to the misidentification, including insufficient morphological descriptions of the components provided to participants, ambiguities of the nomenclature, limitations of the analytical and exercise method, and insufficient experience of the participants. Overall, the results indicate that RLM has the potential to enhance the quality assessment of biomass fuels. However, they also demonstrate that the petrographic classification used in this exercise requires further refinement before it can be standardized. While a new simplified classification of solid biomass fuels components was created as an outcome of this study, future research is necessary to refine the nomenclature, develop a microscopic morphological description of the components, and verify the accuracy of component identification with a follow-up ILS.

biomass↗
DOE OSTI2023

Reproducibility of calculations on Li species with correlation-consistent basis sets

Here we have found that two different basis set series, both labeled cc-pVxZ, are widely available and widely used for calculation on Li compounds such that calculations that should be the same are different, causing a reproducibility problem. Here we study the magnitude of the disagreement of these nominally-the-same basis sets for wave function and density functional calculations of Li clusters. We find deviations among the basis sets of as large as 22 millihartrees. In most cases one obtains lower energies with the noncanonical choices. Therefore, it is important to specify which version of the basis set is used for calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Alchemical Free Energy Estimators and Molecular Dynamics Engines: Accuracy, Precision, and Reproducibility

The binding free energy between a ligand and its target protein is an essential quantity to know at all stages of the drug discovery pipeline. Assessing this value computationally can offer insight into where efforts should be focused in the pursuit of effective therapeutics to treat a myriad of diseases. In this work, we examine the computation of alchemical relative binding free energies with an eye for assessing reproducibility across popular molecular dynamics packages and free energy estimators. The focus of this work is on 54 ligand transformations from a diverse set of protein targets: MCL1, PTP1B, TYK2, CDK2, and thrombin. These targets are studied with three popular molecular dynamics packages: OpenMM, NAMD2, and NAMD3 alpha. Trajectories collected with these packages are used to compare relative binding free energies calculated with thermodynamic integration and free energy perturbation methods. The resulting binding free energies show good agreement between molecular dynamics packages with an average mean unsigned error between them of 0.50 kcal/mol. The correlation between packages is very good, with the lowest Spearman’s, Pearson’s and Kendall’s tau correlation coefficients being 0.92, 0.91, and 0.76, respectively. Agreement between thermodynamic integration and free energy perturbation is shown to be very good when using ensemble averaging.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Ensemble Docking in Drug Discovery: How Many Protein Configurations from Molecular Dynamics Simulations are Needed To Reproduce Known Ligand Binding?

Ensemble docking in drug discovery or chemical biology uses dynamical simulations of target proteins to generate binding site conformations for docking campaigns. We demonstrate that 600 ns molecular dynamics simulations of four G-protein-coupled receptors in their membrane environments generate ensembles of protein configurations that, collectively, are selected by 70–99% of the known ligands of these proteins. Thus, the process of ligand recognition by conformational selection can be reproduced by combining molecular dynamics and docking calculations. Clustering of the molecular dynamics trajectories, however, does not necessarily identify the protein conformations that are most often selected by the ligands.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Overcoming Variability: A Reproducible Approach to SERS Detection of Nanodiamonds

Detonation nanodiamonds (DNDs) are formed at specific pressures and temperatures during explosions. Different explosives produce varied yields of DNDs within their detonation soot, with Composition B producing the highest yield. Raman spectroscopy (RS) is often used for the characterization of sp 2 - and sp 3 -hybridized carbon allotropes in carbonaceous materials because of distinct disorder and graphitic bands. Bulk diamond also gives a distinct Raman peak at 1332 cm –1 . Furthermore, as bulk diamond decreases in size to nanometer-sized species, the peak red-shifts and broadens, becoming increasingly difficult to detect with RS using visible excitations. Therefore, surface-enhanced Raman spectroscopy (SERS) was used to enhance the diamond peak of DNDs, enabling better detection and faster examination of DNDs within detonation soot. Previous literature of the SERS of DNDs delivered inconsistent results in spectral signatures and SERS substrates. Herein, refining of the methodology for the acquisition of SERS spectra of DNDs was achieved. Before any SERS experiments, the DNDs were first characterized with normal Raman (NR) and scanning electron microscopy. Two routes for SERS enhancement were evaluated: colloidal noble metal nanoparticles and evaporated silver films. Silver films produced the best signal enhancement of DNDs with the best signal-to-noise and peak enhancements observed at 20–30 nm thick silver films at 5% (∼300 μW) laser power. Consistent, reproducible SERS spectra were acquired of small aggregates of DNDs down to ∼500 nm. NR and SERS mapping analysis of DNDs before and after evaporation of silver films revealed the improvements in the detection capabilities of SERS compared with NR.

Carbon↗
DOE OSTI2025

Comparative Evaluation of the Ability of the MYNN‐EDMF PBL Scheme in WRF Model to Reproduce Near Surface Wind Speed Over Different Topographical Types

Abstract This study systematically evaluates the performance of the Mellor‐Yamada‐Nakanishi‐Niino‐Eddy‐Diffusion‐Mass‐Flux planetary boundary layer (PBL) scheme within the Weather Research and Forecasting (WRF) model in simulating near‐surface wind speeds across various topographies in New York State (NYS). Simulated wind speeds are compared with in‐situ measurements from 22 surface sites, grouped into six topographic categories: continental plain (CT), lakeside (LS), river valley (RV), Long Island (LI), Block Island (BI), and offshore ocean (OO). A quantitative evaluation based on Relative Euclidean Distance shows that wind speeds at the OO site are the most accurately reproduced, followed by those at LI sites, while the model performs less accurately for the remaining topographic groups. Wind speeds over CT sites tend to be overestimated by approximately 1 m/s, although their diurnal variability (DV) is well captured. In contrast, the model underestimates wind DV at LS, RV, LI, and BI sites, with the largest biases occurring at LI and BI, resulting in underestimated daytime wind speed and/or overestimated nighttime wind speed. The OO winds exhibit minimal diurnal variation, accurately captured by our WRF model. The surface wind diurnal variation is closely linked to PBL development. Among the indicators of PBL development, surface potential temperature biases most strongly correlate with wind speed biases. Our WRF model faces challenges in capturing the distinctions between winds influenced by local circulations and those over continental plains, and the significantly stronger winds at OO compared to BI. Potential causes for these biases are discussed, offering pathways for improving surface wind simulations in future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Design-driven optimization of low-cost reagent formulations for reproducible and high-yielding cell-free gene expression

Access to recombinant proteins is vital in basic science and biotechnology research. Cell-free gene expression systems provide one approach to address this need, but widespread utilization remains limited by the cost, complexity, and inconsistency of current platforms. To address these limitations, we carry out a multi-dimensional definitive screening design to reduce the number of reagent components and remove costly secondary energy substrates. From 1,231 different reagent formulations, we discover a simple and reproducible system based on 12 components. The optimized reagent formulation can produce 2.4 ± 0.3 g/L of protein product at the 15-µL scale (~$\$60$/gprotein) and 3.7 ± 0.2 g/L (~$\$39$/gprotein) at the 4-mL scale with oxygen supplementation. This provides an average 95% reduction in cost over previous cell-free reagent formulations. We further show that the optimized reagent formulation can produce nucleoside triphosphates from nitrogenous bases and ribose and that it is robust to failure across batches of cell lysates, users/locations, and in the synthesis of more than 20 different proteins. For example, we demonstrate the production of fifteen therapeutically relevant products, including full-length aglycosylated monoclonal antibodies. We anticipate that our optimized reagent formulation will democratize the use of cell-free systems for protein manufacturing and synthetic biology applications.

Biologics↗
DOE OSTI2021

Accelerated, scalable and reproducible AI-driven gravitational wave detection

The development of reusable artificial intelligence (AI) models for wider use and rigorous validation by the community promises to unlock new opportunities in multi-messenger astrophysics. Here we develop a workflow that connects the Data and Learning Hub for Science, a repository for publishing AI models, with the Hardware-Accelerated Learning (HAL) cluster, using funcX as a universal distributed computing service. Using this workflow, an ensemble of four openly available AI models can be run on HAL to process an entire month's worth (August 2017) of advanced Laser Interferometer Gravitational-Wave Observatory data in just seven minutes, identifying all four binary black hole mergers previously identified in this dataset and reporting no misclassifications. This approach combines advances in AI, distributed computing and scientific data infrastructure to open new pathways to conduct reproducible, accelerated, data-driven discovery. By combining a repository for artificial intelligence models and a supercomputing cluster, an entire month's worth of advanced LIGO data is analysed in just 7 min, finding all binary black hole mergers previously identified in this dataset and reporting no misclassifications.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Qresp, a tool for curating, discovering and exploring reproducible scientific papers

We propose a strategy and present a simple tool to facilitate scientific data reproducibility by making available, in a distributed manner, all data and procedures presented in scientific papers, together with metadata to render them searchable and discoverable. In particular, we describe a graphical user interface (GUI), Qresp, to curate papers (i.e. generate metadata) and to explore curated papers and automatically access the data presented in scientific publications.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2025

An AI-accelerated pathway for reproducible and stable halide perovskites

Halide perovskites (HPs) have remarkable optoelectronic properties, and in the last decade their photovoltaic power conversion efficiency and light-emitting diode efficiency have skyrocketed. Despite the surge in research on these burgeoning materials, two key challenges in the field remain: material irreproducibility and instability. Their behavior is especially dynamic in response to environmental stressors, due to complex interactions with the perovskite crystal lattice. Here, in this review, we survey the latest achievements in HP materials research accomplished with the assistance of artificial intelligence (AI), through the implementation of automated experimentation and machine learning (ML) data analysis. Automated synthesis and characterization tackle problems with material irreproducibility by systematically controlling parameters with very high precision, creating massive datasets, and allowing methodical comparisons from which unbiased conclusions can be drawn. AI can reveal otherwise unnoticed trends, inform future experiments with the highest potential information gain, and forecast future performance. The review concludes with a forward viewpoint of how human-assisted closed-loop laboratories and shared databases allow halide perovskite materials’ processing, properties, and performance to be potentially optimized with AI, accelerating the development of highly reproducible and stable optoelectronic devices.

Hering, Abigail R. [Univ. of California, Davis, CA↗
DOE OSTI2022

Discovering causal structure with reproducing-kernel Hilbert space ε -machines

We merge computational mechanics’ definition of causal states (predictively equivalent histories) with reproducing-kernel Hilbert space (RKHS) representation inference. The result is a widely applicable method that infers causal structure directly from observations of a system’s behaviors whether they are over discrete or continuous events or time. A structural representation—a finite- or infinite-state kernel ϵ-machine—is extracted by a reduced-dimension transform that gives an efficient representation of causal states and their topology. In this way, the system dynamics are represented by a stochastic (ordinary or partial) differential equation that acts on causal states. We introduce an algorithm to estimate the associated evolution operator. Paralleling the Fokker–Planck equation, it efficiently evolves causal-state distributions and makes predictions in the original data space via an RKHS functional mapping. We demonstrate these techniques, together with their predictive abilities, on discrete-time, discrete-value infinite Markov-order processes generated by finite-state hidden Markov models with (i) finite or (ii) uncountably infinite causal states and (iii) continuous-time, continuous-value processes generated by thermally driven chaotic flows. The method robustly estimates causal structure in the presence of varying external and measurement noise levels and for very high-dimensional data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Controlling morphology and improving reproducibility of magnetized liner inertial fusion experiments

X-ray imaging indicates magnetized liner inertial fusion (MagLIF) stagnation columns have a complicated quasi-helical structure with significant variations in x-ray brightness along the column. In this work, we describe MagLIF experiments aimed at controlling these stagnation structures by varying the initial liner geometry and composition. First, by varying the initial aspect ratio of the liner, we demonstrate a change in the stagnation structures that is consistent with helical magneto Rayleigh–Taylor (MRT) instabilities feedthrough from the outer-to-inner surfaces of the liner. Second, to minimize the seed for such instabilities, we incorporate a dielectric coating on the outer surface of the beryllium liner, which has previously been shown to reduce the growth of the electrothermal instability, a likely seed for MRT growth. Using this coating, we achieve a stagnation column with significantly reduced helical structure and axial variation in x-ray brightness. We discuss how this coating changes the evolution of structures through stagnation along with the spatial uniformity of neutron production. Finally, we show that these more uniform stagnations also result in improved reproducibility in stagnation temperatures and primary DD neutron yield.

Ampleford, D. J. (ORCID:0000000237422421)↗
DOE OSTI2020

Where Is the Provenance? Ethical Replicability and Reproducibility in GIScience and Its Critical Applications

As replicability and reproducibility (R&R) crises develop within emerging convergent inquiry, ethical use of provenance information is central to the establishment and preservation of trust in critical applications of GIScience and geospatial technologies. Today large volumes of geospatial data are generated at high velocity from satellite sensors and unmanned aircraft systems, citizen sensors, geolocation-based data services, global navigation satellite systems, and so on. The extensive use of these data for applications such as disaster and humanitarian response raises the issue of R&R from competing perspectives of location privacy and geospatial data quality. Although geospatial data can be integrated and linked with contextual information to identify individuals’ movements, steps taken to ensure privacy can complicate the multiuser development of high-quality geospatial workflows. Provenance information as digital records of historical (retrospective) and potential future (prospective) geospatial processes is often overlooked, misunderstood, or inadequately addressed. We explore the relationship between provenance information, location privacy, and geospatial data quality in the context of R&R with a focus on disaster analytics. Here, we argue that in the era of big data and deep learning, GIScientists and associated institutions bear greater responsibility both for geospatial workflow quality and for location privacy. Given vastly heterogenous computational landscapes, we provide practical recommendations for ethically driven provenance and R&R research and development within the GIScience community and beyond.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

The Galaxy platform for accessible, reproducible, and collaborative data analyses: 2024 update

Galaxy (https://galaxyproject.org) is deployed globally, predominantly through free-to-use services, supporting user-driven research that broadens in scope each year. Users are attracted to public Galaxy services by platform stability, tool and reference dataset diversity, training, support and integration, which enables complex, reproducible, shareable data analysis. Applying the principles of user experience design (UXD), has driven improvements in accessibility, tool discoverability through Galaxy Labs/subdomains, and a redesigned Galaxy ToolShed. Galaxy tool capabilities are progressing in two strategic directions: integrating general purpose graphical processing units (GPGPU) access for cutting-edge methods, and licensed tool support. Engagement with global research consortia is being increased by developing more workflows in Galaxy and by resourcing the public Galaxy services to run them. The Galaxy Training Network (GTN) portfolio has grown in both size, and accessibility, through learning paths and direct integration with Galaxy tools that feature in training courses. Code development continues in line with the Galaxy Project roadmap, with improvements to job scheduling and the user interface. Environmental impact assessment is also helping engage users and developers, reminding them of their role in sustainability, by displaying estimated CO 2 emissions generated by each Galaxy job.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A round-robin approach provides a detailed assessment of biomolecular small-angle scattering data reproducibility and yields consensus curves for benchmarking

Through an expansive international effort that involved data collection on 12 small-angle X-ray scattering (SAXS) and four small-angle neutron scattering (SANS) instruments, 171 SAXS and 76 SANS measurements for five proteins (ribonuclease A, lysozyme, xylanase, urate oxidase and xylose isomerase) were acquired. From these data, the solvent-subtracted protein scattering profiles were shown to be reproducible, with the caveat that an additive constant adjustment was required to account for small errors in solvent subtraction. Further, the major features of the obtained consensus SAXS data over the q measurement range 0–1 Å −1 are consistent with theoretical prediction. The inherently lower statistical precision for SANS limited the reliably measured q -range to <0.5 Å −1 , but within the limits of experimental uncertainties the major features of the consensus SANS data were also consistent with prediction for all five proteins measured in H 2 O and in D 2 O. Thus, a foundation set of consensus SAS profiles has been obtained for benchmarking scattering-profile prediction from atomic coordinates. Additionally, two sets of SAXS data measured at different facilities to q > 2.2 Å −1 showed good mutual agreement, affirming that this region has interpretable features for structural modelling. SAS measurements with inline size-exclusion chromatography (SEC) proved to be generally superior for eliminating sample heterogeneity, but with unavoidable sample dilution during column elution, while batch SAS data collected at higher concentrations and for longer times provided superior statistical precision. Careful merging of data measured using inline SEC and batch modes, or low- and high-concentration data from batch measurements, was successful in eliminating small amounts of aggregate or interparticle interference from the scattering while providing improved statistical precision overall for the benchmarking data set.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

DataFed: Towards Reproducible Research via Federated Data Management

The increasingly collaborative, globalized nature of scientific research combined with the need to share data and the explosion in data volumes present an urgent need for a scientific data management system (SDMS). An SDMS presents a logical and holistic view of data that greatly simplifies and empowers data organization, curation, searching, sharing, dissemination, etc. We present DataFed - a lightweight, distributed SDMS that spans a federation of storage systems within a loosely-coupled network of scientific facilities. Unlike existing SDMS offerings, DataFed uses high-performance and scalable user management and data transfer technologies that simplify deployment, maintenance, and expansion of DataFed. DataFed provides web-based and command-line interfaces to manage data and integrate with complex scientific workflows. DataFed represents a step towards reproducible scientific research by enabling reliable staging of the correct data at the desired environment.

Stansberry, Dale↗
DOE OSTI2022

Simple steps to enable reproducibility: culture conditions affecting Chlamydomonas growth and elemental composition

Even subtle modifications in growth conditions elicit acclimation responses affecting the molecular and elemental makeup of organisms, both in the laboratory and in natural habitats. Here, we systematically explored the effect of temperature, pH, nutrient availability, culture density, and access to CO 2 and O 2 in laboratory-grown algal cultures on growth rate, the ionome, and the ability to accumulate Fe. We found algal cells accumulate Fe in alkaline conditions, even more so when excess Fe is present, coinciding with a reduced growth rate. Using a combination of Fe-specific dyes, X-ray fluorescence microscopy, and NanoSIMS, we show that the alkaline-accumulated Fe was intracellularly sequestered into acidocalcisomes, which are localized towards the periphery of the cells. At high photon flux densities, Zn and Ca specifically over-accumulate, while Zn alone accumulates at low temperatures. The impact of aeration was probed by reducing shaking speeds and changing vessel fill levels; the former increased the Cu quota of cultures, the latter resulted in a reduction in P, Ca, and Mn at low fill levels. Trace element quotas were also affected in the stationary phase, where specifically Fe, Cu, and Zn accumulate. Cu accumulation here depends inversely on the Fe concentration of the medium. Individual laboratory strains accumulate Ca, P, and Cu to different levels. All together, we identified a set of specific changes to growth rate, elemental composition, and the capacity to store Fe in response to subtle differences in culturing conditions of Chlamydomonas, affecting experimental reproducibility. Accordingly, we recommend that these variables be recorded and reported as associated metadata.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Reproducible growth of Brachypodium in EcoFAB 2.0 reveals that nitrogen form and starvation modulate root exudation

Understanding plant-microbe interactions requires examination of root exudation under nutrient stress using standardized and reproducible experimental systems. We grew Brachypodium distachyon hydroponically in fabricated ecosystem devices (EcoFAB 2.0) under three inorganic nitrogen forms (nitrate, ammonium, and ammonium nitrate), followed by nitrogen starvation. Analyses of exudates with liquid chromatography–tandem mass spectrometry, biomass, medium pH, and nitrogen uptake showed EcoFAB 2.0’s low intratreatment data variability. Furthermore, the three inorganic nitrogen forms caused differential exudation, generalized by abundant amino acids–peptides and alkaloids. Comparatively, nitrogen deficiency decreased nitrogen-containing compounds but increased shikimates-phenylpropanoids. Subsequent bioassays with two shikimates-phenylpropanoids (shikimic and p-coumaric acids) on soil bacteria or Brachypodium seedlings revealed their distinct capacity to regulate both bacterial and plant growth. Our results suggest that (i) Brachypodium alters exudation in response to nitrogen status, which can affect rhizobacterial growth, and (ii) EcoFAB 2.0 is a valuable standardized plant research tool.

59 BASIC BIOLOGICAL SCIENCES↗