Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Front propagation formulation for large eddy simulation of turbulent premixed flames

The front propagation formulation (FPF) for large eddy simulation (LES) of turbulent premixed flames is presented and discussed. The FPF method adopts a regularized Dirac delta function to minimize the spurious propagation of under-resolved filtered flame fronts in LES, while reproducing the reaction characteristics of premixed flame fronts. Here, the extension of the FPF method to LES and the relation to existing sub-filter combustion models are discussed. An algebraic model for the regularized Dirac delta function is presented and validated using direct numerical simulation (DNS) data for statistically planar premixed flames propagating in homogeneous isotropic turbulence. A posteriori validation for a filtered 1-D planar laminar flame is performed to demonstrate the characteristics of FPF in reproducing the propagation speed and the thickness of the under-resolved flame front. LES of a turbulent Bunsen flame is also performed to demonstrate the performance of the proposed method.

42 ENGINEERING↗

Ignition delay times of NH 3 /DME blends at high pressure and low DME fraction: RCM experiments and simulations

Here, autoignition delay times of ammonia/dimethyl ether (NH 3 /DME) mixtures were measured in a rapid compression machine with DME fractions of 0, 2 and 5 and 100% in the fuel. The measurements were performed at equivalence ratios $\varphi$= 0.5, 1.0 and 2.0 and pressures in the range 10–70 bar; depending on the fuel composition, the temperatures after compression varied from 610 K to 1180 K. Admixture of DME is seen to have a dramatic effect on the ignition delay time, effectively shifting the curves of ignition delay vs. temperature to lower temperatures, up to ~250 K compared to pure ammonia. Two-stage ignition is observed at $\varphi$= 1.0 and 2.0 with 2% and 5% DME in the fuel, despite the pressure being higher than that at which pure DME shows two-stage ignition. At $\varphi$= 0.5, a reproducible pre-ignition pressure rise is observed for both DME fractions, which is not observed in the pure fuel components. A novel NH 3 /DME mechanism was developed, including modifications in the NH 3 subset and addition of the NH 2 + CH 3 OCH 3 reaction, with rate coefficients calculated from ab initio theory. Simulations faithfully reproduce the observed pre- ignition pressure rise. While the mechanism also exhibits two-stage ignition for NH 3 /DME mixtures, both qualitative and quantitative improvement is recommended. The overall ignition delay times for ammonia/DME mixtures are predicted well, generally being within 50% of the experimental values, although reduced performance is observed for pure ammonia at $\varphi$= 2.0. Simulating the ignition process, we observe that the DME is oxidized much more rapidly than ammonia. Analysis of the mechanism indicates that this ‘early DME oxidation’ generates reactive species that initiate the oxidation of ammonia, which in turn begins heat release that raises the temperature and accelerates the oxidation process towards ignition. The reaction path analysis shows that the low-temperature chain-branching reactions of DME are important in the early oxidation of the fuel, while the sensitivity analysis indicates that several reactions in the oxidation of DME, including cross reactions between DME and NH 3 species presented here, are critical to ignition, even at fractions of 2% DME in the fuel.

10 SYNTHETIC FUELS↗

Phonon spectrum and phonon focusing in coarse-grained atomistic simulations

This work investigates the accuracy, efficiency, and applicability of coarse-grained (CG) atomistic methods in simulation of phonon dynamics. First, we compute and compare phonon dispersion relations in CG models with those in atomically resolved models, using the concurrent atomistic-continuum (CAC). The CG atomistic models using the CAC method are shown to reproduce long-wavelength phonons with great accuracy, while capturing the dynamics of some short-wavelength phonons that are usually inaccessible to CG methods. We then present CG simulation results of the propagation of heat pulses in Si with the interaction between atoms being modelled with the Stillinger-Weber potential; the experimentally observed phonon-focusing patterns in the (1 0 0) and (1 1 1) planes of Si crystals are reproduced. The accuracy and efficiency of the CAC method in CG simulation of acoustic and optical phonon branches are quantified with respect to atomically-resolved molecular dynamics simulations. The applicability and limitations of concurrent multiscale methods in the simulation of phonon transport across atomistic-continuum interface are investigated. Possible ways to overcome the limitations are discussed.

36 MATERIALS SCIENCE↗

A new interatomic potential for mixed Mg-Al-Ga-In spinels

While density functional theory (DFT) has become the de facto approach for accurate simulation of materials at the atomic scale, there are many aspects of materials that are simply out of reach of DFT methods. In particular, finite temperature properties such as diffusivities, the structure and properties of grain boundaries and interfaces, and the study of defect properties in complex alloys are computationally challenging for DFT methods. Recently, a new class of spinels in which three cations order over two sublattices was discovered. In order to predict the properties of these types of structures, classical potentials are a must. Here, in this work, we derive a new classical potential for Mg-bearing spinels in which the B cations are Al, Ga, and/or In. The potential does well in describing the DFT energetics of various spinel structures as a function of chemistry and inversion. In particular, it reproduces the thermodynamically favorable MgAlGaO 4 structure while correctly predicting that neither MgAlInO 4 nor MgGaInO 4 are stable. Further, it reproduces physical trends in elastic properties as compared against experiment.

36 MATERIALS SCIENCE↗

NanoPSD: A software for automatic detection of Nano-Particle Shape Distribution in electron microscopy images

Accurate quantification of the size and morphology of nanoparticles from electron microscopy (EM) images is essential to understand growth mechanisms, surface reactivity, and functional behavior in nanoscale materials. Manual analysis remains slow, subjective, and difficult to reproduce in large datasets. We introduce NanoPSD (Nano-Particle Shape Distribution), an open-source and fully automated framework for quantitative particle detection and morphology analysis from EM images. NanoPSD integrates adaptive contrast enhancement, polarity-agnostic scale-bar detection, Optical Character Recognition (OCR)-based calibration, and classical segmentation via Otsu thresholding with morphological refinement. Particle contours are used to extract geometric descriptors, including equivalent circular diameter, aspect ratio, circularity, and solidity, enabling automated classification into spherical, rod-like, and aggregate morphologies. The framework supports both single-image and batch processing, generating publication-quality visualizations, LaTeX-ready tables, and structured comma-separated values (CSV) datasets. As a demonstration, we applied NanoPSD to plasma-synthesized nanoparticle samples diagnosed via transmission electron microscopy (TEM). The code produced statistically robust size and morphology distributions spanning a few to tens of nanometers with minimal user supervision. The pipeline demonstrates high reproducibility and scalability, processing large image collections with consistent calibration and output formatting. Its modular design enables seamless integration of future deep-learning-based segmentation models, providing a pathway toward intelligent, data-driven electron microscopy analysis.

36 MATERIALS SCIENCE↗

A benchmark of Gutzwiller conjugate gradient minimization method in ground state energy calculations of dimers

Herein we present numerical results of ground-state energies of 9 molecules in the well-established G2 molecule set given by the Gutzwiller conjugate gradient minimization (GCGM) method. The method, beyond the commonly used Gutzwiller approximation, was recently developed based on Gutzwiller variational wave functions. We find that compared to benchmark data given by full configuration interaction, GCGM total energies are reasonably well reproduced with the minimum basis set. To include the dynamical correlation beyond the minimal basis calculations, we adopt the local density approximation for the dynamical correlation energy $E_c$. By comparing the results with benchmark data given by experiments and large-basis configuration interaction, the GCGM total energies with $E_c$ are in general better reproduced, but discrepancies are still observed for some dimers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Assessment of DFT methods for the prediction of detachment energies and electronic structures of complex and multiply charged anions

Here, in this work, we assess the ability of different density functional theory methods to reproduce the vertical/adiabatic detachment energies (VDEs/ADEs) of a series of 40 anions, including monoanion versus multiply charged anions (MCAs) and covalent versus noncovalent interaction. The statistical analysis of errors is firstly performed by comparing the theoretical values with the experimental benchmark data obtained from the negative ion photoelectron spectroscopy (NIPES). The proposed optimally tuned range-separated (OTRS) functionals are proved to not only well reproduce the experimental VDEs/ADEs, but also simulate experimental NIPES. The result implies a more serious issue of delocalization error for MCAs and a balanced description of electron-rich/- deficient region of anions is necessary. The radius of the spherically symmetric average electron localization function (ELF) region is demonstrated as a useful descriptor for the characterization of electronic structure of anionic systems and a quasilinear fitting model is proposed to efficiently obtain their OTRS parameters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Standards, dissemination, and best practices in systems biology

In this study, the reproducibility of scientific research is crucial to the success of the scientific method. Here, we review the current best practices when publishing mechanistic models in systems biology. We recommend, where possible, to use software engineering strategies such as testing, verification, validation, documentation, versioning, iterative development, and continuous integration. In addition, adhering to the Findable, Accessible, Interoperable, and Reusable modeling principles allows other scientists to collaborate and build off of each other’s work. Existing standards such as Systems Biology Markup Language, CellML, or Simulation Experiment Description Markup Language can greatly improve the likelihood that a published model is reproducible, especially if such models are deposited in well-established model repositories. Where models are published in executable programming languages, the source code and their data should be published as open-source in public code repositories together with any documentation and testing code. For complex models, we recommend container-based solutions where any software dependencies and the run-time context can be easily replicated.

59 BASIC BIOLOGICAL SCIENCES↗

A preference for cold dark matter over Superfluid Dark Matter in local Milky Way data

There are many well-known correlations between dark matter and baryons that exist on galactic scales. These correlations can essentially be encompassed by a simple scaling relation between observed and baryonic accelerations, historically known as the Mass Discrepancy Acceleration Relation (MDAR). The existence of such a relation has prompted many theories that attempt to explain the correlations by invoking additional fundamental forces on baryons. The standard lore has been that a theory that reduces to the MDAR on galaxy scales but behaves like cold dark matter (CDM) on larger scales provides an excellent fit to data, since CDM is desirable on scales of clusters and above. However, this statement should be revised in light of recent results showing that a fundamental force that reproduces the MDAR is challenged by local Milky Way dynamics and rotation curve data between 5–18 kpc. In this study, we test this claim on the example of Superfluid Dark Matter. We find that a standard CDM model is preferred over a static superfluid profile assuming a steady-state Galactic disk and discuss the robustness of this conclusion to disequilibrium effects. This preference is due to the fact that the superfluid model over-predicts vertical accelerations, even while reproducing galactic rotation curves. Our results establish an important criterion that any dark matter model must satisfy within the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗

Dataset describing two reference models for full-spectral lighting and daylight simulations together with implementations for two software systems

A dataset of two spectral lighting simulation reference models - one office and one factory hall - is presented. It aims to demonstrate and support full-spectral daylight and electric lighting simulations and facilitate evaluation of non-visual effects of light. The dataset includes Rhino CAD geometry, comprehensive spectral material and light source data and window system BSDF data. Example implementations in the two software tools, Radiance and OWL, enable reproducible workflows and support adoption in other software. The dataset is openly available on Zenodo. The office model reproduces Room 518 at the University of Innsbruck, including a west-facing façade and interior furnishings. The factory hall model follows the proposed geometry in the European standard 15193 for building energy performance. Interior reflectances in the office were measured in-situ using a handheld spectrometer. Exterior spectra and factory hall materials matching specified reflectances were obtained from an online spectral materials database. Glazing transmittance was derived from IGDB data using LBNL Optics/WINDOW. BSDFs for venetian blinds at various tilt angles, and for a diffusing pane adapted from the Complex Glazing Database, were generated in WINDOW. Luminaires in both models are specified with photometric files (Eulumdat/IES) and lamp spectra (Fluorescent 840, 4000 K LED). The provided example implementations (Radiance, OWL) include prepared input data and scripts to run first spectral simulations; example results are also included. The dataset is prepared to support reuse by researchers, designers and software developers for method validation, software engineering and comparison, and development of spectral metrics and controls.

Geisler-Moroder, David↗

A calibration procedure to improve global rice yield simulations with EPIC

Crop models are increasingly used to assess impacts of climate change/variability and management practices on productivity and environmental performance of alternative cropping systems. Calibration is an important procedure to improve reliability of model simulations, especially for large area applications. However, global-scale crop model calibration has rarely been exercised due to limited data availability and expensive computing cost. Here we present a simple approach to calibrate Environmental Policy Integrated Climate (EPIC) model for a global implementation of rice. We identify four parameters (potential heat unit – PHU, planting density – PD, harvest index – HI, and biomass energy ratio – BER) and calibrate them regionally to capture the spatial pattern of reported rice yield in 2000. Model performance is assessed by comparing simulated outputs with independent FAO national data. The comparison demonstrates that the global calibration scheme performs satisfactorily in reproducing the spatial pattern of rice yield, particularly in main rice production areas. Spatial agreement increases substantially when more parameters are selected and calibrated, but with varying efficiencies. Among the parameters, PHU and HI exhibit the highest efficiencies in increasing the spatial agreement. Simulations with different calibration strategies generate a pronounced discrepancy of 5–35% in mean yields across latitude bands, and a small to moderate difference in estimated yield variability and yield changing trend for the period of 1981–2000. Present calibration has little effects in improving simulated yield variability and trends at both regional and global levels, suggesting further works are needed to reproduce temporal variability of reported yields. This study highlights the importance of crop models’ calibration, and presents the possibility of a transparent and consistent up scaling approach for global crop simulations given current availability of global databases of weather, soil, crop calendar, fertilizer and irrigation management information, and reported yield.

Crop model↗

Predicting lake surface water phosphorus dynamics using process-guided machine learning

Phosphorus (P) loading to lakes is degrading the quality and usability of water globally. Accurate predictions of lake P dynamics are needed to understand whole-ecosystem P budgets, as well as the consequences of changing lake P concentrations for water quality. However, complex biophysical processes within lakes, along with limited observational data, challenge our capacity to reproduce short-term lake dynamics needed for water quality predictions, as well as long-term dynamics needed to understand broad scale controls over lake P. Here we use an emerging paradigm in modeling, process-guided machine learning (PGML), to produce a phosphorus budget for Lake Mendota (Wisconsin, USA) and to accurately predict epilimnetic phosphorus over a time range of days to decades. In our implementation of PGML, which we term a Process-Guided Recurrent Neural Network (PGRNN), we combine a process-based model for lake P with a recurrent neural network, and then constrain the predictions with ecological principles. We test independently the process-based model, the recurrent neural network, and the PGRNN to evaluate the overall approach. The process-based model accounted for most of the observed pattern in lake P; however it missed the long-term trend in lake P and had the worst performance in predicting winter and summer P in surface waters. The root mean square error (RMSE) for the process-based model, the recurrent neural network, and the PGRNN was 33.0 μg P L -1 , 22.7 μg P L -1 , and 20.7 μg P L -1 , respectively. All models performed better during summer, with RMSE values for the three models (same order) equal to 14.3 μg P L -1 , 10.9 μg P L -1 , and 10.7 μg P L -1 . Although the PGRNN had only marginally better RMSE during summer, it had lower bias and reproduced long-term decreases in lake P missed by the other two models. For all seasons and all years, the recurrent neural network had better predictions than process alone, with root mean square error (RMSE) of 23.8 μg P L -1 and 28.0 μg P L -1 , respectively. The output of PGRNN indicated that new processes related to water temperature, thermal stratification, and long term changes in external loads are needed to improve the process model. By using ecological knowledge, as well as the information content of complex data, PGML shows promise as a technique for accurate prediction in messy, real-world ecological dynamics, while providing valuable information that can improve our understanding of process.

54 ENVIRONMENTAL SCIENCES↗

Tidally averaged circulation in Puget Sound sub-basins: Comparison of historical data, analytical model, and numerical model

Through extensive field data collection and analysis efforts conducted since the 1950s, researchers have established an understanding of the characteristic features of circulation in Puget Sound. The pattern ranges from the classic fjordal behavior in some basins, with shallow brackish outflow and compensating inflow immediately below, to the typical two-layer flow observed in many partially mixed estuaries with saline inflow at depth. An attempt at reproducing this behavior by fitting an analytical formulation to past data is presented, followed by the application of a three-dimensional circulation and transport numerical model. The analytical treatment helped identify key physical processes and parameters, but quickly reconfirmed that response is complex and would require site-specific parameterization to include effects of sills and interconnected basins. The numerical model of Puget Sound, developed using unstructured-grid finite volume method, allowed resolution of the sub-basin geometric features, including presence of major islands, and site-specific strong advective vertical mixing created by bathymetry and multiple sills. The model was calibrated using available recent short-term oceanographic time series data sets from different parts of the Puget Sound basin. The results are compared against (1) recent velocity and salinity data collected in Puget Sound from 2006 and (2) a composite data set from previously analyzed historical records, mostly from the 1970s. The results highlight the ability of the model to reproduce velocity and salinity profile characteristics, their variations among Puget Sound subbasins, and tidally averaged circulation. Sensitivity of residual circulation to variations in freshwater inflow and resulting salinity gradient in fjordal sub-basins of Puget Sound is examined.

58 GEOSCIENCES↗

Advancing the practice of health impact assessment in Canada: Obstacles and opportunities

Health Impact Assessment (HIA) is recognized as a useful tool that can identify potential health impacts resulting from projects or policy initiatives. Although HIA has become an established practice in some countries, it is not yet an established practice in Canada. In order to enable broader support for HIA, this study provides a comprehensive review and analysis of the peer-reviewed and gray literature on the state of HIA practice. The results of this review revealed that, although there is an abundance of publications relating to HIA, there remains a lack of transparent, consistent and reproducible approaches and methods throughout the process. Findings indicate a need for further research and development on a number of fronts, including: 1) the nature of HIA triggers; 2) consistent scoping and stakeholder engagement approaches; 3) use of evidence and transparency of decision-making; 4) reproducibility of assessment methods; 5) monitoring and evaluation protocols; and, 6) integration within existing regulatory frameworks. Addressing these issues will aid in advancing the more widespread use of HIA in Canada. - Highlights: • Reviewed current state of practice in the field of HIA • Identified key obstacles and opportunities for HIA advancement • Major issues include lack of consistent approach and methodology. • No national regulatory driver hinders opportunity for widespread use of HIA. • Identified research opportunities vital to developing HIA practice in Canada.

54 ENVIRONMENTAL SCIENCES↗

Stochastic generation of electrolyzer anode catalyst layers

Here, we introduce a stochastic methodology to reproduce the complex pore structure observed in commercial iridium catalyst layers. This method preserves the α pore (pores smaller than 250 nm) and β pore (pores greater than or equal to 250 nm) regions of the catalyst layer. The morphology of the generated materials was validated by comparing the pore size distributions of generated materials against those obtained from commercial materials imaged using x-ray nano computed tomography. We further demonstrate that the pore size distributions of the generated materials are statistically indistinguishable from the imaged catalyst layers, indicating that the stochastic methodology is capable of accurately reproducing catalyst layer morphology. Pore network modelling was conducted on the generated catalyst materials to simulate single-phase permeability, electrical conductivity, and ionic conductivity, and these properties were found to be within experimentally measured ranges for electrolyzer catalyst layers. Additionally, simulations were performed on the generated materials with varying ionomer and iridium catalyst loadings. As the ionomer loading is added, proton conductivity increases exponentially, which demonstrates the importance of optimizing ionomer loading, considering that these effects will be exacerbated in the hydration and temperature conditions of operating electrolyzers. The stochastic material generation method presented in this work is a powerful tool for the development of novel low loading catalyst layers, where the effect of various structural parameters on electrolyzer performance characteristics can be explored.

36 MATERIALS SCIENCE↗

Good practices for documenting AI-based studies on energy and buildings

Artificial intelligence has transformed building science research over the past decade, with applications spanning energy modeling, energy prediction, HVAC optimization and controls, fault detection, and occupancy modeling. However, many studies lack adequate documentation of datasets, algorithms, training procedures, and validation methods. Building science research faces additional challenges including inconsistent evaluation metrics, limited generalizability across building types, climates, and significant gaps between experimental studies and deployed systems. This communication provides practical guidance for good practices in documenting and publishing AI-based research following established standards from the computer science and machine learning communities. By adopting frameworks such as Datasheets for Datasets, Model Cards, and standardized reproducibility checklists, researchers can ensure their work meets the rigorous documentation standards necessary for reproducible, comparable, and impactful building science research.

Hong, Tianzhen [Lawrence Berkeley National Laborat↗

Planning, design and logistics of a decision analysis study: The FBI/Ames study involving forensic firearms examiners

This paper describes design and logistical aspects of a decision analysis study to assess the performance of qualified firearms examiners working in accredited laboratories in the United States in terms of accuracy (error rate), repeatability, and reproducibility of decisions involving comparisons of fired bullets and cartridge cases. The purpose of the study was to validate current practice of the forensic discipline of firearms/toolmarks (F/T) examination. It elicited error rate data by counting the number of false positive and false negative conclusions. Preceded by the experimental design, decisions, and logistics described herein, testing was ultimately administered 173 qualified, practicing F/T examiners in public and private crime laboratories. The first round of testing evaluated accuracy, while two subsequent rounds evaluated repeatability and reproducibility of examiner conclusions. This project expands on previous studies by involving many F/T examiners in challenging comparisons and by executing the study in the recommended double-blind format.

99 GENERAL AND MISCELLANEOUS↗

Plasma shape and position control development for NSTX-U using the GSEvolve plasma simulator

NSTX-U discharges have been reproduced using the GSEvolve plasma simulator in order to improve their control and reduce oscillations during the plasma current (Ip) ramp-up phase, and with the ultimate goal of enabling reliable H-mode access with a double-null shape at high elongation, low internal inductance, and high plasma performance. The control objective is to eliminate undesired oscillations in the plasma shape and vertical position that start when the plasma diverts during the Ip ramp-up phase, and that happened recurrently during the first NSTX-U experimental campaign. Model-based control solutions have been developed, including alternative H-mode access recipes and a Multi-Input Multi-Output (MIMO) decoupling controller. These solutions have demonstrated their capability to reduce or eliminate the aforementioned oscillations in GSEvolve simulations, enabling reproducible H-mode access. The results of this work aim to inform NSTX-U experimental operations on potential control developments to maximize its scientific output, and highlight the powerful capabilities of high-fidelity control-simulation frameworks like GSEvolve.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗