Search NASA⌕ Search

SEARCH · Search NASA

Results for “reproducibility of results”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Toward Complete Leading-Order Predictions for Neutrinoless Double β Decay

The amplitude for the neutrinoless double β (0νββ) decay of the two-neutron system nn → ppe – e – constitutes a key building block for nuclear-structure calculations of heavy nuclei employed in large-scale 0νββ searches. Assuming that the 0νββ process is mediated by a light-Majorana-neutrino exchange, a systematic analysis in chiral effective field theory shows that already at leading order a contact operator is required to ensure renormalizability. Here, we develop a method to estimate the numerical value of its coefficient (in analogy to the Cottingham formula for electromagnetic contributions to hadron masses) and validate the result by reproducing the charge-independence-breaking contribution to the nucleon-nucleon scattering lengths. Our central result, while derived in dimensional regularization, is given in terms of the renormalized amplitude Aν(|p|, |p'|) , matching to which will allow one to determine the contact-term contribution in regularization schemes employed in nuclear-structure calculations. Our results thus greatly reduce a crucial uncertainty in the interpretation of searches for 0νββ decay.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR-MS) peak intensity normalization for complex mixture analyses

Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR-MS) is a preferred technique for analyzing complex organic mixtures. Currently, there is no consensus normalization approach, nor an objective method for selecting one, for quantitative analyses of FT-ICR-MS data. We investigate a method to evaluate and score the amount of bias various normalization approaches introduce into the data. We evaluate the ability of the Statistical Procedure for the Analysis of Normalization Strategies (SPANS) to guide selection of appropriate normalization approaches for two different FT-ICR-MS datasets. Further, we test the robustness of SPANS results to changes in SPANS parameter values and assess the impact of using various normalization approaches on downstream statistical analyses. The normalization approach identified by SPANS differed for the two datasets. Normalization methods impacted the statistical significance of peaks differently, underscoring the importance of carefully evaluating potential methods. More consistent SPANS scores resulted when at least 120 significant peaks are used, where larger sets of peaks were obtained by increasing the p-value threshold. Interestingly, we show that Total Sum Scaling and highest peak normalization, used in previous studies, underperformed relative to SPANS-recommended normalization approaches. While there is no single, best normalization method for all datasets, SPANS provides a mechanism to identify an appropriate normalization method for analyzing FT-ICR-MS data quantitatively. As a result, the number of peaks used in the background distributions of SPANS contributes more significantly to the reproducibility of results than the p-value thresholds used to obtain those peaks.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Mott vs Kondo: Influence of various density functional based methods on the Ce isostructural phase transition mechanism

The cerium iso-structural phase transition (γ–α) is dominated by f-electron localization changes that results in a magnetic ordering change and a volume collapse. Generally, these physics are difficult to capture with ab initio and first principles methods. However, previous works have shown various methods to be successful in predicting at least some of the physics of the γ to α phase transition. Therefore, here, we perform a broad survey of density functional based methods across three levels of theory and types of functions [GGA (generalized gradient approximation), MetaGGA, and hybrid functionals] and compare the results, focusing on hydrostatic compression across the phase boundary at zero kelvin. For the methods that best reproduce experimental results, we directly probe the predicted mechanisms and frame the results in the Mott/Kondo debate, assessing how the underlying methods and assumptions of different functionals can assess the physical drivers in the phase transition, providing insight into the governing processes of this unique phase transition.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Generation of meter-scale hydrogen plasmas and efficient, pump-depletion-limited wakefield excitation using 10 GeV electron bunches

High repetition rates and efficient energy transfer to the accelerating beam are important for a future linear collider based on the beam-driven plasma wakefield acceleration scheme (PWFA-LC). This paper reports the first results from the Plasma Wakefield Acceleration Collaboration (E300) that are beginning to address both of these issues using the recently commissioned FACET-II facility at SLAC national accelerator laboratory. Here we have generated meter-scale hydrogen plasmas using time-structured 10 GeV electron bunches from FACET-II, which hold the promise of dramatically increasing the repetition rate of PWFA by rapidly replenishing the gas between each shot compared to the hitherto used lithium plasmas that operate at 1–10 Hz. Furthermore, we have excited wakes in such plasmas that are suitable for high gradient particle acceleration with high drive-bunch to wake energy transfer efficiency- a first step in achieving a high overall energy transfer efficiency. We have done this by using time-structured electron drive bunches that typically have one or more ultra-high current (> 30 kA) femtosecond spike(s) superimposed on a longer (~0.4 ps) lower current (< 10 kA) bunch structure. The first spike effectively field-ionizes the gas and produces a meter-scale (30–160 cm) plasma, whereas the subsequent beam charge creates a wake. The length and amplitude of the wake depends on the longitudinal current profile of the bunch and plasma density. We find that the onset of pump depletion, when some of the drive beam electrons are nearly fully depleted of their energy, occurs for hydrogen pressure ≥ 1.5Torr. We also show that some electrons in the rear of the bunch can gain several GeV energies from the wake. These results are reproduced by particle-in-cell simulations using the QPAD code. At a pressure of ~2Torr, simulation results and experimental data show that the beam transfers about 60% of its energy to the wake.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Intrinsic Anomalous Hall Conductivity in a Nonuniform Electric Field

We study how the intrinsic anomalous Hall conductivity is modified in two-dimensional crystals with broken time-reversal symmetry due to weak inhomogeneity of the applied electric field. Focusing on a clean noninteracting two-band system without band crossings, we derive the general expression for the Hall conductivity at small finite wave vector q to order q 2 , which governs the Hall response to the second gradient of the electric field. Using the Kubo formula, we show that the answer can be expressed through the Berry curvature, Fubini-Study quantum metric, and the rank-3 symmetric tensor which is related to the quantum geometric connection and physically corresponds to the gauge-invariant part of the third cumulant of the position operator. We further compare our results with the predictions made within the semiclassical approach. By deriving the semiclassical equations of motion, we reproduce the result obtained from the Kubo formula in some limits. We also find, however, that the conventional semiclassical description in terms of the definite position and momentum of the electron is not fully consistent because of singular terms originating from the Heisenberg uncertainty principle. We thus present a clear example of a case when the semiclassical approach inherently suffers from the uncertainty principle, implying that it should be applied to systems in nonuniform fields with extra care.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

Pulsed-Neutron Experiments at the Inherently Safe Subcritical Assembly

The pulsed neutron technique is a powerful, dynamic method to assay the reactivity of a multiplying system. This work presents the novel application of the pulsed neutron technique to the Inherently Safe Subcritical Assembly, an experimental configuration accepted by the International Criticality Safety Benchmark Evaluation Project Handbook. The experiments were replicated with COG11.3, a continuous-energy Monte Carlo code. The pulsed neutron data were analyzed using the Sjöstrand and Gozani area-ratio methods and by extracting the prompt neutron decay constant. Subsequent static k-eigenvalue and 𝛼-eigenvalue simulations were also performed for the same configurations. Neutron detector dead-time effects from the experiments were corrected using the Backwards Extrapolation Method and shown to have a negligible impact on the estimated reactivities. The results highlight that capturing time-dependent effects like delayed neutron precursor buildup are essential to accurately reproduce experimental results. They also highlight the importance of shielding the detectors from generator source neutrons in deeply subcritical configurations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Differential two-particle number and momentum correlations with the AMPT, UrQMD, and EPOS models in Pb-Pb collisions at s N N = 2.76 TeV

We report studies of charge-independent and charge-dependent two-particle differential number correlation functions, R 2 (Δη,Δφ), and transverse momentum correlation functions, P 2 (Δη,Δφ), of charged particles produced in Pb–Pb collisions at the LHC center-of-mass energy √sNN= 2.76 TeV with the UrQMD, AMPT, and EPOS models. Model calculations for R2 and P2 correlation functions are presented for inclusive charged hadrons (h ± ) in selected transverse momentum ranges and with full azimuthal coverage in the pseudorapidity range |η|<1.0. We compare these calculations for the strength, shape, and particularly the width of the correlation functions with recent measurements of these observables by the ALICE collaboration. Our analysis indicates that comparative studies of R 2 and P 2 correlation functions provide valuable insight towards the understanding of particle production in Pb–Pb collisions. We find, in particular, that these models produce quantitatively different magnitudes and shapes for these correlation functions and none reproduce the results reported by the ALICE collaboration. Accounting for quantum number conservation in models, particularly charge conservation, is mandatory to reproduce the detailed measurements of number and transverse momentum correlation functions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

How Reproducible are Surface Areas Calculated from the BET Equation?

Abstract Porosity and surface area analysis play a prominent role in modern materials science. At the heart of this sits the Brunauer–Emmett–Teller (BET) theory, which has been a remarkably successful contribution to the field of materials science. The BET method was developed in the 1930s for open surfaces but is now the most widely used metric for the estimation of surface areas of micro‐ and mesoporous materials. Despite its widespread use, the calculation of BET surface areas causes a spread in reported areas, resulting in reproducibility problems in both academia and industry. To prove this, for this analysis, 18 already‐measured raw adsorption isotherms were provided to sixty‐one labs, who were asked to calculate the corresponding BET areas. This round‐robin exercise resulted in a wide range of values. Here, the reproducibility of BET area determination from identical isotherms is demonstrated to be a largely ignored issue, raising critical concerns over the reliability of reported BET areas. To solve this major issue, a new computational approach to accurately and systematically determine the BET area of nanoporous materials is developed. The software, called “BET surface identification” (BETSI), expands on the well‐known Rouquerol criteria and makes an unambiguous BET area assignment possible.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Calculation of Dynamical Response Functions Using a Bound-State Method

Abstract We investigate a method to extract response functions (dynamical polarisabilities) directly from a bound-state approach applied to calculations of perturbation-induced reactions. The use of a square-integrable basis leads to a response in the form of a sum of $$\delta $$ δ functions. We integrate this over energy and fit a smooth function to the resulting stepwise-continuous one. Its derivative gives the final approximation to the physical response function. We show that the method reproduces analytical results where known, and analyse the details for a variety of models. We apply it to some simple models, using the stochastic variational method as the numerical method. Albeit we find that this approach, and other numerical techniques, have some difficulties with the threshold behavior in coupled-channel problems with multiple thresholds, its stochastic nature allows us to extract robust results even for such cases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2019

Particle Size Analysis and Distribution

Scanning Electron Microscope (SEM) is a instrument used for examining samples at magnifications from 32 X to 500,000 X (for our instrument). The SEM is attached with an electron gun and is directed onto the sample. The sample then produces an image where it is read on the monitor. The electron gun is positioned at the top because it needs to shoot at the sample that is being tested. The electrons are then shot in a downward motion traveling through several lenses, such as the condenser lens for a more precise reading. Once the samples have been read by the instrument, it will show a picture that has a certain number of particles. Particle size distribution have many uses that are essential to life habits (health) or even conventional use for example construction. Here are just a few examples of how particle size analysis and distribution are being used even today. This Standard Reference Material (SRM) is primarily intended for use in the calibration of equipment used to measure particle size distributions (PSD) in the 9 μm to 30 μm range. A unit of SRM 1984 consists of a single bottle containing approximately 14 g of tungsten carbide/cobalt powder. Certified values: The PSD values at five mass percentiles were measured by scanning electron microscopy (SEM) and laser light scattering (LLS). The NIST certified PSD values by SEM are listed. These certified values were determined by the measurement of over 10 000 individual particles from three bottles. Comparing the certified NIST SRM 1984 tungsten carbide/cobalt powder with our results are almost identical. This is great because more accurate work can be done and proves that our laboratory is able to reproduce NIST results. In conclusion, the scanning electron microscope is used to capture the sampled element and display it to be counted. Without the use of particle distribution, it would be a difficult time to get necessities such as medicine, asthma pumps, constructing materials, or as simple as ink. Overall, our study is an experimental comparison of the techniques we have in house, which are LLS and SEM (combined with the NIH ImageJ software) using the NIST SRM-1984 as a common, well characterized sample so that we have an idea of how the results from the techniques compare.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Optimization of the generator coordinate method with machine-learning techniques for nuclear spectra and neutrinoless double- β decay: Ridge regression for nuclei with axial deformation

The generator coordinate method (GCM) is an important tool of choice for modeling large-amplitude collective motion in atomic nuclei. The computational complexity of the GCM increases rapidly with the number of collective coordinates. It imposes a strong restriction on the applicability of the method. In this work, we propose a subspace-reduction algorithm that employs optimal statistical ML models as surrogates for exact quantum-number projection calculations for norm and Hamiltonian kernels. The model space of the original GCM is reduced to a subspace relevant for nuclear low energy spectra and the NME of ground state to ground state 0νββ decay based on the orthogonality condition (OC) and the energy-transition-orthogonality procedure (ENTROP), respectively. For simplicity, the polynomial ridge regression (RR) algorithm is used to learn the norm and Hamiltonian kernels of axially deformed configurations. The efficiency and accuracy of this algorithm are illustrated for 76 Ge and 76 Se by comparing results obtained using the optimal RR models to direct GCM calculations. The low-lying energy spectra of 76 Ge and 76 Se, as well as the 0νββ-decay NME between their ground states, are computed. Furthermore, the results show that the performance of the GCM+OC/ENTROP+RR is more robust than that of the GCM+RR alone, and the former can reproduce the results of the original GCM calculation accurately with a significantly reduced computational cost.

59 ≤ A ≤ 89↗
DOE OSTI2023

Incorporating Full Elastodynamic Effects and Dipping Fault Geometries in Community Code Verification Exercises for Simulations of Earthquake Sequences and Aseismic Slip (SEAS)

ABSTRACT Numerical modeling of earthquake dynamics and derived insight for seismic hazard relies on credible, reproducible model results. The sequences of earthquakes and aseismic slip (SEAS) initiative has set out to facilitate community code comparisons, and verify and advance the next generation of physics-based earthquake models that reproduce all phases of the seismic cycle. With the goal of advancing SEAS models to robustly incorporate physical and geometrical complexities, here we present code comparison results from two new benchmark problems: BP1-FD considers full elastodynamic effects, and BP3-QD considers dipping fault geometries. Seven and eight modeling groups participated in BP1-FD and BP3-QD, respectively, allowing us to explore these physical ingredients across multiple codes and better understand associated numerical considerations. With new comparison metrics, we find that numerical resolution and computational domain size are critical parameters to obtain matching results. Codes for BP1-FD implement different criteria for switching between quasi-static and dynamic solvers, which require tuning to obtain matching results. In BP3-QD, proper remote boundary conditions consistent with specified rigid body translation are required to obtain matching surface displacements. With these numerical and mathematical issues resolved, we obtain excellent quantitative agreements among codes in earthquake interevent times, event moments, and coseismic slip, with reasonable agreements made in peak slip rates and rupture arrival time. We find that including full inertial effects generates events with larger slip rates and rupture speeds compared to the quasi-dynamic counterpart. For BP3-QD, both dip angle and sense of motion (thrust versus normal faulting) alter ground motion on the hanging and foot walls, and influence event patterns, with some sequences exhibiting similar-size characteristic earthquakes, and others exhibiting different-size events. These findings underscore the importance of considering full elastodynamics and nonvertical dip angles in SEAS models, as both influence short- and long-term earthquake behavior and are relevant to seismic hazard.

Geochemistry & Geophysics↗
DOE OSTI2023

Effects of ionising radiation exposure in offspring and next generations: dosimetric aspects and uncertainties

The impact of the exposure to ionizing radiation in the offspring and next generation has been investigated in the last decades and currently is the subject of study of the ICRP Task Group 121. Studying the effects of radiation exposure in pre-conceptional and post-conceptional phases can be a challenge since potential effects to the fetus vary depending on the stage of fetal development. Epidemiology and radiobiology studies are the two sources of information one can use to correlate the radiation dose to the human body and tissues and the resulting effects. For a proper evaluation of the outcomes of such studies, and a correct appraisal of the exposure/dose-effect relationship, (i) reliable dosimetry, (ii) accurate reporting, and (iii) reproducibility of results are required. Although variables related to dose, including for instance source of radiation, geometry of irradiation, dose rate etc., are usually known, especially in radiobiology studies, often important details of the irradiation are not reported. In conclusion, based on standards developed by the National Cancer Institute (NCI), the National Institute of Allergy and Infectious Disease (NIAID) and the National Institute of Standards and Technology (NIST), a review of the scientific studies used by the UNSCEAR to estimate the risk of hereditary effects, and by the ICRP in its current recommendations, was conducted to evaluate the way dosimetry was reported. Dosimetry and the related uncertainties were not adequately described in the vast majority of those studies. This does not necessarily mean that they do not provide relevant information, however it prevents from a thorough verification and reproduction of their findings. In order to guarantee the reliability and robustness of the process of revision of the estimates of risk and detriment it is therefore considered mandatory to include a careful check of the new relevant literature with regard to the criteria on the completeness and reproducibility of the dosimetric information.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2025

Reproductive and leaf litterfall fluxes in forest ecosystem sites globally (1950-2022)

Forest allocation of net primary productivity (NPP) to reproduction is poorly quantified globally, despite its critical role in forest regeneration and a well-supported trade-off with allocation to growth. Although field measurements of total NPP are rare, our work finds that a proxy for reproductive carbon allocation constructed from leaf (L) and reproductive (R) litterfall fluxes, R/(R+L), is strongly correlated with R/NPP, facilitating analysis across a wide range of sites where biometric estimates of NPP are not available (R² = 0.85; Hanbury-Brown et al., 2022, Ward et al., in prep). To investigate relationships between ecosystem-scale reproductive allocation (RA) and climate, soil fertility, and stand age gradients, we conducted a literature search and synthesized 824 observations of annual average leaf and reproductive litterfall fluxes across forest sites globally. The zip file includes 1) a folder Data/ containing the litterfall data ("GlobalForestRA_data.csv") and metadata ("GlobalForestRA_metadata.doc") files. The data file includes geographic coordinates, long-term mean annual temperature and precipitation (1970-2000, extracted from WorldClim2.1), leaf and reproductive litterfall fluxes, sampling interval and protocols, forest characteristics (dominant leaf morphology, information pertaining to forest age and successional stage, and disturbance history) and soil properties (% sand, %silt, %clay, total phosphorus (P), nitrogen (N), cation exchange capacity (CEC) and pH) extracted from SoilGrids250 and from on-site measurements, where available. The metadata file contains information about each variable reported in the data file, including data sources, processing methods, and all references. The Data folder contains two additional files used to create Figure 1; these are described in greater detail in the README.2) R scripts GloalForestRA_analysis.r and GlobalForestRA_SI.r and a folder /Functions used to produce results, figures, and tables in the manuscript Ward et al. (in press)3) a README file describing how the data and R scripts can be used to reproduce statistical results, figures, and tables found in the manuscript. Ward et al. (in press)This repository can also be found at: https://github.com/r-ward/Global_Analysis_ForestRA.Ward, R.E., Zhang-Zheng, H. Aernethy, K., Adu-Bredu, S., Arroyo, L., Bailey, A. et al. (in press). Forest age rivals climate to explain reproductive allocation patterns in forest ecosystems globally. Ecology Letters. Hanbury-Brown, A.R., Ward, R.E. & Kueppers, L.M. (2022). Forest regeneration within Earth system models: current process representations and ways forward. New Phytol., 235, 20–40.Ward et al. (2025), Forest age rivals climate to explain reproductive allocation patterns in forest ecosystems globally, in prep.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A mixed, unified forward/inverse framework for earthquake problems: fault implementation and coseismic slip estimate

SUMMARY We introduce a new finite-element (FE) based computational framework to solve forward and inverse elastic deformation problems for earthquake faulting via the adjoint method. Based on two advanced computational libraries, FEniCS and hIPPYlib for the forward and inverse problems, respectively, this framework is flexible, transparent and easily extensible. We represent a fault discontinuity through a mixed FE elasticity formulation, which approximates the stress with higher order accuracy and exposes the prescribed slip explicitly in the variational form without using conventional split node and decomposition discrete approaches. This also allows the first order optimality condition, that is the vanishing of the gradient, to be expressed in continuous form, which leads to consistent discretizations of all field variables, including the slip. We show comparisons with the standard, pure displacement formulation and a model containing an in-plane mode II crack, whose slip is prescribed via the split node technique. We demonstrate the potential of this new computational framework by performing a linear coseismic slip inversion through adjoint-based optimization methods, without requiring computation of elastic Green’s functions. Specifically, we consider a penalized least squares formulation, which in a Bayesian setting—under the assumption of Gaussian noise and prior—reflects the negative log of the posterior distribution. The comparison of the inversion results with a standard, linear inverse theory approach based on Okada’s solutions shows analogous results. Preliminary uncertainties are estimated via eigenvalue analysis of the Hessian of the penalized least squares objective function. Our implementation is fully open-source and Jupyter notebooks to reproduce our results are provided. The extension to a fully Bayesian framework for detailed uncertainty quantification and non-linear inversions, including for heterogeneous media earthquake problems, will be analysed in a forthcoming paper.

58 GEOSCIENCES↗
DOE OSTI2026

Neutrino flavor instabilities in neutron star mergers with moment transport: Slow, fast, and collisional modes

Determining where, when, and how neutrino flavor oscillations must be included in large-scale simulations of hot and dense astrophysical environments is an enduring challenge that must be tackled to obtain accurate predictions. Here, using an angular moment-based linear stability analysis framework, we examine the different kinds of flavor instabilities that can take place in the context of the postprocessing of a neutron star merger simulation, with a particular focus on the collisional flavor instability and a careful assessment of several commonly used approximations. First, neglecting anisotropies of the neutrino field, we investigate the extent to which commonly used monoenergetic growth rates reproduce the results obtained from a full multienergy treatment. Contrary to the large discrepancies found in core-collapse supernova environments, we propose a simple combination of energy-averaged estimates that reproduces the multienergy growth rates in our representative simulation snapshot. We then quantify the impact of additional physical effects, including nuclear many-body corrections, scattering opacities, and the inclusion of the vacuum term in the neutrino Hamiltonian. Finally, we include the neutrino distribution anisotropies, which allows us to explore, for the first time in a multienergy setting, the interplay between collisional, fast, and slow modes in a moment-based neutron star merger simulation. We find that, despite a dominance of the fast instability in most of the simulation volume, certain regions exhibit only a collisional instability, while others, especially at large distances, exhibit a slow instability that is largely underestimated if anisotropic effects are neglected.

neutrino oscillations↗
DOE OSTI2024

Models, data, and scripts associated with “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning”

This data package is associated with the publication “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning’’ submitted to the Journal of Geophysical Research: Machine Learning and Computation (Scheibe et al. 2024). River sediment respiration observations are expensive and labor intensive to obtain and there is no physical model for predicting this quantity. The Worldwide Hydrobiogeochemisty Observation Network for Dynamic River Systems (WHONDRS) observational data set (Goldman et al.; 2020) is used to train machine learning (ML) models to predict respiration rates at unsampled sites. This repository archives training data, ML models, predictions, and model evaluation results for the purposes of reproducibility of the results in the associated manuscript and community reuse of the ML models trained in this project. One of the key challenges in this work was to find an optimum configuration for machine learning models to work with this feature-rich (i.e. 100+ possible input variables) data set. Here, we used a two-tiered approach to managing the analysis of this complex data set: 1) a stacked ensemble of ML models that can automatically optimize hyperparameters to accelerate the process of model selection and tuning and 2) feature permutation importance to iteratively select the most important features (i.e. inputs) to the ML models. The major elements of this ML workflow are modular, portable, open, and cloud-based, thus making this implementation a potential template for other applications. This data package is associated with the GitHub repository found at Please see the file level metadata (flmd; “sl-archive-whondrs_flmd.csv”) for a list of all files contained in this data package and descriptions for each. Please see the data dictionary (dd; “sl-archive-whondrs_dd.csv”) for a list of all column headers contained within comma separated value (csv) files in this data package and descriptions for each. The GitHub repository is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning models trained on the data in “input_data”; (3) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; (4) “examples” contains the visualization of the results in this repository including plotting scripts for the manuscript (e.g., model evaluation, FPI results) and scripts for running predictions with the ML models (i.e., reusing the trained ML models); (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. Furthermore, depending on the number of features used to train the ML models, the preprocessing and postprocessing scripts, and their intermediate results, can also be different branch-to-branch. The “main-*” branches are meant to be starting points (i.e. trunks) for each model branch (i.e. sprouts). Please see the Branch Navigation section in the top-level README.md in the GitHub repository for more details. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please the top-level README.md in the GitHub repository for more details on the automation.

13C↗
DOE OSTI2023

Curifactory: A research experiment manager

Curifactory is a command line tool and framework for organizing Python experiment code, configuration parameters, and results. It is an opinionated and lightweight approach to workflow management infrastructure and is primarily intended to support researchers conducting experiments on one machine. This software was developed to support the reproducibility of results for several data science projects in the Nuclear Nonproliferation Division at Oak Ridge National Laboratory. Curifactory is intended to be a general framework and is not specific to machine learning or data science. It can aid in any field in which experiments are primarily computation-based studies and can be implemented in Python (e.g., high-energy physics, astronomy, computational chemistry). Here, the design emphasizes the automated caching of intermediate data analysis artifacts to speed up development involving computationally intensive tasks. It also allows for data provenance and experiment reproduction. Individual experiment runs are tracked through logs and their output reports, and entire copies of a run with all cached data and metadata can be exported for others to run using Curifactory on another machine. Curifactory experiments can either be integrated into a project from the beginning or can be written on top of an existing codebase without needing significant modification. A few important views of the Curifactory library can be seen in Figure 1.

97 MATHEMATICS AND COMPUTING↗