Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistically designed experiments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

AI ATAC 1: An Evaluation of Prominent Commercial Malware Detectors

This work presents an evaluation of six prominent commercial endpoint malware detectors, a network malware detector, and a file-conviction algorithm from a cyber technology vendor. The evaluation was administered as the first of the Artificial I ntelligence Applications t o Autonomous Cybersecurity (AI ATAC) prize challenges, funded by / completed in service of the US Navy. The experiment employed 100K files (50/50% benign/malicious) with a stratified distribution of file types, including ~1K zero-day program executables (increasing experiment size two orders of magnitude over previous work). We present an evaluation process of delivering a file to a fresh virtual machine donning the detection technology, waiting 90s to allow static detection, then executing the file and waiting another period for dynamic detection; this allows greater fidelity in the observational data than previous experiments, in particular, resource and time-to-detection statistics. To execute all 800K trials (100K files × 8 tools), a software framework is designed to choreograph the experiment into an automated, time-synced, and reproducible workflow with substantial parallelization. Software with base classes for this framework are provided. A cost-benefit model was configured to integrate the tools’ detection statistics into a comparable quantity by simulating costs of use. This provides a ranking methodology for cyber competitions and a lens for reasoning about the varied statistical results. The results provide insights on state of commercial malware detection.

Bridges, Robert↗
DOE OSTI2024

Expert‐in‐the‐loop design of integral nuclear data experiments

Abstract Nuclear data are fundamental inputs to radiation transport codes used for reactor design and criticality safety. The design of experiments to reduce nuclear data uncertainty has been a challenge for many years, but advances in the sensitivity calculations of radiation transport codes within the last two decades have made optimal experimental design possible. The design of integral nuclear experiments poses numerous challenges not emphasized in classical optimal design, in particular, constrained design spaces (in both a statistical and engineering sense), severely under‐determined systems, and optimality uncertainty. We present a design pipeline to optimize critical experiments that uses constrained Bayesian optimization within an iterative expert‐in‐the‐loop framework. We show a successfully completed experiment campaign designed with this framework that involved two critical configurations and multiple measurements that targeted compensating errors in 239 Pu nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Learning plasma dynamics and robust rampdown trajectories with predict-first experiments at TCV

The rampdown phase of a tokamak pulse is difficult to simulate and often exacerbates multiple plasma instabilities. To reduce the risk of disrupting operations, we leverage advances in Scientific Machine Learning (SciML) to combine physics with data-driven models, developing a neural state-space model (NSSM) that predicts plasma dynamics during Tokamak à Configuration Variable (TCV) rampdowns. The NSSM efficiently learns dynamics from a modest dataset of 311 pulses with only five pulses in a reactor-relevant high-performance regime. The NSSM is parallelized across uncertainties, and reinforcement learning (RL) is applied to design trajectories that avoid instability limits. High-performance experiments at TCV show statistically significant improvements in relevant metrics. A predict-first experiment, increasing plasma current by 20% from baseline, demonstrates the NSSM’s ability to make small extrapolations. The developed approach paves the way for designing tokamak controls with robustness to considerable uncertainty and demonstrates the relevance of SciML for fusion experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Data-driven design of molecular nanomagnets

Three decades of research in molecular nanomagnets have raised their magnetic memories from liquid helium to liquid nitrogen temperature thanks to a wise choice of the magnetic ion and coordination environment. Still, serendipity and chemical intuition played a main role. In order to establish a powerful framework for statistically driven chemical design, here we collected chemical and physical data for lanthanide-based nanomagnets, catalogued over 1400 published experiments, developed an interactive dashboard (SIMDAVIS) to visualise the dataset, and applied inferential statistical analysis. Our analysis shows that the Arrhenius energy barrier correlates unexpectedly well with the magnetic memory. Furthermore, as both Orbach and Raman processes can be affected by vibronic coupling, chemical design of the coordination scheme may be used to reduce the relaxation rates. Indeed, only bis-phthalocyaninato sandwiches and metallocenes, with rigid ligands, consistently present magnetic memory up to high temperature. Analysing magnetostructural correlations, we offer promising strategies for improvement, in particular for the preparation of pentagonal bipyramids, where even softer complexes are protected against molecular vibrations.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2020

Rayleigh-Taylor Instability: A Status Review of Experimental Designs and Measurement Diagnostics

The focus of experiments and the sophistication of diagnostics employed in Rayleigh-Taylor instability (RTI) induced mixing studies have evolved considerably over the past seven decades. The first theoretical analysis by Taylor and the two-dimensional experimental results by Lewis on RTI in 1950 examined single-mode RTI using conventional imaging techniques. Over the next 70 years, several experimental designs have been used to creating an RTI unstable interface between two materials of different densities. These early experiments though innovative, were arduous to diagnose and provided little information on the internal, turbulent structure and initial conditions of the RT mixing layer. Coupled with the availability of high-fidelity diagnostics, the experiments designed and developed in the last three decades allow detailed measurements of various turbulence statistics that have allowed broadly to validate and verify late-time nonlinear models and mix-models for buoyancy-driven flows. Besides, they have provided valuable insights to solve several long-standing disagreements in the field. Herein, this review serves as an opportunity to discuss the understanding of the RTI problem and highlight valuable insights gained into the RTI driven mixing process with a focus on low to high Atwood number (> 0.1) experiments.

42 ENGINEERING↗
DOE OSTI2023

Advanced data analysis in inertial confinement fusion and high energy density physics

Bayesian analysis enables flexible and rigorous definition of statistical model assumptions with well-characterized propagation of uncertainties and resulting inferences for single-shot, repeated, or even cross-platform data. This approach has a strong history of application to a variety of problems in physical sciences ranging from inference of particle mass from multi-source high-energy particle data to analysis of black-hole characteristics from gravitational wave observations. The recent adoption of Bayesian statistics for analysis and design of high-energy density physics (HEDP) and inertial confinement fusion (ICF) experiments has provided invaluable gains in expert understanding and experiment performance. In this Review, we discuss the basic theory and practical application of the Bayesian statistics framework. We highlight a variety of studies from the HEDP and ICF literature, demonstrating the power of this technique. Due to the computational complexity of multi-physics models needed to analyze HEDP and ICF experiments, Bayesian inference is often not computationally tractable. Two sections are devoted to a review of statistical approximations, efficient inference algorithms, and data-driven methods, such as deep-learning and dimensionality reduction, which play a significant role in enabling use of the Bayesian framework. We provide additional discussion of various applications of Bayesian and machine learning methods that appear to be sparse in the HEDP and ICF literature constituting possible next steps for the community. We conclude by highlighting community needs, the resolution of which will improve trust in data-driven methods that have proven critical for accelerating the design and discovery cycle in many application areas.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

On reading Youden: Learning about the practice of statistics and applied statistical research from a master applied statistician

From reading William John “Jack” Youden’s books and articles, Youden (1900-1971), an analytical chemist, becomes an applied statistician by the time he joins the National Bureau of Standards (NBS) in 1948. Here, this article traces his transition from chemist to applied statistician and what his body of work mostly at NBS (1948-1965) demonstrates about his practice of statistics and the role that applied statistical research plays in it. There is much we can learn from a master applied statistician.

42 ENGINEERING↗
DOE OSTI2018

Muon $g-2$, Current Experimental Status and Future Prospects

Here, the muon gyromagnetic anomaly aμ has been measured with a precision δa μ /a μ = 540 ppb using magic-momentum muon decays recorded up to 2001 by the E821 BNL experiment. Two projects aim at significantly improving that experimental precision: the E989 Collaboration at Fermilab plans to collect 21 times the BNL statistics and to improve by a factor four the uncertainty, the E34 Collaboration is designing a new experiment at J-PARC with a novel approach based on the production, injection and storage of ultra-cold low-energy muons. E34 aims at matching the BNL precision in a first phase, and to provide a significantly higher precision measurement in a second phase.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Overview of Algorithms for Using Particle Morphology in Pre-Detonation Nuclear Forensics

A major goal in pre-detonation nuclear forensics is to infer the processing conditions and/or facility type that produced radiological material. This review paper focuses on analyses of particle size, shape, texture (“morphology”) signatures that could provide information on the provenance of interdicted materials. For example, uranium ore concentrates (UOC or yellowcake) include ammonium diuranate (ADU), ammonium uranyl carbonate (AUC), sodium diuranate (SDU), magnesium diuranate (MDU), and others, each prepared using different salts to precipitate U from solution. Once precipitated, UOCs are often dried and calcined to remove adsorbed water. The products can be allowed to react further, forming uranium oxides UO3, U3O8, or UO2 powders, whose surface morphology can be indicative of precipitation and/or calcination conditions used in their production. This review paper describes statistical issues and approaches in using quantitative analyses of measurements such as particle size and shape to infer production conditions. Statistical topics include multivariate t tests (Hotelling’s T 2 ), design of experiments, and several machine learning (ML) options including decision trees, learning vector quantization neural networks, mixture discriminant analysis, and approximate Bayesian computation (ABC). ABC is emphasized as an attractive option to include the effects of model uncertainty in the selected and fitted forward model used for inferring processing conditions.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2021

The importance of independent replication of treatments in plant science

Among other foci, the Journal of Experimental Botany aims to advance understanding of plant environment interactions, including abiotic stress, mineral nutrition, and the response of plants to global change. Advancing understanding in these areas often requires manipulation of the growth environment. Experiments range in scale and include: growth chambers (Yiotis et al., 2020), glasshouses (Rho et al., 2019), whole plant chambers (Sharwood et al., 2017), and open-air field experiments (Ruiz-Vera et al., 2020). The application of environmental manipulations can be constrained by available resources, operational costs, and time. In designing experiments, researchers attempt to balance logistical challenges with the desire to address scientific questions and maximize statistical power.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Effects of Platform Design on the Customer Experience in an Online Solar PV Marketplace

Residential solar photovoltaic (PV) customers are increasingly buying PV systems in online marketplaces, where customers can compare multiple quotes from several installers on quote platforms. In this study, we use data from an online marketplace to explore how quote platform design affects customer experiences. We analyze how four design changes affected customer experiences in terms of factors such as prices. We find that three of the four design changes are associated with statistically significant and robust price reductions, even though none of the changes were implemented specifically to reduce prices. The results suggest that even seemingly small platform design changes can affect PV customer experiences in online marketplaces.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Melt Pool and Heat Treatment Optimization for the Fabrication of High-Strength and High-Toughness Additively Manufactured 4340 Steel

Additively manufactured (AM) components offer superior design flexibility compared to their conventionally manufactured counterparts, and optimizing processing parameters is key to achieving high-quality depositions with desirable and predictable mechanical properties. This study was focused on 4340 steel fabricated using laser powder bed fusion (LPBF), and 42 laser power and scan speed combinations have been systematically investigated to determine an optimized melt pool geometry that would ensure fully-dense parts. The AM material was compared with a wrought 4340 equivalent and studied in two customized heat treated conditions, optimized for strength and toughness, respectively. The microstructures of the as-fabricated and heat treated AM and wrought materials were characterized to assess differences introduced by the layer-by-layer fabrication process and subsequent heat treatment. Tensile properties of both materials were also evaluated and demonstrate that the AM materials offer equal or superior properties compared to the wrought equivalents. Differences in fracture surface morphologies indicate the distinct failure mechanisms associated with the materials’ characteristic microstructures, and the role of inclusions in the failures was studied to elucidate these differences. Complementary to the experimental investigations, the dataset was leveraged to make recommendations for future design of experiments to optimize AM build parameters in other material systems. A statistical Monte Carlo analysis was used to predict the interpolation error produced using reduced datasets and to enable informed processing parameters selection. These findings are discussed to make recommendations for the use of AM materials for high-integrity structural applications.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Assessment of model parameters in MFiX particle-in-cell approach

The limitations in numerical treatment of solids-phase in conventional methods like Discrete Element Model and Two-Fluid Model have facilitated the development of alternative techniques such as Particle-In-Cell (PIC). However, a number of parameters are involved in PIC due to its empiricism. In this work, global sensitivity analysis of PIC model parameters is performed under three distinct operating regimes common in chemical engineering applications, viz. settling bed, bubbling fluidized bed and circulating fluidized bed. Simulations were performed using the PIC method in Multiphase Flow with Interphase eXchanges (MFiX) developed by National Energy Technology Laboratory (NETL). A non-intrusive uncertainty quantification (UQ) based approach is applied using Nodeworks to first construct an adequate surrogate model and then identify the most influential parameters in each case. This knowledge will aid in developing an effective design of experiments and determine optimal parameters through techniques such as deterministic or statistical calibration.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2018

Implementation of cross correlation for energy discrimination on the time-of-flight spectrometer CORELLI

The CORELLI instrument at Oak Ridge National Laboratory is a statistical chopper spectrometer designed and optimized to probe complex disorder in crystalline materials through diffuse scattering experiments. On CORELLI, the high efficiency of white-beam Laue diffraction combined with elastic discrimination have enabled an unprecedented data collection rate to obtain both the total and the elastic-only scattering over a large volume of reciprocal space from a single measurement. To achieve this, CORELLI is equipped with a statistical chopper to modulate the incoming neutron beam quasi-randomly, and then the cross-correlation method is applied to reconstruct the elastic component from the scattering data. Details of the implementation of the cross-correlation method on CORELLI are given and its performance is discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2025

PNNL-Predictive-Phenomics/ProteoMeter

ProteoMeter is a Python package that assists in the statistical analysis of global proteomics, protein post-translation modification (PTM), and limited proteolysis (LiP) data. It contains batch correction, normalization, and statistical testing methods, as well as functions that "roll up" peptide-level data to the single-site level. It has a robust user configuration system, allowing it to flexibly integrate different types of experiment designs. For basic usage, a simple configuration file provides the essential functionality. Advanced users have access to the entire statistical pipeline for fine-tuning analyses. Processed data is easily exported to many common spreadsheet and data-frame formats.

Rozum, Jordan [Pacific Northwest National Lab]↗
DOE OSTI2022

A Stochastic Reduced-Order Model for Statistical Microstructure Descriptors Evolution

Integrated computational materials engineering (ICME) models have been a crucial building block for modern materials development, relieving heavy reliance on experiments and significantly accelerating the materials design process. However, ICME models are also computationally expensive, particularly with respect to time integration for dynamics, which hinders the ability to study statistical ensembles and thermodynamic properties of large systems for long time scales. To alleviate the computational bottleneck, we propose to model the evolution of statistical microstructure descriptors as a continuous-time stochastic process using a non-linear Langevin equation, where the probability density function (PDF) of the statistical microstructure descriptors, which are also the quantities of interests (QoIs), is modeled by the Fokker–Planck equation. In this work, we discuss how to calibrate the drift and diffusion terms of the Fokker–Planck equation from the theoretical and computational perspectives. The calibrated Fokker–Planck equation can be used as a stochastic reduced-order model to simulate the microstructure evolution of statistical microstructure descriptors PDF. Considering statistical microstructure descriptors in the microstructure evolution as QoIs, we demonstrate our proposed methodology in three integrated computational materials engineering (ICME) models: kinetic Monte Carlo, phase field, and molecular dynamics simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Data Analysis for DNA Stable Isotope Probing Experiments Using Multiple Window High-Resolution SIP

DNA stable isotope probing (DNA-SIP) allows for the identification of microbes that assimilate isotopically labeled substrates into DNA. Here we describe the analysis of sequencing data using the multiple window high-resolution DNA-SIP method (MW-HR-SIP). MW-HR-SIP has improved accuracy over other methods and is easily implemented on the statistical platform R. Here, we also discuss key experimental parameters to consider when designing DNA-SIP experiments and how these parameters affect accuracy of analysis.

59 BASIC BIOLOGICAL SCIENCES↗