Search NASA⌕ Search

SEARCH · Search NASA

Results for “optimal experiment design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Gemma V&V/UQ/Credibility Activities: FY2020 Progress

This report describes the credibility activities undertaken in support of Gemma code development in FY20, which include Verification & Validation (V&V), Uncertainty Quantification (UQ), and Credibility process application. The main goal of these activities is to establish capabilities and process frameworks that can be more broadly applied to new and more advanced problems as the Gemma code development effort matures. This will provide Gemma developers and analysts with the tools needed to generate credibility evidence in support of Gemma predictions for future use cases. The FY20 Gemma V&V/UQ/Credibility activities described in this report include experimental uncertainty analysis, the development and use of methods for optimal design of computer experiments, and the development of a framework for validation. These initial activities supported the development of broader credibility planning for Gemma that continued into FY21.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

IER 516: Zirconium Test Assembly CED Phase-1: Preliminary Experiment Design

IER-516, Zirconium Test Assembly (ZTA), is a campaign to design, execute, and document a series of high-fidelity critical benchmark experiments to validate current and future zirconium (Zr) and zirconium hydride (ZrH x ) nuclear data evaluations. ZTA is a collaborative project between Los Alamos National Laboratory and the French Autoritè de Sûretè Nuclèaire et de Radioprotection. The experiments will be fueled with highly enriched uranium (HEU), and utilize the Comet critical assembly machine at the National Criticality Experiments Research Center. A total of ten preliminary critical experiments were designed and optimized for Zr and ZrHx nuclear data sensitivities using the MCNP-Particle Swarm Optimization methodology in the thermal, epithermal, intermediate, and fast neutron energy regions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Inertial Confinement Fusion Design Search Using Bayesian Optimization

Inertial confinement fusion (ICF) experiments rely on complex multi-physics simulation codes such as the Lawrence Livermore National Laboratory-developed HYDRA to guide design work. However, these simulations have several dozen tunable parameters and can be computationally expensive. This makes searching the parameter space challenging and time-consuming. Recently developed automated tools utilize Bayesian optimization to search these high-dimensional parameter spaces for optimal designs. The optimization tools run 2D integrated simulations in HYDRA to converge on a design that produces specified scalar or vector outputs. In this paper, we apply the Bayesian optimization tools to two common tuning scenarios. First, we tune simulation inputs to match measurements of a well-characterized experiment at the National Ignition Facility. This type of tuning is commonly performed to compensate for the use of simplified simulation settings (e.g. reduced resolution) or to account for missing physics in the simulations. Second, we search for an ICF simulation design that has a particular radiation drive profile. These optimizations replicate the kinds of tuning researchers routinely perform, but do so with significantly reduced manual effort. This approach demonstrates a powerful and efficient pathway toward autonomous, high-fidelity design optimization for future ICF experiments.

Bayesian optimization↗
DOE OSTI2021

A Verification of Flux Sensitivity Estimates Using the MCNP Tally Perturbation Tool

Nuclear data is commonly used in applications such as nuclear nonproliferation, safeguards, and criticality safety. More specifically, nuclear data is used in predictive simulation codes like the Monte-Carlo N-Particle (MCNP ® ) transport code, Serpent, and similar radiation transport codes. The improvement of nuclear data enables more precise and accurate simulations, which result in higher fidelity designs and reduced operational/procedural costs. Therefore, the improvement of nuclear data is of paramount importance across the nuclear community. Nuclear data is improved and validated through integral benchmark experiments. The design of benchmark experiments is an extensive process; therefore, these experiments are often optimized on multiple characteristics, including sensitivity to the nuclear data, during the design process. Sensitivity is a measure of how much a quantity changes due to changes in independent variables such as experimental configuration. An experimental design that has a larger sensitivity to the nuclear data of interest will have a larger impact on the accuracy and precision of the validated data. Past integral benchmark experiments have primarily used the effective multiplication factor ($k_{eff}$) as the predominant measured quantity; however, experiments designed with other quantities in mind would be able to optimize on validating different areas of the nuclear data. A primary goal of the EUCLID project is to design, constrain, and reduce compensating errors in experiments focused on quantities other than $k_{eff}$ to better validate nuclear data across the board. Currently, there is a capability in MCNP to easily calculate the sensitivity of $k_{eff}$ to specific nuclear data of numerous reactions types and isotopes (KSEN card); however, the sensitivity of other quantities must be estimated in more strenuous manners. For example, the perturbation feature (PERT card) of MCNP can be used to estimate first-order sensitivities of some response in fixed source simulations. A recent announcement revealed that the first- and second-order perturbation features in previous releases of MCNP contained a bug. It was identified that particles were being scored into the wrong energy bin. The bug is in the most recent public release (MCNP6.2); however, a patch has been added to the most up to date version (MCNP6.2.2) that has not been released publicly. A direct comparison of the PERT card results for an F4 (neutron flux averaged over a cell) tally before and after the patch are shown in figure 1. All simulations used in the sensitivity estimates in this report were performed with MCNP6.2.2. This work verifies the patched MCNP perturbation tool by comparing first order sensitivities made using the PERT card to estimates made using manual perturbation of the compact ENDF (ACE) files.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Modifications to the JET Shattered Pellet Injector to Optimize Disruption Mitigation Experiments for Supporting ITER’s DMS Design

Shattered pellet injection (SPI) experiments on Joint European Torus (JET) are an important element in determining the physics basis for mitigating disruptions in ITER. Here, the initial design of the JET SPI system included three barrels to produce pellets with diameters of 4.5, 8.1, and 12.5 mm. The variability of the pellet speed by operating with and without a mechanical punch was limited and led to poor pellet integrity, so the mechanical punch was removed. Fragment size distribution is a function of pellet speed and the desire to change the resulting fragment size distribution was not originally a requirement. After the first set of SPI experiments on JET, different pellet sizes were considered to enable dual injection experiments with identical pellet diameters. It was also determined that speed control is necessary to improve experimental repeatability and to determine how the fragment size distribution impacts mitigation performance. Two barrels were fabricated to form pellets of 10 mm diameter and a third to form an 8.1 mm diameter pellet. New propellant valves were also fabricated and characterized to improve repeatability and overall performance. To have fine control of pellet speed, inserts to reduce the breech volume were fabricated and installed. Laboratory testing was conducted to ensure pellet release and provide a comparison of propellant gas delivered versus pellet speeds for a range of pellet types and mixtures. This article will also discuss how lessons learned from the JET SPI modifications can be applied to other SPI systems, such as the ITER SPI system, as controlling pellet release with the least amount of propellant gas is essential for optimal SPI effectiveness.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

A Workflow to Optimize Fast Neutron Irradiation in A Thermal Neutron Spectrum Test Reactor Leveraging Open-Source Tools

The Advanced Test Reactor (ATR) located at Idaho National Laboratory (INL) is one of the key nuclear engineering research and testing facilities within the US Department of Energy (DOE). The ATR is one of few high-power research reactors in the world with different application including accelerated testing of nuclear fuel, materials irradiation in a very high neutron flux environment, and medical radioisotope production [1]. Also, the ATR offers opportunities for testing fast spectrum fission and fusion reactor materials. The key challenges in this area are in further detailing and optimizing a fast spectrum environment within a thermal test reactor. This challenge involves researching, developing, and testing novel concepts for the multiplying of neutron populations into ever higher energy spectra in high flux test reactors like ATR. The main objective of this work is to investigate candidate materials for establishing a fast neutron experiment irradiation in thermal neutron spectrum test reactors which can be accomplished by filtering thermal and epithermal neutrons and boosting fast neutrons at designated irradiation positions. However, adding these filters will render the neutron spectrum and the criticality of the system. The selection of the thickness and material layers should be accomplished by developing an optimization design algorithm that is applicable for ATR to enhance the fast neutron spectrum irradiation utilizing high-fidelity Monte Carlo methods along with advanced machine learning capabilities. This paper presents workflow for design optimization to enhance fast neutron irradiation in the ATR. The workflow leverages open-source tools to develop an algorithm that is viable to ATR and can be leveraged in other reactors. The following sections discuss the development of the experiment design optimization workflow and its application to ATR irradiation positions.

42 - ENGINEERING↗
DOE OSTI2024

Optimizing Batch Crystallization with Model-based Design of Experiments

Poster for Foundations of Computer Aided Process Design (FOCAPD) 2024 describing the formality of model-based design of experiments for batch crystallization. This paper focuses on the implementation of model-based design of experiments for parameter precision, enabled by Pyomo.DoE, a package in Python. Specifically, this work outlines an identifiability analysis for the estimability of the model parameters in a batch crystallization system.

Lynch, Hailey↗
DOE OSTI2022

Topology optimization of an airfoil fin microchannel heat exchanger using artificial intelligence

High-performance microchannel heat exchangers are needed to supply heat for power conversion for nuclear microreactors. An airfoil fin microchannel design, constructed of Alloy 617 with helium as the working fluid, is analyzed and optimized using a design of experiments with artificial intelligence techniques. The use of airfoil fins offers the potential to reduce pressure drop across the heat exchanger, as compared to other types of channel configurations. A framework for topology optimization of airfoil fin printed circuit heat exchangers (PCHEs) has been developed that can be readily extended to different fin sizes and shapes, as well as different inlet and operating conditions, materials of construction, and working fluids. An optimization procedure is developed that employs computational fluid dynamics for a set of design points identified using Latin hypercube sampling. Computational fluid dynamics is used to analyze a simplified two-channel configuration where five design parameters are varied – inlet angle, fin scale, extent of staggering, transverse and longitudinal pitches. Two methods (a 5D polynomial and a regression neural network) are compared for generating surrogate models and the resulting response surface approximation is input to a genetic algorithm that is used to identify a set of optimal parameters. The optimal geometries are found across six channel Reynolds numbers ranging from 1000 to 5000, since inlet conditions affect flow through the heat exchanger. Additionally, a set of optimal designs that maximizes heat transfer and minimizes pressure drop is identified, and a thermal stress analysis is performed on the optimal design. Correlations for the Nusselt number and Darcy friction factor are developed that can be useful for thermal hydraulic analyses using system codes. Thermal stresses are analyzed and a brief discussion of the status of code cases of PCHEs for nuclear applications is given. Testing and thermomechanical modeling is needed to facilitate future code compliance of PCHEs for high pressure and high temperature applications.

42 ENGINEERING↗
DOE OSTI2021

Design and Optimization of a Gas-Cooled, Airfoil Fin Microchannel Heat Exchanger

High-performance microchannel heat exchangers are needed to supply heat for power conversion for nuclear microreactors. An airfoil fin microchannel design, constructed of Alloy 617 with helium as the working fluid, was analyzed and optimized using a design of experiments with artificial intelligence and machine learning techniques. The use of airfoil fins offers the potential to reduce pressure drop across the heat exchanger, as compared to other types of channel configurations. A framework for topology optimization of airfoil fin PCHEs has been developed that can be readily extended to different fin sizes and shapes, as well as different inlet and operating conditions, materials of construction, and working fluids. An optimization procedure was developed that employs computational fluid dynamics for a set of design points identified using Latin hypercube sampling. STAR-CCM+ was used to analyze a simplified two-channel configuration where five parameters were varied – inlet angle, fin scale, extent of staggering, transverse and longitudinal pitches. Two methods were compared for generating surrogate models – a 5D polynomial and a regression neural network. A response surface approximation was created from the surrogate models and input to a genetic algorithm. The genetic algorithm identified a set of optimal points on the Pareto front. The optimal geometry was found across six channel Reynolds numbers ranging from 1000 to 5000 to analyze how varying inlet conditions affects the optimal design. A set of optimal designs that maximizes heat transfer and minimizes pressure drop was identified, and a thermal stress analysis was performed on the optimal design. This work has developed a digital framework for the expedient topology design and evaluation of PCHE designs for gas-cooled microreactor applications. Correlations for the Nusselt number and Darcy friction factor were developed that can be useful for thermal hydraulic analyses using system codes. A thermal stress analysis was conducted and a brief discussion of the status of code cases of PCHEs for nuclear applications is given. Testing and thermomechanical modeling is needed to facilitate future code compliance of PCHEs for high pressure and high temperature applications.

42 ENGINEERING↗
DOE OSTI2022

Throughput Optimization of Molybdenum Carbide Nanoparticle Catalysts in a Continuous Flow Reactor Using Design of Experiments

Transition metal carbides (TMCs) have attracted significant attention because of their applications toward a wide range of catalytic transformations. However, the practicality of their synthesis is still limited because of the harsh conditions in which most TMCs are prepared. Recently, a solution-phase synthesis of phase-pure a-MoC1-x nanoparticles was presented. While this synthetic route yielded nanoparticles with exceptional catalytic performance, the reaction parameter space was not explored, and catalyst throughput was not optimized for scale-up. Continuous flow platforms coupled with statistical design of experiments (DoE) can provide a powerful method for understanding the reaction parameter space for optimizations. Here, we demonstrate the use of statistical DoE in tandem with response surface methodology for a parametric screening analysis to optimize the throughput of a MoC1-x nanoparticle synthesis utilizing a millifluidic flow reactor. A full factorial design was implemented to evaluate four input variables (reaction temperature, flow rate, solvent fraction of oleylamine, and precursor concentration) that carry statistically significant effects on three responses (throughput, residence time, and isolated yield). A Doehlert matrix was implemented to investigate each significant variable at a higher number of levels to optimize throughput. Our results give a nonintuitive set of experimental conditions that resulted in an optimized throughput of 2.2 g h-1. This translates to a 50-fold increase in throughput compared to the previously reported batch method. The catalytic performance of the MoC1-x nanoparticles produced under optimized throughput was demonstrated in the CO2 hydrogenation reaction. This DoE screening analysis and throughput optimization of MoC1-x synthesis open the door to an increased feasibility for scale-up.

design of experiments↗
DOE OSTI2022

Pyomo.DOE: An open-source package for model-based design of experiments in Python

Predictive mathematical models are a cornerstone of science and engineering. Yet selecting, calibrating, and validating said science-based models often remains an art in practice. Model-based design of experiments (MBDoE) provides a systematic framework to maximize information gain from experiments while minimizing time and resource costs. But MBDoE remains limited to niche application areas, in part because practitioners must integrate expertise in statistics, computational optimization, and modeling. To help reduce this barrier, we introduce Pyomo.DOE, an open-source package for MBDoE. Pyomo.DOE uses a nonlinear sensitivity analysis code k_aug to quickly approximate the Fisher information matrix and leverages a new stochastic programming abstraction. We demonstrate Pyomo.DOE with the first application of MBDoE to fixed-bed breakthrough experiments, which highlights the power of Pyomo.DOE to quantify the value of experimental modifications a priori for large-scale partial differential-algebraic equation (PDAE) models. Here we also provide a mathematical primer on MBDoE targeted at general chemical engineers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

A study of events with photoelectric emission in the DarkSide-50 liquid argon Time Projection Chamber

Finding unequivocal evidence of dark matter interactions in a particle detector is a major goal of research in physics. Liquid argon time projection chambers offer a path to probe Weakly Interacting Massive Particles scattering cross sections on nuclei down to the so-called neutrino floor, in a mass range from a few GeV to hundreds of TeV. Based on the successful operation of the DarkSide-50 detector at LNGS, a new and more sensitive experiment, DarkSide-20k, has been designed and is now under construction. A thorough understanding of the DarkSide-50 detector response and, therefore, of all types of events observed in the detector, is essential for the optimal design of the new experiment. In this article, we report on a specific set of events, namely, standard two-pulse scintillation–ionization signals with a third small amplitude pulse, occurring within the 440 μ s data acquisition window of standard events. Some of these events are due to the photoionization of the TPC cathode. We compare our results with those published by collaborations using liquid xenon time projection chambers, which observed a similar phenomenon, and, in particular, with a recent paper by the LUX Collaboration (D.S. Akerib et al. Phys.Rev.D 102, 092004 (2020)) From the measured rate of these events, we estimate for the first time the quantum efficiency of the tetraphenyl butadiene deposited on the DarkSide-50 cathode at wavelengths of around 128 nm, in liquid argon. Also, both experiments observe events likely related to the photoionization of impurities in the liquid. The probability of photoelectron emission per unit length turns out to be an order of magnitude lower in DarkSide-50 than in LUX.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Bayesian D‐Optimal Designs for Gaussian Process Surrogate Models

Computer experiments often employ space-filling strategies to create surrogate models with strong predictive performance. The impact of model parameter estimation for Gaussian process surrogates, however, is often overlooked. Obtaining a better initial estimate of the covariance lengthscale parameter, θ, can greatly improve the resulting Gaussian process fit through more effective sequential acquisitions during active learning. In this work, we propose a novel initial design maximizing the Bayesian D-optimality criterion of the Gaussian process lengthscale parameter. Previously published results have shown the emphasis on lengthscale estimation to be promising, but relied on an empirically driven design creation process. Our Bayesian D-optimal designs are rooted in information theory and lead to more informative sequential acquisitions by improving lengthscale estimation. In many cases, these gains eventually result in better surrogates than those seeded with space-filling initial designs. Furthermore, Bayesian D-optimal designs can be tailored to either isotropic or anisotropic covariance structures, and the Bayesian framework enables the inclusion of prior knowledge in the design process, offering greater flexibility and adaptability. Through several simulation studies, we demonstrate the advantages of Bayesian D-optimal designs in terms of both lengthscale estimation accuracy and predictive performance during active learning.

Bayesian experimental design↗
DOE OSTI2023

Clear-sky detection for PV degradation analysis using multiple regression

A method is presented to detect clear-sky periods for plane-of-array irradiance time-averaged data that is based on the algorithm originally described by Reno and Hansen. Here we show this new method improves the state-of-the-art by providing accurate detection at longer data averaging intervals. Moreover, our new method detects clear periods in plane-of-array data, which is novel. The new method is developed by applying a Design of Experiment approach to optimize the parameters used in the Reno method, and Monte Carlo simulations are used to understand the robustness of the found parameters. Clear-sky detection accuracy is compared among four methods: the Reno method, the default clear-sky filter in RdTools, the Ellis method, and the method outlined in this work, using a hand-labeled two-year data set of 1-min plane-of-array irradiance for a fixed tilt system. The RdTools clear-sky filter is marred by excessive false positives. The other methods all perform well at 1-min data intervals; the method developed here provides more accurate detection at longer data averaging intervals. We show that the parameters are directly linked to the data frequency in the hope that these input variables may not have to be optimized for every data frequency and location. However, only a single fixed system in one location was carefully examined. Finally, we illustrate how accurate determination of clear-sky conditions helps to eliminate data noise and bias in the assessment of long-term performance of PV plants.

14 SOLAR ENERGY↗
DOE OSTI2021

Automating Bayesian inference and design to quantify acoustic particle levitation

Self-propulsion of micro- and nanoparticles powered by ultrasound provides an attractive strategy for the remote manipulation of colloidal matter using biocompatible energy inputs. Quantitative understanding of particle motion and its dependence on size, shape, and composition requires accurate characterization of the acoustic field, which depends sensitively on the experimental setup. Here, we show how automated experiments based on Bayesian inference and design can accurately and efficiently characterize the acoustic field within resonant chambers used to propel acoustic nanomotors. Repeated cycles of observation, inference, and design (OID) are guided by a physical model that describes the rate at which levitating particles approach the nodal plane. Using video microscopy, we observe the relaxation of tracer particles to this plane following the application of the acoustic field. We use sequential Monte Carlo methods to infer model parameters such as the amplitude and frequency of the resonant chamber while accounting for particle-level measurement noise and population-level heterogeneity in the field. Guided by simulated outcomes, we select the optimal design for the next experiment as to maximize the information gain in the relevant parameters. We show how this iterative process serves to discriminate between competing hypotheses and efficiently converges to accurate parameter estimates using only few automated experiments. We discuss the need for model criticism to ensure the validity of the guiding model throughout automated cycles of observation, inference, and design. Furthermore, this work demonstrates how Bayesian methods can learn the parameters of nonlinear, hierarchical models used to describe video microscopy data of active colloids.

42 ENGINEERING↗
DOE OSTI2024

Prediction of The TREAT Facility Power and Temperature of Sirius-2c Nuclear Propulsion Fuel Experiment

This paper presents simulation results of the Sirius-2c full power experiment that was performed at the TREAT facility to support experiment modeling and transient analysis of the NASA-sponsored Sirius series of experiments for nuclear thermal propulsion applications. We presents a novel approach to predict the control rod motion and power of the reactor and the temperature of the specimen during transient experiments using the Griffin and Bison packages of the Multiphysics Object Oriented Simulation Environment (MOOSE). First, the model predicts the transient rod motion that results in the desired reactor power shape. Then, the temperature of the specimen is predicted based on the power deposited in the specimen. The prediction results are in good agreement with the measured reactor power and control rod position and over-predicted the specimen temperature which is mainly related to specimen surface emissivities. The reactor reaches a peak power of 80 MW and a specimen temperature of 2500 K and considering the right specimen emissivities the predicted temperature is in an excellent agreement with the measured values. This model can be utilized in helping and supporting the design and optimization a new experiments that are going to be irradiated in the TREAT facility.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Exploring Sensitivity of ICF Outputs to Design Parameters in Experiments Using Machine Learning

We report building a sustainable burn platform in inertial confinement fusion (ICF) requires an understanding of the complex coupling of physical processes and the effects that key experimental design changes have on implosion performance. While simulation codes are used to model ICF implosions, incomplete physics and the need for approximations deteriorate their predictive capability. Identification of relationships between controllable design inputs and measurable outcomes can help guide the future design of experiments and development of simulation codes, which can potentially improve the accuracy of the computational models used to simulate ICF implosions. In this article, we leverage developments in machine learning (ML) and methods for ML feature importance/sensitivity analysis to identify complex relationships in ways that are difficult to process using expert judgment alone. We present work using random forest (RF) regression for prediction of yield, velocity, and other experimental outcomes given a suite of design parameters, along with an assessment of important relationships and uncertainties in the prediction model. We show that RF models are capable of learning and predicting on ICF experimental data with high accuracy, and we extract feature importance metrics that provide insight into the physical significance of different controllable design inputs for various ICF design configurations. These results can be used to augment expert intuition and simulation results for optimal design of future ICF experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗