Search NASA⌕ Search

SEARCH · Search NASA

Results for “surrogate model development”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

High-pressure ignition delay time measurements of a four-component gasoline surrogate and its high-level blends with ethanol and methyl acetate

Ignition delay times of a gasoline surrogate (iso-octane/toluene/n-heptane/1-hexene at 55/25/15/5% by liquid volume, developed in McCormick et al. 2017) with high-level bioblendstock-gasoline surrogate blends (50% and 85% biofuel by liquid volume of each ethanol and methyl acetate) were collected behind reflected shock waves. Post-reflected-shock temperatures ranged from 968 to 1361 K at pressures of about 4, 10, 25, and 50 atm. Data were collected for real fuel–air mixtures at fuel lean and stoichiometric conditions (φ = 0.5, 1.0) with focus on the more-practical, fuel-lean conditions. Ignition delay times were measured from OH* chemiluminescence around 307 nm using an endwall diagnostic. The RON and MON of the surrogate were 90.3 and 84.7, respectively. Ethanol was chosen due to its wide use in flex-fuel vehicles and availability, while also providing an increased octane rating. Methyl acetate was chosen for its especially high octane rating to investigate the effect of an extreme case. To validate the gasoline surrogate, the data are compared to real gasoline (RD387) and several gasoline surrogate experiments from the literature. Using the wide range of pressures studied, the gasoline surrogate’s pressure dependence was quantified to account for test-to-test variations using regression analysis. Similarly, a global correlation for gasoline and its surrogates was developed using all available data from the literature. Two modern chemical kinetics models targeting gasoline and its surrogates are compared to the ignition delay time measurements. These new high-pressure, high-bioblendstock concentration tests provide required chemical kinetic data for optimizing fuel and engine design.

42 ENGINEERING↗

Combustion of petroleum-based transportation fuels and their blends with biofuels: a new approach for developing surrogates and understanding the effects of blending

Accurate and versatile reaction mechanisms are necessary to simulate combustion of transportation fuels blended with biofuels for improving fuel efficiency, reducing fuel consumption and mitigating the formation and emissions of combustion products harmful to the atmosphere. This project involved a combined effort of simulation and experimentation of liquid fuel burning using a combustion configuration amenable to numerical modeling with a level of detail not previously achieved for blends of biofuels with gasoline certification and surrogate fuels. The configuration of an isolated droplet burning under conditions where gas transport arises solely from fuel evaporation was selected as the platform for experiments and numerical modeling. The spherical symmetry and one-dimensional gas transport that results enabled simulating the droplet burning process with an precedented level of detail. Processes associated with unsteady gas and liquid transport, formation of particulate and gaseous products, radiation, multicomponent phase equilibrium at the droplet surface and moving boundary effects from droplet evaporation, were incorporated in a single numerical framework. The numerical model was based on the open source code OPENSmoke++ (OS) adapted to incorporate the effects noted above. In addition to simulation, an experimental design was developed for the isolated droplet configuration to acquire the data needed for validating the numerical model. Several broad accomplishments of the project were the following: demonstrating generally excellent agreement between measured and simulated combustion parameters for the fuel blends examined that included mixtures of heptane and isobutanol as a model system, and surrogates comprised of up to seven miscible components mixed with ethanol or isobutanol as representative biofuel additives; using a new approach to validate reaction mechanisms of biofuel blends which incorporated fuel evaporation into the process along with developing an experimental design for acquiring data to compare with simulations; and showing that a wealth of information could be obtained on the combustion physics of biofuels from experiments requiring volumes on the order of only nanoliters at a time thus opening the way to evaluating biofuels synthesized by new processes early in development.

02 PETROLEUM↗

mystic : software for autonomous discovery and design under uncertainty

Throughout the diverse range of science and engineering applications, there is a growing desire to develop computational methods that can reliably predict the behavior of complex systems. Specifically, there is a strategic need for tools that can robustly forecast the behavior of complex physical systems, where data may be high-dimensional, noisy, or sparse, and models of the system may be time-dependent or include uncertainty. We use mystic to build tools that leverage statistical learning, physics-informed learning, and active learning in the efficient generation of reliably predictive surrogates for complex physical systems. mystic is a robust, proven, open-source optimization and uncertainty quantification toolkit with over a decade of use in the design and optimization of neutron instrumentation, solar-powered drones, and gasguns, and in iterative tuning of models for Raman spectroscopy and elastoplastic materials strength. Recent developments have focused on automated learning of statistically robust surrogates under uncertainty, with applications in materials in extreme environments, nanostructures, materials simulations and strength models, and the failure of shielding under particle radiation. In 2020, McKerns demonstrated active learning of optimally robust surrogates with respect to new simulated data for molecular dynamics simulations of materials mixing in warm dense matter, and is currently applying active learning to the automated steering of particle accelerator beams and the optimal design and control of quantum optical sensor instrumentation.

42 ENGINEERING↗

Program to Optimize Simulated Trajectories II (POST2) Surrogate Models for Mars Ascent Vehicle (MAV) Performance Assessment

The primary purpose of the multiPOST tool is to enable the execution of much larger sets of vehicle cases to allow for broader trade space exploration. However, this exploration is not achieved solely with the increased case throughput. The multiPOST tool is applied to carry out a Design of Experiments (DOE), which is a set of cases that have been structured to capture a maximum amount of information about the design space with minimal computational effort. The results of the DOE are then used to fit a surrogate model, ultimately enabling parametric design space exploration. The approach used for the MAV study includes both DOE and surrogate modeling. First, the primary design considerations for the vehicle were used to develop the variables and ranges for the multiPOST DOE. The final set of DOE variables were carefully selected in order to capture the desired vehicle trades and take into account any special considerations for surrogate modeling. Next, the DOE sets were executed through multiPOST. Following successful completion of the DOE cases, a manual verification trial was performed. The trial involved randomly selecting cases from the DOE set and running them by hand. The results from the human analyst's run and multiPOST were then compared to ensure that the automated runs were being executed properly. Completion of the verification trials was then followed by surrogate model fitting. After fits to the multiPOST data were successfully created, the surrogate models were used as a stand-in for POST2 to carry out the desired MAV trades. Using the surrogate models in lieu of POST2 allowed for visualization of vehicle sensitivities to the input variables as well as rapid evaluation of vehicle performance. Although the models introduce some error into the output of the trade study, they were very effective at identifying areas of interest within the trade space for further refinement by human analysts. The next section will cover all of the ground rules and assumptions associated with DOE setup and multiPOST execution. Section 3.1 gives the final DOE variables and ranges, while section 3.2 addresses the POST2 specific assumptions. The results of the verification trials are given in section 4. Section 5 gives the surrogate model fitting results, including the goodness-of-fit metrics for each fit. Finally, the MAV specific results are discussed in section 6.

Zwack, M. R.↗

PINN surrogate of Li-ion battery models for parameter inference, Part I: Implementation and multi-fidelity hierarchies for the single-particle model

To plan and optimize energy storage demands that account for Li-ion battery aging dynamics, techniques need to be developed to diagnose battery internal states accurately and rapidly. Here, this study seeks to reduce the computational resources needed to determine a battery's internal states by replacing physics-based Li-ion battery models - such as the single-particle model (SPM) and the pseudo-2D (P2D) model - with a physics-informed neural network (PINN) surrogate. The surrogate model makes high-throughput techniques, such as Bayesian calibration, tractable to determine battery internal parameters from voltage responses. This manuscript is the first of a two-part series that introduces PINN surrogates of Li-ion battery models for parameter inference (i.e., state-of-health diagnostics). In this first part, a method is presented for constructing a PINN surrogate of the SPM. A multi-fidelity hierarchical training, where several neural nets are trained with multiple physics-loss fidelities is shown to significantly improve the surrogate accuracy when only training on the governing equation residuals. The implementation is made available in a companion repository (https://github.com/NREL/PINNSTRIPES). The techniques used to develop a PINN surrogate of the SPM are extended in Part II for the PINN surrogate for the P2D battery model, and explore the Bayesian calibration capabilities of both surrogates.

25 ENERGY STORAGE↗

Improving Predictions Under Uncertainty of Material Plasma Device Operations

Understanding the properties of materials when exposed to various plasma temperatures and fluxes is essential to the building and operating of fusion reactors. The Material Plasma Exposure eXperiment (MPEX) is an instrument currently being developed by the Department of Energy (DOE) for this purpose. MPEX is expected to come online in stages over the next five years. Proto-MPEX, the predecessor to MPEX, operated from 2014 to 2021, and was designed to understand the generation of plasma temperatures and fluxes at orders of magnitude below what will be obtained by MPEX. This work uses the recently developed stochastic neural network (SNN), a machine learning technique capable of operating under uncertainty to provide a surrogate model for the Proto-MPEX device. We demonstrate that SNN outperforms Bayesian neural network (BNN), a standard in the field of machine learning with uncertainty. The development of a robust surrogate of the Proto-MPEX will aid in the commissioning and operation of the MPEX device.

Archibald, Rick↗

Evaluation of ceria as a surrogate material for UO 2 in experiments on fuel cracking driven by resistive heating

A variety of normal operation and accident scenarios can generate thermal stresses large enough to cause cracking in light-water reactor (LWR) fuel pellets. Cracking of fuel pellets can lead to reduced heat removal, larger centerline temperatures, and localized stress in cladding all of which impact fuel performance. Furthermore, pellet cracking also contributes to a temperature reduction in the pellet since the pellet fragments tend to move towards the heat sink (cladding), and the heat flow remains predominantly radial despite the presence of cracks. It is important to understand the temperature profile on the pellet before and after cracking to improve cracking models in fuel performance codes However, in-reactor observation and measurement of cracking is very challenging owing to the harsh environment and design of fuel rods. Recently, an experimental pellet cracking test stand was developed for separate effects testing of normal operations and accident temperature conditions, using thermal imaging to capture the pellet surface temperature for evaluation of thermal stresses and optical imaging to capture the evolution of cracking in real time. Cracking experiments were initially performed using ceria (CeO 2 ) as a surrogate fuel material, which is useful for developing and demonstrating the experimental approaches but is also valuable in its own right for cracking model development and validation. A combination of induction and resistance heating was used for volumetric heat generation in the pellet creating a thermal gradient. The material properties of CeO 2 and UO 2 are reviewed and compared for use in model development. Simulations of the experiment were performed to evaluate the behavior of the surrogate (CeO 2 ) fuel in BISON. The measured temperature profiles from BISON models match reasonably well with the observed experiments for the ceria pellets before cracking. The findings from this work will help improve confidence in fracture models used for fuel pellets under similar in-reactor conditions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Quantum surrogate models for uncertainty quantification

Surrogate models are a critical ingredient to computation-based design and validation of many DOE mission-relevant physical systems. When first-principles computation of properties of a physical systems becomes pro hibitive, surrogate models are the only path towards achieving tasks such as uncertainty quantification (UQ), exploration of design space, and validation of design choices. In this project we have developed and demonstrated a new surro gate modeling paradigm for complex models that is data-driven, non-intrusive, and has the potential to be versatile and equipped with performance guaran tees. This combination of features is absent in existing surrogate modeling tools. The framework we have developed in this project exploits a quantum-classical correspondence to establish a quantum system that mimics the dynamics of the classical Hamiltonian system from which data in the form of temporal snapshots is provided. Since quantum dynamics propagates distributions over observables, the framework is naturally suited to propagation of epistemic uncertainties in the form of distributions over initial state and parametric uncertainties. In this project, we take the first step in establishing this novel framework by deriving a quantization and de-quantization procedure, demonstrating the accuracy of the quantum surrogate models these define using two model systems, and defining the next steps in maturing the framework towards a tool applicable to Sandia mission-relevant problems.

97 MATHEMATICS AND COMPUTING↗

Assessment of model parameters in MFiX particle-in-cell approach

The limitations in numerical treatment of solids-phase in conventional methods like Discrete Element Model and Two-Fluid Model have facilitated the development of alternative techniques such as Particle-In-Cell (PIC). However, a number of parameters are involved in PIC due to its empiricism. In this work, global sensitivity analysis of PIC model parameters is performed under three distinct operating regimes common in chemical engineering applications, viz. settling bed, bubbling fluidized bed and circulating fluidized bed. Simulations were performed using the PIC method in Multiphase Flow with Interphase eXchanges (MFiX) developed by National Energy Technology Laboratory (NETL). A non-intrusive uncertainty quantification (UQ) based approach is applied using Nodeworks to first construct an adequate surrogate model and then identify the most influential parameters in each case. This knowledge will aid in developing an effective design of experiments and determine optimal parameters through techniques such as deterministic or statistical calibration.

01 COAL, LIGNITE, AND PEAT↗

Automated path planning for functionally graded materials considering phase stability and solidification behavior: Application to the Mo-Nb-Ta-Ti system

Functionally graded materials have the potential to improve upon monolithic parts by locally tailoring compositions to surrounding environmental conditions. Difficulties arise when designing composition gradients as incompatible materials can result in detrimental phase formation and failure of the gradient joint. As many alloys are multi-component, designing a composition gradient free of detrimental phases is difficult due to the large composition space available to explore. A framework was developed that improves the path planning algorithm and surrogate models with adaptive sampling schemes specific to their problem definition. A cost function was created to minimize a property (such as cracking susceptibility) along a path. This framework was applied to the Mo-Nb-Ta-Ti system as a case study to showcase the efficiency in building the surrogate models and in iterating different optimal compositionally graded paths.

36 MATERIALS SCIENCE↗

On‐site surrogates for large‐scale calibration

Abstract Motivated by a computer model calibration problem from the oil and gas industry, involving the design of a honeycomb seal, we develop a new Bayesian methodology to cope with limitations in the canonical apparatus stemming from several factors. We propose a new strategy of on‐site design and surrogate modeling for a computer simulator acting on a high‐dimensional input space that, although relatively speedy, is prone to numerical instabilities, missing data, and nonstationary dynamics. Our aim is to strike a balance between data‐faithful modeling and computational tractability in a calibration framework—tailoring the computer model to a limited field experiment. Situating our on‐site surrogates within the canonical calibration apparatus requires updates to that framework. We describe a novel yet intuitive Bayesian setup that carefully decomposes otherwise prohibitively large matrices by exploiting the sparse blockwise structure. Empirical illustrations demonstrate that this approach performs well on toy data and our motivating honeycomb example.

Huang, Jiangeng↗

Development of the uncertainty quantification toolkit's python interface and surrogate construction tutorial

The uncertainty quantification toolkit (UQTk) is a collection of c++ libraries that assess the confidence of numerical models. Surrogate approximations, often polynomial chaos expansions (PCEs), lessen the computational cost of these assessments. I developed a Python interface in UQTk for regression and Bayesian compressive sensing to add to the existing Galerkin projection method. These methods receive an object containing the polynomial basis information and NumPy arrays of sample points, call c++ methods, and return the PCE coefficients in a NumPy array. To demonstrate these methods, I wrote a tutorial in which I use them to construct surrogates for Genz functions and calculate the resulting error.

97 MATHEMATICS AND COMPUTING↗

Toward a machine-guided approach to energetic material discovery

In this article, we trained a machine learning (ML) model to connect microstructural details of an energetic material formulation to its performance for the purpose of guiding the discovery of new explosive formulations. Our hypothesis was that the algorithm would robustly learn the training data and produce an accurate surrogate model. Specifically, the algorithm learned the relationship between details of the void size distribution (VSD), initiating shock pressure, and the energetic material performance. We used realistic constraints on the VSD and a range of cases were ingested by a physically informed reactive flow model working within a hydrodynamic solver running on high-performance computing resources. The ML algorithm produced a surrogate model that accurately predicted known test points around the parameter space. In addition to the utility of the model and the process used for its development, we noted interesting comparisons between what we, the authors—subject matter experts, would heuristically conclude from the training data and the surrogate model predictions. We detected nuanced details that were missed by the surrogate model; however, these details are not important to an energetic material formulator. We concluded that the algorithm did indeed robustly learn the training data and produce an accurate surrogate model. We further concluded that the surrogate model is a powerful tool to guide the formulator in the absence of subject matter experts and limited-access computing resources.

42 ENGINEERING↗

DEMONSTRATION OF A DATA-DRIVEN PHYSICS-BASED APPROACH FOR COMPUTATIONALLY EFFICIENT CFD PREDICTION OF TWO-PHASE BUBBLY FLOW

To realize efficient computational fluid dynamics (CFD) prediction of two-phase flow, a multi-scale physics-guided data-driven approach, Feature Similarity Measurement (FSM) technique was developed for error estimation in two-phase flow simulation using coarse-mesh CFD, to achieve a comparable accuracy as fine-mesh simulations with fast-running feature. By defining physics-guided parameters and variable gradients as physical features, FSM has the capability to capture the underlying local patterns in the coarse-mesh CFD simulation. Massive low-fidelity data and respective high-fidelity data are used to explore the underlying information relevant to the main simulation errors and the effects of phenomenological scaling. By learning from previous simulation data, a surrogate model using deep feedforward neural network (DFNN) can be developed and trained to estimate the simulation error of coarse-mesh CFD. In a demonstration case of two-phase bubbly flow, the DFNN model well captured and corrected the unphysical “peaks” in the velocity and void fraction profiles near the wall in the coarse-mesh configuration, even for extrapolative predictions. The research documented supports the feasibility of the physics-guided deep learning methods for coarse mesh CFD simulations which has a potential for the efficient industrial design.

42 ENGINEERING↗

Computationally efficient CFD prediction of bubbly flow using physics-guided deep learning

To realize efficient computational fluid dynamics (CFD) prediction of two-phase flow, a multi-scale framework was proposed in this paper by applying a physics-guided data-driven approach. Instrumental to this framework, Feature Similarity Measurement (FSM) technique was developed for error estimation in two-phase flow simulation using coarse-mesh CFD, to achieve a comparable accuracy as fine-mesh simulations with fast-running feature. In this work, by defining physics-guided parameters and variable gradients as physical features, FSM has the capability to capture the underlying local patterns in the coarse-mesh CFD simulation. Massive low-fidelity data and respective high-fidelity data are used to explore the underlying information relevant to the main simulation errors and the effects of phenomenological scaling. By learning from previous simulation data, a surrogate model using deep feedforward neural network (DFNN) can be developed and trained to estimate the simulation error of coarse-mesh CFD. In a demonstration case of two-phase bubbly flow, the DFNN model well captured and corrected the unphysical “peaks” in the velocity and void fraction profiles near the wall in the coarse-mesh configuration, even for extrapolative predictions. The research documented supports the feasibility of the physics-guided deep learning methods for coarse mesh CFD simulations which has a potential for the efficient industrial design.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Bayesian reduced-order deep learning surrogate model for dynamic systems described by partial differential equations

We propose a reduced-order deep-learning surrogate model for dynamic systems described by time-dependent partial differential equations. This method employs space–time Karhunen–Loève expansions (KLEs) of the state variables and space-dependent KLEs of space-varying parameters to identify the reduced (latent) dimensions. Subsequently, a deep neural network (DNN) is used to map the parameter latent space to the state variable latent space. An approximate Bayesian method is developed for uncertainty quantification (UQ) in the proposed KL-DNN surrogate model. The KL-DNN method is tested for the linear advection–diffusion and nonlinear diffusion equations, and the Bayesian approach for UQ is compared with the deep ensembling (DE) approach, commonly used for quantifying uncertainty in DNN models. It was found that the approximate Bayesian method provides a more informative distribution of the PDE solutions in terms of the coverage of the reference PDE solutions (the percentage of nodes where the reference solution is within the confidence interval predicted by the UQ methods) and log predictive probability. The DE method is found to underestimate uncertainty and introduce bias. For the nonlinear diffusion equation, we compare the KL-DNN method with the Fourier Neural Operator (FNO) method and find that KL-DNN is 10% more accurate and needs less training time than the FNO method.

97 MATHEMATICS AND COMPUTING↗

Machine learning-enhanced model-based scenario optimization for DIII-D

Abstract Scenario development in tokamaks is an open area of investigation that can be approached in a variety of different ways. Experimental trial and error has been the traditional method, but this required a massive amount of experimental time and resources. As high fidelity predictive models have become available, offline development and testing of proposed scenarios has become an option to reduce the required experimental resources. The use of predictive models also offers the possibility of using a numerical optimization process to find the controllable inputs that most closely achieve the desired plasma state. However, this type of optimization can require as many as hundreds or thousands of predictive simulation cases to converge to a solution; many of the commonly used high fidelity models have high computational burdens, so it is only reasonable to run a handful of predictive simulations. In order to make use of numerical optimization approaches, a compromise needs to be found between model fidelity and computational burden. This compromise can be achieved using neural networks surrogates of high fidelity models that retain nearly the same level of accuracy as the models they are trained to replicate while reducing the computation time by orders of magnitude. In this work, a model-based numerical optimization tool for scenario development is described. The predictive model used by the optimizer includes neural network surrogate models integrated into the fast Control-Oriented Transport simulation framework. This optimization scheme is able to converge to the optimal values of the controllable inputs that produce the target plasma scenario by running thousands of predictive simulations in under an hour without sacrificing too much prediction accuracy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗