Search NASA⌕ Search

SEARCH · Search NASA

Results for “SURROGATE MODEL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Machine Learning Approaches for Rare-Earth Silicate Environmental Barrier Coating Thermochemical and Thermomechanical Property Predictions

Environmental barrier coatings (EBCs) are a necessary enabling technology for the transition from superalloys to silicon carbide (SiC) ceramic matrix composites (CMCs) in gas turbine engines for increased efficiency and decreased fuel costs. SiC-based CMCs are prone to oxidation-based degradation in the engine hot section, and rare-earth (RE) silicates are promising candidates for EBCs due to their close thermal expansion match to the composite substrate and oxidation resistance. However, the design of EBCs is hindered by the large chemical space of candidate materials and the difficulty in obtaining material properties for engineering optimization. This is especially difficult as research continues into mixed-cation or “high-entropy” RE silicates. First-principles computational methods such as density functional theory (DFT) are highly effective at calculating material properties to guide coating design but are limited by their computational cost. Atomistic simulations have the potential to both accelerate property calculations and expand the properties able to be calculated due to their lower computational compared to DFT. However, they require interatomic potentials (IAPs) specific to the material system of interest, and, to our knowledge, there are no suitable IAPs for RE silicates. Machine learning (ML) is a promising technique to accelerate material property predictions indirectly by generating IAPs for atomistic simulations or via direct prediction. In this work, we present two ML approaches to accelerate the calculation of RE silicate properties relevant to EBC design: 1) a ML-derived interatomic potential (IAP) for atomistic simulations of yttrium disilicate (Y2Si2O7) from DFT training data, and 2) a neural network (NN) model to directly predict thermochemical properties of RE silicates and oxides directly from easily obtainable unit cell parameters. Classical MD simulations using the IAP yield lattice properties and bond lengths in good agreement with both DFT and experimental results from x-ray diffraction. Thermodynamic properties calculated using the finite-displacement phonon method and quasi-harmonic approximation were orders of magnitude faster than DFT with good agreement to the DFT results. The IAP was also used to calculate properties such as coefficient of thermal expansion (CTE) that require large simulation supercells and are therefore difficult with DFT. The IAP correctly predicted the anisotropic nature of the CTE in three different phases of Y2Si2O7. The NN model predicts constant pressure heat capacity, Cp, orders of magnitude faster than DFT calculations, which can enable its use as a surrogate model for multiscale simulations. The two methods presented in this work demonstrate the utility of ML for accelerating the prediction of RE silicate properties, which can in turn accelerate EBC design and optimization.

machine learning↗

Scale-up of microwave-assisted, continuous flow, liquid phase reactors: Application to 5-Hydroxymethylfurfural production

Microwave (MW) technology can be powerful for the electrification and intensification of chemical manufacturing. However, very few examples of scaled MW processes exist. In this work, we build a scaled, MW-assisted, continuous flow reactor for the processing of liquid phase chemistries with specific application to 5-hydroxymethylfurfural (HMF) production. Here, we demonstrate a corresponding computational fluid dynamics model to simulate the reactor’s temperature profile and performance, both of which are in good agreement with experiments. We construct a surrogate model to relate operating parameters to performance for guiding experiments, without demanding simulations, via active learning. Heat recirculation is demonstrated in this scaled reactor, further extending its scale and reducing the energy demand. An HMF yield of ~55 % and a productivity of 0.1 kg/hr, 8x higher than any other reactor, at a flowrate >20x than prior work, are demonstrated while maintaining energy efficiency of >98 %. A basic economic analysis estimates a $1.85/kg cost of HMF from fructose and >60 % reduction in CO 2 emissions than a conventional system without considering the impact of green electricity. We demonstrate that MW technology is well-applied to systems larger than the laboratory scale, and strategies to further reduction in cost and CO 2 are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A dynamic closure modeling framework for model order reduction of geophysical flows

Here in this paper, a dynamic closure modeling approach has been derived to stabilize the projection-based reduced order models in the long-term evolution of forced-dissipative dynamical systems. To simplify our derivation without losing generalizability, the proposed reduced order modeling (ROM) framework is first constructed by Galerkin projection of the single-layer quasigeostrophic equation, a standard prototype of large-scale general circulation models, onto a set of dominant proper orthogonal decomposition modes. We then propose an eddy viscosity closure approach to stabilize the resulting surrogate model considering the analogy between large eddy simulation (LES) and truncated modal projection. Our efforts, in particular, include the translation of the dynamic subgrid-scale model into our ROM setting by defining a test truncation similar to the test filtering in LES. Finally, the a posteriori analysis shows that our approach is remarkably accurate, allowing us to integrate simulations over long time intervals at a nominally small computational overhead.

42 ENGINEERING↗

Data-driven Mori–Zwanzig modeling of Lagrangian particle dynamics in turbulent flows

The dynamics of Lagrangian particles in turbulence play a crucial role in mixing, transport, and dispersion in complex flows. Their trajectories exhibit highly nontrivial statistical behavior, motivating the development of surrogate models that can reproduce these trajectories without incurring the high computational cost of direct numerical simulations of the full Eulerian field. This task is particularly challenging because reduced-order models typically lack access to the full set of interactions with the underlying turbulent field. Novel data-driven machine learning techniques can be powerful in capturing and reproducing complex statistics of the reduced-order/surrogate dynamics. In this work, we show how one can learn a surrogate dynamical system that is able to evolve a turbulent Lagrangian trajectory in a way that is point-wise accurate for short-time predictions (with respect to Kolmogorov time) and stable and statistically accurate at long times. This approach is based on the Mori–Zwanzig formalism, which prescribes a mathematical decomposition of the full dynamical system into resolved dynamics that depend on the current state and the past history of a reduced set of observables, and the unresolved orthogonal dynamics due to unresolved degrees of freedom of the initial state. We show how by training this reduced order model on a point-wise error metric on short time-prediction, we are able to correctly learn the dynamics of Lagrangian turbulence, such that also the long-time statistical behavior is stably recovered at test time. This opens up a range of applications, for example, for the control of active Lagrangian agents in turbulence.

97 MATHEMATICS AND COMPUTING↗

HIGH-FIDELITY SIMULATION-DRIVEN MODEL DEVELOPMENT FOR COARSE-GRAINED COMPUTATIONAL FLUID DYNAMICS

Nuclear reactor safety analysis requires identifying various credible accident scenarios and determining their consequences. For a full-scale nuclear power plant system behavior, it is impossible to obtain sufficient experimental data for a broad range of risk-significant accident scenarios. In single-phase flow convective problems, Direct Numerical Simulation (DNS) and Large Eddy Simulation (LES) can provide us with high fidelity results when physical data are unavailable. However, these methods are computationally expensive and cannot be afforded for simulation of long transient scenarios in nuclear accidents despite extraordinary advances in high performance scientific computing over the past decades. The major issue is the inability to make the transient computation parallel, thus making number of time steps required in high-fidelity methods unaffordable for long transients. In this work, we propose to apply a high fidelity simulation-driven approach to model sub-grid scale (SGS) effect in Coarse Grained Computational Fluid Dynamics CG-CFD. This approach aims to develop a statistical surrogate model instead of the deterministic SGS model. We chose to start with a turbulent natural convection case with volumetric heating in a horizontal fluid layer with a rigid, insulated lower boundary and isothermal (cold) upper boundary. This scenario of unstable stratification is relevant to turbulent natural convection in a molten corium pool during a severe nuclear reactor accident, as well as in containment mixing and passive cooling. The presented approach demonstrates how to create a correction for the CG-CFD solution by modifying the energy balance equation. A global correction for the temperature equation proves to achieve a significant improvement to the prediction of steady state temperature distribution through the fluid layer.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Data Assimilation - Advances and Applications

This presentation provides an overview of data assimilation (model calibration) for complex computer experiments. Calibration refers to the process of probabilistically constraining uncertain physics/engineering model inputs to be consistent with observed experimental data. An initial probability distribution for these parameters is updated using the experimental information. Utilization of surrogate models and empirical adjustment for model form error in code calibration form the basis for the statistical methodology considered. The role of probabilistic code calibration in supporting code validation is discussed. Incorporation of model form uncertainty in rigorous uncertainty quantification (UQ) analyses is also addressed. Design criteria used within a batch sequential design algorithm are introduced for efficiently achieving predictive maturity and improved code calibration. Predictive maturity refers to obtaining stable predictive inference with calibrated computer codes. These approaches allow for augmentation of initial experiment designs for collecting new physical data. A standard framework for data assimilation is presented and techniques for updating the posterior distribution of the state variables based on particle filtering and the ensemble Kalman filter are introduced.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A mechanistic model for creep and thermal aging in Alloy 709

This report describes a physics-based model for creep and thermal aging in Alloy 709. Alloy 709 is an advanced austenitic alloy, targeted for use in future Sodium Fast Reactors (SFRs) and other advanced reactors. The material has superior high temperature properties compared to currently qualified 316 and 304 stainless steels. However, the available creep and thermal aging test database for Alloy 709 is significantly more limited compared to the historical materials. The physics-based model developed here is one way to accelerate the qualification of the material by providing more accurate long-term predictions for creep properties and thermal aging, compared to current empirical time-extrapolate techniques. The crystal plasticity finite element model is used to predict the deformation and failure of alloy 709. The same setup for the CPFE model is used in both the baseline model calibration process and the simulation campaigns for parameter inference. Specific constitutive choices are made for Alloy 709 to capture the primary deformation mechanisms. The dislocation creep formulation developed by Hu and Cocks is extended to account for coupled precipitation formation and the grain boundary cavitation model developed by Sham, Needleman, et al. is used to model grain boundary cavitation-induced failure. A novel update algorithm is proposed to render the semi-discrete constitutive update for the Sham-Needleman model unconditionally stable. A progressive calibration approach is adopted based on the observations that several types of material responses can be effectively decoupled. A surrogate model is trained based on full-fledged CPFE simulations to accelerate the forward model evaluations, and stochastic variational inference (SVI) is used to calibrate the unknown microstructural model parameters. The calibrated mechanistic model is used to predict the long-term creep life of Alloy 709, and the predictions are compared against classical empirical approaches.

36 MATERIALS SCIENCE↗

Development of a machine learning model for polyethylene pyrolysis using a detailed reaction mechanism

Waste plastics have recently received significant attention as the issue of waste generation continues to increase. Thermal conversion processes, such as pyrolysis and gasification, are attractive potential technologies for utilizing waste plastics and reducing overall waste generation. Efficient utilization of plastics requires a detailed understanding of the conversion process such as pyrolysis and gasification. However, a mechanistic understanding of these processes lead to large and complex kinetic schemes that are not suited for large-scale and long-time simulation methods. Currently, most modeling approaches for pyrolysis and gasification rely on globally lumped, simplified kinetic schemes that provide results that are classified by their product type and not individual species, which limit the level of fidelity achieved via modeling. A machine learning (ML) model has been developed for the primary reactions of high-density polyethylene (HDPE) in an attempt to increase computational efficiency while still maintaining a high level of detail and accuracy. The ML model is trained on a detailed reaction mechanism containing 42 total species and 737 chemical reactions. A DeepONet branch and trunk architecture was adopted to train the model using time-steps relevant to computational fluid dynamics simulations. The ML used physics-informed loss functions to ensure mass conservation. The surrogate model has been deployed in simple MFiX CFD simulations, single particle and an experimental drop tube reactor, and has shown promising performance compared to the original scheme.

Houston, Ross↗

Stochastic Thermo-Hydro Modeling and Neural Network Surrogate Development for Thermal Resource Assessment of the Galleries-to-Calories Geobattery

The Galleries-to-Calories Geobattery concept explores the use of abandoned coal mine workings for large-scale thermal energy transport and storage. The system involves injecting waste heat from a supercomputing facility into flooded mine galleries, where groundwater flow can store and transport thermal energy for potential recovery in downgradient district heating and cooling applications. To evaluate the feasibility and performance of the Geobattery under geological and operational uncertainty, we developed a suite of stochastic thermo-hydrological (TH) simulations using Monte Carlo sampling of key uncertain parameters (e.g., permeability, porosity, thermal conductivity, specific heat capacity) and operating conditions (e.g., injection rate, injection temperature). Results identified injection rate and temperature as the most influential parameters governing thermal front propagation, while the geometry of the room-and-pillar structure played a critical role in directing the extent and orientation of thermal advancement. Optimal combinations of material properties for maximizing heat recovery were also determined. To address the high computational cost of coupled-process stochastic modeling, we trained a neural network surrogate model on 24,000 physics-based realizations, achieving an R² > 0.99 and MAE < 0.1 for temperature predictions at monitoring locations. This surrogate enabled an additional 100,000 realizations for global sensitivity analysis and probabilistic thermal resource assessment. The integrated stochastic physics–surrogate modeling framework offers a computationally efficient tool for quantifying uncertainty, identifying key drivers, and informing early-stage design decisions for Geobattery systems.

15 - GEOTHERMAL ENERGY↗

Phase Diagrams of Alloys and Their Hydrides via On-Lattice Graph Neural Networks and Limited Training Data

Efficient prediction of sampling-intensive thermodynamic properties is needed to evaluate material performance and permit high-throughput materials modeling for a diverse array of technology applications. To alleviate the prohibitive computational expense of high-throughput configurational sampling with density functional theory (DFT), surrogate modeling strategies like cluster expansion are many orders of magnitude more efficient but can be difficult to construct in systems with high compositional complexity. We therefore employ minimal-complexity graph neural network models that accurately predict and can even extrapolate to out-of-train distribution formation energies of DFT-relaxed structures from an ideal (unrelaxed) crystallographic representation. This enables the large-scale sampling necessary for various thermodynamic property predictions that may otherwise be intractable and can be achieved with small training data sets. Two exemplars, optimizing the thermodynamic stability of low-density high-entropy alloys and modulating the plateau pressure of hydrogen in metal alloys, demonstrate the power of this approach, which can be extended to a variety of materials discovery and modeling problems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quantifying uncertainty in the process-structure relationship for Al–Cu solidification

Phase field method (PFM) is a simulation tool to predict microstructural evolution during solidification and is helpful to establish the process-structure relationship for alloys. The robustness of the relationship however is affected by model-form and parameter uncertainties in PFM. In this paper, the uncertainty associated with the thermodynamic and process parameters of PFM is studied and quantified. Surrogate modeling is used to interpolate four quantities of interests (QoIs), including dendritic perimeter, area, primary arm length, and solute segregation, as functions of thermodynamic and process parameters. A sparse grid approach is applied to mitigate the curse-of-dimensionality computational burden in uncertainty quantification. Polynomial chaos expansion is employed to obtain the probability density functions of the QoIs. The effect of parameter uncertainty on the Al–Cu dendritic growth during solidification simulation are investigated. Here, the results show that the dendritic morphology varies significantly with respect to the interface mobility and the initial temperature.

36 MATERIALS SCIENCE↗

Characterizing the acceleration time of laser-driven ion acceleration with data-informed neural networks

Peak ion energy is an important figure-of-merit in short-pulse, laser-driven ion acceleration and is dependent on an associated acceleration time. Standard metrics for these quantities depend on analytical results such as the self-similar fluid model or empirical models based on relatively small experimental and simulation datasets. In this work we attempt to use a data-informed neural network (NN) as a surrogate model for a large ensemble of PIC simulations to investigate an effective acceleration time. We explore the application of a stacked convolutional and recurrent NN architecture for improved regression by incorporating the time dependencies of the data into the training process. Of particular note is how pretraining a network on lower fidelity data, e.g. 1D analytical results, greatly improves the network's ability to learn more complex, higher fidelity data. Finally, the dependency of the acceleration time on various laser and plasma parameters is explored.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Rigorous Data Fusion for Computationally Expensive Simulations

This manuscript comprises the final report for the 1-year, FY19 LDRD project "Rigorous Data Fusion for Computationally Expensive Simulations," wherein an alternative approach to Bayesian calibration was developed based a new sampling technique called VoroSpokes. Vorospokes is a novel quadrature and sampling framework defined with respect to Voronoi tessellations of bounded domains in $R^d$ developed within this project. In this work, we first establish local quadrature and sampling results on convex polytopes using randomly directed rays, or spokes, to approximate the quantities of interest for a specified target function. A theoretical justification for both procedures is provided along with empirical results demonstrating the unbiased convergence in the resulting estimates/samples. The local quadrature and sampling procedures are then extended to global procedures defined on more general domains by applying the local results to the cells of a Voronoi tessellation covering the domain in consideration. We then demonstrate how the proposed global sampling procedure can be used to define a natural framework for adaptively constructing Voronoi Piecewise Surrogate (VPS) approximations based on local error estimates. Finally, we show that the adaptive VPS procedure can be used to form a surrogate model approximation to a specified, potentially unnormalized, density function, and that the global sampling procedure can be used to efficiently draw independent samples from the surrogate density in parallel. The performance of the resulting VoroSpokes sampling framework is assessed on a collection of Bayesian inference problems and is shown to provide highly accurate posterior predictions which align with the results obtained using traditional methods such as Gibbs sampling and random-walk Markov Chain Monte Carlo (MCMC). Importantly, the proposed framework provides a foundation for performing Bayesian inference tasks which is entirely independent from the theory of Markov chains.

97 MATHEMATICS AND COMPUTING↗

Discovering the nature of neutrinos: How nuclear theory will advance this grand endeavor. Final report

Why is there more matter than antimatter in the visible universe? Are neutrinos their own antiparticles? These are some of the most profound questions in science. The detection of a (0vββ) neutrinoless doublebeta decay and the measurement of its half-life is one of the most important experimental endeavors in science because it will answer these questions. Paramount to these measurements are accurate predictions with quantified uncertainties of the 0vββ-decay nuclear transitions, especially for the germanium-76 and xeon-136 nuclei, two candidate materials for building the next generation of DOE funded 0vββ-decay experiments. These predictions will guide the Office of Science’s down selection of experiments as well as aid in determining how much material is needed by these experiments. We studied a specific difficult to assess source of uncertainty that will impact coming microscopic predictions, uncertainty which arises from an incomplete yet systematically improvable model of interactions between nucleons and of nucleons with the other particles involved in decay process, referred to as the theory uncertainty. We employed a surrogate model of the germanium-76 nucleus, and its decay products, just detailed enough to adequately mimic the decaying nucleons need for a reasonable measure of this uncertainty and nothing more, avoiding the immense computational expense required in quantifying uncertainties of the full calculation. We found that microscopic calculations of this process can be expected to achieve relative theory uncertainties around 30%, including an unconstrained contribution that had the potential to spoil microscopic calculations. This results in a nearly order of magnitude on previously estimated uncertainties for this rare decay process.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Uncertainty Quantification of Fatigue Behavior of Rough AM Surfaces and Microstructures to Enable Hydrogen Gas Turbine

Modifying fossil-fueled industrial gas turbines to utilize low or zero-carbon fuels, such as hydrogen or hydrogen-natural gas blends, is a complex endeavor. The successful implementation of this technology hinges on three key design criteria: (1) developing new fuel injectors capable of efficiently burning alternative fuels, (2) ensuring manufacturability to meet cost and time-to-market goals, and (3) achieving component durability in the demanding environment of an operating gas turbine. Additive manufacturing (AM) accelerates product development, yet concerns persist regarding the durability of parts with rough AM surfaces. A fully experimental approach to quantify the fatigue performance of rough AM microstructures is both costly and labor-intensive. To address this, ORNL and Solar Turbines Incorporated (Solar) employed a crystal plasticity finite element (CPFE) model to identify the factors influencing AM surface fatigue behavior. These CPFE findings, combined with targeted experimental data, were used to develop a computationally efficient surrogate model suitable for assessing the lifespan of gas turbine engine components.

08 HYDROGEN↗

Chemical kinetic modeling of component mixtures relevant to gasoline

Detailed kinetic models of pyrolysis and combustion of hydrocarbon fuels are nowadays widely used in the design of internal combustion engines and these models are effectively applied to help meet the increasingly stringent environmental and energetic standards. In previous studies by the combustion community, such models not only contributed to the understanding of pure component combustion, but also provided a deeper insight into the combustion behavior of complex mixtures. One of the major challenges in this field is now the definition and the development of appropriate surrogate models able to mimic the actual features of real fuels. Real fuels are complex mixtures of thousands of hydrocarbon compounds including linear and branched paraffins, naphthenes, olefins and aromatics. Their behavior can be effectively reproduced by simpler fuel surrogates containing a limited number of components. Aside the most commonly used surrogates containing iso-octane and n-heptane only, the so called Primary Reference Fuels (PRF), new mixtures have recently been suggested to extend the reference components in surrogate mixtures to also include alkenes and aromatics. It is generally agreed that, including representative species for all the main classes of hydrocarbons which can be found in real fuels, it is possible to reproduce very effectively in a wide range of operating conditions not just the auto-ignition propensity of gasoline or Diesel fuels, but also their physical properties and their combustion residuals [1]. In this work, the combustion behavior of several components relevant to gasoline surrogate formulation is computationally examined. The attention is focused on the autoignition of iso-octane, hexene and their mixtures. Some important issues relevant to the experimental and modeling investigation of such fuels are discussed with the help of rapid compression machine data and calculations. Following the model validation, the behavior of mixtures is discussed on the basis of computational results.

02 PETROLEUM↗

Modeling a Thermionic Electron Source Using a Physics-Informed Neural Network

We explore the application of Physics-Informed Neural Networks (PINNs) for simulation of thermionic electron sources. This is motivated by the need for quick surrogate models used to simulate such sources within a digital twin of a complete particle accelerator. Here, a PINN was developed on a simplified model of the thermionic source: the planar diode. This model very accurately simulated the system, and performed significantly better than a traditional neural network while also using less training data. We hope to apply this proof-of-concept in motivating the development of a PINN model for a full thermionic electron source at the University of Chicago.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Reduced-dimension Bayesian optimization for model calibration of transient vapor compression cycles

Development and calibration of first-principles dynamic models of vapor compression cycles (VCCs) is of critical importance for applications that include control design and fault detection and diagnostics. Nevertheless, the inherent complexity of models that are represented by large systems of differential–algebraic equations leads to significant challenges for model calibration processes that utilize classical gradient-based methods. Bayesian optimization (BO) is a sample-efficient and gradient-free approach using a probabilistic surrogate model and optimal search over a feasible parameter space. Despite the benefits of BO in reducing computational costs, challenges remain in dealing with a high-dimensional calibration task resulting from a large set of parameters that have significant impacts on system behavior and need to be calibrated simultaneously. This paper presents a reduced-dimension BO framework for calibrating transient VCCs models where the calibration space is projected to a low-dimensional subspace for accelerating convergence of the solution algorithm and consequently reducing the number of transient simulations. The proposed approach was demonstrated via two case studies associated with different VCC applications where 10 parameters were calibrated in each case using laboratory measurements. The reduced-dimension BO framework only required 1 / 8 th of the iterations associated with a standard BO method that deals with high-dimensional calibration parameters for converged solutions and yielded comparable accuracy. Furthermore, both calibrated models revealed significant accuracy improvements compared to uncalibrated models.

Ma, Jiacheng↗