Search NASA⌕ Search

SEARCH · Search NASA

Results for “Surrogate Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Applying uncertainty quantification to multiphase flow computational fluid dynamics

Multiphase computational fluid dynamics plays a major role in design and optimization of fossil fuel based reactors. There is a growing interest in accounting for the influence of uncertainties associated with physical systems to increase the reliability of computational simulation based engineering analysis. The U.S. Department of Energy's National Energy Technology Laboratory (NETL) has recently undertaken an initiative to characterize uncertainties associated with computer simulation of reacting multiphase flows encountered in energy producing systems such as a coal gasifier. The current work presents the preliminary results in applying non-intrusive parametric uncertainty quantification and propagation techniques with NETL's open-source multiphase computational fluid dynamics software MFIX. For this purpose an open-source uncertainty quantification toolkit, PSUADE developed at the Lawrence Livermore National Laboratory (LLNL) has been interfaced with MFIX software. In this study, the sources of uncertainty associated with numerical approximation and model form have been neglected, and only the model input parametric uncertainty with forward propagation has been investigated by constructing a surrogate model based on data-fitted response surface for a multiphase flow demonstration problem. Monte Carlo simulation was employed for forward propagation of the aleatory type input uncertainties. Several insights gained based on the outcome of these simulations are presented such as how inadequate characterization of uncertainties can affect the reliability of the prediction results. Also a global sensitivity study using Sobol' indices was performed to better understand the contribution of input parameters to the variability observed in response variable.

42 ENGINEERING↗

Bayesian Adaptive Polynomial Chaos Expansions

Polynomial chaos expansions (PCEs) are widely used for uncertainty quantification (UQ) tasks, particularly in the applied mathematics community. However, PCE has received comparatively less attention in the statistics literature, and fully Bayesian formulations remain rare—especially with implementations in R. Motivated by the success of adaptive Bayesian machine learning models such as BART, BASS and BPPR, we develop a new fully Bayesian adaptive PCE method with an efficient and accessible R implementation: khaos. Our approach includes a novel proposal distribution that enables data-driven interaction selection and supports a modified g-prior tailored to PCE structure. Through simulation studies and real-world UQ applications, we demonstrate that the Bayesian adaptive PCE provides competitive performance for surrogate modeling, global sensitivity analysis and ordinal regression tasks.

97 MATHEMATICS AND COMPUTING↗

Recent progress on the mesoscale modeling of architected thin-films via phase-field formulations of physical vapor deposition

Thin-film coatings can be found everywhere in modern technological applications due to desirable electrical, mechanical, chemical, and optical properties. These properties directly depend upon the thin-film’s microstructural features, which are themselves influenced by the materials and vapor-deposition processing conditions used for fabrication. As such, understanding processing-microstructure relationships is essential to designing thin-films with optimized properties, and discovering new processing conditions that allow for novel thin-films with multifunctional microstructures. Here, a short review is presented on recent developments that utilize the phase-field method to simultaneously model the vapor-deposition process and corresponding microstructure formation at the mesoscale. Also phase-field-based vapor-deposition models that simulate thin-film growth of immiscible alloy and polycrystalline systems are highlighted in addition to machine-learning-based surrogate models that can facilitate accelerated high-fidelity simulations along with materials design and exploration studies.

36 MATERIALS SCIENCE↗

A deep learning-based workflow for fast prediction of 3D state variables in geological carbon storage: A dimension reduction approach

Deep learning (DL) models are extensively used as surrogate models for high-fidelity simulations of multiphase fluid flow in porous media at large scales, enabling fast forecasts of the spatial–temporal evolution of three-dimensional (3D) state variables in geological carbon storage (GCS). However, training these models in high-dimensional space remains computationally demanding and prone to overfitting because of limited training data. This paper presents a novel workflow to address these challenges by integrating dimension reduction (DR) methods. Here, the proposed workflow employed pre-trained DR models to extract the latent variables of geological models and state variables and utilized the multi-layer perceptron (MLP) for constructing mapping functions between the input and output variables in latent spaces. Subsequently, the pre-trained reconstruction models converted the MLP-predicted latent state variables to their original high-dimensional form. Furthermore, we proposed a novel strategy for the DR and reconstruction of 3D saturation fields to account for the unique data characteristics of sparsity, nonuniformity, and discontinuity. The proposed strategy applied PCA and inverse PCA for 2D average saturation fields and developed a DL-based 3D reconstruction model, leveraging three 2D average saturation fields as input to produce a 3D saturation field as output. The pre-training of DR and reconstruction models and training of MLP models were conducted on 84 Gulf of Mexico (GoM) simulations and evaluated on 12 testing simulations. Each simulation contained 720 monthly time steps, with the first 360 months as the injection period and the rest as the post-injection period. The proposed workflow, incorporating DR and DL models, accurately predicts the normalized 3D pressure fields, achieving mean square error (MSE) of 2.92 × 10 -7 compared to the ground truth obtained from a full-physics simulator. Furthermore, the proposed strategy outperformed PCA and convolutional autoencoder (CAE) models on 3D saturation fields, resulting in minor workflow prediction errors with an MSE of 2.93 × 10 -5 . The results suggest the proposed workflow provides sufficient predictive fidelity across temporal and spatial scales, and enables a speedup of 160 times compared to the full-physics simulator, facilitating improved decision-making and risk assessment for large-scale GCS management in real-time scenarios.

3D reconstruction model↗

Characterizing the elements of Earth's radiative budget: Applying uncertainty quantification to the CESM

Understanding and characterizing sources of uncertainty in climate modeling is an important task. Because of the ever increasing sophistication and resolution of climate modeling it is increasing important to develop uncertainty quantification methods that minimize the computational cost that occurs when these methods are added to climate modeling. This research explores the application of sparse stochastic collocation with polynomial edge detection to characterize portions of the probability space associated with the Earth's radiative budget in the Community Earth System Model (CESM). Specifically, we develop surrogate models with error estimates for a range of acceptable input parameters that predict statistical values of the Earth's radiative budget as derived from the CESM simulation.

42 ENGINEERING↗

Influence of the air-cooled supercritical carbon dioxide recompression cycle design-point on molten salt power tower techno-economic performance

Here, this paper investigates the techno-economic performance of a molten salt power tower integrated with an air-cooled supercritical carbon dioxide recompression cycle. Prior research into the cycle design point showed trade-offs between efficiency, cost, and temperature difference across the heat input, resulting in trade-offs between the design-point generation of the molten salt power tower system and the cost of sensible-heat thermal energy storage. Prior research into cycle off-design showed that colder ambient temperature designs have higher efficiencies on cold days but lower efficiency and capacity degradation on hot days. We present a framework to evaluate how cycle design, cost, and corresponding off-design performance affect the techno-economic performance of the molten salt power tower system. We use a steady-state off-design cycle model assuming fixed shaft speeds, inventory control, and air-cooler fan power control and integrate the cycle model with the molten salt power tower model from the National Renewable Energy Laboratory's System Advisor Model. First, we present a surrogate model that uses a heuristic approach to correct the interpolation when the cycle reaches capacity limitations at ambient temperatures hotter than design. Next, we evaluate how the recompression cycle design-point ambient temperature, air-cooler approach temperature, air-cooler fan power, and recuperator conductance influence cycle and system design metrics. Finally, we complete annual simulations using an hourly "duck curve" pricing schedule and present annual performance metrics to evaluate the cumulative effects of the cycle design parameters and corresponding off-design performance on molten salt power tower techno-economics.

14 SOLAR ENERGY↗

Reliable modeling and prediction of precipitation & radiation for mountainous hydrology

This White Paper focuses on data-driven atmospheric process model emulation and atmospheric process surrogate model development. It proposes leveraging recent AI advances in these approaches to fill in unavoidable observational gaps and enable high-fidelity modeling/predictability of the atmosphere and land-surface interactions in mountainous watersheds. This approach will support studies and predictability of water cycle extremes.

54 ENVIRONMENTAL SCIENCES↗

Resilience Enhancements through Deep Learning Yields

This report documents the Resilience Enhancements through Deep Learning Yields (REDLY) project, a three-year effort to improve electrical grid resilience by developing scalable methods for system operators to protect the grid against threats leading to interrupted service or physical damage. The computational complexity and uncertain nature of current real-world contingency analysis presents significant barriers to automated, real-time monitoring. While there has been a significant push to explore the use of accurate, high-performance machine learning (ML) model surrogates to address this gap, their reliability is unclear when deployed in high-consequence applications such as power grid systems. Contemporary optimization techniques used to validate surrogate performance can exploit ML model prediction errors, which necessitates the verification of worst-case performance for the models.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Characterizing the elements of Earth s radiative budget: Applying uncertainty quantification to the CESM

Understanding and characterizing sources of uncertainty in climate modeling is an important task. Because of the ever increasing sophistication and resolution of climate modeling it is increasing important to develop uncertainty quantification methods that minimize the computational cost that occurs when these methods are added to climate modeling. This research explores the application of sparse stochastic collocation with polynomial edge detection to characterize portions of the probability space associated with the Earth s radiative budget in the Community Earth System Model (CESM). Specifically, we develop surrogate models with error estimates for a range of acceptable input parameters that predict statistical values of the Earth s radiative budget as derived from the CESM simulation. We extend these results in resolution from T31 to T42 and in parameter space increasing the degrees of freedom from two to three.

Archibald, Richard K↗

Development of Supervisory Control System for Thermal Energy Distribution System

The integrated energy system (IES) refers to the combination of nuclear energy generation with other energy sources to enable the efficiency and reliability of power generations. To create technologically viable and economically competitive systems, supervisory control strategies are critical for optimizing performance and ensuring stability across different energy generation, transportation, and utilization. This work focuses on the control strategies for the thermal energy distribution system (TEDS), which is a cornerstone of the Dynamic Energy Transport and Integration Laboratory at Idaho National Laboratory. TEDS currently relies on operators to coordinate across different components to manage energy storage and ensure efficiency. This work demonstrates the use of model predictive control (MPC) with surrogate models in determining optimal setpoints for major TEDS components. The capability of MPC-based supervisory control system is evaluated by autonomously matching the power outputs from a Dymola-based TEDS with target heat demands.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Uncertainty quantification in elastic constants of SiC f /SiC m tubular composites using global sensitivity analysis

Silicon carbide fiber and silicon carbide matrix (SiC f /SiC m ) tubes produced through the chemical vapor infiltration process have become a candidate cladding material in nuclear applications. The performance of this composite is influenced by many variables such as braiding angle, porosity, material properties, etc., which vary over a range of values due to the inherent fluctuations in the manufacturing process. In this study, the variability in elastic constants of SiC f /SiC m composite has been quantified through multiscale finite element (FE) simulations, variable screening, and high-fidelity surrogate modeling. The key variables dominantly affecting the elastic constants of SiC f /SiC m tubes were identified using global sensitivity analysis. A surrogate to the high-fidelity FE-based model was used in Monte Carlo simulations to generate a hundred thousand samples from which the uncertainty in elastic constants was assessed. It turned out that the coefficient of variation was less than 10%.

Materials Science↗

Robust Parameter Design on Dual Stochastic Response Models With Constrained Bayesian Optimization

In engineering system design, minimizing the variations of the quality measurements while guaranteeing their overall quality up to certain levels, namely the robust parameter design (RPD), is crucial. Recent works have dealt with the design of a system whose response-control variables relationship is a deterministic function with a complex shape and function evaluation is expensive. In this work, we propose a Bayesian optimization method for the RPD of stochastic functions. Dual stochastic response models are carefully designed for stochastic functions. The heterogeneous variance of the sample mean is addressed by the predictive mean of the log variance surrogate model in a two-step approach. We establish an acquisition function that favors exploration across the feasible and optimality-improvable regions to effectively and efficiently solve the stochastic constrained optimization problem. Further, the performance of our proposed method is demonstrated by the extensive numerical and case studies. Note to Practitioners-Many manufacturing processes involve undesirable variations, which create variations in the final products. For example, many emerging manufacturing processes, such as nanomanufacturing, involve complex physical and chemical dynamics and transformation, creating variations in the manufacturing output. In such processes, it is crucial to design the manufacturing processes or products so that they have minimum variations in their quality. Meanwhile, it is also important to maintain the overall quality of the designed processes or products. Furthermore, acquiring data from many advanced manufacturing processes is often very costly, especially in the designing stage. In this work, we propose a data-driven method that automatically finds the best setting of manufacturing processes or products with the minimum variations of quality and a given constraint on the average quality satisfied. Our proposed method is used before conducting every experiment; It analyzes the historical data from previous experiments and provides a setting to be used in the next experiment. Our proposed method efficiently utilizes the historical data, and thus finds the best robust setting by conducting only a small number of experiments.

42 ENGINEERING↗

INL Poster - Juan Barrera Salazar

Generation IV nuclear reactors introduce several advantages and benefits in terms of safety and efficiency when compared with their predecessors from previous generation. This is due, among many things, to the use of innovative forms of fuel and coolant, different from the conventional ones used in the last decades. Given that these upcoming designs utilize emerging technologies, the related instrumentation is also in the process of being developed; therefore, it is necessary to establish the sensitivity requirements and the effects of uncertainty on different properties of the components and elements of the reactor designs. This report presents the results of simulations that quantify the impacts of the uncertainties of four thermophysical properties of the refrigerant salt (LiF-BeF2) for the Kairos Power benchmark model (g-FHR) for steady state making use of the Sobol’ method through polynomial chaos surrogate modeling. The properties of the salt to which uncertainty was evaluated were density, dynamic viscosity, thermal conductivity and heat capacity. This study was carried out using the Griffin/Pronghorn multiphysics model under the computational resources of the Idaho National Laboratory (INL) High Performance Computing (HPC). The results indicate a weak dependence of the uncertainty of thermal conductivity on the quantities of core pressure drop and core outlet temperature.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Predicting Atomistic Transitions with Transformers

Accurate knowledge of the atomistic transition pathways in materials and material surfaces is crucial for many material science problems. However, conventional simulation techniques used to find these transitions are extremely computationally intensive. Even with large-scale, accelerated material simulations, the computational cost constrains the applicable domain in practice. Machine learning models, with the potential to learn the complex emergent behaviors governing atomistic transitions as a fast surrogate model, have great promise to predict transitions with a vastly reduced computational cost. Here, we demonstrate how transformers can be trained to predict atomistic transitions in nano-clusters. We show how we evaluate physical validity of the predictions and how a multitude of additional, different microstates can be generated by slightly varying the data provided to the model.

36 MATERIALS SCIENCE↗

Projection pursuit adaptation on polynomial chaos expansions

Here, the present work addresses the issue of accurate stochastic approximations in high-dimensional parametric space using tools from uncertainty quantification (UQ). The basis adaptation method and its accelerated algorithm in polynomial chaos expansions (PCE) were recently proposed to construct low-dimensional approximations adapted to specific quantities of interest (QoI). The present paper addresses one difficulty with these adaptations, namely their reliance on quadrature point sampling, which limits the reusability of potentially expensive samples. Projection pursuit (PP) is a statistical tool to find the “interesting” projections in high-dimensional data and thus bypass the curse-of-dimensionality. In the present work, we combine the fundamental ideas of basis adaptation and projection pursuit regression (PPR) to propose a novel method to simultaneously learn the optimal low-dimensional spaces and PCE representation from given data. While this projection pursuit adaptation (PPA) can be entirely data-driven, the constructed approximation exhibits mean-square convergence to the solution of an underlying governing equation and thus captures the supports and probability distributions associated with the physics constraints. The proposed approach is demonstrated on a borehole problem and a structural dynamics problem, demonstrating the versatility of the method and its ability to discover low-dimensional manifolds with high accuracy with limited data. In addition, the method can learn surrogate models for different quantities of interest while reusing the same data set.

97 MATHEMATICS AND COMPUTING↗

An efficient MILP framework for integrating nonlinear process dynamics and control in optimal production scheduling calculations

The emphasis currently placed on enterprise-wide decision making and optimization has led to an increased need for methods of integrating nonlinear process dynamics and control information in scheduling calculations. The inevitable high dimensionality and nonlinearity of first-principles dynamic process models makes incorporating them in scheduling calculations challenging. In this work, we describe a general framework for deriving data-driven surrogate models of the closed-loop process dynamics. Focusing on Hammerstein–Wiener and finite step response (FSR) model forms, we show that these models can be (exactly) linearized and embedded in production scheduling calculations. The resulting scheduling problems are mixed-integer linear programs with a special structure, which we exploit in a novel and efficient solution strategy. A polymerization reactor case study is utilized to demonstrate the merits of this method. Finally, our framework compares favorably to existing approaches that embed dynamics in scheduling calculations, showing considerable reductions in computational effort.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Neural network ensembles and uncertainty estimation for predictions of inelastic mechanical deformation using a finite element method-neural network approach

The finite element method (FEM) is widely used to simulate a variety of physics phenomena. Approaches that integrate FEM with neural networks (NNs) are typically leveraged as an alternative to conducting expensive FEM simulations in order to reduce the computational cost without significantly sacrificing accuracy. However, these methods can produce biased predictions that deviate from those obtained with FEM, since these hybrid FEM-NN approaches rely on approximations trained using physically relevant quantities. In this work, an uncertainty estimation framework is introduced that leverages ensembles of Bayesian neural networks to produce diverse sets of predictions using a hybrid FEM-NN approach that approximates internal forces on a deforming solid body. The uncertainty estimator developed herein reliably infers upper bounds of bias/variance in the predictions for a wide range of interpolation and extrapolation cases using a three-element FEM-NN model of a bar undergoing plastic deformation. This proposed framework offers a powerful tool for assessing the reliability of physics-based surrogate models by establishing uncertainty estimates for predictions spanning a wide range of possible load cases.

42 ENGINEERING↗

Experimental demonstration of real-time electron temperature profile control in DIII-D

Future tokamak reactor operation will require the ability to maintain a given plasma scenario for extended periods of time. This will necessitate the capability to react to changes in the plasma state and return the plasma to the target scenario; the principal method to achieve this is through feedback control. Thus, it is necessary to develop and test feedback controllers for the plasma profiles that define a target scenario. In this work, a feedback controller for the electron temperature (Te) profile is tested experimentally in DIII-D. This experiment relied on the ability to ascertain the electron temperature profile in real time, which was achieved using an observer algorithm. The observer relies on both diagnostic data and a predictive model of the electron temperature profile evolution; this predictive model includes contributions from neural network surrogate models. Because of these dependencies, a number of capabilities needed to be added to the real-time PCS for DIII-D in order to support the Te profile control experiment. The neural network surrogates needed to be integrated into the PCS to be called in real time. An observer algorithm for the Te profile needed to be added and connected to the Thomson scattering system to allow access to the current state of the profile in real time. When tested, the observer was shown to produce Te profiles that are consistent with the shape of the Thomson scattering data while rejecting much of the noise in the diagnostic data. Finally, the controller itself was tested in real time. This experiment showed that the controller is capable of tracking the electron temperature target at locations across the spatial profile.

Morosohk, Shira [Oak Ridge Associated Universities↗