Search NASA⌕ Search

SEARCH · Search NASA

Results for “multifidelity optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Physics-Informed CoKriging: A Gaussian-Process-Regression-Based Multifidelity Method for Data-Model Convergence

In this work, we propose a new Gaussian process regression (GPR)-based multifidelity method: physics-informed CoKriging (CoPhIK). In CoKriging-based multifidelity methods, the quantities of interest are modeled as linear combinations of multiple parameterized stationary Gaussian processes (GPs), and the hyperparameters of these GPs are estimated from data via optimization. In CoPhIK, we construct a GP representing low-fidelity data using physics-informed Kriging (PhIK), and model the discrepancy between low- and highfidelity data using a parameterized GP with hyperparameters identified via optimization. Our approach reduces the cost of optimization for inferring hyperparameters by incorporating partial physical knowledge. We prove that the physical constraints in the form of deterministic linear operators are satisfied up to an error bound. Furthermore, we combine CoPhIK with a greedy active learning algorithm for guiding the selection of additional observation locations. The eciency and accuracy of CoPhIK are demonstrated for reconstructing the partially observed modified Branin function, reconstructing the sparsely observed state of a steady state heat transport problem, and learning a conservative tracer distribution from sparse tracer concentration measurements.

Yang, Xiu↗

Linear Regression Based Multi-fidelity Surrogate for Disturbance Amplification in Multi-phase Explosion

When simulations are very expensive and many are required, as for optimization or uncertainty quantification, a way to reduce cost is using surrogates. With multiple simulations to predict the quantity of interest, some being very expensive and accurate (high-fidelity simulations) and others cheaper but less accurate (low-fidelity simulations), it may be worthwhile to use multifidelity surrogates (MFSs). Moreover, if we can afford just a few high-fidelity simulations or experiments, MFS becomes necessary. Co-Kriging, which is probably the most popular MFS, replaces both low-fidelity and high-fidelity simulations by a single MFS. A recently proposed linear regression–based MFS (LR-MFS) offers the option to correct the LF simulations instead of correcting the LF surrogate in the MFS. When the low-fidelity simulation is cheap enough for use in an application, such as optimization, this may be an attractive option. Here, we explore the performance of LR-MFS using exact and surrogate-replaced low-fidelity simulations. The concern studied is a cylindrical dispersal of 100-μ m-diameter solid particles after detonation and the quantity of interest is a measure of the amplification of the departure from axisymmetry. We find very substantial accuracy improvements for this problem using the LR-MFS with exact low-fidelity simulations. Inspired by these results, we also compare the performance of co-Kriging to the use of Kriging to correct exact low-fidelity simulations and find a similar accuracy improvement when simulations are directly used. For this problem, further improvements in accuracy are achievable by taking advantage of inherent parametric symmetries. These findings may alert users of MFSs to the possible advantages of using exact low-fidelity simulations when this is affordable.

42 ENGINEERING↗

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗

Release on the Virtual Test Bed of a Molten Salt Reactor Experiment SAM-Pronghorn Coupled Model using the Domain Overlapping Approach

The nuclear industry is taking leaps in innovations with companies seeking a sustainable energy future through advanced nuclear reactors. The Department of Energy (DOE)’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program seeks to substantiate and bolster the deployment of advanced reactors through flexible multifidelity, multiphysics simulations of advanced nuclear reactors. Applications like SAM for one-dimensional systems thermalhydraulics, and Pronghorn for multidimensional coarse mesh thermal-hydraulics, are geared to support innovations in industry by facilitating design, optimization, and licensing of advanced nuclear reactors. Coupling systems thermal-hydraulics and computational fluid dynamics codes can be difficult as the pressure coupling converges slowly; however, it is important to obtain the desired accuracy in each part of the primary loop. The authors of this model created an Overlapping-Domain Coupling (ODC) approach to coupling SAM and Pronghorn. Leveraging this coupling technique, a Molten Salt Reactor Experiment (MSRE) model was developed and released to the NEAMS/National Reactor Innovation Center (NRIC) Virtual Test Bed (VTB). The MSRE was chosen to be modeled because of the wealth of experimental data available and because of the strong physics coupling between the core and primary circuit. This paper contextualizes the history of the MSRE, describes the thermal hydraulics models used, and detail the implementation of multidimensional thermal-hydraulics and system codes based on the ODC method for the MSRE model. Finally, this paper presents how other modelers could apply the SAM Pronghorn ODC for other advanced reactor models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Screening and Discovery of Metal Compound Active Sites for Strong and Selective Adsorption of N 2 in Air

Photocatalytic nitrogen fixation has the potential to provide a greener route for producing nitrogen-based fertilizers under ambient conditions. Computational screening is a promising route to discover new materials for the nitrogen fixation process, but requires identifying “descriptors” that can be efficiently computed. In this work, we argue that selectivity toward the adsorption of molecular nitrogen and oxygen can act as a key descriptor. A catalyst that can selectively adsorb nitrogen and resist poisoning of oxygen and other molecules present in air has the potential to facilitate the nitrogen fixation process under ambient conditions. Here we provide a framework for active site screening based on multifidelity density functional theory (DFT) calculations for a range of metal oxides, oxyborides, and oxyphosphides. The screening methodology consists of initial low-fidelity fixed geometry calculations and a second screening in which more expensive geometry optimizations were performed. The approach identifies promising active sites on several TiO 2 polymorph surfaces and a VBO 4 surface, and the full nitrogen reduction pathway is studied with the BEEF-vdW and HSE06 functionals on two active sites. The findings suggest that metastable TiO 2 polymorphs may play a role in photocatalytic nitrogen fixation, and that VBO 4 may be an interesting material for further studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

nPINNs: Nonlocal physics-informed neural networks for a parametrized nonlocal universal Laplacian operator. Algorithms and applications

Physics-informed neural networks (PINNs) are effective in solving inverse problems based on differential and integro-differential equations with sparse, noisy, unstructured, and multifidelity data. PINNs incorporate all available information, including governing equations (reflecting physical laws), initial-boundary conditions, and observations of quantities of interest, into a loss function to be minimized, thus recasting the original problem into an optimization problem. In this paper, we extend PINNs to parameter and function inference for integral equations such as nonlocal Poisson and nonlocal turbulence models, and we refer to them as nonlocal PINNs (nPINNs). The contribution of the paper is three-fold. First, we propose a unified nonlocal Laplace operator, which converges to the classical Laplacian as one of the operator parameters, the nonlocal interaction radius $\delta$ goes to zero, and to the fractional Laplacian as $\delta$ goes to infinity. This universal operator forms a super-set of classical Laplacian and fractional Laplacian operators and, thus, has the potential to fit a broad spectrum of data sets. We also provide theoretical convergence rates with respect to $\delta$ and verify them via numerical experiments. Second, we use nPINNs to estimate the two parameters, $\delta$ and $\alpha$, characterizing the kernel of the unified operator. The strong non-convexity of the loss function yielding multiple (good) local minima reveals the occurrence of the operator mimicking phenomenon, that is, different pairs of estimated parameters could produce multiple solutions of comparable accuracy. Third, we propose another nonlocal operator with spatially variable order $\alpha(y)$, which is more suitable for modeling turbulent Couette flow. Our results show that nPINNs can jointly infer this function as well as $\delta$. More importantly, these parameters exhibit a universal behavior with respect to the Reynolds number, a finding that contributes to our understanding of nonlocal interactions in wall-bounded turbulence.

97 MATHEMATICS AND COMPUTING↗

nPINNs: nonlocal Physics-Informed Neural Networks for a parametrized nonlocal universal Laplacian operator. Algorithms and Applications

Physics-informed neural networks (PINNs) are effective in solving inverse problems based on differential and integro-differential equations with sparse, noisy, unstructured, and multifidelity data. PINNs incorporate all available information, including governing equations (reflecting physical laws), initial-boundary conditions, and observations of quantities of interest, into a loss function to be minimized, thus recasting the original problem into an optimization problem. In this paper, we extend PINNs to parameter and function inference for integral equations such as nonlocal Poisson and nonlocal turbulence models, and we refer to them as nonlocal PINNs (nPINNs). The contribution of the paper is three-fold. First, we propose a unified nonlocal Laplace operator, which converges to the classical Laplacian as one of the operator parameters, the nonlocal interaction radius δ goes to zero, and to the fractional Laplacian as δ goes to infinity. This universal operator forms a super-set of classical Laplacian and fractional Laplacian operators and, thus, has the potential to fit a broad spectrum of data sets. We provide theoretical convergence rates with respect to δ and verify them via numerical experiments. Second, we use nPINNs to estimate the two parameters, δ and α, characterizing the kernel of the unified operator. The strong non-convexity of the loss function yielding multiple (good) local minima reveals the occurrence of the operator mimicking phenomenon, that is, different pairs of estimated parameters could produce multiple solutions of comparable accuracy. Third, we propose another nonlocal operator with spatially variable order α(γ), which is more suitable for modeling turbulent Couette flow. Our results show that nPINNs can jointly infer this function as well as δ. More importantly, these parameters exhibit a universal behavior with respect to the Reynolds number, a finding that contributes to our understanding of nonlocal interactions in wall-bounded turbulence.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Release on the Virtual Test Bed of an MSRE thermal hydraulics model

The nuclear industry is taking leaps in innovations with companies seeking a sustainable energy future through advanced nuclear reactors. The \gls{DOE}’s \gls{neams} program seeks to substantiate and bolster the deployment of advanced reactors through flexible multifidelity, multiphysics simulations of advanced nuclear reactors. Applications like SAM for one-dimensional systems thermal-hydraulics, and Pronghorn for multidimensional coarse mesh thermal-hydraulics, are geared to support innovations in industry by facilitating design, optimization, and licensing of advanced nuclear reactors. Coupling systems thermal-hydraulics and computational fluid dynamics codes can be difficult as the pressure coupling converges slowly; however, it is important to obtain the desired accuracy in each part of the primary loop. The authors of this model created an \gls{odc}~\cite{Mau23} approach to coupling SAM and Pronghorn. Leveraging this coupling technique, a \gls{msre} model was developed and released to the \gls{neams}/\gls{nric} \gls{vtb}. The \gls{msre} was chosen to be modeled because of the wealth of experimental data available and because of the strong physics coupling between the core and primary circuit \cite{doi:10.13182/NT8-2-118}. This document contextualizes the history of the \gls{msre}, describes the thermal hydraulics models used, and detail the implementation of multidimensional thermal-hydraulics and system codes based on the \gls{odc} method~\cite{Penn} for the \gls{msre} model. Finally, this document presents how other modelers could apply the SAM-Pronghorn \gls{odc} for other advanced reactor models. Current item is the set of slides for ANS Winter 23. The release of the model and the ANS summary have already been approved

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Release on the Virtual Test Bed of an MSRE thermal hydraulics model

The nuclear industry is taking leaps in innovations with companies seeking a sustainable energy future through advanced nuclear reactors. The \gls{DOE}’s \gls{neams} program seeks to substantiate and bolster the deployment of advanced reactors through flexible multifidelity, multiphysics simulations of advanced nuclear reactors. Applications like SAM for one-dimensional systems thermal-hydraulics, and Pronghorn for multidimensional coarse mesh thermal-hydraulics, are geared to support innovations in industry by facilitating design, optimization, and licensing of advanced nuclear reactors. Coupling systems thermal-hydraulics and computational fluid dynamics codes can be difficult as the pressure coupling converges slowly; however, it is important to obtain the desired accuracy in each part of the primary loop. The authors of this model created an \gls{odc}~\cite{Mau23} approach to coupling SAM and Pronghorn. Leveraging this coupling technique, a \gls{msre} model was developed and released to the \gls{neams}/\gls{nric} \gls{vtb}. The \gls{msre} was chosen to be modeled because of the wealth of experimental data available and because of the strong physics coupling between the core and primary circuit \cite{doi:10.13182/NT8-2-118}. This document contextualizes the history of the \gls{msre}, describes the thermal hydraulics models used, and detail the implementation of multidimensional thermal-hydraulics and system codes based on the \gls{odc} method~\cite{Penn} for the \gls{msre} model. Finally, this document presents how other modelers could apply the SAM-Pronghorn \gls{odc} for other advanced reactor models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

HydroChrono: An Open-Source Hydrodynamics Package for Project Chrono

In this paper we present the development and verification of HydroChrono, a hydrodynamics package for the Project Chrono physics engine. This package includes the implementation of hydrodynamics equations, the added mass for multibody systems, the development of I/O functions as well as a Python API, and comparison against standard reference cases and other existing tools. HydroChrono provides a flexible, fully open-source solution for simulating wave energy converters (WECs), floating offshore wind turbines (FOWTs) platforms, and other hydrodynamic systems. Here we show, via comparisons with existing tools for benchmark verification cases, that HydroChrono accurately models hydrodynamic forces - making it a useful tool for the design and optimization of these systems. Additionally, the integration of HydroChrono with Project Chrono offers access to finite element modeling capabilities and high-fidelity modelling - with Chrono's existing coupling to CFD and SPH codes. This provides numerical modelers with a multifidelity simulation framework for designing and validating these systems. The development of HydroChrono provides a new, open-source solution for simulating hydrodynamic systems. Its compatibility with other simulation tools enables a more streamlined and efficient design process, advancing the field and providing new opportunities for innovation in this area.

BEM↗

Improving Multi-Model Trajectory Simulation Estimators using Model Selection and Tuning

Multi-model Monte Carlo methods have been demonstrated to be an efficient and accurate alternative to standard Monte Carlo (MC) in the model-based propagation of uncertainty in entry, descent, and landing (EDL) applications. These multi-model MC methods fuse predictions from low-fidelity models with the high-fidelity EDL model of interest to produce unbiased statistics with a fraction of the computational cost. The accuracy and efficiency of the multi-model MC methods are dependent upon the magnitude of correlations of the low-fidelity models with the high-fidelity model, but also upon the correlation amongst the low-fidelity models, and their relative computational cost. Because of this layer of complexity, the question of how to optimally select the set of low-fidelity models has remained open. In this work, methods for optimal model construction and tuning are investigated as a means to increase the speed and precision of trajectory simulation for EDL. Specifically, the focus is on the inclusion of low-fidelity model tuning within the sample allocation optimization that accompanies multi-model MC methods. Preliminary results indicate that low-fidelity model tuning can significantly improve efficiency and precision of trajectory simulations and provide an increased edge to multi-model MC methods when compared to standard MC. The challenges and potential benefits to exploring a fully iterative and comprehensive optimization strategy in future work are highlighted.

uncertainty quantification↗

Analysis of the Challenges in Developing Sample-Based Multi-fidelity Estimators for Non-deterministic Models

Multifidelity (MF) uncertainty quantification (UQ) seeks to leverage and fuse information from a collection of models to achieve greater statistical accuracy with respect to a single-fidelity counterpart, while maintaining an efficient use of computational resources. Despite many recent advancements in MF UQ, several challenges remain and these often limit its practical impact in certain application areas. In this manuscript, we focus on the challenges introduced by nondeterministic models to sampling MF UQ estimators. Nondeterministic models produce different responses for the same inputs, which means their outputs are effectively noisy. MF UQ is complicated by this noise since many state-of-the-art approaches rely on statistics, e.g., the correlation among models, to optimally fuse information and allocate computational resources. Here, we demonstrate how the statistics of the quantities of interest, which impact the design, effectiveness, and use of existing MF UQ techniques, change as functions of the noise. With this in hand, we extend the unifying approximate control variate framework to account for nondeterminism, providing for the first time a rigorous means of comparing the effect of nondeterminism on different multifidelity estimators and analyzing their performance with respect to one another. Numerical examples are presented throughout the manuscript to illustrate and discuss the consequences of the presented theoretical results.

97 MATHEMATICS AND COMPUTING↗

Integration of Multifidelity Multidisciplinary Computer Codes for Design and Analysis of Supersonic Aircraft

This paper documents the development of a conceptual level integrated process for design and analysis of efficient and environmentally acceptable supersonic aircraft. To overcome the technical challenges to achieve this goal, a conceptual design capability which provides users with the ability to examine the integrated solution between all disciplines and facilitates the application of multidiscipline design, analysis, and optimization on a scale greater than previously achieved, is needed. The described capability is both an interactive design environment as well as a high powered optimization system with a unique blend of low, mixed and high-fidelity engineering tools combined together in the software integration framework, ModelCenter. The various modules are described and capabilities of the system are demonstrated. The current limitations and proposed future enhancements are also discussed.

Geiselhart, Karl A.↗

DiaMonD: An Integrated Multifaceted Approach to Mathematics at the Interfaces of Data, Models, and Decisions

The major goal of the project was to invent, analyze, implement, and apply new algorithms to speed up the computational simulation of complex systems in settings in which multiple simulations are needed. The main efforts we undertook are as follows: 1. Develop novel reduced order methods to reduce the costs of simulations, especially in settings (e.g., UQ, inference, optimization and control) for which numerous simulation are needed and also for nonlocal problems (e.g., fractional derivative, anomalous diffusion, nonlocal mechanics) for which lack of sparsity results in more expensive full-order simulation than encountered in partial differential equations settings; rigorous analyses as well as computational tests were carried out, 2. Develop multifidelity methods based on the usage of a variety of models having different fidelities and different costs to accelerate simulations again in settings where numerous simulations are needed or are especially expensive; rigorous analyses as well as computational tests were carried out, 3. Develop ensemble methods to reduced the costs of simulations again in settings where numerous simulations are needed or are especially expensive; rigorous analyses as well as computational tests were carried out, and 4. Analyze a model for Richardson pair dispersion in turbulent flows and develop discretization methods for the efficient and accurate approximations of the solution of the model; rigorous analyses as well as computational tests were carried out.

97 MATHEMATICS AND COMPUTING↗

An efficient Bayesian data-worth analysis using a multilevel Monte Carlo method

Improving the understanding of subsurface systems and thus reducing prediction uncertainty requires collection of data. As the collection of subsurface data is costly, it is important that the data collection scheme is cost-effective. Design of a cost-effective data collection scheme, i.e., data-worth analysis, requires quantifying model parameter, prediction, and both current and potential data uncertainties. Assessment of these uncertainties in large-scale stochastic subsurface hydrological model simulations using standard Monte Carlo (MC) sampling or surrogate modeling is extremely computationally intensive, sometimes even infeasible. In this paper, we propose an efficient Bayesian data-worth analysis using a multilevel Monte Carlo (MLMC) method. Compared to the standard MC that requires a significantly large number of high-fidelity model executions to achieve a prescribed accuracy in estimating expectations, the MLMC can substantially reduce computational costs using multifidelity approximations. Since the Bayesian data-worth analysis involves a great deal of expectation estimation, the cost saving of the MLMC in the assessment can be outstanding. While the proposed MLMC-based data-worth analysis is broadly applicable, we use it for a highly heterogeneous two-phase subsurface flow simulation to select an optimal candidate data set that gives the largest uncertainty reduction in predicting mass flow rates at four production wells. Finally, the choices made by the MLMC estimation are validated by the actual measurements of the potential data, and consistent with the standard MC estimation. But compared to the standard MC, the MLMC greatly reduces the computational costs.

97 MATHEMATICS AND COMPUTING↗

A systems engineering vision for floating offshore wind cost optimization

The U.S. offshore wind resource potential is immense, and often in close proximity to densely-populated coastal load centers. In many U.S. coastal areas, water depths favor the deployment of floating over fixed-bottom offshore wind technology. Floating offshore wind plants have the potential to be cost-competitive with fixed-bottom installations, but because the technology has not yet been deployed at commercial scale, it is not clear when and with what configurations this potential cost parity can be achieved. This article first reviews the state of floating offshore wind technology and deployments to identify key gaps that must be addressed to bring down the overall cost of energy produced. The article then puts forth a long-term vision for a research program and design methodology that may be able to push floating wind plants toward a lower levelized cost of energy than fixed-bottom offshore wind. The method involves a fully integrated systems-engineering and techno-economic design approach to capture the complex interactions between the physics, manufacturing, installation, and operation of floating wind turbines to achieve transformational cost reductions. The approach also envisions multifidelity and uncertainty management strategies to examine the most robust and viable concepts in the design trade-space. To better focus the computational resources, engineering lessons learned from existing offshore wind systems and concept studies are used to develop a set of criteria that can be applied to prefilter candidate technology building blocks that have the greatest cost reduction potential.

17 WIND ENERGY↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

The AEOLUS Center is dedicated to developing a unified optimization-under-uncertainty framework for (1) learning predictive models from data and (2) optimizing experiments, processes, and designs governed by these models, all driven by complex, uncertain energy systems. AEOLUS addressed the critical need for principled, rigorous, scalable, and structure-exploiting capabilities for exploring parameter and decision spaces of complex forward simulation models---the so-called outer loop. This report summarizes the work done under DE-SC0021077 on (1) nonlocal models for solidification problems, (2) a multifidelity method for a nonlocal diffusion model, and (3) multifidelity Monte Carlo methods.

97 MATHEMATICS AND COMPUTING↗

An improved multilevel Monte Carlo method for estimating probability distribution functions in stochastic oil reservoir simulations

In this paper, we develop an improved multilevel Monte Carlo (MLMC) method for estimating cumulative distribution functions (CDFs) of a quantity of interest, coming from numerical approximation of large-scale stochastic subsurface simulations. Compared with Monte Carlo (MC) methods, that require a significantly large number of high-fidelity model executions to achieve a prescribed accuracy when computing statistical expectations, MLMC methods were originally proposed to significantly reduce the computational cost with the use of multifidelity approximations. The improved performance of the MLMC methods depends strongly on the decay of the variance of the integrand as the level increases. However, the main challenge in estimating CDFs is that the integrand is a discontinuous indicator function whose variance decays slowly. To address this difficult task, we approximate the integrand using a smoothing function that accelerates the decay of the variance. In addition, we design a novel a posteriori optimization strategy to calibrate the smoothing function, so as to balance the computational gain and the approximation error. The combined proposed techniques are integrated into a very general and practical algorithm that can be applied to a wide range of subsurface problems for high-dimensional uncertainty quantification, such as a fine-grid oil reservoir model considered in this effort. The numerical results reveal that with the use of the calibrated smoothing function, the improved MLMC technique significantly reduces the computational complexity compared to the standard MC approach. Finally, we discuss several factors that affect the performance of the MLMC method and provide guidance for effective and efficient usage in practice.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗