Search NASA⌕ Search

SEARCH · Search NASA

Results for “multi-fidelity methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Multi Model Monte Carlo with Python (MXMCPy)

Multi Model Monte Carlo with Python (\mxmc {}) is a software package developed as a general capability for computing the statistics of outputs from an expensive, high-fidelity model by leveraging faster, low-fidelity models for speedup. Motivated by uncertainty propagation problems where classical Monte Carlo (MC) simulation is computationally intractable, various multi-model MC approaches have recently emerged that yield unbiased estimators with significantly reduced variance relative to MC for the same cost. These existing methods include multi-level Monte Carlo (MLMC), multi-fidelity Monte Carlo (MFMC), and approximate control variates (ACV). Given a fixed computational budget and a collection of models with varying cost/accuracy, each method seeks a sample allocation strategy across the models that results in an estimator with optimal variance reduction. \mxmc {} is a versatile tool that enables convenient access to many existing multi-model MC approaches within one modular and extensible package. With \mxmc {}, users can easily compare existing methods to determine the best choice for their particular problem, while developers have a basis for implementing and sharing new variance reduction approaches. This report introduces the \mxmc {} software, providing a summary of the problem-solving workflow for users as well as a brief overview of the code layout for developers.

Geoffrey F Bomarito↗

Applications of Nickelate perovskites for neuromorphic computing from electronic structure and Machine Learning

While the limit of Moore's law is presently being reached with current microelectronic technologies, we need to develop new paradigms that overcome this limitation. In that respect, neuromorphic computing is a concept that emulates the neural behavior and response of the human brain, and it has been recognized as a promising alternative approach. In this research project, we will perform multi-fidelity scale bridging to explore the potential use of materials with metal to insulator transition for neuromorphic applications. In particular, rare earth nickelates are promising for such purposes, as the transition in these materials is quite sensitive to a broad set of different external stimuli. Our multi-fidelity approach will bridge the high-fidelity electronic structure calculations with classical potentials. We will bridge dynamical mean field theory with a classical atomistic representation via a deep learning force field. The neural network is trained with energies, charges, and forces obtained by accurate electronic structure theories based on Dynamical Mean Field Theory. The configurational space is generated from known crystal phases, ab initio molecular dynamics with exchange-correlation functionals corrected with the Hubbard model, disordered phases with different concentrations of oxygen vacancies, and nonsymmetrical positions and induced strain by grain interfaces or contact with a substrate. Strategies to train the model with a reduced number of training examples are obtained from active learning methods, and new structures for improving the learning process are generated by using machine learning autoencoders. This classical potential will be validated through a diversity of electronic structure methods and represents an important step to combine the flexibility and accuracy of first-principles with the speed of classical potentials. The generated multi-fidelity surrogate model will be used to understand the role of strain, oxygen vacancies, proton doping, the variation of the crystal phase, substrate effects, vibrational effects as the octahedral rotation, grain boundaries and defect effects on the response of a Metal to Insulator Transition (MIT) in correlated materials. Long time and large-scale simulations will help understand the role of different stimuli to control the hysteresis of the MIT, as it has been experimentally suggested. Selected configurations will be analyzed with higher-level theories to provide an accurate electronic description and to study how the orbitals and charges are rearranged under different conditions.

36 MATERIALS SCIENCE↗

Review of multi-fidelity models

Multi-fidelity models provide a framework for integrating computational models of varying complexity, allowing for accurate predictions while optimizing computational resources. These models are especially beneficial when acquiring high-accuracy data is costly or computationally intensive. This review offers a comprehensive analysis of multi-fidelity models, focusing on their applications in scientific and engineering fields, particularly in optimization and uncertainty quantification. It classifies publications on multi-fidelity modeling according to several criteria, including application area, surrogate model selection, types of fidelity, combination methods and year of publication. The study investigates techniques for combining different fidelity levels, with an emphasis on multi-fidelity surrogate models. Here this work discusses reproducibility, open-sourcing methodologies and benchmarking procedures to promote transparency. The manuscript also includes educational toy problems to enhance understanding. Additionally, this paper outlines best practices for presenting multi-fidelity-related savings in a standardized, succinct and yet thorough manner. The review concludes by examining current trends in multi-fidelity modeling, including emerging techniques, recent advancements, and promising research directions.

42 ENGINEERING↗

Visibility-enhanced model-free deep reinforcement learning algorithm for voltage control in realistic distribution systems using smart inverters

Increasing integration of distributed solar photovoltaic (PV) into distribution networks could result in adverse effects on grid operation. Traditional model-based control algorithms require accurate model information that is difficult to acquire and thus are challenging to implement in practice. Here, this paper proposes a surrogate model-enabled grid visibility scheme to empower deep reinforcement learning (DRL) approach for distribution network voltage regulation using PV inverters with minimal system knowledge. In contrast to existing DRL methods, this paper presents and corroborates the adverse impact of missing load information on DRL performance and, based on this finding, proposes a surrogate model methodology to impute load information utilizing observable data. Additionally, a multi-fidelity neural network is utilized to construct the DRL training environment, chosen for its efficient data utilization and enhanced robustness to data uncertainty. The feasibility and effectiveness of the proposed algorithm are assessed by considering DRL testing across varying degrees of observable load information and diverse training environments on a realistic power system.

14 SOLAR ENERGY↗

Hybrid renewable energy systems

In the pursuit of ecologically sustainable and resilient energy systems, increasingly more attention is being devoted to a diversity of energy generation and storage methods. As the landscape of generation technology gains nuance and complexity, a wide-ranging set of technical questions has emerged, touching on topics that range from control and optimization of hybrid systems to finance and economic viability to multi-fidelity modeling and scientific machine learning. In the context of this special issue, hybrid renewable energy systems are any systems that consider the combined dynamics of more than one form of generation, storage, or grid subsystem. Research endeavors have delved into improving the flexibility of energy systems by utilizing existing resources, introducing novel operational strategies, deploying enhanced renewable forecasts, and exploring emerging technologies. In conclusion, the interconnection among various sectors has garnered heightened attention, not only due to the provision of additional tradable energy products but also for furnishing flexible headroom to system operators.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Variable-Complexity Multidisciplinary Optimization on Parallel Computers

This report covers work conducted under grant NAG1-1562 for the NASA High Performance Computing and Communications Program (HPCCP) from December 7, 1993, to December 31, 1997. The objective of the research was to develop new multidisciplinary design optimization (MDO) techniques which exploit parallel computing to reduce the computational burden of aircraft MDO. The design of the High-Speed Civil Transport (HSCT) air-craft was selected as a test case to demonstrate the utility of our MDO methods. The three major tasks of this research grant included: development of parallel multipoint approximation methods for the aerodynamic design of the HSCT, use of parallel multipoint approximation methods for structural optimization of the HSCT, mathematical and algorithmic development including support in the integration of parallel computation for items (1) and (2). These tasks have been accomplished with the development of a response surface methodology that incorporates multi-fidelity models. For the aerodynamic design we were able to optimize with up to 20 design variables using hundreds of expensive Euler analyses together with thousands of inexpensive linear theory simulations. We have thereby demonstrated the application of CFD to a large aerodynamic design problem. For the predicting structural weight we were able to combine hundreds of structural optimizations of refined finite element models with thousands of optimizations based on coarse models. Computations have been carried out on the Intel Paragon with up to 128 nodes. The parallel computation allowed us to perform combined aerodynamic-structural optimization using state of the art models of a complex aircraft configurations.

Grossman, Bernard↗

Multi-fidelity learning for interatomic potentials: low-level forces and high-level energies are all you need

The promise of machine learning interatomic potentials (MLIPs) has led to an abundance of public quantum mechanical (QM) training datasets. The quality of an MLIP is directly limited by the accuracy of the energies and atomic forces in the training dataset. Unfortunately, most of these datasets are computed with relatively low-accuracy QM methods, e.g. density functional theory with a moderate basis set. Due to the increased computational cost of more accurate QM methods, e.g. coupled-cluster theory with a complete basis set (CBS) extrapolation, most high-accuracy datasets are much smaller and often do not contain atomic forces. The lack of high-accuracy atomic forces is quite troubling, as training with force data greatly improves the stability and quality of the MLIP compared to training to energy alone. Because most datasets are computed with a unique level of theory, traditional single-fidelity (SF) learning is not capable of leveraging the vast amounts of published QM data. In this study, we apply multi-fidelity learning (MFL) to train an MLIP to multiple QM datasets of different levels of accuracy, i.e. levels of fidelity. Specifically, we perform three test cases to demonstrate that MFL with both low-level forces and high-level energies yields an extremely accurate MLIP—far more accurate than a SF MLIP trained solely to high-level energies and almost as accurate as a SF MLIP trained directly to high-level energies and forces. Therefore, MFL greatly alleviates the need for generating large and expensive datasets containing high-accuracy atomic forces and allows for more effective training to existing high-accuracy energy-only datasets. Indeed, low-accuracy atomic forces and high-accuracy energies are all that are needed to achieve a high-accuracy MLIP with MFL.

36 MATERIALS SCIENCE↗

Robust Conceptual Design of Transonic Airfoils

This paper describes an integrated, multi-fidelity analysis and heuristic design approach that can be used to derive initial airfoil designs for transonic flight. If successful, the final result is a geometry that can be expected to produce reasonable aerodynamic performance when used with higher order analysis methods. A key aspect of the methodology is the use of a “sonic-plateau” pressure distribution as the target distribution for inverse design. The sonic- plateau distribution is easily parameterized and has the advantage of automatically resulting in a smooth airfoil shape without any discontinuities built into the surface due to the presence of a shock in the target pressure distribution. Inverse design is performed on each airfoil using a parametrically defined pressure distribution at a reduced lift coefficient and Mach number from the design condition. The methodology is demonstrated by designing an airfoil at 38% of the wing semispan for a 737-200-like aircraft. The demonstration problem shows that the methodology is able to achieve rapid and robust convergence to the solution. The calculated designed airfoil was found to be sufficiently higher than Mach number, and the maximum thickness was close to the targeted value.

Olson, Erik D.↗

Progress Toward Efficient Laminar Flow Analysis and Design

A multi-fidelity system of computer codes for the analysis and design of vehicles having extensive areas of laminar flow is under development at the NASA Langley Research Center. The overall approach consists of the loose coupling of a flow solver, a transition prediction method and a design module using shell scripts, along with interface modules to prepare the input for each method. This approach allows the user to select the flow solver and transition prediction module, as well as run mode for each code, based on the fidelity most compatible with the problem and available resources. The design module can be any method that designs to a specified target pressure distribution. In addition to the interface modules, two new components have been developed: 1) an efficient, empirical transition prediction module (MATTC) that provides n-factor growth distributions without requiring boundary layer information; and 2) an automated target pressure generation code (ATPG) that develops a target pressure distribution that meets a variety of flow and geometry constraints. The ATPG code also includes empirical estimates of several drag components to allow the optimization of the target pressure distribution. The current system has been developed for the design of subsonic and transonic airfoils and wings, but may be extendable to other speed ranges and components. Several analysis and design examples are included to demonstrate the current capabilities of the system.

Campbell, Richard L.↗

Review of recent activities with MOOSE, an open-source finite element & finite volume multi-fidelity simulation framework

Modeling and simulation are an increasing part of engineering. This is undoubtedly driven by the high costs of constructing experimental facilities, but also enabled by the exponential increase in computing powers over the last decades, which allows computational models to be closer than ever to reality. One of the main drivers for the development of MOOSE is supporting advanced nuclear reactor simulations. A challenging aspect of modeling advanced nuclear reactors is the plurality of physics involved, including neutronics, thermal hydraulics and fuel performance. These physics are all coupled to some extent and are generally solved in a sequential but iterative fashion. The United States (U.S.) national laboratories have been developing MOOSE, an open source multiphysics framework since its inception at the Idaho National Laboratory (INL) in 2008. This framework enables seamless coupling of multiphysics simulations and facilitates the implementation of new physics and material governing laws. It is continuously expanded with novel numerical methods and new pre-implemented physics module. Numerous applications, developed within the Department of Energy (DOE) laboratories, academia, and industry, including outside of nuclear engineering, have been developed to study specialized physics problems. International collaborations are welcome on this open-source modeling and simulation project.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

PINN surrogate of Li-ion battery models for parameter inference, Part II: Regularization and application of the pseudo-2D model

Bayesian parameter inference is useful to improve Li-ion battery diagnostics and can help formulate battery aging models. However, it is computationally intensive and cannot be easily repeated for multiple cycles, multiple operating conditions, or multiple replicate cells. To reduce the computational cost of Bayesian calibration, numerical solvers for physics-based models can be replaced with faster surrogates. A physics-informed neural network (PINN) is developed as a surrogate for the pseudo-2D (P2D) battery model calibration. For the P2D surrogate, additional training regularization was needed as compared to the PINN single-particle model (SPM) developed in Part I. Both the PINN SPM and P2D surrogate models are exercised for parameter inference and compared to data obtained from a direct numerical solution of the governing equations. A parameter inference study highlights the ability to use these PINNs to calibrate scaling parameters for the cathode Li diffusion and the anode exchange current density. By realizing computational speed-ups of ~2250x for the P2D model, as compared to using standard integrating methods, the PINN surrogates enable rapid state-of-health diagnostics. Finally, in the low-data availability scenario, the testing error was estimated to ~2 mV for the SPM surrogate and ~10 mV for the P2D surrogate which could be mitigated with additional data.

25 ENERGY STORAGE↗

Explainable multi-fidelity Bayesian neural network for distribution system state estimation

Distribution System State Estimation (DSSE) is frequently constrained by limited real-time measurements, the uncertainties introduced by distributed energy resources, and the presence of bad data. To address them, this paper proposes an enhanced Multi-Fidelity Bayesian Neural Network (MFBNN) DSSE approach. A low-fidelity layer based on a Deep Neural Network (DNN) is first pre-trained on pseudo-measurement data to learn fundamental state features. Subsequently, a high-fidelity Bayesian Neural Network (BNN) layer leverages limited but high-quality real-time measurements to refine these features, thereby achieving accurate DSSE. Additionally, the deep SHapley Additive exPlanation (SHAP) is developed to quantify the influence of measurement data on DSSE through dual perspectives of global feature importance and local nodal contributions, establishing a hierarchical explainability framework for machine learning-based DSSE. Comparative studies conducted on the IEEE 13-bus system and a real-world 2135-node system from Dominion Energy demonstrate that the proposed method excels in estimation accuracy, even under situations of high noise levels, bad data, and missing data. Further comparisons with Weighted Least Squares (WLS) and other machine learning-based DSSE approaches verify that the proposed framework offers higher accuracy, improved interpretability, and enhanced robustness.

Bad data↗

Multi-task Parallelism for Robust Pre-training of Graph Foundation Models on Multi-source, Multi-fidelity Atomistic Modeling Data

Graph foundation models using graph neural networks promise sustainable, efficient atomistic modeling. To tackle challenges of processing multi-source, multi-fidelity data during pre-training, recent studies employ multi-task learning, in which shared message passing layers initially process input atomistic structures regardless of source, then route them to multiple decoding heads that predict data-specific outputs. This approach stabilizes pre-training and enhances a model’s transferability to unexplored chemical regions. Preliminary results on approximately four million structures are encouraging, yet questions remain about generalizability to larger, more diverse datasets and scalability on supercomputers. We propose a multi-task parallelism method that distributes each head across computing resources with GPU acceleration. Implemented in the open-source HydraGNN architecture, our method was trained on over 24 million structures from five datasets and tested on the Perlmutter, Aurora, and Frontier supercomputers, demonstrating efficient scaling on all three highly heterogeneous super-computing architectures.

Lupo Pasini, Massimiliano [ORNL] (ORCID:0000000249↗

Learning Latent Representations to Bridge Coarse-Grained and Atomistic Resolutions in Polymer Simulations

We present a machine-learning-based framework for learning reduced-order representations of polymer chain conformations across coarse-grained (CG) and united-atom (UA) fidelities. By employing linear singular value decomposition and nonlinear autoencoders, we compress high-dimensional polymer configurations into latent spaces with minimal loss of structural accuracy. Crucially, we demonstrate a near-perfect linear mapping between CG and UA latent spaces, enabling an efficient super-resolution back-mapping procedure that reconstructs high-fidelity UA configurations from CG simulations. While minor structural inaccuracies occur, they are effectively corrected through a brief molecular dynamics relaxation, forming a practical hybrid machine learning−physics scheme. This approach establishes the key structural prerequisites for accelerated polymer dynamics simulations: a compact and accurate latent encoding of polymer chain conformations and a validated multi-fidelity mapping that permits reconstruction of UA structures from CG configurations. The extension of this framework to explicit time evolution within the latent space, enabling dynamics to be propagated at CG fidelity and decoded to UA resolution only when required, represents a natural and well-motivated direction for future work.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Initial Integration of Noise Prediction Tools for Acoustic Scattering Effects

This effort provides an initial glimpse at NASA capabilities available in predicting the scattering of fan noise from a non-conventional aircraft configuration. The Aircraft NOise Prediction Program, Fast Scattering Code, and the Rotorcraft Noise Model were coupled to provide increased fidelity models of scattering effects on engine fan noise sources. The integration of these codes led to the identification of several keys issues entailed in applying such multi-fidelity approaches. In particular, for prediction at noise certification points, the inclusion of distributed sources leads to complications with the source semi-sphere approach. Computational resource requirements limit the use of the higher fidelity scattering code to predict radiated sound pressure levels for full scale configurations at relevant frequencies. And, the ability to more accurately represent complex shielding surfaces in current lower fidelity models is necessary for general application to scattering predictions. This initial step in determining the potential benefits/costs of these new methods over the existing capabilities illustrates a number of the issues that must be addressed in the development of next generation aircraft system noise prediction tools.

Nark, Douglas M.↗

TPSAS-NF1676L-14336-DND

Problem Statement: Develop robust CFD-based methods for rapid design and analysis of supersonic cruise aircraft that are highly efficient, and have a low sonic boom. What is our approach? - Advanced Efficient Analysis / Design Methods - Develop computational algorithms and techniques for rapid high fidelity analysis of supersonic fluid flow phenomena, which will also contribute to multi-fidelity analysis / design tools. - Experimental Validation - Validate concepts for design optimization of both high aerodynamic efficiency and low sonic boom.

Linda Bangert↗

Multi-Fidelity CFD Simulation of the Multirotor Test Bed

The high-fidelity and reduced order CFD method's validation and analysis are presented for the Multirotor Test Bed. The reduced-order method uses a rotor-disk model in the OVERFLOW CFD code and is an important aspect of this study. A rotor-trim option loosely coupling the Comprehensive code CAMRAD II with the OVERFLOW CFD code is included in the simulation that captures rotor blade aerodynamics, blade and rotor performance, rotor-rotor, and rotor-body interactions. Detailed comparison and validation were performed for both higher-fidelity full rotor unsteady flows and reduced-order rotor-disk methods. The tunnel geometry is included in the detailed computational effort. Computations of the low-Reynolds number flows were performed for a different number of in-plane rotors as well as for a single rotor modeled inside the tunnel.

ARMD↗

Uncertainty Reduction With Multi-Model Monte Carlo for Crystal Plasticity Simulations of Additively Manufactured Metals

In this work, multi-model Monte Carlo estimators are developed to reduce uncertainty in quantities of interest (QoIs) extracted from crystal plasticity simulations of additively manufactured (AM) metals. A significant concern in AM parts is uncertainty in mechanical properties caused in part by complex microstructures that arise from the AM process. Quantifying uncertainty in microstructure-sensitive behavior using experiments alone is costly, especially when mechanical allowables must be established. Quantitative relationships among microstructure, micromechanical metrics like slip accumulation, crack initiation, and failure are also difficult to capture with limited experiments. Crystal plasticity material models instead enable computational prediction of micromechanical stress and strain fields given a discretized microstructure. However, high-fidelity finely discretized crystal plasticity simulations are computationally expensive, while lower-fidelity models are less accurate and generally biased, making uncertainty quantification and reduction computationally difficult as well. Multi-model Monte Carlo methods leverage correlations between high- and low-fidelity models to produce unbiased estimators for QoIs with reduced uncertainty relative to standard Monte Carlo. Crystal plasticity QoIs considered in this work include yield strength and the mean and extreme values of micromechanical fields that are relevant to crack initiation. Multi-model Monte Carlo estimators are developed for each individual QoI and several groups of QoIs. The results of this work establish relationships among model correlations, sample allocation, and uncertainty reduction for different combinations of QoIs and demonstrate a trend of less uncertainty reduction as QoIs become more sensitive to local microstructure. Limitations from using pilot samples to estimate model covariances and train low-fidelity models are also addressed. The uncertainty reduction achieved by multi-model Monte Carlo is an important step toward using computational mechanics models to predict microstructure-sensitive crack initiation and failure in AM parts.

uncertainty quantification↗