Search NASA⌕ Search

SEARCH · Search NASA

Results for “machine learning surrogate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Simulating the CMS High Granularity Calorimeter with ML

Detector simulation is a key component of physics analysis and related activities in CMS. In the upcoming High Luminosity LHC era, simulation will be required to use a smaller fraction of computing in order to satisfy resource constraints. At the same time, CMS will be upgraded with the new High Granularity Calorimeter (HGCal), which requires significantly more resources to simulate than the existing CMS calorimeters. This computing challenge motivates the use of generative machine learning models as surrogates to replace full physics-based simulation. We study the application of state-of-the-art diffusion models to simulate particle showers in the CMS HGCal. We will discuss methods to overcome the challenges posed by the high-dimensional, irregular geometry of the HGCal. The quality of the showers produced by the diffusion model will be assessed by comparison to the full GEANT4-based simulation. The increase in simulation throughput will be quantified and methods to accelerate the diffusion model inference will also be discussed.

Amram, Oz↗
DOE OSTI2025

Implementation of disruptive designs for gas turbine components using direct energy deposition additive manufacturing

This research aims to develop a framework for establishing the correlation between in-situ monitoring data, process parameters, and microstructure evolution in blown-powder laser-directed energy deposition (DED) additive manufacturing (AM). To achieve this, a comprehensive manufacturing framework has been developed, spanning from in-situ data acquisition, melt-pool simulation, microstructure modeling, and statistical microstructure quantification. A machine learning-based surrogate model is constructed to predict melt pool geometry directly from in-situ coaxial camera data. The surrogate model is trained using outputs from a high-fidelity melt pool simulation, which provides accurate melt pool dimension data under varying process conditions. The predicted melt pool geometry is then used as input to a microstructure model to predict microstructural features. To rigorously compare and analyze microstructures, the project introduces statistical metrics that quantify differences based on key features such as morphology and texture. Microstructures are represented using advanced statistical descriptors including angular chord length distribution, two-point spatial statistics, orientation distribution function, and global spherical harmonic. These representations are used to compute four distinct “dissimilarity scores” that quantitatively capture differences in texture and morphology. This framework is demonstrated to enable automated calibration of simulation parameters by minimizing discrepancies between simulated and target microstructures. The technology developed in this project enables direct correlation between in-situ monitoring data and resulting microstructure, paving the way for adaptive microstructure control in metal AM. This capability strengthens the connection between process parameters and final material properties, facilitating more precise and reliable material design.

36 MATERIALS SCIENCE↗
DOE OSTI2026

EXERGETIC: De-Risking Next-Generation Resilient Geothermal Hybrids via At-Scale Evaluation Using Virtual Emulation Digital Twin Environment for Efficient Operation

The DOE-GTO-funded project, award number 5.1.2.12, entitled "EXERGETIC - De-risking Next Generation Resilient Geothermal Hybrids via at-Scale Evaluation Using a Virtual Emulation Digital Twin Environment for Efficient Operation," advances the solution to these challenges by developing and validating a geothermal co-emulation environment implemented at the National Laboratory of the Rockies (NLR)'s Advanced Research on Integrated Energy Systems (ARIES) platform. This framework enables the de-risking of next-generation geothermal and geothermal hybrid systems through high-fidelity modeling, real-time digital emulation, advanced control strategies, and techno-economic assessment. The project focused on geothermal hybrid configurations that integrate geothermal power plants with concentrated solar power and underground thermal energy storage, enabling enhanced efficiency, flexibility, and grid support capabilities. The main goal of this project was the development of a geothermal digital co-emulation environment to demonstrate the technical and economic value of geothermal hybrid systems and their contribution to grid stability and flexibility. The EXERGETIC framework combined physics-based models, controls, and real assets at ARIES, including digital real-time simulators (DRTS), a 20-MW-scale controllable grid interface (CGI), and a 2-MW conventional generator. Detailed transient models were developed for the key subsystems of a hybrid geothermal plant, including parabolic trough solar collectors, reservoir thermal energy storage (RTES), and a binary Organic Rankine Cycle (ORC) power plant. The ORC model explicitly captured thermal inertia and off-design operation and integrated control strategies to dynamically respond to electric load profiles. The models were validated against published experimental and numerical studies, demonstrating strong agreement and confirming the accuracy and robustness of the modeling approach. The resulting digital twin represents geothermal-solar-storage systems at multiple scales (1 MW to 100 MW) and enables realistic emulation of grid-connected operation. The control architecture allows the geothermal resource to provide stable baseload generation, while solar and stored thermal energy supply flexible, dispatchable support during periods of high demand or variable grid conditions. A key contribution of the EXERGETIC project is the demonstration that geothermal hybrid systems can be designed to be active grid assets rather than passive baseload generators. Using the ARIES platform, the digital twin was evaluated under multiple grid scenarios, including load following, voltage support at the distribution level, and frequency response at the transmission level. Results show that hybrid geothermal systems can respond effectively to dynamic grid conditions, providing inertia-like behavior, primary frequency support, and voltage regulation through coordinated control. In addition to the performance and grid services capability analysis of geothermal and hybrid geothermal systems, the EXERGETIC project also focused on scalability and techno-economic analysis of geothermal hybrid plants. In particular, for the scalability analysis, machine-learning (ML)-based surrogate models were trained using data generated from the geothermal digital twin under different grid-connected scenarios and plant capacities. These ML models demonstrated strong interpolation and extrapolation capabilities across plant sizes, accurately reproducing both steady-state and transient responses with very low errors. Regarding the techno-economic analysis, plant performance results were integrated with cost models for hybrid geothermal systems, and the levelized cost of electricity (LCOE) was used as the main economic metric to evaluate system performance across a range of system capacities, solar shares, solar multiples, and storage durations. Results indicate that economies of scale significantly reduce geothermal LCOE as plant capacity increases, with large-scale systems (25-100 MW) achieving substantially lower costs than small plants. Hybridization with solar thermal energy and storage further improves economic performance by increasing capacity utilization and enabling flexible dispatch. In addition, thermal storage plays a critical role in reducing LCOE by maximizing geothermal, solar, and stored energy resources. In summary, the results from this project demonstrate that geothermal hybrid systems represent a promising alternative for increasing the energy conversion efficiency of geothermal technologies, contributing to the preservation of geothermal resources, and supporting the transition of geothermal plants from traditional baseload resources into flexible, resilient, and cost-competitive energy conversion technologies.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

IMPACT: Design of Integrated Multiphysics Producible Additive Components for Turbomachinery

The overall objective of the IMPACT program was to enable a dramatic reduction in design maturation time for an additive hot-section turbomachinery component through the following: • A fast crack-risk producibility surrogate model generated from machine learning applied to additive process simulation data generated via exascale computing, • Linking this surrogate model to multi-physics topology optimization (TO) to enable the creation of producible, near-optimal structural/thermal designs for additive hot-section components, • Maturing this toolset to reduce hot-section component design-for-manufacturing iterations by a large fraction, and eventually, • Using these tools to develop more efficient gas turbines in much shorter design cycle times.

42 ENGINEERING↗
DOE OSTI2021

Scale Bridging through Active Learning [PowerPoint]

The slides discuss Active Learning and building dynamic surrogate models with confidence with Machine Learning. A prototype example involving mixing and transport in an inertial confinement and fusion experiment illustrates the concept.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Beyond Price Taker: Optimizing Integrated Energy Systems Considering Market/Grid Interactions

Integrated Energy Systems (IES) combine two or more processes to increase the efficiency, flexibility of operation, and the overall reliability. However, analyzing IESs in volatile electricity markets is challenging, since the volatility in electricity prices makes the conventional levelized cost-type analysis less realistic. This work presents two approaches to address the challenge: price-taker and a surrogates-based approach for incorporating market interactions. The price-taker approach formulates a multiperiod optimization problem that takes the time-varying electricity prices into account, and solves the optimization problem to determine the optimal operational schedule that maximizes the chosen economic metric. This approach is successfully applied to investigate the performance of flexible power and hydrogen co-production systems. The market surrogates approach trains a machine learning model to predict the market behavior as a function of the characteristics of the IES. The trained surrogate model is used to optimize the design and operation of the given IES in an electricity market. This approach is demonstrated on a case study involving a nuclear power plant retrofitted with a low-temperature electrolysis unit to co-produce power and hydrogen.

beyond price taker↗
DOE OSTI2025

Factorization Machine‐Based Active Learning for Functional Materials Design with Optimal Initial Data

The optimization of functional materials is important to enhance their properties, but their complex geometries pose great challenges to optimization. Data-driven algorithms efficiently navigate such complex design spaces by learning relationships between material structures and performance metrics to discover high-performance functional materials. Surrogate-based active learning, continually improving its surrogate model by iteratively including high-quality data points, has emerged as a cost-effective data-driven approach. Furthermore, it can be coupled with quantum computing to enhance optimization processes, especially when paired with a special form of surrogate model (i.e., quadratic unconstrained binary optimization), formulated by factorization machine (FM). However, current practices often overlook the variability in design space sizes when determining the initial data size for optimization. In this work, we investigate the optimal initial data sizes required for efficient convergence across various design space sizes. By employing averaged piecewise linear regression, we identify initiation points where convergence begins, highlighting the crucial role of employing adequate initial data in achieving efficient optimization. These results contribute to the efficient optimization of functional materials by ensuring faster convergence and reducing computational costs in FM-based active learning.

active learning↗
DOE OSTI2021

Multiscale Modeling Meets Machine Learning: What Can We Learn?

Machine learning is increasingly recognized as a promising technology in the biological, biomedical, and behavioral sciences. There can be no argument that this technique is incredibly successful in image recognition with immediate applications in diagnostics including electrophysiology, radiology, or pathology, where we have access to massive amounts of annotated data. However, machine learning often performs poorly in prognosis, especially when dealing with sparse data. This is a field where classical physics-based simulation seems to remain irreplaceable. In this review, we identify areas in the biomedical sciences where machine learning and multiscale modeling can mutually benefit from one another: Machine learning can integrate physics-based knowledge in the form of governing equations, boundary conditions, or constraints to manage ill-posted problems and robustly handle sparse and noisy data; multiscale modeling can integrate machine learn- ing to create surrogate models, identify system dynamics and parameters, analyze sensitivities, and quantify uncertainty to bridge the scales and understand the emergence of function. With a view towards applications in the life sciences, we discuss the state of the art of combining machine learning and multiscale modeling, identify applications and opportunities, raise open questions, and address potential challenges and limitations. We anticipate that it will stimulate discussion within the community of computational mechanics and reach out to other disciplines including mathematics, statistics, computer science, artificial intelligence, biomedicine, systems biology, and precision medicine to join forces towards creating robust and efficient models for biological systems.

machine learning, multiscale modeling, physics-bas↗
DOE OSTI2024

Accelerating Thermochemical Equilibrium Calculations for Nuclear Reactor Applications

Thermochemical properties play a key role in modeling and simulation of several key phenomena in nuclear reactors. There has been an increasing interest in incorporating CALPHAD-based formulations in multiphysics simulations including for Molten Salt Reactors where knowledge of phase evolution of the salt and the chemical potentials of various elements are of utmost importance in source term analyses and redox control. However, the size of such simulations is often limited by the high computational cost of full thermodynamic equilibrium calculations. This work discusses the current efforts aimed at accelerating thermochemical equilibrium calculations for multiphysics simulations performed using the open-source finite element / finite volume code Multiphysics Object Oriented Simulation Environment (MOOSE) [1]. While several methods have been proposed for accelerating phase equilibrium calculations [2], most focus on relatively small systems and often rely on a- priori knowledge of the state-space of the system. Nuclear materials, however, are often multi-component systems owing to the evolution of composition under irradiation and an approach based on a-priori mapping of phase diagram is often not enough. This work is aimed at demonstrating an on-the-fly surrogate modeling framework that uses active learning to reduce the number of full equilibrium calculations that must be performed. By combining with efficient coupling approaches, the surrogate framework helps in reducing the computational cost of thermodynamic equilibrium informed multiphysics simulations of nuclear materials. The performance is benchmarked against full coupling with the thermochemistry library Thermochimica [3]. This work uses a machine learning based approach for constructing surrogate models to predict the stable phases in a multicomponent system. The surrogates were constructed using neural networks and Gaussian process classification. In this work, we compare the relative performance of the two methods. We also demonstrate the use of caching previous calculations by interpolating the values from nearest neighbors. References [1] Lindsay, A.D., et al. "2.0 – MOOSE: Enabling massively parallel multiphysics simulation", SoftwareX, 20 (2022): 101202. [2] Roos, W.A. and Zietsman J.H. "Accelerating complex chemical equilibrium calculations – A Review", Calphad, 77 (2022): 102380. [3] Piro, M.H.A., et al. "The thermochemistry library Thermochimica", Computational Materials Science, 67 (2013): 266-272.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Probabilistic neural networks for fluid flow surrogate modeling and data recovery

We consider the use of probabilistic neural networks for fluid flow surrogate modeling and data recovery. This framework is constructed by assuming that the target variables are sampled from a Gaussian distribution conditioned on the inputs. Consequently, the overall formulation sets up a procedure to predict the hyperparameters of this distribution which are then used to compute an objective function given training data. We demonstrate that this framework has the ability to provide for prediction confidence intervals based on the assumption of a probabilistic posterior, given an appropriate model architecture and adequate training data. The applicability of the present framework to cases with noisy measurements and limited observations is also assessed. To demonstrate the capabilities of this framework, we consider canonical regression problems of fluid dynamics from the viewpoint of reduced-order modeling and spatial data recovery for four canonical data sets. The examples considered in this study arise from (i) the shallow-water equations, (ii) a two-dimensional cylinder flow, (iii) the wake of a NACA0012 airfoil with a Gurney flap, and (iv) the NOAA sea surface temperature data set. Furthermore, the present results indicate that the probabilistic neural network not only produces a machine-learning-based fluid flow surrogate model but also systematically quantifies the uncertainty therein to assist with model interpretability.

42 ENGINEERING↗
DOE OSTI2024

IDAES-PSE 2.7.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications. IDAES-PSE 2.7.0 Release Highlights New features: AutoScaler and CustomScalerBase classes: Such tools are the core of the new scaling framework being implemented in IDAES. Wider adoption of scaling tools among users will result in quicker and more robust model solutions. Scaler for equilibrium reactor and saponification properties: These scaler models are examples to follow for how to use the new scaling tools. ONNX Surrogate support from Optimization & Machine Learning Toolkit (OMLT): ONNX is an open standard format to save and load ML/AI models that is widely supported by all major frameworks. This capability makes it easier for IDAES users to create surrogate models and use them without having to support each framework individually. 1D Membrane Model for CO2 Capture and Utilization: Supports ongoing efforts for modeling and optimizing polymer membrane processes for CO2 capture and conversion into formic acid. StreamScaler unit model: Unrelated to the CustomScalerBase, this unit model allows a stream’s extensive variables to be scaled by a fixed factor. This allows streams being processed by multiple units in parallel to be scaled down to unit scale and scaled back up to process scale. Bug fixes or improvements: Scaling, EoS, Diagnostics tool, Modular Properties, tests & documentation Deprecations: Old Cubic EoS

AS↗
DOE OSTI2024

Towards verifiable cancer digital twins: tissue level modeling protocol for precision medicine

Cancer exhibits substantial heterogeneity, manifesting as distinct morphological and molecular variations across tumors, which frequently undermines the efficacy of conventional oncological treatments. Developments in multiomics and sequencing technologies have paved the way for unraveling this heterogeneity. Nevertheless, the complexity of the data gathered from these methods cannot be fully interpreted through multimodal data analysis alone. Mathematical modeling plays a crucial role in delineating the underlying mechanisms to explain sources of heterogeneity using patient-specific data. Intra-tumoral diversity necessitates the development of precision oncology therapies utilizing multiphysics, multiscale mathematical models for cancer. This review discusses recent advancements in computational methodologies for precision oncology, highlighting the potential of cancer digital twins to enhance patient-specific decision-making in clinical settings. We review computational efforts in building patient-informed cellular and tissue-level models for cancer and propose a computational framework that utilizes agent-based modeling as an effective conduit to integrate cancer systems models that encode signaling at the cellular scale with digital twin models that predict tissue-level response in a tumor microenvironment customized to patient information. Furthermore, we discuss machine learning approaches to building surrogates for these complex mathematical models. These surrogates can potentially be used to conduct sensitivity analysis, verification, validation, and uncertainty quantification, which is especially important for tumor studies due to their dynamic nature.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

A Fast Time-Stepping Strategy for Dynamical Systems Equipped with a Surrogate Model

Simulation of complex dynamical systems arising in many applications is computationally challenging due to their size and complexity. Model order reduction, machine learning, and other types of surrogate modeling techniques offer cheaper and simpler ways to describe the dynamics of these systems but are inexact and introduce additional approximation errors. In order to overcome the computational difficulties of the full complex models, on one hand, and the limitations of surrogate models, on the other, this work proposes a new accelerated time-stepping strategy that combines information from both. This approach is based on the multirate infinitesimal general-structure additive Runge--Kutta framework. The inexpensive surrogate model is integrated with a small time step to guide the solution trajectory, and the full model is treated with a large time step to occasionally correct for the surrogate model error and ensure convergence. Here, we provide a theoretical error analysis, and several numerical experiments, to show that this approach can be significantly more efficient than using only the full or only the surrogate model for the integration.

Surrogate models↗
DOE OSTI2023

One System, Many Models: Designing a Surrogate Model for Sulfur Thermal Energy Storage: Preprint

Industrial process heating (IPH) relies primarily on thermal energy generated by fossil fuel combustion to produce, treat, and alter manufactured goods. Thermal energy storage (TES) helps reduce the carbon footprint of IPH systems by facilitating the utilization of renewable and waste heat sources. A promising new TES technology uses elemental sulfur as the heat-storage medium. The design of sulfur TES systems can be evaluated with the aid of computational fluid dynamics (CFD). However, the computational cost of such CFD efforts is prohibitive to comprehensive optimizations over design parameters. To reduce this computational cost, machine learning (ML) models can be developed to act as surrogates for CFD. In this paper, we describe the process of building and evaluating surrogate ML models for facilitating optimization of sulfur TES systems for IPH. To enforce the thermodynamic relationship between the two modeled quantities, we develop a hybrid model for sulfur temperature using both direct predictions of temperature and calculations of temperature from predictions of the heat transfer coefficient. The hybrid model enforces this constraint at the expense of the slightly reduced accuracy compared to two disjoint models. The overall high accuracy observed in our model evaluation demonstrates the usefulness of such surrogate modeling for studying TES systems. This work contributes to the field of TES surrogate modeling by offering a novel accurate hybrid approach to predicting simultaneously the heat transfer coefficient and temperature of the heat storage medium.

computational fluid dynamics↗
DOE OSTI2021

Enhanced prediction of terrestrial feedbacks to the coastal carbon cycle:using machine learning to improve sub-grid biogeochemical processes

Focal Areas: The paper aims to improve predictability of the coastal carbon cycle through improved model representation and quantification of the terrestrial feedbacks to aquatic ecosystems. The paper covers two focus areas, 1. Improved predictive modeling of terrestrial and aquatic biogeochemistry through ML-enabled surrogate models, and 2. Employing machine learning to integrate multimodal data sets collected across terrestrial and aquatic ecosystems at high spatial and temporal resolution.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Accelerating computational fluid dynamics simulation of post-combustion carbon capture modeling with MeshGraphNets

Packed columns are commonly used in post-combustion processes to capture CO 2 emissions by providing enhanced contact area between a CO 2 -laden gas and CO 2 -absorbing solvent. To study and optimize solvent-based post-combustion carbon capture systems (CCSs), computational fluid dynamics (CFD) can be used to model the liquid–gas countercurrent flow hydrodynamics in these columns and derive key determinants of CO 2 -capture efficiency. However, the large design space of these systems hinders the application of CFD for design optimization due to its high computational cost. In contrast, data-driven modeling approaches can produce fast surrogates to study large-scale physics problems. We build our surrogates using MeshGraphNets (MGN), a graph neural network framework that efficiently learns and produces mesh-based simulations. We apply MGN to a random packed column modeled with over 160K graph nodes and a design space consisting of three key input parameters: solvent surface tension, inlet velocity, and contact angle. Our models can adapt to a wide range of these parameters and accurately predict the complex interactions within the system at rates over 1700 times faster than CFD, affirming its practicality in downstream design optimization tasks. This underscores the robustness and versatility of MGN in modeling complex fluid dynamics for large-scale CCS analyses.

97 MATHEMATICS AND COMPUTING↗