SEARCH · Search NASA

Results for “surrogate model development”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Compression Analysis of Materials via in situ X-ray Computed Tomography

X-ray computed tomography (X-ray CT) is an analytical technique used in materials science to non– destructively characterize features in a variety of materials like polymers, metals, composites, and explosives. The non-destructive imaging allows for the analysis of features (voids and cracks), which give a fundamental understanding of material characteristics.This is more effective when combinedwith a load cell to expose the material to realworld stimuli to understand material characteristics and morphological behavior in situ. This study focused on using in situ X-ray CT to understand the material characteristics and morphological changes of sugar prills and a lattice under a compressive load. Sugar prills are used as a surrogate to analyze explosives in a safer and less expensiveway. The sugar prills were found to be brittle and shattered when compressed via the CT renderings and the stress/strain information. The lattices are used as both the basis and ground truth comparison for the development of models to predict the morphological and material characteristic changes that occur as a result of loading. The lattice was found to have weak regions due to low polymer interlayer fusion in these regions during the printing process. It was also found that under the initial compression the lattice demonstrated elastic behavior as its cellular structure was intact until the cellular structure started to collapse causing yielding in the lattice. Additionally, the analysis of the sugar prills and lattice demonstrate the information that can be gleaned from in situ X-ray CT experiments that would be lost in traditional pre- and post-mortem X-rayCT analysis.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Advanced Ceramic Membranes/Modules for Ultra Efficient Hydrogen (H2) Production/Carbon Dioxide (CO2) Capture for Coal-Based Polygeneration Plants: Fabrication, Testing, and CFD Modeling

Inorganic membrane-based systems are a promising technology for precombustion CO2 capture with simultaneous H2 production. State-of-the-art packages for high temperature and pressure service consist of multiple tube membrane bundles prepared in a "candle filter" configuration, in which the membrane tubes are open at one end and sealed at the other. This configuration is used for practical reasons, specifically the need to minimize problems due to thermal expansion mismatch between the ceramic tube bundle and the steel housing. However, the primary technical problem with the candle filter format for commercial-scale installations is the inability to purge the tube side (typically the permeate side), a feature that is crucial for high H2 recovery. In this study, the focus is to design and fabricate the first dual-end open full ceramic multiple tube membrane bundle that enables tube side (permeate) purge for gas separation applications. An additional key feature of this design is the simplified module layout, as the membrane bundles can be installed end-to-end with tube side (permeate) flow directly from one bundle to the next. This layout simplifies the membrane to housing seals and yields significant improvement in membrane packing density. Detailed focus areas in our studies include: (i) Materials development and preparation of the tube-to-tube sheet potting for the dual-ended bundle; (ii) the sealing and optimal module configuration design to minimize membrane stress upon module mounting; (iii) the demonstration, via the fabrication of CMS and Pd-alloy membranes supported on full-size, dual-ended ceramic support bundles, of the first example of a purgeable ceramic membrane and module; and (iv) development of a CFD model of the membrane module for calculation of feed flow distribution, and for use in scale-up, and capital cost estimating. The CFD model was validated using experimental data with the multi-tubular membrane system, employing He/N2 as a model gas mixture (surrogate for H2/CO2), and has been shown to be quite accurate. Employing the model, we are able to study the effects of operating pressure and temperature, feed and sweep gas flow rates, and the choice of membrane tube configuration on system performance.

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2022

Advanced Ceramic Membranes/Modules for Ultra Efficient Hydrogen (H2) Production/Carbon Dioxide (CO2) Capture for Coal-Based Polygeneration Plants: Fabrication, Testing and CFD Modeling

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2024

Differentiable Multiphysics Codes: A Breakthrough Technology for Simulation and Computing

This document summarizes the findings of a strategic planning exercise commissioned by the Weapons Simulation and Computing, Computational Physics (WSC/CP) program at the Lawrence Livermore National Laboratory (LLNL) in FY24. During the year, the committee met with multiple stakeholder communities to gather input, opinions, suggestions and concerns which have been incorporated throughout this document. The key findings from this exercise are summarized: • The development of multiphysics modelling and simulation (mod/sim) codes and software technologies, their deployment on exascale compute platforms, and their broad adoption across the NNSA is a major success of the Advanced Simulation and Computing (ASC) program and the Exascale Computing Project (ECP). Sustained investment in these core technologies is essential. • Today’s state of the art involves running ensembles of O(100K) simulations to perform uncertainty quantification (UQ) and design studies using multiple statistical methods such as Bayesian optimization to understand sensitivities of our models and explore parameterized design spaces. Even with exascale computing, we are practically limited to O(10) parameters in these studies since the number of simulations required to sample the space scales exponentially with the number of design parameters. • The data from these simulation ensembles is increasingly being used to train machine learned (ML) surrogates (or reduced order models, ROMs) which can then be used for optimization or real time design exploration. However, the trained surrogates are still limited in the number of parameters they can represent due to the sampling limitations previously noted. • Augmenting our suite of integrated multiphysics simulation codes, both current and emerging, with the ability to compute gradients (solution derivatives) of arbitrary simulation outputs with respect to (some or all) simulation inputs would be a breakthrough technology, opening the door to a new era of efficient and automated inverse design based on verified and validated mod/sim capabilities. • This capability, which we refer to as differentiable multiphysics codes (DMCs), would revolutionize both UQ and optimization studies by breaking the curse of dimensionality that presently limits our “gradient-free” ensemble based computing approach. A similar breakthrough occurred in the AI/ML community once the ability to compute gradients of arbitrary loss functions using back-propagation became commonplace. Gradient information from the multiphysics codes can also be used to dramatically improve the efficiency and scale of training of ML/ROM surrogates for rapid assessments. • Achieving this in our suite of codes will be a grand challenge, similar to the amount of effort that was required to transition from CPU to GPU computing. It will require buy-in from the entire WSC/CP program and beyond, including all integrated codes, physics and engineering models, third-party library dependencies and performance portability abstractions. It will also require investment in research and development of numerical methods for computing adjoints of coupled physics across multiple adaptively refined moving meshes and of stochastic (Monte Carlo) and mesh free (SPH) methods. • New software and numerical techniques, largely pioneered by the AI/ML community, make this feasible. Chief among these is automatic differentiation (AD), the ability to employ AD at point-wise locations in a physics calculation (instead of traditional black-box approaches) and the ability to perform “back-propagation in time” (or reverse mode AD) for non-linear partial differential equations (PDEs). Fundamentally, the conclusion of this strategic planning exercise is that the time is right to undertake a large scale effort in WSC, centered on the existing integrated codes, to continue the natural evolution of mod/sim in the age of AI/ML. Instead of attempting to replace mod/sim with purely data driven AI/ML models, we believe the key to success is to integrate AI/ML by building on top of the decades of hard-won knowledge and the verified/validated multiphysics modelling capability that is the hallmark of the ASC program.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Effect of sample size on the maximum value distribution of fatigue driving forces in metals and alloys

An analytical framework is presented to predict the effects of sample size on the maximum value distribution (MVD) of the driving forces for fatigue crack formation in metals and alloys. The distribution of the maximum driving force for fatigue crack formation over the domain follows the generalized extreme value theory in the limit as the domain size increases to infinity. Here, a simulation-based analysis of microstructure influences on fatigue resistance for polycrystalline metals and alloys is very costly, and reaching those limits is intractable. This work models the MVD of Fatigue Indicator Parameters (FIPs), which serve as surrogate measures for the driving force for fatigue crack formation, at finite sample sizes prior to their convergence to a limiting extreme value distribution. Large-scale crystal plasticity finite element (CPFE) simulations of FCC Al 7075-T6 with microstructure realizations of various sizes are incorporated to calibrate and evaluate the developed framework, and a total of ∼6.5 million grains of Al 7075-T6 are examined. The calibrated analytical solution agrees well with the brute force Monte Carlo simulation results extracted from the CPFE simulations. Furthermore, the developed formulation can predict the MVD of FIPs for different sample sizes using a size-dependent parameter, and it is capable of accurately extrapolating the MVD of FIPs for much larger microstructure sample sizes than the size used for its calibration.

Crystal plasticity↗

DOE OSTI2020

Effects of fuel composition and octane sensitivity on polycyclic aromatic hydrocarbon and soot emissions of gasoline–ethanol blend surrogates

The sooting propensity of a fuel is closely coupled with the fuel composition and chemistry. A detailed understanding of their effects is, therefore, needed to develop next-generation fuels which can minimize particulate emissions. With this overarching goal, the present work numerically investigates the effects of fuel composition and octane sensitivity (S) on polycyclic aromatic hydrocarbons (PAH) and soot emissions, for four-component gasoline-ethanol blend surrogates comprising isooctane, n-heptane, toluene, and ethanol. A partially-premixed counterflow flame is chosen as the canonical configuration for this study and simulations are performed using CHEMKIN-Pro-employing a kinetic mechanism developed by Park et al. (2017). In addition, a, detailed soot model based on the sectional method is used to capture the spatial characteristics of soot emissions. The kinetic mechanism and soot model are validated using available experimental data for various targets. A total of 86 TPRF-E mixtures, spanning a wide range of concentration of each component, and a wide range of S are analyzed. The effect of each non-paraffinic fuel component on the resultant PAH and soot emissions is investigated. PAH and soot emissions are found to vary significantly depending upon the blend composition. Additionally, based on the parametric sweeps, a regression analysis is carried out to identify global parameters that govern the formation of PAHs and soot. The analysis shows that both toluene content and S have a prominent effect on the formation of PAHs and soot, with toluene content having a stronger impact. Moreover, larger PAHs have higher dependency on toluene content and S. Furthermore, a detailed analysis is carried out to understand the physical and chemical phenomena associated with the observed trends of PAH and soot emissions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Real-time capable modeling of ICRF heating on NSTX and WEST via machine learning approaches

Abstract A real-time capable core Ion Cyclotron Range of Frequencies (ICRF) heating model on NSTX and WEST is developed. The model is based on two nonlinear regression algorithms, the random forest ensemble of decision trees and the multilayer perceptron neural network. The algorithms are trained on TORIC ICRF spectrum solver simulations of the expected flat-top operation scenarios in NSTX and WEST assuming Maxwellian plasmas. The surrogate models are shown to successfully capture the multi-species core ICRF power absorption predicted by the original model for the high harmonic fast wave and the ion cyclotron minority heating schemes while reducing the computational time by six orders of magnitude. Although these models can be expanded, the achieved regression scoring, computational efficiency and increased model robustness suggest these strategies can be implemented into integrated modeling frameworks for real-time control applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

ASK: Adversarial Soft k-Nearest Neighbor Attack and Defense

K-Nearest Neighbor (kNN)-based deep learning methods have been applied to many applications due to their simplicity and geometric interpretability. However, the robustness of kNN-based deep classification models has not been thoroughly explored and kNN attack strategies are underdeveloped. In this paper, we first propose an Adversarial Soft kNN (ASK) loss for developing more effective kNN-based deep neural network attack strategies and designing better defense methods against them. Our ASK loss provides a differentiable surrogate of the expected kNN classification error. It is also interpretable as it preserves the mutual information between the perturbed input and the in-class-reference data. We use the ASK loss to design a novel attack method called the ASK-Attack (ASK-Atk), which shows superior attack efficiency and accuracy degradation relative to previous kNN attacks on hidden layers. We then derive an ASK-Defense (ASK-Def) method that optimizes the worst-case ASK training loss. Experiments on CIFAR-10 (ImageNet) show that (i) ASK-Atk achieves ≥13% (≥ 13% ) improvement in attack success rate over previous kNN attacks, and (ii) ASK-Def outperforms the conventional adversarial training method by ≥ 6.9% (≥ 3.5% ) in terms of robustness improvement. Relevant codes are available at https://github.com/wangren09/ASK .

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Uncertainty propagation in feed-forward neural network models

We develop new uncertainty propagation methods for feed-forward neural network architectures with leaky ReLU activation functions subject to random perturbations in the input vectors. In particular, we derive analytical expressions for the probability density function (PDF) of the neural network output and its statistical moments as a function of the input uncertainty and the parameters of the network, i.e., weights and biases. A key finding is that an appropriate linearization of the leaky ReLU activation function yields accurate statistical results even for large perturbations in the input vectors. This can be attributed to the way information propagates through the network. We also propose new analytically tractable Gaussian copula surrogate models to approximate the full joint PDF of the neural network output. To validate our theoretical results, we conduct Monte Carlo simulations and a thorough error analysis on a multi-layer neural network representing a nonlinear integro-differential operator between two polynomial function spaces. Our findings demonstrate excellent agreement between the theoretical predictions and Monte Carlo simulations.

MLP networks↗

DOE OSTI2023

Neural network ensembles and uncertainty estimation for predictions of inelastic mechanical deformation using a finite element method-neural network approach

The finite element method (FEM) is widely used to simulate a variety of physics phenomena. Approaches that integrate FEM with neural networks (NNs) are typically leveraged as an alternative to conducting expensive FEM simulations in order to reduce the computational cost without significantly sacrificing accuracy. However, these methods can produce biased predictions that deviate from those obtained with FEM, since these hybrid FEM-NN approaches rely on approximations trained using physically relevant quantities. In this work, an uncertainty estimation framework is introduced that leverages ensembles of Bayesian neural networks to produce diverse sets of predictions using a hybrid FEM-NN approach that approximates internal forces on a deforming solid body. The uncertainty estimator developed herein reliably infers upper bounds of bias/variance in the predictions for a wide range of interpolation and extrapolation cases using a three-element FEM-NN model of a bar undergoing plastic deformation. This proposed framework offers a powerful tool for assessing the reliability of physics-based surrogate models by establishing uncertainty estimates for predictions spanning a wide range of possible load cases.

42 ENGINEERING↗

DOE OSTI2023

Learning Provably Stable Local Volt/Var Controllers for Efficient Network Operation

Here this paper develops a data-driven framework to synthesize local Volt/Var control strategies for distributed energy resources (DERs) in power distribution grids (DGs). Aiming to improve DG operational efficiency, as quantified by a generic optimal reactive power flow (ORPF) problem, we propose a two-stage approach. The first stage involves learning the manifold of optimal operating points determined by an ORPF instance. To synthesize local Volt/Var controllers, the learning task is partitioned into learning local surrogates (one per DER) of the optimal manifold with voltage input and reactive power output. Since these surrogates characterize efficient DG operating points, in the second stage, we develop local control schemes that steer the DG to these operating points. We identify the conditions on the surrogates and control parameters to ensure that the locally acting controllers collectively converge, in a global asymptotic sense, to a DG operating point agreeing with the local surrogates. We use neural networks to model the surrogates and enforce the identified conditions in the training phase. AC power flow simulations on the IEEE 37-bus network empirically bolster the theoretical stability guarantees obtained under linearized power flow assumptions. The tests further highlight the optimality improvement compared to prevalent benchmark methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Towards automating structural discovery in scanning transmission electron microscopy *

Abstract Scanning transmission electron microscopy is now the primary tool for exploring functional materials on the atomic level. Often, features of interest are highly localized in specific regions in the material, such as ferroelectric domain walls, extended defects, or second phase inclusions. Selecting regions to image for structural and chemical discovery via atomically resolved imaging has traditionally proceeded via human operators making semi-informed judgements on sampling locations and parameters. Recent efforts at automation for structural and physical discovery have pointed towards the use of ‘active learning’ methods that utilize Bayesian optimization with surrogate models to quickly find relevant regions of interest. Yet despite the potential importance of this direction, there is a general lack of certainty in selecting relevant control algorithms and how to balance a priori knowledge of the material system with knowledge derived during experimentation. Here we address this gap by developing the automated experiment workflows with several combinations to both illustrate the effects of these choices and demonstrate the tradeoffs associated with each in terms of accuracy, robustness, and susceptibility to hyperparameters for structural discovery. We discuss possible methods to build descriptors using the raw image data and deep learning based semantic segmentation, as well as the implementation of variational autoencoder based representation. Furthermore, each workflow is applied to a range of feature sizes including NiO pillars within a La:SrMnO 3 matrix, ferroelectric domains in BiFeO 3 , and topological defects in graphene. The code developed in this manuscript is open sourced and will be released at github.com/nccreang/AE_Workflows .

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

A data-driven peridynamic continuum model for upscaling molecular dynamics

Nonlocal models, including peridynamics, often use integral operators that embed lengthscales in their definition. However, the integrands in these operators are difficult to define from the data that are typically available for a given physical system, such as laboratory mechanical property tests. In contrast, molecular dynamics (MD) does not require these integrands, but it suffers from computational limitations in the length and time scales it can address. To combine the strengths of both methods and to obtain a coarse-grained, homogenized continuum model that efficiently and accurately captures materials’ behavior, we propose a learning framework to extract, from MD data, an optimal Linear Peridynamic Solid (LPS) model as a surrogate for MD displacements. To maximize the accuracy of the learnt model we allow the peridynamic influence function to be partially negative, while preserving the well-posedness of the resulting model. To achieve this, we provide sufficient well-posedness conditions for discretized LPS models with sign-changing influence functions and develop a constrained optimization algorithm that minimizes the equation residual while enforcing such solvability conditions. This framework guarantees that the resulting model is mathematically well-posed, physically consistent, and that it generalizes well to settings that are different from the ones used during training. We illustrate the efficacy of the proposed approach with several numerical tests for single layer graphene. Our two-dimensional tests show the robustness of the proposed algorithm on validation data sets that include thermal noise, different domain shapes and external loadings, and discretizations substantially different from the ones used for training.

homogenization↗

DOE OSTI2023

An ICME Modeling Framework for Titanium/Tungsten-Carbide Metal Matrix Composites

This report describes a collaborative project to develop a validated, predictive model for the high temperature mechanical properties of a titanium-matrix, tungsten-carbide/cobalt-reinforced metal matrix composite. The modeling approach was to first develop a detailed, microstructural model linking the material structure and the interfacial debonding properties to the effective properties of the material. The project then completed a throughput simulation campaign to generate a large number of simulations for discrete microstructures and different debonding parameters. Finally, the project trained a fast, Gaussian process surrogate model against this simulation database to provide a quick model linking the material compositions, structure, and processing parameters to the resulting material properties. This model was validated against high temperature tensile test data on a few particular composite compositions. The tests validate the model predictions for ultimate tensile strength and uniform elongation/ductility, meaning the final surrogate model can now be used to tune the material composition and processing parameters to identify optimal composite compositions for particular applications.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Development of risk mitigation guidance for sensor placement inside mechanically ventilated enclosures – Phase 1

Guidance on Sensor Placement was identified as the top research priority for hydrogen sensors at the 2018 HySafe Research Priority Workshop on hydrogen safety in the category Mitigation, Sensors, Hazard Prevention, and Risk Reduction. This paper discusses the initial steps (Phase 1) to develop such guidance for mechanically ventilated enclosures. This work was initiated as an international collaborative effort to respond to emerging market needs related to the design and deployment equipment for hydrogen infrastructure that is often installed in individual equipment cabinets or ventilated enclosures. The ultimate objective of this effort is to develop guidance for an optimal sensor placement such that, when integrated into a facility design and operation, will allow earlier detection at lower levels of incipient leaks, leading to significant hazard reduction. Reliable and consistent early warning of hydrogen leaks will allow for the risk mitigation by reducing or even eliminating the probability of escalation of small leaks into large and uncontrolled events. To address this issue, a study of a real-world mechanically ventilated enclosure containing GH2 equipment was conducted, where CFD modeling of the hydrogen dispersion (performed by AVT and UQTR, and independently by the JRC) was validated by the NREL Sensor laboratory using a Hydrogen Wide Area Monitor (HyWAM) consisting of a 10-point gas and temperature measurement analyzer. In the release test, helium was used as a hydrogen surrogate. Expansion of indoor releases to other larger facilities (including parking structures, vehicle maintenance facilities and potentially tunnels) and incorporation into QRA tools, such as HyRAM is planned for Phase 2. It is anticipated that results of this work will be used to inform national and international standards such as NFPA 2 Hydrogen Technologies Code, Canadian Hydrogen Installation Code (CHIC) and relevant ISO/TC 197 and CEN documents.

08 HYDROGEN↗

DOE OSTI2022

Recent progress on the mesoscale modeling of architected thin-films via phase-field formulations of physical vapor deposition

Thin-film coatings can be found everywhere in modern technological applications due to desirable electrical, mechanical, chemical, and optical properties. These properties directly depend upon the thin-film’s microstructural features, which are themselves influenced by the materials and vapor-deposition processing conditions used for fabrication. As such, understanding processing-microstructure relationships is essential to designing thin-films with optimized properties, and discovering new processing conditions that allow for novel thin-films with multifunctional microstructures. Here, a short review is presented on recent developments that utilize the phase-field method to simultaneously model the vapor-deposition process and corresponding microstructure formation at the mesoscale. Also phase-field-based vapor-deposition models that simulate thin-film growth of immiscible alloy and polycrystalline systems are highlighted in addition to machine-learning-based surrogate models that can facilitate accelerated high-fidelity simulations along with materials design and exploration studies.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Machine learning surrogates for ion energy–angle distributions in thermal and RF plasma sheaths

Ion energy–angle distributions (IEADs) at material surfaces are a critical input for plasma–material interaction (PMI) studies in fusion devices, yet they are computationally expensive to obtain using particle-in-cell (PIC) simulations. In this work, we develop a machine learning surrogate based on a deep deconvolutional neural network (DDeCNN) trained on large databases generated with the hPIC2 code. The surrogate is capable of reconstructing IEADs from sheath parameters for both thermal and radio-frequency (RF) plasmas, including cases with multiple ion species. Across thousands of test cases, the model achieves high accuracy, with over 97 % of predictions classified as good or average based on standard error metrics (MAE, MSE, L2). Even in the more challenging RF and multi-species regimes, the surrogate reliably captures the multi-peak structure of PIC results. Once trained, the surrogate produces IEADs in milliseconds on a common workstation, yielding speedups of six to seven orders of magnitude compared with running a full PIC simulation. This computational gain enables dense parameter scans and direct coupling of IEAD predictions with PMI and erosion models on whole-device scales in fusion-relevant conditions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

Computational and Experimental Study for the Denitrification of Biomass-Derived Hydrothermal Liquefaction Oil

Hydrothermal liquefaction (HTL) is a promising method for processing wet biomass and waste feedstock to produce biofuels. During the HTL process, proteins and other biomolecules in certain feedstock get converted into nitrogenous compounds in produced biocrude, which represents a major challenge to further upgrading them into fuels. One promising approach is to separate nitrogenous compounds from the biocrude using polymeric resins. In this study, experiments were conducted to down-select sorbent and resin systems using a nitrogen-compound-containing surrogate biocrude. We model the binding interactions between an Amberlyst polymeric resin with various compounds present in the biocrude mixture such as nitrogenous compounds like pyrrole, pyridine, hexanamide, and representative co-existing compounds like phenol and dodecanoic acid. To ascertain the efficiency of various resins in the denitrogenation process, we have developed a quantitative structure–function model for the interacting components in the mixture. Our results suggest that the Amberlyst resin is a viable candidate for efficient removal of target nitrogen-containing compounds (such as pyridine) from the biocrude as a result of favorable interactions. The computational studies provide some insight into how and why the identified resin (Amberlyst) works in selective extraction of nitrogenous compound(s).

09 BIOMASS FUELS↗