Search NASASearch

SEARCH · Search NASA

Results for “generative diffusion model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Generative unfolding with distribution mapping

Machine learning enables unbinned, highly-differential cross section measurements. A recent idea uses generative models to morph a starting simulation into the unfolded data. We show how to extend two morphing techniques, Schrödinger Bridges and Direct Diffusion, in order to ensure that the models learn the correct conditional probabilities. This brings distribution mapping (DM) to a similar level of accuracy as the state-of-the-art conditional generative unfolding methods. Numerical results are presented with a standard benchmark dataset of single jet substructure as well as for a new dataset describing a 22-dimensional phase space of Z+2 -jets.

Butter, Anja

Prediction of vacancy defect diffusion paths in high entropy alloys via machine learning on molecular dynamics data

Identifying the diffusion path of point defects is a critical step in understanding their evolution and the mechanisms of related phenomena. Defect diffusion occurs at small length and time scales, with impacts on material properties that may continue to evolve over ns to μs, ms, and the continuum scale (s, min, etc., and cm, m, etc.). The time scale accessible to molecular dynamics (MD) simulations is limited by small step sizes, typically in the fs range. Thus, surrogate models of MD simulations through machine learning (ML)-based algorithms are of great interest, especially for complex systems such as high entropy alloys (HEAs). In this work, dynamics governing vacancy migration in HEA were approximated with graph convolutional network (GCN) models as ansatzes for kinetic Monte Carlo (KMC) rate catalogs. Network design considered that diffusion in crystalline solids generally depends on interactions between defects and their immediate neighbor atoms. Graphs represented the vacancy surroundings, MD-generated trajectories provided training and comparison datasets, and unsupervised GCN models approximated interatomic dynamics governing vacancy migration in HEAs as ansatzes for KMC. A proof-of-concept model trained on MD data for the Fe, Ni, Cr, Co, and Cu HEA environment was used with two different neighbor interactions to assess the feasibility of training a GCN to predict vacancy defect transition rates in the HEA environment. The resulting setup rapidly generated MD-formatted synthetic trajectories based on dynamics learned from the MD training set, with a time acceleration of roughly two orders of magnitude and a similar diffusion coefficient to MD observations. Additionally, Nudged Elastic Band (NEB) calculations were performed on randomly generated FeNiCrCoCu HEA structures to determine vacancy migration barriers across nearest-neighbor sites. Transition probabilities for each jump, categorized by atomic type, were extracted from these calculations. NEB-based and GCN-based approaches led to similar outcomes.

Reimer, C

Generative learning for slow manifolds and bifurcation diagrams

In dynamical systems characterized by separation of time scales, the approximation of so called “slow manifolds”, on which the long term dynamics lie, is a useful step for model reduction. Initializing on such slow manifolds is a useful step in modeling, since it circumvents fast transients, and is crucial in multiscale algorithms (like the equation-free approach) alternating between fine scale (fast) and coarser scale (slow) simulations. In a similar spirit, when one studies the infinite time dynamics of systems depending on parameters, the system attractors (e.g., its steady states) lie on bifurcation diagrams (curves for one-parameter continuation, and more generally, on manifolds in state parameter space. Sampling these manifolds gives us representative attractors (here, steady states of ODEs or PDEs) at different parameter values. Algorithms for the systematic construction of these manifolds (slow manifolds, bifurcation diagrams) are required parts of the “traditional” numerical nonlinear dynamics toolkit. In more recent years, as the field of Machine Learning develops, conditional score-based generative models (cSGMs) have been demonstrated to exhibit remarkable capabilities in generating plausible data from target distributions that are conditioned on some given label. It is tempting to exploit such generative models to produce samples of data distributions (points on a slow manifold, steady states on a bifurcation surface) conditioned on (consistent with) some quantity of interest (QoI, observable). In this work, we present a framework for using cSGMs to quickly (a) initialize on a low-dimensional (reduced-order) slow manifold of a multi-time-scale system consistent with desired value(s) of a QoI (a “label”) on the manifold, and (b) approximate steady states in a bifurcation diagram consistent with a (new, out-of-sample) parameter value. This conditional sampling can help uncover the geometry of the reduced slow-manifold and/or approximately “fill in” missing segments of steady states in a bifurcation diagram. Finally, the quantity of interest, which determines how the sampling is conditioned, is either known a priori or identified using manifold learning-based dimensionality reduction techniques applied to the training data.

Dynamical systems

Generative AI for Wind-Wave Inflows

Extreme wind-wave conditions can create dangerous or damaging environmental conditions for sea-based structures and watercrafts. However, the model of consistent, coupled wind-wave flow conditions is computational expensive, even for simple flow scenarios. This work examines the use of diffusion-based generative artificial intelligence tools to accelerate the generation of these two-phase flows and to characterize probabilities of various states to help with the generation of extreme patterns.

17 WIND ENERGY

Helium bubble formation in aged plutonium metal at ambient conditions

A model of helium bubble formation is developed that assumes the initial nascent bubbles are generated when two diffusing helium atoms come within a distance of about the interatomic spacing of the plutonium atoms. These nascent bubbles are assumed to be locked in place and grow as additional helium atoms diffuse across their surfaces. Calculations of the helium-bubble number density and sizes as a function of age are compared to experiment. This leads to an inferred helium diffusion coefficient of-the-order of 10 -20 m 2 /s, supports the idea that most of the helium from alpha-decay end up in bubbles, and that previous transmission electron microscopy size estimates are biased low. The energy that helium can transfer to 40-year-old plutonium, upon expansion, is determined to be <0.1 Joules per gram of metal. The model predicts differences between the bubble properties in naturally and accelerated aged plutonium.

36 MATERIALS SCIENCE

Model Parameter Development for Complex Materials: Species-Specific Diffusion Barriers in 316 Stainless Steel from Systematic DFT Calculations

Vacancy-mediated diffusion barriers in 316 stainless steel have been systematically calculated using density functional theory to provide essential parameters for mesoscale microstructure evolution models. A statistical sampling approach employing 210 nudged elastic band calculations across multiple special quasi-random structures captures the effects of local chemical environments in this concentrated alloy. The computational methodology addresses challenges specific to chemically disordered systems, including proper magnetic treatment throughout multi-step calculations and validation against experimental structural properties. The calculated activation barriers reveal clear species-dependent diffusion behavior with the hierarchy Ni >> Fe ˜ Cr >> Mo. Nickel exhibits the highest barriers (0.74–1.31 eV, mean 1.045 eV), confirming its role as the slowest-diffusing major component. Iron and chromium show similar moderate barriers averaging 0.587 eV and 0.522 eV, respectively. Remarkably, molybdenum demonstrates exceptionally low barriers (0.12–0.28 eV, mean 0.194 eV), suggesting much higher mobility than previously recognized and potentially significant implications for precipitation kinetics and microstructure evolution. The barrier ranges remain consistent across different 316 SS compositions, supporting parameter transferability for modeling applications. The overall mean barrier of 0.64 eV provides a practical approximation for phase field simulations, while species-specific values enable detailed treatments of diffusion-controlled processes. This systematic approach establishes a validated framework for generating diffusion parameters in other concentrated alloys where experimental data are limited, while providing the first systematic set of species-specific barriers for predictive modeling of 316 stainless steel microstructure evolution.

36 MATERIALS SCIENCE

Statistical inference of anomalous thermal transport with uncertainty quantification for interpretive 2D SOL models

The critical task of inferring anomalous cross-field transport coefficients is addressed in simulations of boundary plasmas with fluid models. A workflow for parameter inference in the UEDGE fluid code is developed using Bayesian optimization with parallelized sampling and integrated uncertainty quantification. In this workflow, transport coefficients are inferred by maximizing their posterior probability distribution, which is generally multidimensional and non-Gaussian. Uncertainty quantification is integrated throughout the optimization within the Bayesian framework that combines diagnostic uncertainties and model limitations. As a concrete example, we infer the anomalous electron thermal diffusivity $\chi_\perp$ from an interpretive 2D model describing electron heat transport in the conduction-limited region with radiative power loss. The workflow is first benchmarked against synthetic data and then tested on H-, L-, and I-mode discharges to match their midplane temperature and divertor heat flux profiles. We demonstrate that the workflow efficiently infers diffusivity and its associated uncertainty, generating 2D profiles that match 1D measurements. Future efforts will focus on incorporating more complicated fluid models and analyzing transport coefficients inferred from a large database of experimental results.

Bayesian optimization

Development of a Griffin model of the advanced test reactor

In the pursuit of a higher fidelity deterministic simulation capability of the Advanced Test Reactor, it is important to have a fast yet accurate deterministic neutronics model. Here, to achieve this, we employed an advanced two-step method. The first step involves generating homogenized cross sections using OpenMC, a cutting-edge Monte Carlo neutron transport code. OpenMC offers excellent modular capabilities, allowing for easy component integration and flexibility in incorporating new designs into the model. The second step involves deterministic transport calculations, which are performed using Griffin, a reactor physics application based on the Multiphysics Object-Oriented Simulation Environment (MOOSE). To ensure the accurate spatial resolution and assignment of material cross sections, a Cubit-generated mesh for the Advanced Test Reactor is utilized as an intermediate step between the OpenMC and Griffin models; Griffin utilizes the mesh for its finite element solution, while OpenMC material identifications are written to the mesh file to be used in Griffin material assignments. Additionally, a Python-based script converts the cross sections generated by OpenMC into the ISOXML format required by Griffin. Initial comparisons using the Griffin diffusion solver indicated good agreement between the neutron multiplication factors obtained from the standalone OpenMC model and the Griffin model, with differences of less than 10 pcm in the 2D geometry configuration; it was later determined that this agreement was likely due to compensating effect and was more likely on the order of –700 pcm relative to the OpenMC solution. However, in three-dimensional calculations, an unacceptably large error (almost 8,000 pcm) was found in the Griffin solution with the diffusion solver. Subsequent calculations using Griffin’s discrete ordinates solver demonstrated substantially improved agreement, within 116 pcm of the OpenMC solution used to generate the cross sections for Griffin. Building on this capability, future work will seek to perform more detailed validation calculations. The ultimate goal is to evaluate both transient and multiphysics simulations of the reactor.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS

Chemo‐Mechanical Coupling in Hydrogels: Dynamics in the Diffusion‐Limited Regime

Hydrogels are characterized by substantial volume changes in response to external stimuli, making them promising candidates for developing smart materials with enhanced adaptability and responsiveness. By integrating chemical reactions, hydrogels acquire dynamic and tunable responsiveness to external stimuli through chemo‐mechanical coupling, expanding their potential in emerging applications. However, capturing their transient behavior remains challenging due to the complex interplay of chemical reactions, solvent transport, and polymer network deformation. Classical theories capture equilibrium swelling but fail to describe time‐dependent phenomena. To address this, a time‐dependent continuum model is developed that explicitly couples these processes. Volume phase transition in hydrogels with homogeneous chemical reactions is investigated, then the effects of reaction kinetics on these transitions are analyzed. The coupling of these mechanisms is further explored through a study of transient mechanical instabilities. To illustrate the impact of distinct reaction and diffusion timescales, a photo‐active gripper is studied for robotic applications. Finally, a photo‐active microswimmer that exhibits non‐reciprocal motion is proposed to highlight the solvent diffusion for locomotion at the micro‐ and nano‐ scales. The work establishes that transient dynamics of chemo‐mechanical hydrogels generate functions not accessible by steady state models and provides a predictive platform for designing adaptive materials in emerging applications.

chemo-mechanical coupling

The accuracy of multi-group models for nonlocal electron transport in magnetized plasmas

In the extreme conditions of inertial confinement fusion experiments, heat flow plays a vital role, but local diffusive models frequently break down and overestimate the heat flow. The situation becomes more complicated again in the significant magnetic fields generated during laser–plasma interactions or in magnetized fusion schemes. Accurate non-local and magnetized heat flow computations can be carried out using Vlasov–Fokker–Planck (VFP) simulations, but these are computationally expensive. There is, therefore, significant interest in using faster multi-group models to accurately calculate the non-local heat flow in magnetized plasmas. We benchmark two such multi-group models for calculating the heat flow, M1 and hybrid-AWBS-BGK, against diffusive models and full VFP simulations, before applying the models to realistic example test cases, both magnetized and unmagnetized. We find that the multi-group models generally perform very well for moderate non-localities up to kλmfp∼0.01, but the computational cost increases dramatically. hybrid-AWBS-BGK performs more effectively than M1 at high non-localities, up to kλmfp∼1, due to its adaptive solver and robust P1 closure, but tends to fail in very strong magnetic fields. Both codes are much faster than VFP simulations but are still slow in steep temperature gradients.

Arran, C. (ORCID:0000000286448118)

Geospatial Diffusion for Land Cover Imperviousness Change Forecasting

Land-use and land-cover (LULC) has a significant effect on several Earth system processes. For example, impervious surfaces reduce infiltration and speed water flow, impacting regional hydrology and flood risk. While Earth System models have improved forecasting hydrologic and atmospheric processes at higher resolutions, the ability to forecast LULC change has lagged behind. In this paper, we propose a new paradigm exploiting Generative AI (GenAI) for land cover change forecasting by framing it as a data synthesis problem conditioned on historical and auxiliary data-sources. To demonstrate the feasibility of our methodology, we perform experiments where a diffusion model is trained for decadal forecasting of imperviousness change across the entire United States. We find that our model yields MAE lower than a no-change baseline for resolutions ≥ 0.7 X 0.7km2 on average, demonstrating its ability to capture and project accurate spatiotemporal patterns. Finally, we discuss future research to incorporate Earth's physical properties and enabling scenario simulations via driver variables.

Varshney, Debvrat [ORNL] (ORCID:0000000188981736)

Neutronics and Thermo-Fluids Simulation of Generic Pebble-Bed Fluoride-Salt-Cooled High-Temperature Reactor

The fluoride-salt-cooled high-temperature reactor (FHR) is one of the advanced reactors that has been attracting considerable interest from both the research community and the nuclear industry. To help facilitate the nuclear community's familiarity with the FHR, Kairos Power has developed a generic FHR (gFHR) benchmark. In the research performed here, this benchmark was used to assess innovative modeling methods that combine stochastic and deterministic computer codes to perform the design and analysis of the gFHR. Further, the Monte Carlo code Serpent 2 was used to generate few-group cross sections that were then used in the neutron diffusion and thermal-fluids code AGREE to perform full-core neutronics and thermal-fluids steady-state and transient core analysis. The Argonne National Laboratory code SAM was then used to model the gFHR system and to simulate the load-follow operation of the gFHR.

22 GENERAL STUDIES OF NUCLEAR REACTORS

Interstitialcy-mediated transport in Hematite

Defect transport mechanisms drive the performance of materials in both energy storage and energy generating systems. Iron oxide systems are of particular interest with use cases in both realms. Previous studies of a-Fe2O3 (hematite) determined that the primary point defects at elevated temperature are O vacancies and Fe interstitials, and these defects determine transport rates at temperatures >850°C. However, in advanced nuclear reactor designs, operating temperatures will range between 400-800°C. In this study, we utilize isotopic tracers and the nanoscale resolution of atom probe tomography to determine diffusivities at lower temperatures relevant to nuclear energy generating systems. Supported by a density functional theory informed rate theory model, we find a change from vacancy to interstitialcy-mediated transport < 800°C in the anion lattice.

Yano, Kayla H.

HIGH-FIDELITY SIMULATION OF SOOT FORMATION AND THERMAL RADIATION IN A LABORATORY-SCALE RICH-QUENCH-LEAN BURNER

High-fidelity simulations of a swirl-stabilized turbulent spray flame in a laboratory-scale aero-combustor have been performed to evaluate the predictability of state-of-the-art models in capturing soot formation. The simulations employ a complex chemical mechanism developed for Jet-A with PAH chemistry, coupled with the Hybrid Method of Moments (HMOM) soot model, and a Lagrangian dilute spray model for the fuel injection. Two simulations are performed to compare the results when thermal radiation is neglected or included in the solution with a mean spectral model. Modeling closures for the soot differential diffusion effects in mixture fraction space, as well as turbulence-radiation interaction are also evaluated using the data generated by the simulations. Given the degree of complexity of the simulation, the results showed good agreement with experimental measurements of the spatial distribution of the soot volume fraction ensemble average. A closer agreement with the experiment is observed when thermal radiation is included in the solution. Thermal radiation is observed to reduce the flame temperature and increase the flame intermittency, denoted by the increase in the temperature standard deviation in mixture fraction space. The reduction in temperature also leads to a reduction in PAH production and soot volume fraction. Turbulence is observed to have different effects on radiative emission depending on the mixture fraction. Turbulent scalar fluctuations significantly enhance radiative emission in fuel lean mixtures and can also play a role for fuel rich conditions. The statistical description of the turbulence-radiation interaction, previously proposed in the literature, was observed to correctly reproduce the high-fidelity results. Model coefficients were provided for swirl-stabilized flames. The soot differential diffusion model, previously proposed in the literature, based on the residual between the exact term and its model approximation, was also evaluated. The residual correction term further improved the agreement with exact differential diffusion term evaluated with the high-fidelity simulation data in mixture fraction space. The results suggest that the effective turbulent Lewis number can be equal to unity in simulations of turbulent non-premixed recirculating flames.

Soriano, Bruno [Sandia National Laboratories (SNL)

Using convolutional neural networks to accelerate three-dimensional coherent synchrotron radiation computations

Calculating the effects of coherent synchrotron radiation (CSR) is one of the most computationally expensive tasks in accelerator physics. Here, we use convolutional neural networks (CNNs), along with a latent conditional diffusion (LCD) model, trained on physics-based simulations to speed up calculations. Specifically, we produce the 3D CSR wakefields generated by electron bunches in circular orbit in the steady-state condition. Two datasets are used for training and testing the models: wakefields generated by three-dimensional Gaussian electron distributions and wakefields from a sum of up to 25 three-dimensional Gaussian distributions. The CNNs are able to accurately produce the 3D wakefields ∼250–1000 times faster than the numerical calculations, while the LCD achieves a gain of a factor of ∼34. We also test the extrapolation and out-of-distribution generalization ability of the models. They generalize well on distributions with larger spreads than what they were trained on but struggle with smaller spreads.

43 PARTICLE ACCELERATORS

Enabling probabilistic learning on manifolds through double diffusion maps

Here, we present a generative learning framework for probabilistic sampling that extends Probabilistic Learning on Manifolds (PLoM), which is designed to generate statistically consistent realizations of a random vector in a finite-dimensional Euclidean space, informed by a (representative) set of observations. In its original form, PLoM constructs a reduced-order probabilistic model by combining three main components: (a) kernel density estimation to approximate the underlying probability measure, (b) Diffusion Maps to characterize the manifold of the data, and (c) a reduced-order Itô Stochastic Differential Equation (ISDE) to sample from the learned distribution. However, its sampling dynamics are posed in the ambient space and the retained number of reduced coordinates is chosen by projection-reconstruction error. In practice, this often (i) requires more coordinates than the data’s intrinsic dimension to achieve stable sampling and (ii) lacks a smooth, basis-independent lifting back to the data domain; moreover, standard Diffusion Maps emphasize harmonic eigenfunctions and can miss non-harmonic latent structure. We address these limitations by decoupling geometry learning from sampling: a first Diffusion Maps pass identifies non-harmonic coordinates on which we formulate a full-order ISDE directly in the latent space, while Double Diffusion Maps captures multiscale geometric features and Geometric Harmonics (GH) learns a smooth lifting map to the ambient variables that is independent of the particular diffusion basis. This hybrid design preserves the system’s dynamical richness with a compact geometric representation and enables principled out-of-sample inference. The effectiveness and robustness of the proposed method are illustrated through two numerical studies: one based on data generated from two-dimensional Hermite polynomial functions and another based on high-fidelity simulations of a detonation wave in a reactive flow.

Double diffusion maps

Gray-Scott reaction-diffusion

This dataset consists of 1000 records in a single HDF5 file generated from the simulation code available at: https://github.com/lezahlie/greyscott_simulation. More about the Gray-Scott model is explained here https://visualpde.com/nonlinear-physics/gray-scott.html.

97 MATHEMATICS AND COMPUTING

Simulating the CMS High Granularity Calorimeter with ML

Detector simulation is a key component of physics analysis and related activities in CMS. In the upcoming High Luminosity LHC era, simulation will be required to use a smaller fraction of computing in order to satisfy resource constraints. At the same time, CMS will be upgraded with the new High Granularity Calorimeter (HGCal), which requires significantly more resources to simulate than the existing CMS calorimeters. This computing challenge motivates the use of generative machine learning models as surrogates to replace full physics-based simulation. We study the application of state-of-the-art diffusion models to simulate particle showers in the CMS HGCal. We will discuss methods to overcome the challenges posed by the high-dimensional, irregular geometry of the HGCal. The quality of the showers produced by the diffusion model will be assessed by comparison to the full GEANT4-based simulation. The increase in simulation throughput will be quantified and methods to accelerate the diffusion model inference will also be discussed.

Amram, Oz