Generating Multiphase Fluid Configurations in Fractures using Diffusion Models
Explore the source record for details and available documents.
Computer Science↗
SEARCH · Search NASA
Results for “generative diffusion”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Latent diffusion can map beam loss to two-dimensional phase-space projections
Beam loss monitors (BLMs) and beam current monitors (BCMs) are ubiquitous at particle accelerators around the world. These simple devices provide noninvasive high-level beam measurements but give no insight into the detailed 6D (𝑥,𝑦,𝑧,𝑝 𝑥 ,𝑝 𝑦 ,𝑝 𝑧 ) beam phase-space distributions or dynamics. We show that generative conditional latent diffusion models can learn intricate patterns to solve the extreme inverse problem of mapping waveforms of tens of BLMs or BCMs along an accelerator to detailed 2D projections of a charged particle beam’s 6D phase-space density. This transformational method can be used at any particle accelerator to transform simple noninvasive devices into detailed beam phase-space diagnostics. We demonstrate this concept via multiparticle simulations of the high-intensity beam in the kilometer-long Los Alamos Neutron Science Center linear proton accelerator.
43 PARTICLE ACCELERATORS↗
Field-level reconstruction from foreground-contaminated 21-cm maps
Current and upcoming 21-cm experiments will soon be able to map 21-cm spatial fluctuations in three dimensions for a wide range of redshifts. However, bright foreground contamination and the nature of radio interferometry create significant challenges, making it difficult to access rich cosmological information from the Fourier modes that lie within the “foreground wedge”. Here, in this work, we introduce two approaches aiming to reconstruct the full 21-cm density field, including the missing modes in the wedge: (a) a field-level inference under an effective field theory (EFT) framework; (b) a diffusion-based deep generative model trained on simulations. Under the EFT framework, we implement a fully differentiable forward model that maps the initial conditions of matter fluctuations to the observed, foreground-filtered 21-cm maps. This enables a gradient-based sampler to simultaneously sample the initial conditions and bias parameters, allowing a physically motivated mode reconstruction. Alternatively, we apply a variational diffusion model to perform 21-cm density reconstruction at the map level. Our model is trained on semi-numerical simulations over a wide range of astrophysical parameters. Our results from both approaches should provide improved cosmological constraints from the field level and also enable cross-correlation between experiments that have little or no overlapping modes.
cosmological perturbation theory↗
Helium bubble formation in aged plutonium metal at ambient conditions
A model of helium bubble formation is developed that assumes the initial nascent bubbles are generated when two diffusing helium atoms come within a distance of about the interatomic spacing of the plutonium atoms. These nascent bubbles are assumed to be locked in place and grow as additional helium atoms diffuse across their surfaces. Calculations of the helium-bubble number density and sizes as a function of age are compared to experiment. This leads to an inferred helium diffusion coefficient of-the-order of 10 -20 m 2 /s, supports the idea that most of the helium from alpha-decay end up in bubbles, and that previous transmission electron microscopy size estimates are biased low. The energy that helium can transfer to 40-year-old plutonium, upon expansion, is determined to be <0.1 Joules per gram of metal. The model predicts differences between the bubble properties in naturally and accelerated aged plutonium.
36 MATERIALS SCIENCE↗
Enhancing Unknown Waveform Detection by Learning Intra and Inter-domain Dependencies with Advanced Attention Fusion Mechanisms
Detection of unknown waveforms in mission-critical communications is a crucial area of interest for the Department of Energy (DoE). Traditional methods and recent deep learning-based approaches often assume that the training set includes all possible classes, which is impractical for detecting new waveforms. This limitation gives rise to the problem of open-set recognition (OSR), which involves correctly identifying known classes while detecting and rejecting unknown or unseen classes. To address this limitation, we propose a novel dual-domain complex-valued neural architecture that jointly processes time-domain and frequency-domain signal representations using transformer mechanisms. A transformer model is a deep learning architecture that uses self-attention mechanisms to process and learn relationships in sequential data. Our model employs a cosine similarity loss to extract domain-specific features and incorporates a transformer architecture in the latent space to weigh the importance of different features from the time and frequency domains. The transformer layer includes stacked self-attention and cross-attention modules to learn intra-domain and inter-domain dependencies, creating a more holistic signal representation. An attention-based fusion module intelligently combines the time and frequency-domain features using multi-head attention, enabling the network to learn the optimal feature for each domain in each input signal. Quantitative results demonstrate the impact of these architectural choices on overall performance, showing significant improvement after incorporating self and cross-attention modules and using complex attention fusion over simple weighted fusion. Our ongoing work will focus on addressing the limitations of threshold-based OSR methods by developing a novel generative framework that integrates a conditional diffusion probabilistic model (DPM). DPM is a generative framework that learns to synthesize complex data by reversing a gradual noising process using a neural network trained to denoise step-by-step. Our goal is to leverage the inherent strengths of DPMs for identifying unknown signals more robustly. One primary advantage of using a DPM is its ability to provide a more reliable anomaly score based on the model's reconstruction error, rather than relying solely on classifier confidence. Additionally, the iterative denoising process of DPMs makes this approach naturally resilient to low Signal-to-Noise Ratio (SNR) conditions, where traditional methods often fail. By implementing this generative framework, we aim to enhance the model's capability to accurately detect unknown waveforms and maintain performance in challenging environments.
99 - GENERAL AND MISCELLANEOUS↗
Diffusion Barrier Coatings for Liquid Metal Corrosion Resistance in Next-Generation Nuclear Reactors
The goal of this study is to characterize the chemical and physical interactions that occur between a ceramic diffusion barrier coating applied onto nuclear reactor cladding and liquid metal coolants used in Sodium-Cooled Fast Reactors (SFRs) and Lead-Cooled Fast Reactors (LFRs).
Hromiak, Alexander A. [Virginia Polytechnic Inst. ↗
Enabling probabilistic learning on manifolds through double diffusion maps
Here, we present a generative learning framework for probabilistic sampling that extends Probabilistic Learning on Manifolds (PLoM), which is designed to generate statistically consistent realizations of a random vector in a finite-dimensional Euclidean space, informed by a (representative) set of observations. In its original form, PLoM constructs a reduced-order probabilistic model by combining three main components: (a) kernel density estimation to approximate the underlying probability measure, (b) Diffusion Maps to characterize the manifold of the data, and (c) a reduced-order Itô Stochastic Differential Equation (ISDE) to sample from the learned distribution. However, its sampling dynamics are posed in the ambient space and the retained number of reduced coordinates is chosen by projection-reconstruction error. In practice, this often (i) requires more coordinates than the data’s intrinsic dimension to achieve stable sampling and (ii) lacks a smooth, basis-independent lifting back to the data domain; moreover, standard Diffusion Maps emphasize harmonic eigenfunctions and can miss non-harmonic latent structure. We address these limitations by decoupling geometry learning from sampling: a first Diffusion Maps pass identifies non-harmonic coordinates on which we formulate a full-order ISDE directly in the latent space, while Double Diffusion Maps captures multiscale geometric features and Geometric Harmonics (GH) learns a smooth lifting map to the ambient variables that is independent of the particular diffusion basis. This hybrid design preserves the system’s dynamical richness with a compact geometric representation and enables principled out-of-sample inference. The effectiveness and robustness of the proposed method are illustrated through two numerical studies: one based on data generated from two-dimensional Hermite polynomial functions and another based on high-fidelity simulations of a detonation wave in a reactive flow.
Double diffusion maps↗
Direct Visualization of Defect‐Controlled Diffusion in van der Waals Gaps
Abstract Diffusion processes govern fundamental phenomena such as phase transformations, doping, and intercalation in van der Waals (vdW) bonded materials. Here, the diffusion dynamics of W atoms by visualizing the motion of individual atoms at three different vdW interfaces: hexagonal boron nitride (BN)/vacuum, BN/BN, and BN/WSe 2 , by recording scanning transmission electron microscopy movies is quantified. Supported by density functional theory (DFT) calculations, it is inferred that in all cases diffusion is governed by intermittent trapping at electron beam‐generated defect sites. This leads to diffusion properties that depend strongly on the number of defects. These results suggest that diffusion and intercalation processes in vdW materials are highly tunable and sensitive to crystal quality. The demonstration of imaging, with high spatial and temporal resolution, of layers and individual atoms inside vdW heterostructures offers possibilities for direct visualization of diffusion and atomic interactions, as well as for experiments exploring atomic structures, their in situ modification, and electrical property measurements of active devices combined with atomic resolution imaging.
Chemistry↗
Generative models on phase space
Deep generative models such as diffusion and flow matching are powerful machine learning tools capable of learning and sampling from high-dimensional distributions. They are particularly useful when the training data appears to be concentrated on a submanifold of the data embedding space. For high-energy physics data, consisting of collections of relativistic energy-momentum 4-vectors, this submanifold can enforce extremely strong physically-motivated priors, such as energy and momentum conservation. If these constraints are learned only approximately, rather than exactly, this can inhibit the interpretability and reliability of such generative models. To remedy this deficiency, we introduce generative models which are, by construction, confined at every step of their sampling trajectory to the manifold of massless N-particle Lorentz-invariant phase space in the center-of-momentum frame. In the case of diffusion models, the "pure noise" forward process endpoint corresponds to the uniform distribution on phase space, which provides a clear starting point from which to identify how correlations among the particles emerge during the reverse (de-noising) process. We demonstrate that our models are able to learn both few-particle and many-particle distributions with various singularity structures, paving the way for future interpretability studies using generative models trained on simulated jet data.
Bogorad, Zachary [Fermilab]↗
Coupled cluster and dislocation dynamics modeling of microstructure evolution in irradiated materials
We develop here a coupled cluster and dislocation dynamics framework to study the microstructure evolution of irradiated materials. The framework not only accounts for the three dimensional diffusion of radiation-generated clusters, but also their interaction with dislocation networks and the resultant climb motion of discrete dislocations within finite crystals. The framework is solved with a superposition solution scheme, and is applied to investigate the evolution of the irradiation-induced dislocation loops in zirconium (Zr), considering the effects of various bias factors including the diffusion anisotropy difference (DAD) of interstitials and interstitial clusters, the dislocation bias of defects to discrete dislocation segments, and the production bias of defects from the radiation cascade. We find that the DAD is the most critical factor influencing the kinetics of the loop evolution in Zr, while the recombination/interaction of mobile defects can induce a strong spatial dependence of the loop evolution together with the DAD. Here, the method is also adopted to study the evolution of interstitial $\langle$a$\rangle$ and vacancy $\langle$c$\rangle$ dislocation loop ensembles consistent with the microstructure observed during irradiation-induced growth of Zr. Our findings not only reveal the spatial dependence of the size and ellipticity of the dislocation loops, but also suggest a limit on the anisotropy factor of interstitials to reproduce the co-growth of $\langle$a$\rangle$ and $\langle$c$\rangle$ loops in zirconium, in good agreement with experimental observations and other simulation results.
Bias factors↗
Conditional distribution estimation of building characteristics with diffusion models for urban energy modeling
Understanding current energy consumption behavior in communities is critical for informing future energy use decisions and enabling efficient energy management. Urban energy models, which are used to simulate these energy use patterns, require large datasets with detailed building characteristics for accurate outcomes. However, such detailed characteristics at the individual building level are often unknown and costly to acquire, or unavailable. Through this work, we propose using a generative modeling approach to generate realistic building attributes to fill in the data gaps and finally provide complete characteristics as inputs to energy models. Our model learns complex, building-level patterns from training on a large-scale residential building stock model containing 2.2 million buildings. We employ a tabular diffusion-based framework that is designed to handle heterogeneous (discrete and continuous) features in tabular building data, such as occupancy, floor area, heating, cooling, and other equipment details. We develop a capability for conditional diffusion, enabling the imputation of missing building characteristics conditioned on known attributes. We conduct a comprehensive validation of our conditional diffusion model, firstly by comparing the generated conditional distributions against the underlying data distribution, and secondly, by performing a case study for a Baltimore residential region, showing the practical utility of our approach. Our work is one of the first to demonstrate the potential of generative modeling to accelerate building energy modeling workflows.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Generative AI for design of nanoporous materials: review and future prospects
Generative artificial intelligence (AI) is emerging as a powerful tool for advancing the design of nanoporous materials such as metal–organic frameworks, covalent–organic frameworks, and zeolites. These materials have potential application in important areas such as carbon capture, catalysis, gas storage, chemical separation, and drug delivery due to their modular, tunable structures, and their performance in these areas depends on precise control over their structure, chemical functionalities, and properties. Herein, we provide a review of generative AI algorithms that are emerging as powerful tools for the design of nanoporous materials, namely generative adversarial networks, variational autoencoders, diffusion models, genetic algorithms, reinforcement learning, and large language models. Some models are particularly good at generating diverse and high-quality designs, while others excel at exploring large design spaces or optimizing materials with desired properties. Certain algorithms also allow for efficient transitions between different designs, and some offer versatility in generating materials based on textual input. We discuss the advantages, limitations, and applications of these algorithms in porous material design and emphasize the future potential of integrating AI with experimental workflows to accelerate the development and validation of AI-generated materials.
36 MATERIALS SCIENCE↗
Hybrid learning techniques for scientific data reduction with performance guarantees
The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.
97 MATHEMATICS AND COMPUTING↗
Final report- UFL - RAPIDS2: A SciDAC Institute for Computer Science, Data, and Artificial Intelligence
The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.
97 MATHEMATICS AND COMPUTING↗
Multi-Objective design of interlocking metasurfaces using conditional diffusion models
Unit cell design remains a major challenge for interlocking metasurfaces, a promising joining technology for dissimilar materials, due to the complex, competing, multivariate design space and the need for rapid adaptation to varying performance requirements. This study explores Conditional Diffusion Models as a design optimization tool for interlocking metasurfaces. Given the complex, competing, multivariate design space for interlocking metasurfaces, unit cell design remains a major challenge for this joining technology. We trained a conditional diffusion model on 25,000 finite element analysis-simulated interlocking metasurface unit cells to generate designs with tailored thermo-mechanical properties (tensile strength, shear strength, and thermal conductivity) based on specified performance criteria. The model demonstrated a success rate of approximately 72 % in producing designs that met specified property bounds. The conditional diffusion model generated both thermally resistive and conductive designs, revealing clear trends in design characteristics: taller, dendritic structures were advantageous for tensile loads, while shorter, robust designs excelled in shear applications. Our findings indicate that the model's performance is more influenced by the breadth of the design space than by the quantity of training data, highlighting the importance of expansive design domains for generating innovative solutions. This work establishes conditional diffusion models as a highly efficient and adaptable tool for rapid interlocking metasurface unit cell design, paving the way for advancements in multi-material joining technologies, as well as highlighting the justification to leverage conditional diffusion models as design tools across complex design domains.
Conditional diffusion models↗
Pressure-Tolerant 3D Anodes Enable Short-Circuit Prevention and Low Heat Generation in Argyrodite Solid-State Batteries
Solid-state batteries (SSBs) offer a safer, higher-energy-density alternative to lithium-ion batteries, yet commercialization is hindered by incompatibility with lithium metal. Here, to overcome these challenges, we developed a cost-effective, commercially available prelithiated micro carbon fiber framework (Li-Cf) anode featuring a high-pressure-tolerance, for use with argyrodite solid-state electrolytes (SSEs). This 3D structure accommodates uniform lithium deposition, simplifies cell assembly under elevated pressure, inhibits dendrite growth toward SSEs, reduces heat generation, and enhances overall compatibility. Notably, our architecture enables the cell to tolerate pressures up to 400 MPa without short-circuiting during assembly. Meanwhile, the 3D framework serves as a preferential pathway for lithium deposition, thereby reducing lithium growth toward the SSEs and mitigating the risk of dendrite formation in SSEs. Operando calorimetry and distribution of relaxation times analysis reveal that lithium morphology degradation at the interface with the SSEs is a key failure mechanism in lithium metal argyrodite SSBs, leading to increased diffusion resistance and heat generation. In contrast, the Li-Cf anode mitigates these issues by reducing both heat flux and charge transfer resistance. Full cells with LiNi 0.8 Co 0.1 Mn 0.1 O 2 /Li 6 PS 5 Cl/Li-Cf retain ~79% capacity after 600 cycles, demonstrating significantly improved cycling stability and strong potential for practical energy storage applications.
25 ENERGY STORAGE↗
GenAI4UQ: A software for forward and inverse uncertainty quantification using conditional generative AI
We introduce GenAI4UQ, a software package for forward and inverse uncertainty quantification in model calibration, parameter estimation, and ensemble forecasting. GenAI4UQ leverages a generative AI-based conditional modeling framework to address limitations of traditional inverse modeling techniques, such as Markov Chain Monte Carlo (MCMC) methods. By replacing computationally intensive iterative processes with a direct, learned mapping, GenAI4UQ enables efficient calibration of input parameters and generation of predictions directly from observations. The software supports rapid ensemble forecasting with robust uncertainty quantification while maintaining computational and storage efficiency. Built-in auto-tuning of hyperparameters simplifies model training, ensuring accessibility for users with varying expertise. Its versatile conditional generative framework is applicable across diverse scientific domains. While GenAI4UQ offers significant advantages in flexibility and efficiency, users should interpret its uncertainty estimates with caution in data-sparse scenarios, as the model may overestimate uncertainty—an effect common to all surrogate-based approaches including MCMC with surrogate models. Despite this, GenAI4UQ transforms inverse modeling by providing a fast, reliable, and user-friendly solution. It empowers researchers and practitioners to quickly estimate parameter distributions and generate model predictions for new observations, facilitating efficient decision-making and advancing the state of uncertainty quantification in computational modeling.
97 MATHEMATICS AND COMPUTING↗
Diffusion model approach to simulating electron-proton scattering events
Generative artificial intelligence is a fast-growing area of research offering various avenues for exploration in high-energy nuclear physics. In this work, we explore the use of generative models for simulating electron-proton collisions relevant to experiments like the Continuous Electron Beam Accelerator Facility and the future Electron-Ion Collider (EIC). These experiments play a critical role in advancing our understanding of nucleons and nuclei in terms of quark and gluon degrees of freedom. The use of generative models for simulating collider events faces several challenges such as the sparsity of the data, the presence of global or eventwide constraints, and steeply falling particle distributions. In this work, we focus on the implementation of diffusion models for the simulation of electron-proton scattering events at EIC energies. Our results demonstrate that diffusion models can reproduce relevant observables such as momentum distributions and correlations of particles, momentum sum rules, and the leading electron kinematics, all of which are of particular interest in electron-proton collisions. Although the sampling process is relatively slow compared to other machine-learning architectures, we find diffusion models can generate high-quality samples. We foresee various applications of our work including inference for nuclear structure, interpretable generative machine learning, and searches of physics beyond the Standard Model. Published by the American Physical Society 2024
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗