Search NASASearch

SEARCH · Search NASA

Results for “Conditional diffusion models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Hybrid learning techniques for scientific data reduction with performance guarantees

The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.

97 MATHEMATICS AND COMPUTING

Final report- UFL - RAPIDS2: A SciDAC Institute for Computer Science, Data, and Artificial Intelligence

The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.

97 MATHEMATICS AND COMPUTING

Report on the AAPM grand challenge on deep generative modeling for learning medical image statistics

Abstract Background The findings of the 2023 AAPM Grand Challenge on Deep Generative Modeling for Learning Medical Image Statistics are reported in this Special Report. Purpose The goal of this challenge was to promote the development of deep generative models for medical imaging and to emphasize the need for their domain‐relevant assessments via the analysis of relevant image statistics. Methods As part of this Grand Challenge, a common training dataset and an evaluation procedure was developed for benchmarking deep generative models for medical image synthesis. To create the training dataset, an established 3D virtual breast phantom was adapted. The resulting dataset comprised about 108 000 images of size 512 512. For the evaluation of submissions to the Challenge, an ensemble of 10 000 DGM‐generated images from each submission was employed. The evaluation procedure consisted of two stages. In the first stage, a preliminary check for memorization and image quality (via the Fréchet Inception Distance [FID]) was performed. Submissions that passed the first stage were then evaluated for the reproducibility of image statistics corresponding to several feature families including texture, morphology, image moments, fractal statistics, and skeleton statistics. A summary measure in this feature space was employed to rank the submissions. Additional analyses of submissions was performed to assess DGM performance specific to individual feature families, the four classes in the training data, and also to identify various artifacts. Results Fifty‐eight submissions from 12 unique users were received for this Challenge. Out of these 12 submissions, 9 submissions passed the first stage of evaluation and were eligible for ranking. The top‐ranked submission employed a conditional latent diffusion model, whereas the joint runners‐up employed a generative adversarial network, followed by another network for image superresolution. In general, we observed that the overall ranking of the top 9 submissions according to our evaluation method (i) did not match the FID‐based ranking, and (ii) differed with respect to individual feature families. Another important finding from our additional analyses was that different DGMs demonstrated similar kinds of artifacts. Conclusions This Grand Challenge highlighted the need for domain‐specific evaluation to further DGM design as well as deployment. It also demonstrated that the specification of a DGM may differ depending on its intended use.

Radiology, Nuclear Medicine & Medical Imaging

Latent diffusion can map beam loss to two-dimensional phase-space projections

Beam loss monitors (BLMs) and beam current monitors (BCMs) are ubiquitous at particle accelerators around the world. These simple devices provide noninvasive high-level beam measurements but give no insight into the detailed 6D (𝑥,𝑦,𝑧,𝑝 𝑥 ,𝑝 𝑦 ,𝑝 𝑧 ) beam phase-space distributions or dynamics. We show that generative conditional latent diffusion models can learn intricate patterns to solve the extreme inverse problem of mapping waveforms of tens of BLMs or BCMs along an accelerator to detailed 2D projections of a charged particle beam’s 6D phase-space density. This transformational method can be used at any particle accelerator to transform simple noninvasive devices into detailed beam phase-space diagnostics. We demonstrate this concept via multiparticle simulations of the high-intensity beam in the kilometer-long Los Alamos Neutron Science Center linear proton accelerator.

43 PARTICLE ACCELERATORS

Development of mathematical techniques for the assimilation of remote sensing data into atmospheric models

The problem of the assimilation of remote sensing data into mathematical models of atmospheric pollutant species was investigated. The data assimilation problem is posed in terms of the matching of spatially integrated species burden measurements to the predicted three-dimensional concentration fields from atmospheric diffusion models. General conditions were derived for the reconstructability of atmospheric concentration distributions from data typical of remote sensing applications, and a computational algorithm (filter) for the processing of remote sensing data was developed.

Seinfeld, J. H.

Development of mathematical techniques for the assimilation of remote sensing data into atmospheric models

The problem of the assimilation of remote sensing data into mathematical models of atmospheric pollutant species was investigated. The problem is posed in terms of the matching of spatially integrated species burden measurements to the predicted three dimensional concentration fields from atmospheric diffusion models. General conditions are derived for the "reconstructability' of atmospheric concentration distributions from data typical of remote sensing applications, and a computational algorithm (filter) for the processing of remote sensing data is developed.

Seinfeld, J. H.

A comparison of probabilistic generative frameworks for molecular simulations

Generative artificial intelligence is now a widely used tool in molecular science. Despite the popularity of probabilistic generative models, numerical experiments benchmarking their performance on molecular data are lacking. Here, in this work, we introduce and explain several classes of generative models, broadly sorted into two categories: flow-based models and diffusion models. We select three representative models: neural spline flows, conditional flow matching, and denoising diffusion probabilistic models, and examine their accuracy, computational cost, and generation speed across datasets with tunable dimensionality, complexity, and modal asymmetry. Our findings are varied, with no one framework being the best for all purposes. In a nutshell, (i) neural spline flows do best at capturing mode asymmetry present in low-dimensional data, (ii) conditional flow matching outperforms other models for high-dimensional data with low complexity, and (iii) denoising diffusion probabilistic models appear the best for low-dimensional data with high complexity. Our datasets include a Gaussian mixture model and the dihedral torsion angle distribution of the Aib9 peptide, generated via a molecular dynamics simulation. We hope our taxonomy of probabilistic generative frameworks and numerical results may guide model selection for a wide range of molecular tasks.

Artificial intelligence

ClimGen: Learning the Forcing-Response Relationship in Climate System

Solar Radiation Management (SRM) is emerging as a potential geoengineering strategy to address the anthropogenic impact on climate, but its effective implementation requires an iterative and large ensemble of highly accurate and efficient climate projections. Traditional climate projections rely on executing computationally demanding and time-consuming numerical climate models. Recent advances in machine learning (ML) aim to enhance these approaches by emulating traditional methods. In this work, we propose a novel framework for directly learning the relationship between solar radiation flux at the top of the atmosphere and the corresponding surface temperature response. To evaluate the feasibility of this direct ML-based projection, we developed a dataset using an intermediate complexity model, incorporating a comprehensive suite of different forcing patterns and evaluation metrics to rigorously assess the ML model’s performance. We introduce a Conditional Denoising Diffusion Probabilistic Model (cDDPM) for this task, which demonstrates encouraging skill in representing climate statistics under previously unseen forcing patterns. This approach provides a promising pathway for direct climate projections by accurately learning the forcing-response relationship, with a wide range of applications in impact mitigation, emissions policy design, and SRM strategies.

Chen, Tse-Chun [BATTELLE (PACIFIC NW LAB)] (ORCID:

A study of plasmaspheric density distributions for diffusive equilibrium conditions

The plasmaspheric density distribution has been modeled for a range of solar cycle, seasonal and diurnal conditions with a magnetic flux tube dependent diffusive equilibrium model by using experimentally determined values of ionospheric parameters at 675 km as boundary conditions. Data is presented in terms of plasmaspheric H(+) and He(+) density contours, total flux tube content, and equatorial plasma density for a range of L-values from 1.15 to 3.0. The variation of equatorial density with L-value shows good agreement with the 1/L exp 4 dependence observed experimentally. The results show that the model predicts larger solar cycle and diurnal variation in equatorial plasma density than observed using whistler techniques. However, the whistler method requires a model to deduce the equatorial density and is therefore open to interpretation. Seasonal variations are rather artificial since in this general model no attempt has been made to match equatorial densities for flux tubes emanating from the winter and summer hemispheres.

Li, W.

Computer simulation of impurity diffusion in silicon, part 1

The elementary classical models for idealized diffusion conditions are described, and the principles are then used in developing more realistic models. The practical models require some type of numerical analysis. The numerical techniques are outlined and details concerning their implementation are given. Some results are presented which were obtained with the computer programs implementing the numerical techniques with implicit and explicit methods. Special problems of impurity-rich interlayers forming between an oxide and silicon are considered. A set of computed curves for sheet resistance, junction depth, and oxide thickness for different diffusion schedules is included.

Gassaway, J. D.

Towards universal unfolding of detector effects in high-energy physics using denoising diffusion probabilistic models

Correcting for detector effects in experimental data, particularly through unfolding, is critical for enabling precision measurements in high-energy physics. However, traditional unfolding methods face challenges in scalability, flexibility, and dependence on simulations. We introduce a novel approach to multidimensional object-wise unfolding using conditional Denoising Diffusion Probabilistic Models (cDDPM). Our method utilizes the cDDPM for a non-iterative, flexible posterior sampling approach, incorporating distribution moments as conditioning information, which exhibits a strong inductive bias that allows it to generalize to unseen physics processes without explicitly assuming the underlying distribution. Our results highlight the potential of this method as a step towards a "universal" unfolding tool that reduces dependence on truth-level assumptions, while enabling the unfolding of a wide range of measured distributions with improved adaptability and accuracy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC

Phase-field modeling of diffusion bonding in 316H stainless steel: Impact of processing conditions on grain morphology and bonding quality

A novel multi-phase, multi-component phase‐field model is presented to study the diffusion bonding of 316H stainless steel. Combined with targeted experimental investigations, this model simulates the bond-growth process and predicts the bonding quality. Unlike previous models, our approach captures the simultaneous evolution of voids and grain structures, while quantifying bonding quality using defined bonding ratio. A comprehensive analysis of bond process control is performed by changing temperature, pressure and surface roughness observing the resulting bond structure, which is consistent with experimental observations and analytical predictions. Temperature is determined to be the dominant factor, with the transition from a flat to a robust bond occurring between 1000 °C and 1050 °C. At the ideal bonding temperature of 1050 °C, a surface roughness exceeding 0.6 μm or an applied stress below 4 MPa results in poor bonding quality. Beyond this, higher pressures and smoother surfaces reduce void size, accelerate void shrinkage, and lead to improved bond integrity. This diffuse-interface model can be extended to other material systems if supplied with appropriate thermodynamic and kinetic data. In conclusion, this makes it an effective modeling platform for optimizing high-temperature diffusion bonding and developing reliable bonded components such as compact heat exchangers.

Diffusion bonding

Thermodynamic and Diffusion Model Estimates on Metamorphic Temperatures and Timescales for Basaltic Eucrite GRA 98098

Introduction: HED meteorites are thought to rep-resent igneous rocks from Vesta’s basaltic crust and preserve evidence of early crustal metamorphism. Determining the temperatures and timescales of thermal metamorphism is important for reconstructing crustal evolution in the early solar system. Here, we study basaltic eucrite Graves Nunataks (GRA) 98098, which has been identified as a highly metamorphosed eucrite [1]. We present new estimates on metamorphic temperatures determined via thermodynamic modeling as well as the initial results from diffusion models constraining timescales of thermal metamorphism. Sample Description: GRA 98098 is an unbrecciated eucrite with a granoblastic plagioclase and pyroxene mineralogy. Millimeter to cm-long lathes of tridymite cross-cut and poikilitically enclose plagioclase and pyroxene [1,this work]. Pyroxene grains have exsolved into Ca-rich (~Wo38En29Fs33) and Ca-poor (~Wo4.5En36Fs59.5) lamellae. Both unzoned and zoned plagioclase grains are observed. Unzoned plagioclase grains are found solely with tridymite laths. These grains have ~An92 compositions. The cores of the zoned plagioclase grains have the same composition and thin, relatively sodic rims (~An67), (Fig. 1). The bulk sample is unusually enriched in highly in-compatible elements and has one of the most fractionated REE patterns reported [1]. Maximum metamorphic temperatures of 985±78°C have been estimated using two-pyroxene thermometry [2]. Methods: Thermodynamic modeling. Thermodynamic models were constructed using the software Perple_X, which employs a Gibbs free energy minimization in order to determine the most stable phase assemblage for a given bulk rock composition [3]. Bulk composition was calculated using mineral com-positions acquired via EMPA (this study) and the observed abundancies present in the thin section. Two bulk compositions were estimated; 1) includes all phases present in the thin section, (assumes that all phases are present during metamorphism), 2) excludes tridymite from the bulk calculation (assumes that tridymite was not present during metamorphism). In order to determine whether metamorphic equilibria was achieved and estimate temperatures of metamorphism, we compared measured pyroxene compositions with thermodynamically predicted compositions [4, Fig. 2]. Diffusion Modeling. Several time-temperature de-pendent diffusion profiles were calculated in order to determine the best match for XAn chemical profiles observed at the edges of the zoned plagioclase (Fig. 3). We assumed that the start condition was a stepwise gradient at the plagioclase/pyroxene interface. We also assumed an average diffusion coefficient (D) and a constant temperature using the equation in [5]. D was determined for two temperatures (T = 1060ºC; near eucrite solidus [6] and T = 985ºC; metamorphism reported in [4]) and then XAn was calculated as a function of distance from plagioclase core to rim using an error function solution to Fick’s second law. Results: Thermodynamic model results are summarized in Fig. 2. For a bulk composition that includes all phases in the thin section, pyroxene endmember compositions plot in the following temperature ranges: Fs ~660-860ºC, En~1000ºC & 1150ºC, and Wo~760-900ºC (Fig. 2a). For a bulk composition that excludes tridymite from the peak metamorphic assemblage (i.e., the bulk composition minus the contribution from tridymite), a temperature range could not be determined for the Fs component of pyroxene. For Wo, T~760-900ºC and En, T~1000ºC & 1150ºC (Fig. 2b). Fig. 3 summarizes the diffusion model results. For T = 1060°C & 985°C, the most appropriate time interval was estimated based on which diffusion curve most matched (solid lines, Fig. 3) the EMPA data. For T = 1060°C, the best looking match was t = 500 ka. For T = 985°C, the best match was t = 7 Ma. Discussion and future work: Temperature estimates from thermodynamic models are not conclusive because the temperature ranges determined for pyroxene endmember stability do not overlap (colored fields in Fig. 2), thus implying that there is disequilibrium between pyroxene crystals and the bulk composition considered [4]. Thus, additional exploration is needed to define a metamorphically equilibrated do-main that accurately records peak temperature. The utility of defining metamorphically equilibrated do-mains to improve the accuracy and level of detail elucidated regarding the petrogenetic history of metamorphose samples has been demonstrated previously [4,7]. We suggest that in the case of Fig. 2a, the thin section composition is not representative of the length scales over which metamorphic equilibrium was achieve and in the case of Fig. 2b, the assumption that tridymite was not present during metamorphism was incorrect. However, results from thermodynamic models can provide insight into the relative timing of mineral and compositional textures. For example from texture alone, it is unclear whether tridymite was igneous in origin and represents the last bits of melt in a crystallizing magma chamber, or if it formed during (and possibly initiated) open system thermal metamorphism. The latter could be consistent with a partial melt hypothesis [8,9] while the former implies that simple fractional crystallization can yield the textures present in GRA 98098. The lack of coincidence be-tween pyroxene endmember compositions in Fig. 2b suggest that the bulk composition minus tridymite was not the assemblage in equilibrium with the pyroxene, suggesting that tridymite was present during metamorphism and formed during igneous crystallization. We conclude that the development of the Na-rich plagioclase rims likely occurred during or immediately after peak thermal metamorphism, because eucrites of similar metamorphic grade and texture have unzoned plagioclase (~An92) [2,4,8], and Na zoning is only observed in the plagioclase not included in the tridymite. This suggests that the zoning formed after tridymite formation, and therefore after igneous crystallization. Thus, the timescales calculated via diffusion modeling possibly represent the time interval over which thermal metamorphism occurred. Cooling rates approximated for the Vestan crust predict that the crust cooled below 300°C around 35-40 Ma after formation[10]. This is consistent with our modeling results that predict formation of the Na rich plagioclase rims occurring at higher temperatures over a period of 0.5 to 7 Ma years. Future work. Additional thermodynamic modeling work will focus on selecting an equilibrated bulk rock domain in which to elucidate metamorphic conditions. Diffusion models currently provide a minimum time-scale, since diffusion slows down as the system cools. Future work with will focus on integrating cooling into the diffusion models and constraining the depth at which thermal metamorphism occurs because it could be used to determine whether the range of time-scales calculated for thermal metamorphism are consistent with the geologic environment.

J S Gorce

On the modeling of scalar diffusion in isotropic turbulence

The objectives of the study were to establish the behavior of conditional scalar dissipation and diffusion at the extreme values of mass fraction and to derive and evaluate closure models for these terms using the scalar probability density function. The conditional scalar dissipation, its derivative with respect to mass fraction, and conditional scalar diffusion are all found to be zero at extreme values of mass fraction. A model for conditional scalar dissipation is derived which exhibits the correct behavior at the extreme values of scalar concentration.

Girimaji, Sharath S.

Global temperature distributions from OGO-6 6300 A airglow measurements

The OGO-6 6300 A airglow temperature measurements have been used to develop models of the global temperature distributions under solstice and equinox conditions for the altitude region from 240 to 300 km and for times ranging from dawn in this altitude region to shortly after sunset. The distributions are compared with models derived from satellite orbital decay and incoherent scatter sounding. The seasonal variation of the temperature as a function of latitude is shown to be very different from that derived from static diffusion models with constant boundary conditions.

Blamont, J. E.

Simulation of plasma and neutral transport in PISCES-RF using SOLPS-ITER

In this research, the fluid plasma transport code SOLPS-ITER is applied and validated against experimental data from the plasma interaction surface component experimental station (PISCES)-RF linear plasma device to establish a physics basis for plasma and neutral transport in its two magnetic field (B-field) geometry setups-(1)the cusp and (2) non-cusp or linear B-field. The main focus of this study is to understand (1) radial plasma transport (2) heat and particle loads on the upstream dump and downstream target plate, and (3) the physics of plasma-neutral interactions in PISCES-RF. The simulation setup adheres to typical PISCES-RF experimental conditions, with a 2D helicon power deposition profile as an input heating source. SOLPS-ITER simulations reproduce experimental conditions with the Bohm diffusion model for both B-field configurations of the PISCES-RF experiment. Major energy loss channels include neutral radiation and power deposited on the wall and dump plate, with only 1% of the input power reaching the target. The ionization front is well confined near the dump plate due to the heating and puffing regions. Additionally, SOLPS-ITER simulation results are also found to be in very good agreement with the particle-in-cell calculations using the code-PICOS++ which supports the validity of SOLPS in low collisionality regime.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

CaloChallenge 2022: a community challenge for fast calorimeter simulation

Here, we present the results of the ‘Fast Calorimeter Simulation Challenge 2022’—the CaloChallenge. We study state-of-the-art generative models on four calorimeter shower datasets of increasing dimensionality, ranging from a few hundred voxels to a few tens of thousand voxels. The 31 individual submissions span a wide range of current popular generative architectures, including variational autoencoders (VAEs), generative adversarial networks (GANs), normalizing flows, diffusion models, and models based on conditional flow matching. We compare all submissions in terms of quality of generated calorimeter showers, as well as shower generation time and model size. To assess the quality we use a broad range of different metrics including differences in one-dimensional histograms of observables, KPD/FPD scores, AUCs of binary classifiers, and the log-posterior of a multiclass classifier. The results of the CaloChallenge provide the most complete and comprehensive survey of cutting-edge approaches to calorimeter fast simulation to date. In addition, our work provides a uniquely detailed perspective on the important problem of how to evaluate generative models. As such, the results presented here should be applicable for other domains that use generative AI and require fast and faithful generation of samples in a large phase space.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND