Search NASA⌕ Search

SEARCH · Search NASA

Results for “diffusion surrogate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Generative diffusion model surrogates for mechanistic agent-based biological models

Mechanistic, multicellular, agent-based models are commonly used to investigate tissue, organ, and organism-scale biology at single-cell resolution. The Cellular-Potts Model (CPM) is a powerful and popular framework for developing and interrogating these models. CPMs become computationally expensive at large space- and time- scales making application and investigation of developed models difficult. Surrogate models may allow for the accelerated evaluation of CPMs of complex biological systems. However, the stochastic nature of these models means each set of parameters may give rise to different model configurations, complicating surrogate model development. In this work, we leverage denoising diffusion probabilistic models (DDPMs) to train a generative AI surrogate of a CPM used to investigate in vitro vasculogenesis. We describe the use of an image classifier to learn the characteristics that define unique areas of a 2-dimensional parameter space. We then apply this classifier to aid in surrogate model selection and verification. Our CPM model surrogate generates model configurations 20,000 timesteps ahead of a reference configuration and demonstrates approximately a 22x reduction in computational time as compared to native code execution. Our work represents a step towards the implementation of DDPMs to develop digital twins of stochastic biological systems.

97 MATHEMATICS AND COMPUTING↗

An Experimental Method to Measure Gaseous Diffusivity in Tight and Partially Saturated Porous Media via Continuously Monitored Mass Spectrometry

Detection of radioxenon and radioargon produced by underground nuclear explosions is one of the primary methods by which the Comprehensive Nuclear-Test–Ban Treaty (CTBT) monitors for nuclear activities. However, transport of these noble gases to the surface via barometric pumping is a complex process relying on advective and diffusive processes in a fractured porous medium to bring detectable levels to the surface. To better understand this process, experimental measurements of noble gas and chemical surrogate diffusivity in relevant lithologies are necessary. However, measurement of noble gas diffusivity in tight or partially saturated porous media is challenging due to the transparent nature of noble gases, the lengthy diffusion times, and difficulty maintaining consistent water saturation. Here, the quasi-steady-state Ney–Armistead method is modified to accommodate continuous gas sampling via effusive flow to a mass spectrometer. An analytical solution accounting for the cumulative sampling losses and induced advective flow is then derived. Experimental results appear in good agreement with the proposed theory, suggesting the presence of retained groundwater reduces the effective diffusivity of the gas tracers by 10–1000 times. Finally, by using a mass spectrometer, the method described herein is applicable to a broad range of gas species and porous media.

47 OTHER INSTRUMENTATION↗

Grassmannian diffusion maps based surrogate modeling via geometric harmonics

Abstract A novel surrogate model based on the Grassmannian diffusion maps (GDMaps) and utilizing geometric harmonics (GH) is developed for predicting the response of complex physical phenomena. The method utilizes GDMaps to obtain a low‐dimensional representation of the underlying behavior of physical/mathematical systems with respect to uncertain input parameters. Using this representation, GH, an out‐of‐sample extension technique, is employed to create a global map from the input parameter space to a Grassmannian diffusion manifold. GH is further employed to locally map points on the diffusion manifold onto the tangent space of a Grassmann manifold. The exponential map is then used to project the points in the tangent space onto the Grassmann manifold, where reconstruction of the full solution is performed. The performance of the proposed surrogate model is verified with three examples. The first problem is a toy example used to illustrate the technique. In the second example, errors associated with the various mappings are assessed by studying response predictions of the electric potential of a dielectric cylinder in a homogeneous electric field. The last example applies the method for uncertainty prediction in the strain field evolution in a model amorphous material using the shear transformation zone theory of plasticity.

42 ENGINEERING↗

Deep Learning Approaches to Surrogates for Solving the Diffusion Equation for Mechanistic Real-World Simulations

In many mechanistic medical, biological, physical, and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs), especially for diffusion, fluid flow and mechanical relaxation, can make simulations impractically slow. Biological models of tissues and organs often require the simultaneous calculation of the spatial variation of concentration of dozens of diffusing chemical species. One clinical example where rapid calculation of a diffusing field is of use is the estimation of oxygen gradients in the retina, based on imaging of the retinal vasculature, to guide surgical interventions in diabetic retinopathy. Furthermore, the ability to predict blood perfusion and oxygenation may one day guide clinical interventions in diverse settings, i.e., from stent placement in treating heart disease to BOLD fMRI interpretation in evaluating cognitive function (Xie et al., 2019; Lee et al., 2020). Since the quasi-steady-state solutions required for fast-diffusing chemical species like oxygen are particularly computationally costly, we consider the use of a neural network to provide an approximate solution to the steady-state diffusion equation. Machine learning surrogates, neural networks trained to provide approximate solutions to such complicated numerical problems, can often provide speed-ups of several orders of magnitude compared to direct calculation. Surrogates of PDEs could enable use of larger and more detailed models than are possible with direct calculation and can make including such simulations in real-time or near-real time workflows practical. Creating a surrogate requires running the direct calculation tens of thousands of times to generate training data and then training the neural network, both of which are computationally expensive. Often the practical applications of such models require thousands to millions of replica simulations, for example for parameter identification and uncertainty quantification, each of which gains speed from surrogate use and rapidly recovers the up-front costs of surrogate generation. We use a Convolutional Neural Network to approximate the stationary solution to the diffusion equation in the case of two equal-diameter, circular, constant-value sources located at random positions in a two-dimensional square domain with absorbing boundary conditions. Such a configuration caricatures the chemical concentration field of a fast-diffusing species like oxygen in a tissue with two parallel blood vessels in a cross section perpendicular to the two blood vessels. To improve convergence during training, we apply a training approach that uses roll-back to reject stochastic changes to the network that increase the loss function. The trained neural network approximation is about 1000 times faster than the direct calculation for individual replicas. Because different applications will have different criteria for acceptable approximation accuracy, we discuss a variety of loss functions and accuracy estimators that can help select the best network for a particular application. We briefly discuss some of the issues we encountered with overfitting, mismapping of the field values and the geometrical conditions that lead to large absolute and relative errors in the approximate solution.

60 APPLIED LIFE SCIENCES↗

A comparative study of machine learning models for predicting the state of reactive mixing

Mixing phenomena are important mechanisms controlling flow, species transport, and reaction processes in fluids and porous media. Accurate predictions of reactive mixing are critical for many Earth and environmental science problems such as contaminant fate and remediation, macroalgae growth, and plankton biomass evolution. Here, to investigate the evolution of mixing dynamics under different scenarios (e.g., anisotropy, fluctuating velocity fields), a finite-element-based numerical model was built to solve the fast, irreversible bimolecular reaction-diffusion equations to simulate a range of reactive-mixing scenarios. A total of 2,315 simulations were performed using different sets of model input parameters comprising various spatial scales of vortex structures in the velocity field, time-scales associated with velocity oscillations, the perturbation parameter for the vortex-based velocity, anisotropic dispersion contrast (i.e., ratio of longitudinal-to-transverse dispersion), and molecular diffusion. The outputs comprised concentration profiles of reactants and products. The inputs to and outputs from these simulations were concatenated into feature and label matrices, respectively, to train 20 different machine learning (ML) models intended to emulate system behavior. These 20 ML emulators, based on linear methods, Bayesian methods, ensemble learning methods, and multilayer perceptrons (MLPs), were trained to classify the state of mixing and predict three quantities of interest (QoIs) characterizing species production, decay (i.e., average concentration, square of average concentration), and degree of mixing (i.e., variances of species concentration). Unsurprisingly, linear classifiers and regressors failed to reproduce the QoIs; however, ensemble methods (classifiers and regressors) and the MLP model accurately classified the state of reactive mixing and the QoIs. Among ensemble methods, random forest and decision-tree-based AdaBoost faithfully predicted the QoIs. At run time, trained ML emulators produced results times faster than the finite-element simulations. Due to their low computational expense and high accuracy, ensemble and MLP models are excellent emulators for these numerical simulations and great utilities in uncertainty quantification exercises, which can require 1,000s of forward model runs.

97 MATHEMATICS AND COMPUTING↗

Soot formation and precursor chemistry in Counterflow flames of aviation fuel surrogates

To meet market demands, the aviation sector is interested in utilizing drop-in Synthetic Aviation Turbine Fuels (SATF), either as neat fuels or in blends with conventional Jet A. SATF currently approved in standard specifications may have lower aromatic content with significant fractions of normal, branched, and cyclo-alkanes. Fundamental studies on soot formation from aviation fuels (Jet A, SATF) and their surrogate components are essential to understand how fuel composition influences soot and soot precursor formation. Here, this study reports new measurements of polycyclic aromatic hydrocarbons (PAH) and soot in counterflow diffusion flames (CDFs) of aviation fuel surrogates. Both intrusive and non-intrusive diagnostics are employed to determine the profiles of temperature, gas phase species, PAHs (up to C16), and soot volume fraction (SVF) in CDFs of iso-octane and surrogate mixtures. These measurements shed light on the transition of soot precursors to primary soot particles. In addition to serving as a common surrogate component in Jet A surrogate mixtures, iso-octane is a template species for larger, less volatile branched alkanes found in SATF mixtures. The newly developed Lawrence Livermore National Laboratory (LLNL) PAH and soot model successfully captures temperature, precursor species, and SVF profiles for the mixtures and conditions discussed in this work. Finally, a high-fidelity surrogate for Jet A is proposed that matches targeted physical and chemical properties well, while leveraging the wide range of candidate fuel molecules available in the LLNL detailed chemical model. The proposed surrogate formulation is validated against newly acquired measurements of the surrogate and literature measurements of Jet A. These new experiments and simulations provide critical insights into the PAH and soot formation from aviation fuels. Reaction pathways which require further investigation are highlighted, such that future work may bridge the remaining quantitative gaps in predicting soot formation from aviation fuel surrogates and surrogate components.

Aviation fuels↗

A Quantum Monte Carlo Study of the Structural, Energetic, and Magnetic Properties of Two-Dimensional H and T Phase VSe 2

Previous works have controversially claimed near-room-temperature ferromagnetism in two-dimensional (2D) VSe 2 , with conflicting results throughout the literature. These discrepancies in magnetic properties between both phases (T and H) of 2D VSe 2 are most likely due to the structural parameters being coupled to the magnetic properties. Specifically, both phases have a close lattice match and similar total energies, which makes it difficult to determine which phase is being observed experimentally. Here, in this study, we used a combination of density functional theory, highly accurate diffusion Monte Carlo (DMC), and a surrogate Hessian line-search optimization technique to resolve the previously reported discrepancy in structural parameters and relative phase stability. With DMC accuracy, we determined the free-standing geometry of both phases and constructed a phase diagram. Our findings demonstrate the successes of the DMC method coupled with the surrogate Hessian structural optimization technique when applied to a 2D magnetic system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Estimating an executive summary of a time series: the tendency

In this paper, we revisit the problem of decomposing a signal into a tendency and a residual. The tendency describes an executive summary of a signal that encapsulates its notable characteristics while disregarding seemingly random, less interesting aspects. Building upon the Intrinsic Time Decomposition (ITD) and information-theoretical analysis, we introduce two alternative procedures for selecting the tendency from the ITD baselines. The first is based on the maximum extrema prominence, namely the maximum difference between extrema within each baseline. Specifically this method selects the tendency as the baseline from which an ITD step would produce the largest decline of the maximum prominence. The second method uses the rotations from the ITD and selects the tendency as the last baseline for which the associated rotation is statistically stationary. We delve into a comparative analysis of the information content and interpretability of the tendencies obtained by our proposed methods and those obtained through conventional low-pass filtering schemes, particularly the Hodrik–Prescott (HP) filter. Our findings underscore a fundamental distinction in the nature and interpretability of these tendencies, highlighting their context-dependent utility with emphasis in multi-scale signals. Through a series of real-world applications, we demonstrate the computational robustness and practical utility of our proposed tendencies, emphasizing their adaptability and relevance in diverse time series contexts.

Time series analysis↗

CaloScore v2: single-shot calorimeter shower simulation with diffusion models

Diffusion generative models are promising alternatives for fast surrogate models, producing high-fidelity physics simulations. However, the generation time often requires an expensive denoising process with hundreds of function evaluations, restricting the current applicability of these models in a realistic setting. In this work, we report updates on the CaloScorearchitecture, detailing the changes in the diffusion process, which produces higher quality samples, and the use of progressive distillation, resulting in a diffusion model capable of generating new samples with a single function evaluation. Here we demonstrate these improvements using the Calorimeter Simulation Challenge 2022 dataset.

47 OTHER INSTRUMENTATION↗

Self-consistent equilibrium and transport simulations for NSTX-U plasmas enhanced via machine learning surrogate models

The Control-Oriented Transport SIMulator (COTSIM) is an advanced equilibrium and transport code designed for simulating tokamak discharges at computational speeds suitable for control applications. COTSIM’s modular framework enables users to select models that balance accuracy with speed according to specific needs, allowing the code to operate from fast to faster-than-real-time performance levels. This work presents recent enhancements to COTSIM’s predictive accuracy for NSTX-U scenarios, achieved by integrating neural-network-based surrogate models and self-consistent equilibrium calculations. To improve source deposition predictions, a surrogate model for NUBEAM has been incorporated. Additionally, a surrogate model for the Multi-Mode Module (MMM) now supports predictions of anomalous thermal, momentum, and particle diffusivities—key factors for modeling the evolution of temperature and rotation. Each surrogate model was specifically trained for the NSTX-U operational regime to enhance COTSIM’s accuracy while maintaining computational efficiency. Moreover, COTSIM now couples fixed-boundary equilibrium solvers with its transport solvers, enabling self-consistent predictions of plasma profiles and equilibrium evolution over the discharge. Simulation results demonstrate strong agreement between COTSIM and TRANSP predictions for NSTX-U discharges. These substantial advancements expand COTSIM’s utility in model-based control applications for NSTX-U. Potential applications include simultaneous optimization of equilibrium and transport scenarios, integration into digital twins, real-time profile estimation (e.g., temperature and rotation) from limited or noisy measurements, and advanced feedback-based scenario control.

Equilibrium and transport modeling↗

Time-series forecasting using manifold learning, radial basis function interpolation, and geometric harmonics

We address a three-tier numerical framework based on nonlinear manifold learning for the forecasting of high-dimensional time series, relaxing the “curse of dimensionality” related to the training phase of surrogate/machine learning models. At the first step, we embed the high-dimensional time series into a reduced low-dimensional space using nonlinear manifold learning (local linear embedding and parsimonious diffusion maps). Then, we construct reduced-order surrogate models on the manifold (here, for our illustrations, we used multivariate autoregressive and Gaussian process regression models) to forecast the embedded dynamics. Finally, we solve the pre-image problem, thus lifting the embedded time series back to the original high-dimensional space using radial basis function interpolation and geometric harmonics. The proposed numerical data-driven scheme can also be applied as a reduced-order model procedure for the numerical solution/propagation of the (transient) dynamics of partial differential equations (PDEs). In conclusion, we assess the performance of the proposed scheme via three different families of problems: (a) the forecasting of synthetic time series generated by three simplistic linear and weakly nonlinear stochastic models resembling electroencephalography signals, (b) the prediction/propagation of the solution profiles of a linear parabolic PDE and the Brusselator model (a set of two nonlinear parabolic PDEs), and (c) the forecasting of a real-world data set containing daily time series of ten key foreign exchange rates spanning the time period 3 September 2001–29 October 2020.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Optimized structure and electronic band gap of monolayer GeSe from quantum Monte Carlo methods

Here, we have used highly accurate quantum Monte Carlo methods to determine the chemical structure and electronic band gaps of monolayer GeSe. Two-dimensional (2D) monolayer GeSe has received a great deal of attention due to its unique thermoelectric, electronic, and optoelectronic properties with a wide range of potential applications. Density functional theory (DFT) methods have usually been applied to obtain optical and structural properties of bulk and 2D GeSe. For the monolayer, DFT typically yields a larger band-gap energy than for bulk GeSe but cannot conclusively determine if the monolayer has a direct or indirect gap. Moreover, the DFT-optimized lattice parameters and atomic coordinates for monolayer GeSe depend strongly on the choice of approximation for the exchange-correlation functional, which makes the ideal structure-and its electronic properties-unclear. In order to obtain accurate lattice parameters and atomic coordinates for the monolayer, we use a surrogate Hessian-based parallel line search within diffusion Monte Carlo to fully optimize the GeSe monolayer structure. The DMC-optimized structure is different from those obtained using DFT, as are calculated band gaps. The potential energy surface has a shallow minimum at the optimal structure. This, combined with the sensitivity of the electronic structure to strain, suggests that the optical properties of monolayer GeSe are highly tunable by strain.

36 MATERIALS SCIENCE↗

Denoising diffusion models with geometry adaptation for high fidelity calorimeter simulation

Simulation is crucial for all aspects of collider data analysis, but the available computing budget in the High Luminosity LHC era will be severely constrained. Generative machine learning models may act as surrogates to replace physics-based full simulation of particle detectors, and diffusion models have recently emerged as the state of the art for other generative tasks. Here, we introduce CaloDiffusion, a denoising diffusion model trained on the public CaloChallenge datasets to generate calorimeter showers. Our algorithm employs 3D cylindrical convolutions, which take advantage of symmetries of the underlying data representation. To handle irregular detector geometries, we augment the diffusion model with a new geometry latent mapping (GLaM) layer to learn forward and reverse transformations to a regular geometry that is suitable for cylindrical convolutions. The showers generated by our approach are nearly indistinguishable from the full simulation, as measured by several different metrics.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Comparison of mercury (Hg) bioaccumulation with mono- and mixed Lemna minor and Spirodela polyrhiza cultures

Mercury (Hg) is a prevalent and harmful contaminant that persists in the environment. For phytoremediation, it is important to discover which plants can bioaccumulate meaningful amounts of Hg while also tolerating its toxicity. Additionally, increasing biodiversity could create a more resilient and self-sustaining system for remediation. This study explores whether mixed populations of Lemna minor and Spirodela polyrhiza can better bioaccumulate and tolerate Hg than monocultures. Mono- and mixed cultures of L. minor and S. polyrhiza were grown in mesocosms of 0.5 μg/L or 100 μg/L Hg ( HgCl2) spiked water for 96 h. Change in weight of duckweed was used to assess Hg tolerance. Diffusive gradients in thin-films (DGTs) were used as surrogate monitoring devices for bioavailable levels of Hg. For biomass growth, the mixed culture of the L. minor was greater than the monoculture at the high dose. The L. minor accumulated more Hg in the mixed culture at the low dose while the S. polyrhiza was higher in the mixed at the high dose. Hg speciation in water was modeled using Windermere Humic Aqueous Model 7 (WHAM7) to compare the bioavailable species indicated by the DGTs. Potentially due to the controlled conditions, the WHAM7 output of bioavailable Hg was almost 1:1 to that estimated by the DGTs, indicating good predictive capability of geochemical modeling and passive sampler DGT on metal bioavailability. Altogether, the mixed cultures statistically performed as well as or better than the monocultures when tolerating and bioaccumulating Hg. However, there needs to be further work to see if the significant differences translate into practical differences worth the extra resources to maintain multiple species.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗