Search NASA⌕ Search

SEARCH · Search NASA

Results for “differentiable simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Data-driven selection of stiff chemistry ODE solver in operator-splitting schemes

Most computational fluid dynamics simulations of practical combustion applications employ operator-splitting schemes, where chemistry and transport are separated and integrated with distinct numerical methods. The changes in composition due to chemistry are evaluated by solving ordinary differential equations (ODE) in each cell of the computational domain, which typically dominates the computational cost when detailed chemistry is considered. In this work, a data-driven approach for the selection of chemistry ODE solvers in operator-splitting schemes is presented. Neural networks are used to predict the ODE solvers CPU times and errors for a given thermochemical state. This allows the selection of an optimal ODE solver on a cell-by-cell, timestep-by-timestep basis. The models are trained using a wide set of thermochemical states generated through partially-stirred reactors and flames simulations. The methodology is validated by quantifying the prediction errors, the classification accuracy, and the computational speedup. The model predicts the optimal ODE solver for 70 to 95% of the validation cases and decreases the computional cost by a factor of 3 or more. The generalizability of the methodology to different chemical mechanisms and different fuels is assessed and it is shown that the model’s performance is only slightly degraded and its applicability is significantly enhanced if the inputs to the neural networks are restricted to a small set of thermochemical state variables present in most chemical mechanisms. In conclusion, the models are used in an homogeneous reactor case and a multi-dimensional CFD simulation of a diesel spray at high pressure where a speedup of more than 3 is achieved.

42 ENGINEERING↗

JAX-CanVeg: A Differentiable Land Surface Model

Land surface models consider the exchange of water, energy, and carbon along the soil-canopy-atmosphere continuum, which is challenging to model due to their complex interdependency and associated challenges in representing and parameterizing them. Differentiable modeling provides a new opportunity to capture these complex interactions by seamlessly hybridizing process-based models with deep neural networks (DNNs), benefiting both worlds, that is, the physical interpretation of process-based models and the learning power of DNNs. Here, we developed a differentiable land model, JAX-CanVeg. The new model builds on the legacy CanVeg by incorporating advanced functionalities through JAX in the graphic processing unit support, automatic differentiation, and integration with DNNs. We demonstrated JAX-CanVeg's hybrid modeling capability by applying the model at four flux tower sites with varying aridity. To this end, we developed a hybrid version of the Ball-Berry equation that emulates the water stress impact on stomatal closure to explore the capability of the hybrid model in (a) improving the simulations of latent heat fluxes (LE) and net ecosystem exchange (NEE), (b) improving the optimization trade-off when learning observations of both LE and NEE, and (c) benefiting a multi-layer canopy model setup. Our results show that the proposed hybrid model improved the simulations of LE and NEE at all sites, with an improved optimization trade-off over the process-based model. Additionally, the multi-layer canopy set benefited hybrid modeling at some sites. Anchored in differentiable modeling, our study provides a new avenue for modeling land-atmosphere interactions by leveraging the benefits of both data-driven learning and process-based modeling.

54 ENVIRONMENTAL SCIENCES↗

Neural simulation-based inference approach for characterizing the Galactic Center γ-ray excess

The nature of the Fermi γ-ray Galactic Center Excess (GCE) has remained a persistent mystery for over a decade. Although the excess is broadly compatible with emission expected due to dark matter annihilation, an explanation in terms of a population of unresolved astrophysical point sources e.g., millisecond pulsars, remains viable. The effort to uncover the origin of the GCE is hampered in particular by an incomplete understanding of diffuse emission of Galactic origin. This can lead to spurious features that make it difficult to robustly differentiate smooth emission, as expected for a dark matter origin, from more “clumpy” emission expected from a population of relatively bright, unresolved point sources. Here, we use recent advancements in the field of simulation-based inference, in particular density estimation techniques using normalizing flows, in order to characterize the contribution of modeled components, including unresolved point source populations, to the GCE. Compared to traditional techniques based on the statistical distribution of photon counts, our machine learning-based method is able to utilize more of the information contained in a given model of the Galactic Center emission, and in particular can perform posterior parameter estimation while accounting for pixel-to-pixel spatial correlations in the γ-ray map. This makes the method demonstrably more resilient to certain forms of model misspecification. On application to Fermi data, the method generically attributes a smaller fraction of the GCE flux to unresolved point sources when compared to traditional approaches. We nevertheless infer such a contribution to make up a non-negligible fraction of the GCE across all analysis variations considered, with at least $38^{+9}_{-19}$% of the excess attributed to unresolved point sources in our baseline analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Strain localization criteria for viscoplastic geomaterials

This report presents a viscoplastic localization criterion to detect quasi-instantaneous (i.e., load-induced) and delayed (creep-induced) strain localization in rate-dependent solids. The study is based on the theory of controllability and a viscoplastic description of the mechanical response. Analytical precursors of unstable states are defined through systems of ordinary differential equations (OEDs). The use of the proposed criteria is illustrated at the material point level through a set of strain localization analyses simulating active strain localization of a porous rock. In addition, full-field finite element simulations of compression tests conducted under various pressures are reported to demonstrate the role of local unstable viscoplasticity in the spontaneous propagation of deformation bands under stationary boundary conditions. The study shows that the viscoplastic localization criterion maintains a negative sign as long as the behavior is unstable, that is, the rate of deformation is accelerating. The sign switch coincides with the transition to decelerating deformation. The analyses revealed that pulses of overstress always emerge in correspondence with the growth of unstable behavior, and the peak matches the transition to stable behavior. The local responses recovered from full-field analyses were consistent with those observed in analyses at material point level and the predictions of the presented theory.

36 MATERIALS SCIENCE↗

The carboxylation status of osteocalcin has important consequences for its structure and dynamics

The carboxylation status of Osteocalcin (Ocn) not only influences formation and structure in bones but also has important endocrine functions affecting energy metabolism and expenditure. In this study, the role of γ-carboxylation of the glutamate residues in the structure-dynamics-function relationship in Ocn is investigated. Three forms of Ocn, differentially carboxylated at the Glu-17, 21 and 24 residues, along with a mutated form of Ocn carrying Glu/Ala mutations, are modeled and simulated using molecular dynamics (MD) simulation in the presence of calcium ions. Characterization of the global conformational dynamics of Ocn, described in terms of the orientational variations within its 3-helical domain, highlights large structural variations in the non-carboxylated osteocalcin (nOcn). The bi-carboxylated Ocn (bOcn) and tri-carboxylated (tOcn) species, in contrast, display relatively rigid tertiary structures, with the dynamics of most regions strongly correlated. Radial distribution functions calculated for both bOcn and tOcn show long-range ordering of the calcium ion distribution around the carboxylated glutamate (γGlu) residues, likely playing an important role in promoting stability of these Ocns. Additionally, the same calcium ions are observed to coordinate with neighboring γGlu, better shielding their negative charges and in turn stabilizing these systems more than do the singly coordinating calcium ions observed in the case of nOcn. bOcn is also found to exhibit a more helical C-terminal structure, that has been shown to activate its cellular receptor GPRC6A, highlighting the allosteric role of Ocn carboxylation in modulating the stability and binding potential of the active C-terminal. Furthermore, the carboxylation status of Ocn as well and its calcium coordination appear to have a direct influence on Ocn structure and dynamics, possibly leading to the known differences in Ocn biological function.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Magnetic droplet soliton pairs

We demonstrate magnetic droplet soliton pairs in all-perpendicular spin-torque nano-oscillators (STNOs), where one droplet resides in the STNO free layer (FL) and the other in the reference layer (RL). Typically, theoretical, numerical, and experimental droplet studies have focused on the FL, with any additional dynamics in the RL entirely ignored. Here we show that there is not only significant magnetodynamics in the RL, but the RL itself can host a droplet driven by, and coexisting with, the FL droplet. Both single droplets and pairs are observed experimentally as stepwise changes and sharp peaks in the dc and differential resistance, respectively. While the single FL droplet is highly stable, the coexistence state exhibits high-power broadband microwave noise. Furthermore, micromagnetic simulations reveal that the pair dynamics display periodic, quasi-periodic, and chaotic signatures controlled by applied field and current. The strongly interacting and closely spaced droplet pair offers a unique platform for fundamental studies of highly non-linear soliton pair dynamics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Measurement of nuclear effects in neutrino-argon interactions using generalized kinematic imbalance variables with the MicroBooNE detector

We present a set of new generalized kinematic imbalance variables that can be measured in neutrino scattering. These variables extend previous measurements of kinematic imbalance on the transverse plane and are more sensitive to modeling of nuclear effects. We demonstrate the enhanced power of these variables using simulation and then use the MicroBooNE detector to measure them for the first time. We report flux-integrated single- and double-differential measurements of charged-current muon neutrino scattering on argon using a topology with one muon and one proton in the final state as a function of these novel kinematic imbalance variables. These measurements allow us to demonstrate that the treatment of charged current quasielastic interactions in genie version 2 is inadequate to describe data. As a result, they reveal tensions with more modern generator predictions particularly in regions of phase space where final state interactions are important.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Lifetime measurement of excited states in 116 Xe

Lifetimes of excited states in 116 Xe were measured using the recoil-distance Doppler-shift technique. Excited 116 Xe nuclei were populated in the fusion-evaporation reaction 102 Pd( 16 O,2n) 116 Xe. Lifetimes of the $2^{+}_{1}$ and $4^{+}_{1}$ states were evaluated using the differential decay-curve method with $\gamma$-$\gamma$-coincidence data as well as lifetimes of the $6^{+}_{1}$ and $7^{-}_{1}$ states using simulations of spectra considering Doppler-shift attenuation effects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Isogeometric large-eddy simulations of turbulent particle-laden flows

In recent years, isogeometric analysis (IGA) has attracted significant attention from the computational mechanics community due to its ability to integrate design and analysis. Besides, IGA is also a higher-order discretization technique for solving partial differential equations, showing high approximation capability per degree of freedom. In this paper, we extend the application realm of IGA to particle-laden flows based on Eulerian–Eulerian description that couples Navier–Stokes equations with a density transport equation through a Boussinesq approximation. The coupled systems are solved by using quadratic non-uniform rational B-spline (NURBS) functions and a recently developed residual-based variational multiscale (VMS) formulation, which introduces coupling between the fine velocity scales and density equation residuals. We deploy the proposed approach to perform large-eddy simulations (LES) of dilute particle-laden flows over a flat surface at Reynolds number = 10,000. We compare the simulation results against direct numerical simulation (DNS) results from the literature. We find that combining VMS and IGA, the proposed approach enables accurate prediction of a wide range of flow/particle statistics with a relatively lower mesh resolution.

Mathematics↗

Semi-Analytical Hierarchical Bayesian Inference of Nonlinear Model Structure in Stochastic Dynamics: Applied to Compartmental Models of Infectious Diseases

A Bayesian computational framework for parsimonious inference in stochastic nonlinear dynamical systems is presented. This framework enables the concurrent estimation of system states, time-varying parameters, time-invariant parameters, and the optimal sparsity structure of the model parameters. Because differential equation-based models are often simplified mechanistic or phenomenological representations, robust inference from noisy measurement data requires explicit treatment of model error and uncertainty. Model error and time-varying parameters can be represented as random processes, enabling inference while making minimal assumptions about the underlying sources of discrepancy and variability. Adopting stochastic differential equation representations affords the model significant flexibility, but can also render it susceptible to overfitting during statistical inversion, where the inferred model may track noise rather than the underlying signal. To alleviate the effects of overfitting and to enable the discovery of the optimal sparse representation of the time-invariant parameters, a Bayesian sparse learning algorithm is embedded within the framework. This sparse learning framework adopts an approximate hierarchical Bayesian setting defined by a series of semi-analytical expressions. The model structure inference framework is validated using a stochastic compartmental model for tracking and forecasting active cases of an infectious disease. Compartmental models describe population-level infectious disease dynamics through interactions among population fractions grouped by disease state. Mathematically, such models consist of a system of coupled ordinary differential equations. This example adopts an expressive compartmental model that includes multiple possible interactions between disease states, motivated by early uncertainty surrounding COVID-19 reinfection dynamics and their implications for long-term epidemic forecasting. The sparse learning exercise permits the inference of a priori unknown epidemiological dynamics from simulated public health data, discovering the nested compartmental model that optimizes the trade-off between average data-fit and model complexity. It is shown that inducing sparsity among the model parameters eliminates redundant interactions between compartments, equivalently revealing the optimal coupling structure between differential equations.

97 MATHEMATICS AND COMPUTING↗

Simulating Electron Impact Ionization using a General Particle Tracer (GPT) Custom Element

A new C++ custom element has been developed with the framework of General Particle Tracer (GPT) to simulate electron impact ionization of residual gas molecules. The custom element uses Monte-Carlo routines to determine both the ion production rate and the secondary electron kinetic energy based on user-defined gas densities and theoretical values for the ionization cross section and the secondary electron differential cross section. It then uses relativistic kinematics to track the secondary electron, the scattered electron, and the newly formed ion after ionization. The ion production rate and the secondary electron energy distribution determined by the custom element have been benchmarked against theoretical calculations and against simulations made using the simulation package IBSimu. While the custom element was originally built for particle accelerator simulations, it is readily extensible to other applications. The custom element will be described in detail and examples of applications at the Thomas Jefferson National Accelerator Facility will be presented for ion production in a DC high voltage photo-gun.

Yoskowitz, J. T.↗

A meshless stochastic method for Poisson–Nernst–Planck equations

A plethora of biological, physical, and chemical phenomena involve transport of charged particles (ions). Its continuum-scale description relies on the Poisson–Nernst–Planck (PNP) system, which encapsulates the conservation of mass and charge. The numerical solution of these coupled partial differential equations is challenging and suffers from both the curse of dimensionality and difficulty in efficiently parallelizing. We present a novel particle-based framework to solve the full PNP system by simulating a drift–diffusion process with time- and space-varying drift. We leverage Green’s functions, kernel-independent fast multipole methods, and kernel density estimation to solve the PNP system in a meshless manner, capable of handling discontinuous initial states. The method is embarrassingly parallel, and the computational cost scales linearly with the number of particles and dimension. We use a series of numerical experiments to demonstrate both the method’s convergence with respect to the number of particles and computational cost vis-à-vis a traditional partial differential equation solver.

Chemistry↗

A Kinetic Monte Carlo Approach for Simulating Cascading Transmission Line Failure

In this work, cascading transmission line failures are studied through a dynamical model of the power system operating under fixed conditions. The power grid is modeled as a stochastic dynamical system where first-principles electromechanical dynamics are excited by small Gaussian disturbances in demand and generation around a specified operating point. In this context, a single line failure is interpreted in a large deviation context as a first escape event across a surface in phase space defined by line security constraints. The resulting system of stochastic differential equations admits a transverse decomposition of the drift, which leads to considerable simplification in evaluating the quasipotential (rate function) and, consequently, computation of exit rates. Tractable expressions for the rate of transmission line failure in a restricted network are derived from large deviation theory arguments and validated against numerical simulations. Extensions to realistic settings are considered, and individual line failure models are aggregated into a Markov model of cascading failure inspired by chemical kinetics. Cascades are generated by traversing a graph composed of weighted edges representing transitions to degraded network topologies. Numerical results indicate that the Markov model can produce cascades with qualitative power-law properties similar to those observed in empirical cascades.

Kinetic Monte Carlo, rare events, Cascading Failur↗

Fast and accurate reduced-order modeling of a MOOSE-based additive manufacturing model with operator learning

One predominant challenge in additive manufacturing (AM) is to achieve specific material properties by manipulating manufacturing process parameters during the runtime. Such manipulation tends to increase the computational load imposed on existing simulation tools employed in AM. The goal of the present work is to construct a fast and accurate reduced-order model (ROM) for an AM model developed within the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework, ultimately reducing the time/cost of AM control and optimization processes. Our adoption of the operator learning (OL) approach enabled us to learn a family of differential equations produced by altering process variables in the laser’s Gaussian point heat source. More specifically, we used the Fourier neural operator (FNO) and deep operator network (DeepONet) to develop ROMs for time-dependent responses. Furthermore, we benchmarked the performance of these OL methods against a conventional deep neural network (DNN)-based ROM. Ultimately, we found that OL methods offer comparable performance and, in terms of accuracy and generalizability, even outperform DNN at predicting scalar model responses. The DNN-based ROM afforded the fastest training time. Furthermore, all the ROMs were faster than the original MOOSE model yet still provided accurate predictions. FNO had a smaller mean prediction error than DeepONet, with a larger variance for time-dependent responses. Unlike DNN, both FNO and DeepONet were able to simulate time series data without the need for dimensionality reduction techniques. Finally, the present work can help facilitate the AM optimization process by enabling faster execution of simulation tools while still preserving evaluation accuracy.

36 MATERIALS SCIENCE↗

Dissipation measures in weakly collisional plasmas

ABSTRACT The physical foundations of the dissipation of energy and the associated heating in weakly collisional plasmas are poorly understood. Here, we compare and contrast several measures that have been used to characterize energy dissipation and kinetic-scale conversion in plasmas by means of a suite of kinetic numerical simulations describing both magnetic reconnection and decaying plasma turbulence. We adopt three different numerical codes that can also include interparticle collisions: the fully kinetic particle-in-cell vpic, the fully kinetic continuum Gkeyll, and the Eulerian Hybrid Vlasov–Maxwell (HVM) code. We differentiate between (i) four energy-based parameters, whose definition is related to energy transfer in a fluid description of a plasma, and (ii) four distribution function-based parameters, requiring knowledge of the particle velocity distribution function. There is an overall agreement between the dissipation measures obtained in the PIC and continuum reconnection simulations, with slight differences due to the presence/absence of secondary islands in the two simulations. There are also many qualitative similarities between the signatures in the reconnection simulations and the self-consistent current sheets that form in turbulence, although the latter exhibits significant variations compared to the reconnection results. All the parameters confirm that dissipation occurs close to regions of intense magnetic stresses, thus exhibiting local correlation. The distribution function-based measures show a broader width compared to energy-based proxies, suggesting that energy transfer is co-localized at coherent structures, but can affect the particle distribution function in wider regions. The effect of interparticle collisions on these parameters is finally discussed.

79 ASTRONOMY AND ASTROPHYSICS↗

Verification of Bison fission product species conservation under TRISO reactor conditions

When assessing the reliability and predictive capabilities of a simulation tool, code verification is used to ensure that the implemented numerical algorithm is a faithful representation of its underlying mathematical model, including partial differential or integral equations, initial and boundary conditions, and auxiliary relationships. During this process, numerical results in a discrete solution are compared to the analytical solution of the mathematical model. Here, in this paper, the code verification process is applied to one-dimensional spatiotemporal problems that exercise partial differential equation governing the conservation of fission product species (or mass diffusion). Numerical experiments were performed in the Bison fuel performance code to evaluate its predictive capability under various TRISO reactor conditions such as base irradiation and safety heating test conditions for either short- or long-lived fission product species, as well as a case concerning evaporation from the outer surface of a particle. The code predictions were compared with the expected exact results obtained from the analytical expressions, and the fact that they demonstrate the correct analytical behavior provides strong evidence of proper numerical algorithm implementation.

07 ISOTOPE AND RADIATION SOURCES↗

PythonFOAM: In-situ data analyses with OpenFOAM and Python

Here, we outline the development of a general-purpose Python-based data analysis tool for OpenFOAM. Our implementation relies on the construction of OpenFOAM applications that have bindings to data analysis libraries in Python. Double precision data in OpenFOAM is cast to a NumPy array using the NumPy C-API and Python modules may then be used for arbitrary data analysis and manipulation on flow-field information. We highlight how the proposed wrapper may be used for an in-situ online singular value decomposition (SVD) implemented in Python and accessed from the OpenFOAM solver PimpleFOAM. Here, 'in-situ' refers to a programming paradigm that allows for a concurrent computation of the data analysis on the same computational resources utilized for the partial differential equation solver. In addition, to demonstrate parallel deployments, we deploy a distributed SVD, which collects snapshot data across the ranks of a distributed simulation to compute the global left singular vectors. Crucially, both OpenFOAM and Python share the same message passing interface (MPI) communicator for this deployment which allows Python objects and functions to exchange NumPy arrays across ranks. Subsequently, we provide scaling assessments of this distributed SVD on multiple nodes of Intel Broadwell and KNL architectures for canonical test cases such as the large eddy simulations of a backward facing step and a channel flow at friction Reynolds number of 395. Finally, we demonstrate the deployment of a deep neural network for compressing the flow-field information using an autoencoder to demonstrate an ability to use state-of-the-art machine learning tools in the Python ecosystem.

97 MATHEMATICS AND COMPUTING↗

Fourier-MIONet: Fourier-enhanced multiple-input neural operators for multiphase modeling of geological carbon sequestration

Geologic carbon sequestration (GCS) is a safety-critical technology that aims to reduce the amount of carbon dioxide in the atmosphere, which also places high demands on reliability. Multiphase flow in porous media is essential to understand CO 2 migration and pressure fields in the subsurface associated with GCS. However, numerical simulation for such problems in 4D is computationally challenging and expensive, due to the multiphysics and multiscale nature of the highly nonlinear governing partial differential equations (PDEs). It prevents us from considering multiple subsurface scenarios and conducting real-time optimization. Here, we develop a Fourier-enhanced multiple-input neural operator (Fourier-MIONet) to learn the solution operator of the problem of multiphase flow in porous media. Fourier-MIONet utilizes the recently developed framework of the multiple-input deep neural operators (MIONet) and incorporates the Fourier neural operator (FNO) in the network architecture. Once Fourier-MIONet is trained, it can predict the evolution of saturation and pressure of the multiphase flow under various reservoir conditions, such as permeability and porosity heterogeneity, anisotropy, injection configurations, and multiphase flow properties. Compared to the enhanced FNO (U-FNO), the proposed Fourier-MIONet has 90% fewer unknown parameters, and it can be trained in significantly less time (about 3.5 times faster) with much lower CPU memory (<15%) and GPU memory (<35%) requirements, to achieve similar prediction accuracy. In addition to the lower computational cost, Fourier-MIONet can be trained with only 6 snapshots of time to predict the PDE solutions for 30 years. Furthermore, we observed that Fourier-MIONet can maintain good accuracy when predicting out-of-distribution (OOD) data. The excellent generalizability of Fourier-MIONet is enabled by its adherence to the physical principle that the solution to a PDE is continuous over time. Furthermore, the developed Fourier-MIONet makes it possible to solve the long-time evolution of geological carbon sequestration in a large-scale three-dimensional space accurately and efficiently.

97 MATHEMATICS AND COMPUTING↗