Search NASA⌕ Search

SEARCH · Search NASA

Results for “Stochastic Dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Generative AI models for learning flow maps of stochastic dynamical systems in bounded domains

Simulating stochastic differential equations (SDEs) in bounded domains, presents significant computational challenges due to particle exit phenomena, which requires accurate modeling of interior stochastic dynamics and boundary interactions. Despite the success of machine learning-based methods in learning SDEs, existing learning methods are not applicable to SDEs in bounded domains because they cannot accurately capture the particle exit dynamics. We present a unified hybrid data-driven approach that combines a conditional diffusion model with an exit prediction neural network to capture both interior stochastic dynamics and boundary exit phenomena. Our ML model consists of two major components: a neural network that learns exit probabilities using binary cross-entropy loss with rigorous convergence guarantees, and a training-free diffusion model that generates state transitions for non-exiting particles using closed-form score functions. The two components are integrated through a probabilistic sampling algorithm that determines particle exit at each time step and generates appropriate state transitions. Here, the performance of the proposed approach is demonstrated via three test cases: a one-dimensional simplified problem for theoretical verification, a two-dimensional advection-diffusion problem in a bounded domain, and a three-dimensional problem of interest to magnetically confined fusion plasmas.

Bounded domains↗

Learning stochastic dynamics and predicting emergent behavior using transformers

We show that a neural network originally designed for language processing can learn the dynamical rules of a stochastic system by observation of a single dynamical trajectory of the system, and can accurately predict its emergent behavior under conditions not observed during training. We consider a lattice model of active matter undergoing continuous-time Monte Carlo dynamics, simulated at a density at which its steady state comprises small, dispersed clusters. We train a neural network called a transformer on a single trajectory of the model. The transformer, which we show has the capacity to represent dynamical rules that are numerous and nonlocal, learns that the dynamics of this model consists of a small number of processes. Forward-propagated trajectories of the trained transformer, at densities not encountered during training, exhibit motility-induced phase separation and so predict the existence of a nonequilibrium phase transition. Transformers have the flexibility to learn dynamical rules from observation without explicit enumeration of rates or coarse-graining of configuration space, and so the procedure used here can be applied to a wide range of physical systems, including those with large and complex dynamical generators.

97 MATHEMATICS AND COMPUTING↗

Identifying stochastic dynamics via finite expression methods

Modeling stochastic differential equations (SDEs) is crucial for understanding complex dynamical systems in various scientific fields. Recent methods often employ neural network-based models, which typically represent SDEs through a combination of deterministic and stochastic terms. However, these models usually lack interpretability and have difficulty in generalizing beyond their training domain. Here, this paper introduces the Finite Expression Method (FEX), a symbolic learning approach designed to derive interpretable mathematical representations of the deterministic component of SDEs. For the stochastic component, we integrate FEX with advanced generative modeling techniques to provide a comprehensive representation of SDEs. The numerical experiments on linear, nonlinear, and multidimensional SDEs demonstrate that FEX generalizes well beyond the training domain and delivers more accurate long-term predictions compared to neural network-based methods. The symbolic expressions identified by FEX not only improve prediction accuracy but also offer valuable scientific insights into the underlying dynamics of the systems.

Complex dynamical systems↗

SDYN-GANs: Adversarial learning methods for multistep generative models for general order stochastic dynamics

We introduce adversarial learning methods for data-driven generative modeling of dynamics of nth-order stochastic systems. Our approach builds on Generative Adversarial Networks (GANs) with generative model classes based on stable m-step stochastic numerical integrators. From observations of trajectory samples, we introduce methods for learning long-time predictors and stable representations of the dynamics. Our approaches use discriminators based on Maximum Mean Discrepancy (MMD), training protocols using both conditional and marginal distributions, and methods for learning dynamic responses over different time-scales. We show how our approaches can be used for modeling physical systems to learn force-laws, damping coefficients, and noise-related parameters. Our adversarial learning approaches provide methods for obtaining stable generative models for dynamic tasks including long-time prediction and developing simulations for stochastic systems.

• Artificial intelligence (AI) / machine learning ↗

Semi-Analytical Hierarchical Bayesian Inference of Nonlinear Model Structure in Stochastic Dynamics: Applied to Compartmental Models of Infectious Diseases

A Bayesian computational framework for parsimonious inference in stochastic nonlinear dynamical systems is presented. This framework enables the concurrent estimation of system states, time-varying parameters, time-invariant parameters, and the optimal sparsity structure of the model parameters. Because differential equation-based models are often simplified mechanistic or phenomenological representations, robust inference from noisy measurement data requires explicit treatment of model error and uncertainty. Model error and time-varying parameters can be represented as random processes, enabling inference while making minimal assumptions about the underlying sources of discrepancy and variability. Adopting stochastic differential equation representations affords the model significant flexibility, but can also render it susceptible to overfitting during statistical inversion, where the inferred model may track noise rather than the underlying signal. To alleviate the effects of overfitting and to enable the discovery of the optimal sparse representation of the time-invariant parameters, a Bayesian sparse learning algorithm is embedded within the framework. This sparse learning framework adopts an approximate hierarchical Bayesian setting defined by a series of semi-analytical expressions. The model structure inference framework is validated using a stochastic compartmental model for tracking and forecasting active cases of an infectious disease. Compartmental models describe population-level infectious disease dynamics through interactions among population fractions grouped by disease state. Mathematically, such models consist of a system of coupled ordinary differential equations. This example adopts an expressive compartmental model that includes multiple possible interactions between disease states, motivated by early uncertainty surrounding COVID-19 reinfection dynamics and their implications for long-term epidemic forecasting. The sparse learning exercise permits the inference of a priori unknown epidemiological dynamics from simulated public health data, discovering the nested compartmental model that optimizes the trade-off between average data-fit and model complexity. It is shown that inducing sparsity among the model parameters eliminates redundant interactions between compartments, equivalently revealing the optimal coupling structure between differential equations.

97 MATHEMATICS AND COMPUTING↗

Photoinduced correlations in stochastic dynamics of a solid-state ionic conductor

Photoexcitation by ultrashort laser pulses plays a crucial role in controlling reaction pathways, creating nonequilibrium material properties, and probing complex molecular dynamics. The photoresponse following a laser pulse is generally nonidentical between exposures due to spatiotemporal fluctuations or the stochastic nature of dynamical pathways. However, most ultrafast pump-probe experiments struggle to distinguish intrinsic sample fluctuations from extrinsic apparatus noise, often missing deviations from the averaged response. Leveraging the stability and high photon flux of time-resolved X-ray micro-diffraction at a synchrotron, we characterized stochastic photoinduced dynamics in a solid-state ionic conductor. By analyzing temporal evolutions of the lattice parameter of a single grain, we found that shot-to-shot fluctuations are not independent. Instead, correlations exist between nonequilibrium lattice trajectories following adjacent shots, with a characteristic correlation length of approximately 1500 shots, corresponding to an energy barrier of 0.4 ± 0.1 eV, close to the activation energy of lithium-ion diffusion.

36 MATERIALS SCIENCE↗

A Pseudoreversible Normalizing Flow for Stochastic Dynamical Systems with Various Initial Distributions

Here, we present a pseudoreversible normalizing flow method for efficiently generating samples of the state of a stochastic differential equation (SDE) with various initial distributions. The primary objective is to construct an accurate and efficient sampler that can be used as a surrogate model for computationally expensive numerical integration of SDEs, such as those employed in particle simulation. After training, the normalizing flow model can directly generate samples of the SDE’s final state without simulating trajectories. The existing normalizing flow model for SDEs depends on the initial distribution, meaning the model needs to be retrained when the initial distribution changes. The main novelty of our normalizing flow model is that it can learn the conditional distribution of the state, i.e., the distribution of the final state conditional on any initial state, such that the model only needs to be trained once and the trained model can be used to handle various initial distributions. This feature can provide a significant computational saving in studies of how the final state varies with the initial distribution. Additionally, we propose to use a pseudoreversible network architecture to define the normalizing flow model, which has sufficient expressive power and training efficiency for a variety of SDEs in science and engineering, e.g., in particle physics. We provide a rigorous convergence analysis of the pseudoreversible normalizing flow model to the target probability density function in the Kullback–Leibler divergence metric. Numerical experiments are provided to demonstrate the effectiveness of the proposed normalizing flow model.

97 MATHEMATICS AND COMPUTING↗

Time-Resolved Stochastic Dynamics of Quantum Thermal Machines

Steady-state quantum thermal machines are typically characterized by a continuous flow of heat between different reservoirs. However, at the level of discrete stochastic realizations, heat flow is unraveled as a series of abrupt quantum jumps, each representing an exchange of finite quanta with the environment. Here, in this work, we present a framework that resolves the dynamics of quantum thermal machines into cycles classified as enginelike, coolinglike, or idle. We analyze the statistics of individual cycle types and their durations, enabling us to determine both the fraction of cycles useful for thermodynamic tasks and the average waiting time between cycles of a given type. Central to our analysis is the notion of intermittency, which captures the operational consistency of the machine by assessing the frequency and distribution of idle cycles. Our framework offers a novel approach to characterizing thermal machines, with significant relevance to experiments involving mesoscopic transport through quantum dots.

full counting statistics↗

Assimilating partial observation to enhance feedback control of stochastic dynamical systems

Here, in this paper, we present a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage partial observation of the state process, a common occurrence in practical scenarios. Traditional stochastic optimal control methods assume full state observation, which is often not feasible in real-world fluid dynamics control problems. Our approach underscores the significance of utilizing observational data to inform control policy design. Specifically, we introduce a kernel learning backward stochastic differential equation (SDE) filter to enhance data assimilation efficiency and propose a sample-wise stochastic optimization method within the stochastic maximum principle framework. We demonstrate the efficacy and accuracy of our method in the control of advection-diffusion-reaction flow problem and the Dubins airplane maneuvering problem with model uncertainty.

data driven↗

The reproduction number and its probability distribution for stochastic viral dynamics

We consider stochastic models of individual infected cells. The reproduction number, R, is understood as a random variable representing the number of new cells infected by one initial infected cell in an otherwise susceptible (target cell) population. Variability in R results partly from heterogeneity in the viral burst size (the number of viral progeny generated from an infected cell during its lifetime), which depends on the distribution of cellular lifetimes and on the mechanism of virion release. We analyse viral dynamics models with an eclipse phase: the period of time after a cell is infected but before it is capable of releasing virions. The duration of the eclipse, or the subsequent infectious, phase is non-exponential, but composed of stages. We derive the probability distribution of the reproduction number for these viral dynamics models, and show it is a negative binomial distribution in the case of constant viral release from infectious cells, and under the assumption of an excess of target cells. In a deterministic model, the ultimate in-host establishment or extinction of the viral infection depends entirely on whether the mean reproduction number is greater than, or less than, one, respectively. Here, the probability of extinction is determined by the probability distribution of R, not simply its mean value. In particular, we show that in some cases the probability of infection is not an increasing function of the mean reproduction number.

59 BASIC BIOLOGICAL SCIENCES↗

Preliminary study of auto-differentiation algorithm in beam dynamics with stochastic process

Modern particle accelerator optimization requires sophisticated computational methods to address the inherently stochastic nature of beam dynamics. This research develops a framework applying AD to SDEs that specifically addresses beam dynamics challenges in particle accelerators, focusing on accurately modeling and optimizing beam behavior in regimes dominated by stochastic processes. By incorporating key physical phenomena such as synchrotron radiation, wakefield effects, and quantum excitation, the framework aims to provide auto differentiation on the figure of merit of the phase space evolution and beam dynamics. The methodology will enable effective optimization method in a dynamic system with stochastic process.

Accelerator Physics↗

Simulations of Stochastic Fluid Dynamics near a Critical Point in the Phase Diagram

Here, we present simulations of stochastic fluid dynamics in the vicinity of a critical endpoint belonging to the universality class of the Ising model. This study is motivated by the challenge of modeling the dynamics of critical fluctuations near a conjectured critical endpoint in the phase diagram of quantum chromodynamics (QCD). We focus on the interaction of shear modes with a conserved scalar density, which is known as model H. We show that the observed dynamical scaling behavior depends on the correlation length and the shear viscosity of the fluid. As the correlation length is increased or the viscosity is decreased we observe a crossover from the dynamical exponent of critical diffusion, z≃4, to the expected scaling exponent of model H, z≃3. We use our method to investigate the time-dependent correlation function of non-Gaussian moments M n (t) of the order parameter. We find that the relaxation time depends in a nontrivial manner on the power n.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A spatially-resolved model of neutron-irradiated tungsten coupling stochastic cluster dynamics and finite deformation plasticity

Structural materials used in nuclear reactors face severe degradation in mechanical properties, such as hardening and embrittlement. At the microscopic scale, this occurs due to creation and accumulation of irradiation-induced defects and their interaction with system dislocations. Although techniques exist which can model evolution of irradiation defects, for instance kinetic transport theory-based models, their interaction with mechanical deformation of the bulk material has not been investigated extensively. In this work, we demonstrate a novel spatially-resolved multiscale coupling between microscopic irradiation defect evolution, modeled using Stochastic Cluster Dynamics (SCD) and macroscopic mechanical deformation modeled using a finite-deformation plasticity model. SCD is used to determine the statistically averaged defect cluster spacing, dependent on operating conditions such as irradiation dose and temperature. This acts as an initial condition that governs the critical resolved shear stress of dislocation glide in the macroscopic plasticity model. This framework is used to predict mechanical behavior in post-mortem test of irradiated Tungsten samples, which has found its importance as structural material used in nuclear reactors. The results obtained using the coupled approach are in good agreement with experimental data of uniaxial tension tests. The model is able to capture the effect of temperature and irradiation dose on the material hardening. Two methods are proposed to estimate hardness – using Tabor's Law relating uniaxial yield stress to hardness and from flat-punch simulations. The results are in reasonable agreement with hardness data from micro-indentation experiments of irradiated Tungsten samples. Finally, the model is also able to reveal microstructural details such as spatial variation in defect density and local stress.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Interpreting experimental measurements of helium bubbles using stochastic cluster dynamics models of heterogeneous nucleation and growth in irradiated ferritic alloys

Among a number of other advantageous features, ferritic/martensitic steels are being considered as fusion reactor structural materials due to their low intrinsic swelling under irradiation. However, under high-energy neutron irradiation, He produced through (n, α) reactions stabilizes vacancy clusters, which then act as seeds for bubble formation and growth, negating the intrinsic swelling resistance of these alloys. Standard models of irradiation damage accumulation and microstructural evolution consider homogeneous nucleation as the basis for bubble formation and growth. However, this generally does not explain the large bubble densities and sizes observed experimentally under a number of different conditions. Here, we propose a more realistic physical model of bubble nucleation, formation, and growth designed to capture recent experimental measurements of He-bubble formation and evolution during co-implantation of He and Fe ions in model ferritic alloys. We find that experimental results are explained only when the following three features are considered simultaneously: (i) heterogeneous nucleation of He-vacancy bubbles at defect sinks (e.g., dislocations, grain boundaries, and second-phase precipitates), (ii) nucleation and growth of bubbles via the ‘trap mutation’ mechanism (i.e., spontaneous production of Frenkel pairs due to absorption of He atoms), and (iii) transition from a growth-limited, He-stabilized bubble regime to a ‘runaway’ void-type growth scenario. The model is implemented into a stochastic cluster dynamics framework that takes advantage of cluster size grouping methods to accelerate the simulations, allowing us to reach 10 dpa of simulated irradiated dose, and to capture cluster sizes in excess of 20 nm. Further, a careful extrapolation exercise conducted assuming classical nucleation theory leads to excellent agreement with the experimental measurements at 50 dpa of irradiation.

36 MATERIALS SCIENCE↗

Optimal mitigation and control over power system dynamics for stochastic grid resilience

Optimal mitigation planning for highly disruptive contingencies to a transmission-level power system requires optimization with dynamic power system constraints, due to the key role of dynamics in system stability to major perturbations. We formulate a generalized disjunctive program to determine optimal grid component hardening choices for protecting against major failures, with differential algebraic constraints representing system dynamics (specifically, differential equations representing generator and load behavior and algebraic equations representing instantaneous power balance over the transmission system). We optionally allow stochastic optimal pre-positioning across all considered failure scenarios, and optimal emergency control within each scenario. This novel formulation allows, for the first time, analyzing the resilience interdependencies of mitigation planning, preventive control, and emergency control. Using all three strategies in concert is particularly effective at maintaining robust power system operation under severe contingencies, as we demonstrate on the western system coordinating council 9-bus test system using synthetic multi-device outage scenarios.

30 DIRECT ENERGY CONVERSION↗

Insights into ENSO Diversity from an Intermediate Coupled Model. Part II: Role of Nonlinear Dynamics and Stochastic Forcing

Abstract In this study, we investigate how a single leading linear El Niño–Southern Oscillation (ENSO) mode, as studied in Part I, leads to the irregular coexistence of central Pacific (CP) and eastern Pacific (EP) ENSO, a phenomenon known as ENSO spatiotemporal diversity. This diversity is fundamentally generated by deterministic nonlinear pathways to chaos via the period-doubling route and, more prevailingly, the subharmonic resonance route with the presence of a seasonally varying basic state. When residing in the weakly nonlinear regime, the coupled system sustains a weak periodic oscillation with a mixed CP/EP pattern as captured by the linear ENSO mode. With a stronger nonlinearity effect, the ENSO behavior experiences a period-doubling bifurcation. The single ENSO orbit splits into coexisting CP-like and EP-like ENSO orbits. A sequence of period-doubling bifurcation results in an aperiodic oscillation featuring irregular CP and EP ENSO occurrences. The overlapping of subharmonic resonances between ENSO and the seasonal cycle allows this ENSO irregularity and diversity to be more readily excited. In the strongly nonlinear regime, the coupled system is dominated by regular EP ENSO. The deterministic ENSO spatiotemporal diversity is thus confined to a relatively narrow range corresponding to a moderately unstable ENSO mode. Stochastic forcing broadens this range and allows ENSO diversity to occur when the ENSO mode is weakly subcritical. A close relationship among a weakened mean zonal temperature gradient, stronger ENSO activity, and more (fewer) occurrences of EP (CP) ENSO is noted, indicating that ENSO–mean state interaction may yield ENSO regime modulations on the multidecadal time scale.

Geng, Licheng↗

Effective Action for Relativistic Hydrodynamics from the Crooks Fluctuation Theorem

A new effective theory framework for fluctuating hydrodynamics in the relativistic regime is derived using standard thermodynamical principles and general properties of nonequilibrium stochastic dynamics. For the first time, we establish clear and concise conditions for ensuring that the resulting effective theories are causal, stable, and well-posed within general relativity. Here, these properties are independent of spacetime foliation and are valid in the full nonlinear regime. Out-of-equilibrium fluctuations are constrained by a relativistically covariant version of the Crooks fluctuation theorem, which determines how the entropy production is distributed even when the system is driven by an external force. This leads to an emerging Z 2 symmetry responsible for imposing fluctuation-dissipation relations for n-point correlation functions, which matches the standard constraints for the Schwinger-Keldysh effective action.

Fluctuation theorems↗