Search NASA⌕ Search

SEARCH · Search NASA

Results for “STOCHASTICITY”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Efficient estimators for likelihood ratio sensitivity indices of complex stochastic dynamics

We demonstrate that centered likelihood ratio estimators for the sensitivity indices of complex stochastic dynamics are highly efficient with low, constant in time variance and consequently they are suitable for sensitivity analysis in long-time and steady-state regimes. These estimators rely on a new covariance formulation of the likelihood ratio that includes as a submatrix a Fisher information matrix for stochastic dynamics and can also be used for fast screening of insensitive parameters and parameter combinations. The proposed methods are applicable to broad classes of stochastic dynamics such as chemical reaction networks, Langevin-type equations and stochastic models in finance, including systems with a high dimensional parameter space and/or disparate decorrelation times between different observables. Furthermore, they are simple to implement as a standard observable in any existing simulation algorithm without additional modifications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Full particle orbit effects in regular and stochastic magnetic fields

Here we present a numerical study of charged particle motion in a time-independent magnetic field in cylindrical geometry. The magnetic field model consists of an unperturbed reversed-shear (non-monotonic q-profile) helical part and a perturbation consisting of a superposition of modes. Contrary to most of the previous studies, the particle trajectories are computed by directly solving the full Lorentz force equations of motion in a six-dimensional phase space using a sixth-order, implicit, symplectic Gauss-Legendre method. The level of stochasticity in the particle orbits is diagnosed using averaged, effective Poincare sections. It is shown that when only one mode is present, the particle orbits can be stochastic even though the magnetic field line orbits are not stochastic (i.e., fully integrable). The lack of integrability of the particle orbits in this case is related to separatrix crossing and the breakdown of the global conservation of the magnetic moment. Some perturbation consisting of two modes creates resonance overlapping, leading to Hamiltonian chaos in magnetic field lines. Then, the particle orbits exhibit a nontrivial dynamics depending on their energy and pitch angle. It is shown that the regions where the particle motion is stochastic decrease as the energy increases. The non-monotonicity of the q-profile implies the existence of magnetic ITBs (internal transport barriers) which correspond to shearless flux surfaces located in the vicinity of the q-profile minimum. It is shown that depending on the energy, these magnetic ITBs might or might not confine particles. That is, magnetic ITBs act as an energy-dependent particle confinement filter. Magnetic field lines in reversed-shear configurations exhibit topological bifurcations (from homoclinic to heteroclinic) due to separatrix reconnection. Finally, we show that a similar but more complex scenario appears in the case of particle orbits that depend in a non-trivial way on the energy and pitch angle of the particles.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Stochastic bias from non-Gaussian initial conditions

In this article, we show that a stochastic form of scale-dependent halo bias arises in multi-source inflationary models, where multiple fields determine the initial curvature perturbation. We derive this effect for general non-Gaussian initial conditions and study various examples, such as curvaton models and quasi-single field inflation. Furthermore, we present a general formula for both the stochastic and the non-stochastic parts of the halo bias, in terms of the N-point cumulants of the curvature perturbation at the end of inflation. At lowest order, the stochasticity arises if the collapsed limit of the four-point function is boosted relative to the square of the three-point function in the squeezed limit. We derive all our results in two ways, using the barrier crossing formalism and the peak-background split method. In a companion paper, we prove that these two approaches are mathematically equivalent.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations

We developed a new class of physics-informed generative adversarial networks (PI-GANs) to solve forward, inverse, and mixed stochastic problems in a unified manner based on a limited number of scattered measurements. Unlike standard GANs relying solely on data for training, here we encoded into the architecture of GANs the governing physical laws in the form of stochastic differential equations (SDEs) using automatic differentiation. In particular, we applied Wasserstein GANs with gradient penalty (WGAN-GP) for its enhanced stability compared to vanilla GANs. We first tested WGAN-GP in approximating Gaussian processes of different correlation lengths based on data realizations collected from simultaneous reads at sparsely placed sensors. We obtained good approximation of the generated stochastic processes to the target ones even if there is a mismatch between the input noise dimensionality and the effective dimensionality of the target stochastic processes. We also studied the overfitting issue for both the discriminator and the generator, and we found that overfitting occurs also in the generator in addition to the discriminator as previously reported. Subsequently, we considered the solution of elliptic SDEs requiring approximations of three stochastic processes, namely the solution, the forcing, and the diffusion coefficient. Here again, we assumed data collected from simultaneous reads at a limited number of sensors for the multiple stochastic processes. Furthermore, three generators were used for the PI-GANs: two of them were feed forward deep neural networks (DNNs), while the other one was the neural network induced by the SDE. For the case where we have one group of data, we employed one feed forward DNN as the discriminator, while for the case of multiple groups of data we employed multiple discriminators in PI-GANs. We solved forward, inverse, and mixed problems without changing the framework of PI-GANs, obtaining both the means and the standard deviations of the stochastic solution and the diffusion coefficient in good agreement with benchmarks. In this work, we have demonstrated the effectiveness of PI-GANs in solving SDEs for about 120 dimensions. In principle, PI-GANs could tackle very high dimensional problems given more sensor data with low-polynomial growth in computational cost.

97 MATHEMATICS AND COMPUTING↗

A Stochastic Gradient Descent Approach for Stochastic Optimal Control

In this work, we introduce a stochastic gradient descent approach to solve the stochastic optimal control problem through stochastic maximum principle. The motivation that drives our method is the gradient of the cost functional in the stochastic optimal control problem is under expectation, and numerical calculation of such an expectation requires fully computation of a system of forward backward stochastic differential equations, which is computationally expensive. By evaluating the expectation with single-sample representation as suggested by the stochastic gradient descent type optimisation, we could save computational efforts in solving FBSDEs and only focus on the optimisation task which aims to determine the optimal control process.

97 MATHEMATICS AND COMPUTING↗

A stochastic perturbation theory for non-autonomous systems

We develop a perturbation theory for a class of first order nonlinear non-autonomous stochastic ordinary differential equations that arise in climate physics. The perturbative procedure produces moments in terms of integral delay equations, whose order by order decay is characterized in a Floquet-like sense. Both additive and multiplicative sources of noise are discussed and the question of how the nature of the noise influences the results is addressed theoretically and numerically. By invoking the Martingale property, we rationalize the transformation of the underlying Stratonovich form of the model to an Ito form, independent of whether the noise is additive or multiplicative. The generality of the analysis is demonstrated by developing it both for a Brownian particle moving in a periodically forced quartic potential, which acts as a simple model of stochastic resonance, as well as for our more complex climate physics model. The validity of the approach is shown by comparison with numerical solutions. The particular climate dynamics problem upon which we focus involves a low-order model for the evolution of Arctic sea ice under the influence of increasing greenhouse gas forcing ΔF{sub 0}. The deterministic model, developed by Eisenman and Wettlaufer [“Nonlinear threshold behavior during the loss of Arctic sea ice,” Proc. Natl. Acad. Sci. U.S.A. 106(1), 28–32 (2009)] exhibits several transitions as ΔF{sub 0} increases and the stochastic analysis is used to understand the manner in which noise influences these transitions and the stability of the system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Repopulation of interacting tumor cells during fractionated radiotherapy: Stochastic modeling of the tumor control probability

Purpose: Optimal treatment planning for fractionated external beam radiation therapy requires inputs from radiobiology based on recent thinking about the “five Rs” (repopulation, radiosensitivity, reoxygenation, redistribution, and repair). The need is especially acute for the newer, often individualized, protocols made feasible by progress in image guided radiation therapy and dose conformity. Current stochastic tumor control probability (TCP) models incorporating tumor repopulation effects consider “stem-like cancer cells” (SLCC) to be independent, but the authors here propose that SLCC-SLCC interactions may be significant. The authors present a new stochastic TCP model for repopulating SLCC interacting within microenvironmental niches. Our approach is meant mainly for comparing similar protocols. It aims at practical generalizations of previous mathematical models. Methods: The authors consider protocols with complete sublethal damage repair between fractions. The authors use customized open-source software and recent mathematical approaches from stochastic process theory for calculating the time-dependent SLCC number and thereby estimating SLCC eradication probabilities. As specific numerical examples, the authors consider predicted TCP results for a 2 Gy per fraction, 60 Gy protocol compared to 64 Gy protocols involving early or late boosts in a limited volume to some fractions. Results: In sample calculations with linear quadratic parameters α = 0.3 per Gy, α/β = 10 Gy, boosting is predicted to raise TCP from a dismal 14.5% observed in some older protocols for advanced NSCLC to above 70%. This prediction is robust as regards: (a) the assumed values of parameters other than α and (b) the choice of models for intraniche SLCC-SLCC interactions. However, α = 0.03 per Gy leads to a prediction of almost no improvement when boosting. Conclusions: The predicted efficacy of moderate boosts depends sensitively on α. Presumably, the larger values of α are the ones appropriate for individualized treatment protocols, with the smaller values relevant only to protocols for a heterogeneous patient population. On that assumption, boosting is predicted to be highly effective. Front boosting, apart from practical advantages and a possible advantage as regards iatrogenic second cancers, also probably gives a slightly higher TCP than back boosting. If the total number of SLCC at the start of treatment can be measured even roughly, it will provide a highly sensitive way of discriminating between various models and parameter choices. Updated mathematical methods for calculating repopulation allow credible generalizations of earlier results.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Tunable Stochasticity in an Artificial Spin Network

Metamaterials present the possibility of artificially generating advanced functionalities through engineering of their internal structure. Artificial spin networks, in which a large number of nanoscale magnetic elements are coupled together, are promising metamaterial candidates that enable the control of collective magnetic behavior through tuning of the local interaction between elements. In this work, the motion of magnetic domain-walls in an artificial spin network leads to a tunable stochastic response of the metamaterial, which can be tailored through an external magnetic field and local lattice modifications. This type of tunable stochastic network produces a controllable random response exploiting intrinsic stochasticity within magnetic domain-wall motion at the nanoscale. An iconic demonstration used to illustrate the control of randomness is the Galton board. In this system, multiple balls fall into an array of pegs to generate a bell-shaped curve that can be modified via the array spacing or the tilt of the board. A nanoscale recreation of this experiment using an artificial spin network is employed to demonstrate tunable stochasticity. Furthermore, this type of tunable stochastic network opens new paths toward post-Von Neumann computing architectures such as Bayesian sensing or random neural networks, in which stochasticity is harnessed to efficiently perform complex computational tasks.

Artificial spin network↗

Discontinuity detection in multivariate space for stochastic simulations

Edge detection has traditionally been associated with detecting physical space jump discontinuities in one dimension, e.g. seismic signals, and two dimensions, e.g. digital images. Hence most of the research on edge detection algorithms is restricted to these contexts. High dimension edge detection can be of significant importance, however. For instance, stochastic variants of classical differential equations not only have variables in space/time dimensions, but additional dimensions are often introduced to the problem by the nature of the random inputs. The stochastic solutions to such problems sometimes contain discontinuities in the corresponding random space and a prior knowledge of jump locations can be very helpful in increasing the accuracy of the final solution. Traditional edge detection methods typically require uniform grid point distribution. They also often involve the computation of gradients and/or Laplacians, which can become very complicated to compute as the number of dimensions increases. The polynomial annihilation edge detection method, on the other hand, is more flexible in terms of its geometric specifications and is furthermore relatively easy to apply. This paper discusses the numerical implementation of the polynomial annihilation edge detection method to high dimensional functions that arise when solving stochastic partial differential equations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Preservation of physical properties of stochastic Maxwell equations with additive noise via stochastic multi-symplectic methods

Stochastic Maxwell equations with additive noise are a system of stochastic Hamiltonian partial differential equations intrinsically, possessing the stochastic multi-symplectic conservation law. It is shown that the averaged energy increases linearly with respect to the evolution of time and the flow of stochastic Maxwell equations with additive noise preserves the divergence in the sense of expectation. Moreover, we propose three novel stochastic multi-symplectic methods to discretize stochastic Maxwell equations in order to investigate the preservation of these properties numerically. We make theoretical discussions and comparisons on all of the three methods to observe that all of them preserve the corresponding discrete version of the averaged divergence. Meanwhile, we obtain the corresponding dissipative property of the discrete averaged energy satisfied by each method. Especially, the evolution rates of the averaged energies for all of the three methods are derived which are in accordance with the continuous case. Numerical experiments are performed to verify our theoretical results.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Distribution and regulation of stochasticity and plasticity in Saccharomyces cerevisiae

Stochasticity is an inherent feature of complex systems with nanoscale structure. In such systems information is represented by small collections of elements (e.g. a few electrons on a quantum dot), and small variations in the populations of these elements may lead to big uncertainties in the information. Unfortunately, little is known about how to work within this inherently noisy environment to design robust functionality into complex nanoscale systems. Here, we look to the biological cell as an intriguing model system where evolution has mediated the trade-offs between fluctuations and function, and in particular we look at the relationships and trade-offs between stochastic and deterministic responses in the gene expression of budding yeast (Saccharomyces cerevisiae). We find gene regulatory arrangements that control the stochastic and deterministic components of expression, and show that genes that have evolved to respond to stimuli (stress) in the most strongly deterministic way exhibit the most noise in the absence of the stimuli. We show that this relationship is consistent with a bursty 2-state model of gene expression, and demonstrate that this regulatory motif generates the most uncertainty in gene expression when there is the greatest uncertainty in the optimal level of gene expression.

59 BASIC BIOLOGICAL SCIENCES↗

Magnetic stochasticity and transport due to nonlinearly excited subdominant microtearing modes

Subdominant, linearly stable microtearing modes are identified as the main mechanism for the development of magnetic stochasticity and transport in gyrokinetic simulations of electromagnetic ion temperature gradient driven plasma microturbulence. The linear eigenmode spectrum is examined in order to identify and characterize modes with tearing parity. Connections are demonstrated between microtearing modes and the nonlinear fluctuations that are responsible for the magnetic stochasticity and electromagnetic transport, and nonlinear coupling with zonal modes is identified as the salient nonlinear excitation mechanism. A simple model is presented, which relates the electromagnetic transport to the electrostatic transport. These results may provide a paradigm for the mechanisms responsible for electromagnetic stochasticity and transport, which can be examined in a broader range of scenarios and parameter regimes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Learning effective stochastic differential equations from microscopic simulations: Linking stochastic numerics to deep learning

We identify effective stochastic differential equations (SDEs) for coarse observables of fine-grained particle- or agent-based simulations; these SDEs then provide useful coarse surrogate models of the fine scale dynamics. We approximate the drift and diffusivity functions in these effective SDEs through neural networks, which can be thought of as effective stochastic ResNets. The loss function is inspired by, and embodies, the structure of established stochastic numerical integrators (here, Euler–Maruyama and Milstein); our approximations can thus benefit from backward error analysis of these underlying numerical schemes. They also lend themselves naturally to “physics-informed” gray-box identification when approximate coarse models, such as mean field equations, are available. Existing numerical integration schemes for Langevin-type equations and for stochastic partial differential equations can also be used for training; we demonstrate this on a stochastically forced oscillator and the stochastic wave equation. Our approach does not require long trajectories, works on scattered snapshot data, and is designed to naturally handle different time steps per snapshot. We consider both the case where the coarse collective observables are known in advance, as well as the case where they must be found in a data-driven manner.

97 MATHEMATICS AND COMPUTING↗

An adaptive high-dimensional stochastic model representation technique for the solution of stochastic partial differential equations

A computational methodology is developed to address the solution of high-dimensional stochastic problems. It utilizes high-dimensional model representation (HDMR) technique in the stochastic space to represent the model output as a finite hierarchical correlated function expansion in terms of the stochastic inputs starting from lower-order to higher-order component functions. HDMR is efficient at capturing the high-dimensional input-output relationship such that the behavior for many physical systems can be modeled to good accuracy only by the first few lower-order terms. An adaptive version of HDMR is also developed to automatically detect the important dimensions and construct higher-order terms using only the important dimensions. The newly developed adaptive sparse grid collocation (ASGC) method is incorporated into HDMR to solve the resulting sub-problems. By integrating HDMR and ASGC, it is computationally possible to construct a low-dimensional stochastic reduced-order model of the high-dimensional stochastic problem and easily perform various statistic analysis on the output. Several numerical examples involving elementary mathematical functions and fluid mechanics problems are considered to illustrate the proposed method. The cases examined show that the method provides accurate results for stochastic dimensionality as high as 500 even with large-input variability. The efficiency of the proposed method is examined by comparing with Monte Carlo (MC) simulation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Fractional noise destroys or induces a stochastic bifurcation

Little seems to be known about the stochastic bifurcation phenomena of non-Markovian systems. Our intention in this paper is to understand such complex dynamics by a simple system, namely, the Black-Scholes model driven by a mixed fractional Brownian motion. The most interesting finding is that the multiplicative fractional noise not only destroys but also induces a stochastic bifurcation under some suitable conditions. So it opens a possible way to explore the theory of stochastic bifurcation in the non-Markovian framework.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Book Review: Lectures on BSDEs, Stochastic Control, and Stochastic Differential Games with Financial Applications by Rene Carmona

This book is a collection of lecture notes on various topics in the area of stochastic control, stochastic differential games, and financial applications. It makes for an excellent resource for those who already have some familiarity with these topics, although as the author points out, it is not a polished textbook. If the reader is not well versed in stochastic processes and control theory this book may not be the best introduction since prerequisite knowledge of these topics is a must before diving into the material. On the other hand, the book contains a very useful section of notes at the end of each chapter describing references that can be used to get up to speed and to put the material into the wider context. In this respect, it can be used as a guide for those interested in navigating the various books and papers that are drawn upon. The book is divided into three parts: Stochastic Calculus Preliminaries, Stochastic Control, and Stochastic Differential Games. The underlying theory is developed in a systematic manner and many financial applications are scattered throughout the book.

97 MATHEMATICS AND COMPUTING↗