Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Stochastic growth of quantum fluctuations during slow-roll inflation

We compute the growth of the mean square of quantum fluctuations of test fields with small effective mass during a slowly changing, nearly de Sitter stage which takes place in different inflationary models. We consider a minimally coupled scalar with a small mass, a modulus with an effective mass {proportional_to}H{sup 2} (with H the Hubble parameter), and a massless nonminimally coupled scalar in the test field approximation and compare the growth of their relative mean square with the one of gauge-invariant inflaton fluctuations. We find that in most of the single field inflationary models the mean square gauge-invariant inflaton fluctuation grows faster than any test field with a non-negative effective mass. Hybrid inflationary models can be an exception: the mean square of a test field can dominate over the gauge-invariant inflaton fluctuation one on suitably chosen parameters. We also compute the stochastic growth of quantum fluctuations of a second field, relaxing the assumption of its zero homogeneous value, in a generic inflationary model; as a main result, we obtain that the equation of motion of a gauge-invariant variable associated, order by order, with a generic quantum scalar fluctuation during inflation can be obtained only if we use the number of e-folds as the time variable in the corresponding Langevin and Fokker-Planck equations for the stochastic approach. We employ this approach to derive some bounds for the case of a model with two massive fields.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Uncertainty Quantification for Data-Driven Machine Learning Models in Nuclear Engineering Applications: Where We Are and What Do We Need?

Machine learning (ML) has been leveraged to tackle a diverse range of tasks in almost all branches of nuclear engineering. Many of the successes in ML applications can be attributed to the recent performance breakthroughs in deep learning, the growing availability of computational power, data, and easy-to-use ML libraries. However, these empirical successes have often outpaced our formal understanding of the ML algorithms. An important but under-rated area is uncertainty quantification (UQ) of ML. ML-based models are subject to approximation uncertainty when they are used to make predictions, due to sources including but not limited to, data noise, data coverage, extrapolation, imperfect model architecture and the stochastic training process. The goal of this paper is to clearly explain and illustrate the importance of UQ of ML. We will elucidate the differences in the basic concepts of UQ of physics-based models and data-driven ML models. Various sources of uncertainties in physical modeling and data-driven modeling will be discussed, demonstrated, and compared. We will also present and demonstrate a few techniques to quantify the ML prediction uncertainties, including Monte Carlo dropout, deep ensemble, Bayesian neural networks, Gaussian Processes and conformal prediction. Lastly, we will discuss the need for building a verification, validation and UQ framework to establish ML credibility.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Relativistic particle transport in hot accretion disks

Accretion disks around rapidly rotating black holes provide one of the few plausible models for the production of intense radiation in Acitve Galactic Nuclei (AGNs) above energies of several hundred MeV. The rapid rotation of the hole increases the binding energy per nucleon in the last stable orbit relative to the Schwarzschild case, and naturally leads to ion temperatures in the range 10(exp 12) - 10(exp 13) K for sub-Eddington accretion rates. The protons in the hot inner region of a steady, two-temperature disk form a reservoir of energy that is sufficient to power the observed Energetic Gamma Ray Experiment Telescope (EGRET) outbursts if the black hole mass is 10(exp 10) solar mass. Moreover, the accretion timescale for the inner region is comparable to the observed transient timescale of approximately 1 week. Hence EGRET outbursts may be driven by instabilities in hot, two-temperature disks around supermassive black holes. In this paper we discuss turbulent (stochastic) acceleration in hot disks as a possible source of GeV particles and radiation. We constrain the model by assuming the turbulence is powered by a collective instability that drains energy from the hot protons. We also provide some ideas concerning new, high-energy Penrose processes that produce GeV emission be directly tapping the rotational energy of Kerr black holes.

Becker, Peter A.↗

Stochastic Models for an Optimal Blending of Biomass under Cost, Quality and Uncertainty Considerations

Blending biomass materials of different physical or chemical properties provides an opportunity to passively adjust the quality of the feedstock to meet the specifications of the conversion platform. We propose a model which identifies the right mix of biomass to optimize the performance of the Thermochemical conversion process at the minimum cost. This is a chance-constraint programming (CCP) model which takes into account the stochastic nature of biomass availability and quality. The proposed CCP model takes as inputs the physical and chemical properties, and biomass availability. We use the sample average approximation (SAA) method to solve the problem. We develop a case study for South Carolina by using data provided by the Billion Ton Study. We conduct extensive numerical analysis to evaluate the quality of the solutions obtained.

09 BIOMASS FUELS↗

Nonperturbative model of hot SU(2) gluodynamics

A hot-gluodynamics model based on taking consistently into account nonperturbative fluctuations of the gluon field in the temperature-deconfining phase is proposed. In order to perform averaging over nonperturbative fields, the gluon system (partition function) is broken down into a fast and a slow subsystem. In one of these subsystems, nonperturbative fields play the role of rapidly changing (stochastic) degrees of freedom, whose effect on soft gluons is considered within the cluster-expansion method for Green's functions in the nonperturbative background field. The effect of long-wavelength chromomagnetic fluctuations on hard gluons is studied within adiabatic perturbation theory in the strong-field approximation. The pressure and the energy density of SU(2) gluon matter are calculated for T > T{sub c}.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Stochastic Transport Model for the Cumulative Number of Fissions and Deposited Fission Energy

The stochastic theory of neutron transport is extended to describe the cumulative distribution of fission numbers and deposited fission energy in a multiplying assembly. Solutions for the probability distributions are obtained using analytical approximations and Monte Carlo simulation in lumped geometry and in symmetric homogeneous and heterogeneous spheres. The results show the development of a power-law tail in the steady state fission number and deposited energy distributions when the medium is critical, independent of the fission neutron multiplicity distribution and domain heterogeneity. In contrast, the asymptotic decay is faster than exponential in subcritical media due to rapid chain extinction and in supercritical media due to the increasing probability of chain divergence. Here, a formal asymptotic analysis of the problem in lumped geometry with an arbitrary fission neutron multiplicity confirms the existence of power-law tails at critical.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Formulation and solution approach for calibrating activity-based travel demand model-system via microsimulation

This study addresses the problem of calibrating utility-maximizing nested logit activity-based travel demand model-systems. After estimation, it is common practice to use aggregate measurements to calibrate the estimated model-system’s parameters prior to their application in transportation planning, policy making, and operations. However, calibration of activity-based model-systems has received much less attention. Existing calibration approaches are myopic heuristics in the sense that they do not consider the fundamental inter-dependencies among choice-models and do not have a systematic way to adjust model parameters. Also, other purely simulation-based approaches do not perform well in large-scale applications. In this study, we focus on utility-maximizing nested logit activity-based model-systems and calibrating aggregate statistics such as activity shares, mode shares, time-dependent & mode-specific OD flows, and time-dependent & mode-specific sensor counts. We formulate the calibration problem as a simulation-based optimization problem and propose a stochastic gradient-based solution procedure to solve it. The solution procedure relies on microsimulation to calculate expectations of the aggregate statistics of interest to the calibration problem. Additionally, we derive approximate analytical expressions for the gradient of the objective function —that are evaluated through microsimulation on mini-batches of the population. The proposed solution procedure is sensitive to the fundamental structure of the activity-based model-system and is non-myopic in considering the dependencies across its model components. The formulated optimization problem is non-convex, highly nonlinear, and potentially has multiple-minima. Lastly, we show —through a real-world application— that the proposed solution procedure outperforms other state-of-the-art purely simulation-based optimization approaches in terms of computational efficiency, stability, and convergence. We also compare various gradient-based solution algorithms to determine the best algorithm to update the parameters. This work has the potential to facilitate wider and easier application of activity-based model-systems.

97 MATHEMATICS AND COMPUTING↗

N-particle irreducible actions for stochastic fluids

We construct one- and two-particle irreducible (1PI and 2PI) effective actions for the stochastic fluid dynamics of a conserved density undergoing diffusive motion. We compute the 1PI action in one-loop order and the 2PI action in two-loop approximation. We derive a set of Schwinger-Dyson equations and regularize the resulting equations using Pauli-Villars fields. We numerically solve the Schwinger-Dyson equations for a non-critical fluid. We find that higher-loop effects summed by the Schwinger-Dyson renormalize the non-linear coupling. We also find indications of a diffuson-cascade, the appearance of n-loop correction with smaller and smaller exponential suppression.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Stationary Distribution and Perturbation Bounds for a Stochastic Inventory Model

In this paper, we use the theory of generalized inverses to compute the stationary distribution of the (s, S) inventory model directly from the transition matrix of the underlying Markov chain and to provide perturbation bounds. Indeed, approximations are employed to build a tractable model, and statistical methods are used to estimate the unknown parameters and distributions. Hence, the system is subject to perturbations that may cause deviation in the characteristics. The proposed perturbation bound provides a means to estimate the impact of the perturbations on the performance measures of the considered inventory system.

97 MATHEMATICS AND COMPUTING↗

On-lattice kinetic Monte Carlo approaches for modeling molecular anisotropy in resveratrol crystallization

Stilbenes are a class of organic compounds with broad-ranging pharmaceutical and agricultural applications, which are typically isolated and purified through recrystallization. We are motivated by reducing experimental waste and optimizing yield via developing predictive simulations for processing-dependent crystal morphologies. Using resveratrol as a model stilbene system, we have developed an approach for simulating crystallization with molecular resolution using on-lattice kinetic Monte Carlo. In this work, we highlight modifications to the Stochastic Parallel PARticle Kinetic Simulator (SPPARKS) software package, which were essential to this application. Key enhancements include the incorporation of non-orthogonal cell shapes and monomer anisotropy approximations using bound hard spheres. This new SPPARKS application has been applied to resveratrol with attachment energy libraries obtained from density functional theory, resulting in excellent agreement with experimental morphology prediction.

crystallization↗

Testing Gravity with Realistic Gravitational Waveforms in Pulsar Timing Arrays

We consider the effects of relaxing the assumption that gravitational waves composing the stochastic gravitational wave background (SGWB) are uncorrelated between frequencies in analyses of the data from Pulsar Timing Arrays (PTAs). While individual monochromatic plane waves are often a good approximation, a background composed of astrophysical sources cannot be monochromatic since an infinite plane wave carries no signal. We consider how relaxing this assumption allows us to extract potential information about modified dispersion relations and other fundamental physics questions, as both the group and phase velocity of waves become relevant. After developing the formalism we carry out simple Gaussian wavepacket examples and then consider more realistic waveforms, such as that from binary inspirals. When the frequency evolves only slowly across the PTA temporal baseline, the monochromatic assumption at an effective mean frequency remains a good approximation and we provide scaling relations that characterize its accuracy.

Hu, Wayne↗

CI-MOR Final Report: Analysis and Validation of Critical Infrastructure Models using Model Order Reduction

This report summarizes the research and capabilities developed as part of the project “Analysis and Validation of Critical Infrastructure Models using Model Order Reduction” (CI-MOR) LDRD project. CI-MOR research enables the solution of large, complex optimization models that naturally arise in national security challenges involving critical infrastructures. Specifically, CI-MOR researchers developed methods to (1) rigorously approximate complex, nonlinear optimization formulations, (2) identify alternative near-optimal solutions, (3) accelerate optimization workflows used for complex applications, and (4) rigorously integrate domain knowledge in stochastic-process models. This report provides an overview of the research done in CI-MOR, and we describe application exemplars used to illustrate CI-MOR capabilities. Furthermore, we describe the software developed by CI-MOR that researchers can leverage to analyze new applications.

97 MATHEMATICS AND COMPUTING↗

Multifractal characterizations of nonstationarity and intermittency in geophysical fields: Observed, retrieved, or simulated

Geophysical data rarely show any smoothness at any scale, and this often makes comparison with theoretical model output difficult. However, highly fluctuating signals and fractal structures are typical of open dissipative systems with nonlinear dynamics, the focus of most geophysical research. High levels of variability are excited over a large range of scales by the combined actions of external forcing and internal instability. At very small scales we expect geophysical fields to be smooth, but these are rarely resolved with available instrumentation or simulation tools; nondifferentiable and even discontinuous models are therefore in order. We need methods of statistically analyzing geophysical data, whether measured in situ, remotely sensed or even generated by a computer model, that are adapted to these characteristics. An important preliminary task is to define statistically stationary features in generally nonstationary signals. We first discuss a simple criterion for stationarity in finite data streams that exhibit power law energy spectra and then, guided by developments in turbulence studies, we advocate the use of two ways of analyzing the scale dependence of statistical information: singular measures and qth order structure functions. In nonstationary situations, the approach based on singular measures seeks power law behavior in integrals over all possible scales of a nonnegative stationary field derived from the data, leading to a characterization of the intermittency in this (gradient-related) field. In contrast, the approach based on structure functions uses the signal itself, seeking power laws for the statistical moments of absolute increments over arbitrarily large scales, leading to a characterization of the prevailing nonstationarity in both quantitative and qualitative terms. We explain graphically, step by step, both multifractal statistics which are largely complementary to each other. The geometrical manifestations of nonstationarity and intermittency, 'roughness' and 'sparseness', respectively, are illustrated and the associated analytical (differentiability and continuity) properties are discussed. As an example, the two techniques are applied to a series of recent measurements of liquid water distributions inside marine stratocumulus decks; these are found to be multifractal over scales ranging from approximately 60 m to approximately 60 km. Finally, we define the 'mean multifractal plane' and show it to be a simple yet comprehensive tool with many applications including data intercomparison, (dynamical or stochastic) model and retrieval validations.

Davis, Anthony↗

Hybrid framework for the simulation of stochastic chemical kinetics

Stochasticity plays a fundamental role in various biochemical processes, such as cell regulatory networks and enzyme cascades. Isothermal, well-mixed systems can be modelled as Markov processes, typically simulated using the Gillespie Stochastic Simulation Algorithm (SSA) [25]. While easy to implement and exact, the computational cost of using the Gillespie SSA to simulate such systems can become prohibitive as the frequency of reaction events increases. This has motivated numerous coarse-grained schemes, where the “fast” reactions are approximated either using Langevin dynamics or deterministically. While such approaches provide a good approximation when all reactants are abundant, the approximation breaks down when one or more species exist only in small concentrations and the fluctuations arising from the discrete nature of the reactions become significant. This is particularly problematic when using such methods to compute statistics of extinction times for chemical species, as well as simulating non-equilibrium systems such as cell-cycle models in which a single species can cycle between abundance and scarcity. In this paper, a hybrid jump-diffusion model for simulating well-mixed stochastic kinetics is derived. It acts as a bridge between the Gillespie SSA and the chemical Langevin equation. For low reactant reactions the underlying behaviour is purely discrete, while purely diffusive when the concentrations of all species are large, with the two different behaviours coexisting in the intermediate region. A bound on the weak error in the classical large volume scaling limit is obtained, and three different numerical discretisations of the jump-diffusion model are described. The benefits of such a formalism are illustrated using computational examples.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty

Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.

42 ENGINEERING↗

Sepsis reconsidered: Identifying novel metrics for behavioral landscape characterization with a high-performance computing implementation of an agent-based model

Objectives: Sepsis affects nearly 1 million people in the United States per year, has a mortality rate of 28–50% and requires more than $20 billion a year in hospital costs. Over a quarter century of research has not yielded a single reliable diagnostic test or a directed therapeutic agent for sepsis. Central to this insufficiency is the fact that sepsis remains a clinical/physiological diagnosis representing a multitude of molecularly heterogeneous pathological trajectories. Advances in computational capabilities offered by High Peformance Computing (HPC) platforms call for an evolution in the investigation of sepsis to attempt to define the boundaries of traditional research (bench, clinical and computational) through the use of computational proxy models. We present a novel investigatory and analytical approach, derived from how HPC resources and simulation are used in the physical sciences, to identify the epistemic boundary con- ditions of the study of clinical sepsis via the use of a proxy agent-based model of systemic inflammation. Design: Current predictive models for sepsis use correlative methods that are limited by patient heterogeneity and data sparseness. We address this issue by using an HPC version of a system-level validated agent-based model of sepsis, the Innate Immune Response ABM (IIRBM), as a proxy system in order to identify boundary conditions for the possible behavioral space for sepsis. We then apply advanced analysis derived from the study of Random Dynamical Systems (RDS) to identify novel means for characterizing system behavior and providing insight into the tractability of traditional investigatory methods. Results: The behavior space of the IIRABM was examined by simulating over 70 million sepsis patients for up to 90 days in a sweep across the following parameters: cardio-respiratory-metabolic resilience; microbial invasiveness; microbial toxigenesis; and degree of nosocomial exposure. In addition to using established methods for describing parameter space, we developed two novel methods for characterizing the behavior of a RDS: Probabilistic Basins of Attraction (PBoA) and Stochastic Trajectory Analysis (STA). Computationally generated behavioral landscapes demonstrated attractor structures around stochastic re- gions of behavior that could be described in a complementary fashion through use of PBoA and STA. The stochasticity of the boundaries of the attractors highlights the challenge for correlative attempts to characterize and classify clinical sepsis. Conclusions: HPC simulations of models like the IIRABM can be used to generate approximations of the behavior space of sepsis to both establish “boundaries of futility” with respect to existing investi- gatory approaches and apply system engineering principles to investigate the general dynamic properties of sepsis to provide a pathway for developing control strategies. Here, the issues that bedevil the study and treatment of sepsis, namely clinical data sparseness and inadequate experimental sampling of system behavior space, are fundamental to nearly all biomedical research, manifesting in the “Crisis of Reproducibility” at all levels. HPC-augmented simulation-based research offers an investigatory strategy more consistent with that seen in the physical sciences (which combine experiment, theory and simulation), and an opportunity to utilize the leading advances in HPC, namely deep machine learning and evolutionary computing, to form the basis of an iterative scientific process to meet the full promise of Precision Medicine (right drug, right patient, right time).

59 BASIC BIOLOGICAL SCIENCES↗

Integration of multiple coinflip devices for high-quality random sampling

Artificial intelligence, scientific computing, and probabilistic computing use random sampling to approximate solutions to various problems, with larger models requiring a substantial quantity of random numbers. To generate the required vast quantity of random numbers at high rates, we explore so-called “coinflip” devices, which are stochastic microelectronic devices ideally capable of independently generating random bits with a tunable weight at a high rate. However, coinflip devices are inherently analog and demonstrate nonidealities, like temperature dependence and drift, that can introduce determinism into the outputs. We present important considerations for building systems of multiple coinflip devices to produce high-quality bitstreams with low error and little dependency on previous bits. Using tunnel diodes as coinflip devices, we implement a control loop to adapt to temperature dependence and generate fair bitstreams with each device. While this can lead to dependencies between bits in a single bitstream, we demonstrate that combining results generated in parallel with individual tunnel diodes can produce fair and unpredictable bitstreams. The suitability of these bitstreams for use in probabilistic computing is then demonstrated through a Monte Carlo approximation of π.

Taylor, Brady Garland [Sandia National Laboratorie↗