Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Stochastic Differential Equations for Modeling, Estimation and Identification of Mobile-to-Mobile Communication Channels

Mobile-to-mobile networks are characterized by node mobility that makes the propagation environment time varying and subject to fading. As a consequence, the statistical characteristics of the received signal vary continuously, giving rise to a Doppler power spectral density (DPSD) which varies from one observation instant to the next. The current models do not capture and track the time varying characteristics. This paper is concerned with dynamical modelling of mobile-to-mobile channels, parameter estimation and identification from received signal measurements. The evolution of the propagation environment is described by stochastic differential equations. In particular, it is shown that the parameters of the models can be determined by approximating the band-limited DPSD using the Gauss-Newton method. However, since the DPSD is not available online, we propose to use a filter-based expectation maximization algorithm and Kalman filter to estimate the channel parameters and states, respectively. The scheme results in a finite dimensional filter which only uses the first and second order statistics. The algorithm is recursive allowing the inphase and quadrature components and parameters to be estimated online from received signal measurements. The algorithms are tested using experimental data collected from moving sensor nodes in indoor and outdoor environments demonstrating the method s viability.

99 GENERAL AND MISCELLANEOUS↗

Emulation of dynamic simulators with application to hydrology

Many simulation-intensive tasks in the applied sciences, such as sensitivity analysis, parameter inference or real time control, are hampered by slow simulators. Emulators provide the opportunity of speeding up simulations at the cost of introducing some inaccuracy. An emulator is a fast approximation to a simulator that interpolates between design input–output pairs of the simulator. Increasing the number of design data sets is a computationally demanding way of improving the accuracy of emulation. We investigate the complementary approach of increasing emulation accuracy by including knowledge about the mechanisms of the simulator into the formulation of the emulator. To approximately reproduce the output of dynamic simulators, we consider emulators that are based on a system of linear, ordinary or partial stochastic differential equations with a noise term formulated as a Gaussian process of the parameters to be emulated. This stochastic model is then conditioned to the design data so that it mimics the behavior of the nonlinear simulator as a function of the parameters. The drift terms of the linear model are designed to provide a simplified description of the simulator as a function of its key parameters so that the required corrections by the conditioned Gaussian process noise are as small as possible. The goal of this paper is to compare the gain in accuracy of these emulators by enlarging the design data set and by varying the degree of simplification of the linear model. We apply this framework to a simulator for the shallow water equations in a channel and compare emulation accuracy for emulators based on different spatial discretization levels of the channel and for a standard non-mechanistic emulator. Our results indicate that we have a large gain in accuracy already when using the simplest mechanistic description by a single linear reservoir to formulate the drift term of the linear model. Adding some more reservoirs does not lead to a significant improvement in accuracy. However, the transition to a spatially continuous linear model leads again to a similarly large gain in accuracy as the transition from the non-mechanistic emulator to that based on one reservoir.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Chance-Constrained Optimization for Critical Infrastructure Protection

Stochastic optimization deals with making highly reliable decisions under uncertainty. Chance constraints are a crucial tool of stochastic optimization to develop mathematical optimization models; they form the backbone of many important national security data science applications. These include critical infrastructure resiliency, cyber security, power system operations, and disaster relief management. However, existing algorithms to solve chance-constrained optimization models are severely limited by problem size and structure. In this investigative study, we (i) develop new algorithms to approximate chance-constrained optimization models, (ii) demonstrate the application of chance-constraints to a national security problem, and (iii) investigate related stochastic optimization problems. We believe our work will pave way for new research is stochastic optimization as well as secure national infrastructures against unforeseen attacks.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Semi-Analytical Hierarchical Bayesian Inference of Nonlinear Model Structure in Stochastic Dynamics: Applied to Compartmental Models of Infectious Diseases

A Bayesian computational framework for parsimonious inference in stochastic nonlinear dynamical systems is presented. This framework enables the concurrent estimation of system states, time-varying parameters, time-invariant parameters, and the optimal sparsity structure of the model parameters. Because differential equation-based models are often simplified mechanistic or phenomenological representations, robust inference from noisy measurement data requires explicit treatment of model error and uncertainty. Model error and time-varying parameters can be represented as random processes, enabling inference while making minimal assumptions about the underlying sources of discrepancy and variability. Adopting stochastic differential equation representations affords the model significant flexibility, but can also render it susceptible to overfitting during statistical inversion, where the inferred model may track noise rather than the underlying signal. To alleviate the effects of overfitting and to enable the discovery of the optimal sparse representation of the time-invariant parameters, a Bayesian sparse learning algorithm is embedded within the framework. This sparse learning framework adopts an approximate hierarchical Bayesian setting defined by a series of semi-analytical expressions. The model structure inference framework is validated using a stochastic compartmental model for tracking and forecasting active cases of an infectious disease. Compartmental models describe population-level infectious disease dynamics through interactions among population fractions grouped by disease state. Mathematically, such models consist of a system of coupled ordinary differential equations. This example adopts an expressive compartmental model that includes multiple possible interactions between disease states, motivated by early uncertainty surrounding COVID-19 reinfection dynamics and their implications for long-term epidemic forecasting. The sparse learning exercise permits the inference of a priori unknown epidemiological dynamics from simulated public health data, discovering the nested compartmental model that optimizes the trade-off between average data-fit and model complexity. It is shown that inducing sparsity among the model parameters eliminates redundant interactions between compartments, equivalently revealing the optimal coupling structure between differential equations.

97 MATHEMATICS AND COMPUTING↗

Inferring Stochastic Rates from Heterogeneous Snapshots of Particle Positions

Many imaging techniques for biological systems—like fixation of cells coupled with fluorescence microscopy—provide sharp spatial resolution in reporting locations of individuals at a single moment in time but also destroy the dynamics they intend to capture. In this study, these snapshot observations contain no information about individual trajectories, but still encode information about movement and demographic dynamics, especially when combined with a well-motivated biophysical model. The relationship between spatially evolving populations and single-moment representations of their collective locations is well-established with partial differential equations (PDEs) and their inverse problems. However, experimental data is commonly a set of locations whose number is insufficient to approximate a continuous-in-space PDE solution. Here, motivated by popular subcellular imaging data of gene expression, we embrace the stochastic nature of the data and investigate the mathematical foundations of parametrically inferring demographic rates from snapshots of particles undergoing birth, diffusion, and death in a nuclear or cellular domain. Toward inference, we rigorously derive a connection between individual particle paths and their presentation as a Poisson spatial process. Using this framework, we investigate the properties of the resulting inverse problem and study factors that affect quality of inference. One pervasive feature of this experimental regime is the presence of cell-to-cell heterogeneity. Rather than being a hindrance, we show that cell-to-cell geometric heterogeneity can increase the quality of inference on dynamics for certain parameter regimes. Altogether, the results serve as a basis for more detailed investigations of subcellular spatial patterns of RNA molecules and other stochastically evolving populations that can only be observed for single instants in their time evolution.

59 BASIC BIOLOGICAL SCIENCES↗

Quantifying Uncertainty of Deep Reinforcement Learning Based Decision Making for Operations and Maintenance of Nuclear Power Plant

This paper summarizes research that integrates condition monitoring and prognostics with decision making for nuclear power plant operations and maintenance. As part of this research, we have developed an online asset management tool to help reduce life-cycle maintenance and repair costs. Using the latest advancements in condition monitoring, supply chain analytics, and deep reinforcement learning, we have created a predictive maintenance tool that can optimize the maintenance and spare-part management of a repairable nuclear system. To demonstrate these methods, preliminary studies were conducted on a simple, representative maintenance system undergoing a stochastic degradation process that requires repairs or replacement to continue operation. Through Monte Carlo simulations, we were able to reduce maintenance spending by approximately 50% compared to optimized, time-based maintenance strategies. Not only does the decision maker reduce the average life-cycle costs, it also minimizes the chance of high cost scenarios, lowering the variance of the expected cost distributions, and reducing overall financial risk. Furthermore, this work also studies the ability of the decision maker to handle various levels of noise from observation uncertainty. By introducing uncertainty into the decision-making process, we have quantified the robustness and resiliency of the decision maker, as well as identified necessary levels of observability to demonstrate cost effectiveness.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Stochastic Resolution of Identity for Real-Time Second-Order Green’s Function: Ionization Potential and Quasi-Particle Spectrum

Here, we develop a stochastic resolution of identity approach to the real-time second-order Green's function (real-time sRI-GF2) theory, extending our recent work for imaginary-time Matsubara Green's function [ Takeshita et al. J. Chem. Phys. 2019 , 151 , 044114 ]. The approach provides a framework to obtain the quasi-particle spectra across a wide range of frequencies and predicts ionization potentials and electron affinities. To assess the accuracy of the real-time sRI-GF2, we study a series of molecules and compare our results to experiments as well as to a many-body perturbation approach based on the GW approximation, where we find that the real-time sRI-GF2 is as accurate as self-consistent GW. The stochastic formulation reduces the formal computatinal scaling from O(N e 5 ) down to O(N e 3 ) where N e is the number of electrons. Finally, this is illustrated for a chain of hydrogen dimers, where we observe a slightly lower than cubic scaling for systems containing up to N e ≈ 1000 electrons.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Mechanism of heating of pre-formed plasma electrons in relativistic laser-matter interaction

The role of the longitudinal ambipolar electric field, present inside a pre-formed plasma, in electron heating and beam generation is investigated by analyzing single electron motion in the presence of one electromagnetic plane wave and 'V' shaped potential well (constant electric field) in a one dimensional slab approximation. It is shown that for the electron confined in an infinite potential well, its motion becomes stochastic when the ratio of normalized laser electric field a{sub 0}, to normalized longitudinal electric field E{sub z}, exceeds unity, i.e., a{sub 0}/E{sub z} Greater-Than-Or-Equivalent-To 1. For a more realistic potential well of finite depth, present inside the pre-formed plasma, the condition for stochastic heating of electrons gets modified to 1 Less-Than-Or-Equivalent-To a{sub 0}/E{sub z} Less-Than-Or-Equivalent-To {radical}(L), where L is the normalized length of the potential well. The energy of electron beam leaving such a potential well and entering the solid scales {approx}a{sub 0}{sup 2}/E{sub z}, which can exceed the laser ponderomotive energy ({approx}a{sub 0}) in the stochastic regime.

43 PARTICLE ACCELERATORS↗

Computation of the halo mass function using physical collapse parameters: application to non-standard cosmologies

In this article we compare the halo mass function predicted by the excursion set theory with a drifting diffusive barrier against the results of N-body simulations for several cosmological models. This includes the standard ΛCDM case for a large range of halo masses, models with different types of primordial non-Gaussianity, and the Ratra-Peebles quintessence model of Dark Energy. We show that in all those cosmological scenarios, the abundance of dark matter halos can be described by a drifting diffusive barrier, where the two parameters describing the barrier have physical content. In the case of the Gaussian ΛCDM, the statistics are precise enough to actually predict those parameters at different redshifts from the initial conditions. Furthermore, we found that the stochasticity in the barrier is non-negligible making the simple deterministic spherical collapse model a bad approximation even at very high halo masses. We also show that using the standard excursion set approach with a barrier inspired by peak patches leads to inconsistent predictions of the halo mass function.

79 ASTRONOMY AND ASTROPHYSICS↗

Modeling of carbon pellets disruption mitigation in an NSTX-U plasma

Single carbon pellet disruption mitigation simulations using M3D-C1 were conducted for an NSTX-U-like plasma to support the electromagnetic pellet injection concept (EPI). A carbon ablation model has been implemented in M3D-C1 and tested with available data. 2D simulations were conducted in order to estimate the amount of carbon needed to quench the plasma, finding that the content in a 1 mm radius vitreous carbon pellet (~3.2x10E20 atoms) would be enough if it is entirely ablated. 3D simulations were performed, scanning over pellet velocity and parallel thermal conductivity, as well as different injection directions and pellet concepts (solid pellets and shell pellets). The sensitivity of the thermal quench and other related quantities to these parameters has been evaluated. A 1 mm radius solid pellet only partially ablates at velocities of 300 m/s or higher, thus being unable to fully quench the plasma. To further enhance the ablation, approximations to an array of pellets and the shell pellet concept were also explored. 3D field line stochastization plays an important role in both quenching the center of the plasma and in heat flux losses, thus lowering the amount of carbon needed to mitigate the plasma when compared to the 2D case. This study constitutes an important step forward in `predict-first' simulations for disruption mitigation in NSTX-U and other devices, such as ITER.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Probabilistic Voltage Sensitivity Analysis to Quantify Impact of High PV Penetration on Unbalanced Distribution System

From an operational and planning perspective, it is important to quantify the impact of increasing penetration of photovoltaics on the distribution system. Most existing impact assessment studies are scenario-based where derived results are scenario specific and not generalizable. Moreover, stochasticity in the temporal behavior of spatially distributed PVs requires a large number of scenarios that increase with the size of the network and the level of penetration. Therefore, we propose a new computationally efficient analytical framework of voltage sensitivity analysis that allows for stochastic analysis of voltage change due to random changes in PV generation. We first derive an analytical approximation for voltage change at any node of the network due to change in power at other nodes in an unbalanced distribution network. The quality of this approximation is reinforced via bounds on the approximation error. Then, we derive the probability distribution of voltage change at a certain node due to random changes in power injections/consumptions at multiple locations of the network. The accuracy of the proposed PVSA is illustrated using a modified version of the IEEE 37 bus test system. As a result, the proposed PVSA can serve as a powerful tool for proactive monitoring/control and ease the computational burden associated with perturbation based cybersecurity mechanisms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Probabilistic and deterministic aspects of linear estimation in geodesy

Recent advances in observational techniques related to geodetic work (VLBI, laser ranging) make it imperative that more consideration should be given to modeling problems. Uncertainties in the effect of atmospheric refraction, polar motion and precession-nutation parameters, cannot be dispensed with in the context of centimeter level geodesy. Even physical processes that have generally been previously altogether neglected (station motions) must now be taken into consideration. The problem of modeling functions of time or space, or at least their values at observation points (epochs) is explored. When the nature of the function to be modeled is unknown. The need to include a limited number of terms and to a priori decide upon a specific form may result in a representation which fails to sufficiently approximate the unknown function. An alternative approach of increasing application is the modeling of unknown functions as stochastic processes.

Dermanis, A.↗

Surrogate Optimization for Quantum Circuits

Variational quantum Eigensolvers are touted as a near-term algorithm capable of impacting many applications. However, the potential has yet to be realized with few claims of quantum advantage and high resource estimates mainly due to the need for optimization in the presence of noise. Finding algorithms and methods to improve the convergence is essential to accelerate the capabilities of near-term hardware for VQE or more broad applications of hybrid methods in which optimization is required. To this goal we look to use modern approaches recently developed in circuit simulations and stochastic classical optimization that can be combined in a surrogate optimization approach to classical circuits. Using an approximate state vector simulator, we efficiently calculate an approximate Hessian, fed as an input for a detailed quantum circuit simulator. We demonstrate the capabilities of such an approach with and without sampling noise. We also show that this method outperforms Powell in the presence of quantum circuit shot noise by a factor of 2-4

quantum computing↗

Stochastic Inflation at NNLO

Stochastic Inflation is an important framework for understanding the physics of de Sitter space and the phenomenology of inflation. In the leading approximation, this approach results in a Fokker-Planck equation that calculates the probability distribution for a light scalar field as a function of time. Despite its successes, the quantum field theoretic origins and the range of validity for this equation have remained elusive, and establishing a formalism to systematically incorporate higher order effects has been an area of active study. In this paper, we calculate the next-to-next-to-leading order (NNLO) corrections to Stochastic Inflation using Soft de Sitter Effective Theory (SdSET). In this effective description, Stochastic Inflation manifests as the renormalization group evolution of composite operators. The leading impact of non-Gaussian quantum fluctuations appears at NNLO, which is presented here for the first time; we derive the coefficient of this term from a two-loop anomalous dimension calculation within SdSET. We solve the resulting equation to determine the NNLO equilibrium distribution and the low-lying relaxation eigenvalues. In the process, we must match the UV theory onto SdSET at one-loop order, which provides a non-trivial confirmation that the separation into Wilson-coefficient corrections and contributions to initial conditions persists beyond tree level. Furthermore, these results illustrate how the naive factorization of time and momentum integrals in SdSET no longer holds in the presence of logarithmic divergences. It is these effects that ultimately give rise to the renormalization group flow that yields Stochastic Inflation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Dynamic Bertrand Oligopoly

We study continuous time Bertrand oligopolies in which a small number of firms producing similar goods compete with one another by setting prices. We first analyze a static version of this game in order to better understand the strategies played in the dynamic setting. Within the static game, we characterize the Nash equilibrium when there are N players with heterogeneous costs. In the dynamic game with uncertain market demand, firms of different sizes have different lifetime capacities which deplete over time according to the market demand for their good. We setup the nonzero-sum stochastic differential game and its associated system of HJB partial differential equations in the case of linear demand functions. We characterize certain qualitative features of the game using an asymptotic approximation in the limit of small competition. The equilibrium of the game is further studied using numerical solutions. We find that consumers benefit the most when a market is structured with many firms of the same relative size producing highly substitutable goods. However, a large degree of substitutability does not always lead to large drops in price, for example when two firms have a large difference in their size.

97 MATHEMATICS AND COMPUTING↗

A stochastic downscaling approach for generating high-frequency solar irradiance scenarios

Solar power is increasingly cost viable with solar photovoltaic (PV) installations becoming commonplace. PV planning and operational studies, however, require high-frequency solar irradiance scenarios to understand potential electric grid impacts due to the variability and uncertainty of the underlying solar resource. Existing remote sensing solar data products are often available over large spatial domains, but are limited in temporal resolution. For example, the global horizontal irradiance (GHI) component contained within the National Solar Radiation Database (NSRDB) is available at time resolution of 30 min on an approximately four-kilometer grid. In contrast, substantial solar variability is present at finer time scales and this article describes an algorithm to stochastically generate one-minute GHI from widely available sub-hourly NSRDB. A generalized linear modeling (GLM) framework is proposed, which includes non-Gaussian mixtures, and extends the literature involving the synthesis of GHI data. The model is trained on a set of sample locations around Oregon, USA, and validated across the USA using both the Surface Radiation Budget Network (SURFRAD) dataset and Solar Radiation Monitoring Laboratory (SRML) network. Simulated ensembles show good coverage properties and temporal correlation structure. The resulting downscaled ensembles allow for understanding the unpredictable variability inherent in GHI at locations without direct measurements. Here, future work can leverage the algorithm as part of a stochastic optimization of electric grid operations with high-penetration PV systems.

14 SOLAR ENERGY↗

The adhesion model as a field theory for cosmological clustering

The adhesion model has been proposed in the past as an improvement of the Zel'dovich approximation, providing a good description of the formation of the cosmic web. We recast the model as a field theory for cosmological large scale structure, adding a stochastic force to account for power generated from very short, highly non-linear scales that is uncorrelated with the initial power spectrum. The dynamics of this Stochastic Adhesion Model (SAM) is reminiscent of the well known Kardar-Parisi-Zhang equation with the difference that the viscosity and the noise spectrum are time dependent. Choosing the viscosity proportional to the growth factor D restricts the form of noise spectrum through a 1-loop renormalization argument. For this choice, the SAM field theory is renormalizable to one loop. We comment on the suitability of this model for describing the non-linear regime of the CDM power spectrum and its utility as a relatively simple approach to cosmological clustering.

79 ASTRONOMY AND ASTROPHYSICS↗

OBSERVATIONAL TEST OF STOCHASTIC HEATING IN LOW-{beta} FAST-SOLAR-WIND STREAMS

Spacecraft measurements show that protons undergo substantial perpendicular heating during their transit from the Sun to the outer heliosphere. In this paper, we use Helios 2 measurements to investigate whether stochastic heating by low-frequency turbulence is capable of explaining this perpendicular heating. We analyze Helios 2 magnetic field measurements in low-{beta} fast-solar-wind streams between heliocentric distances r = 0.29 AU and r = 0.64 AU to determine the rms amplitude of the fluctuating magnetic field, {delta}B{sub p}, near the proton gyroradius scale {rho}{sub p}. We then evaluate the stochastic heating rate Q{sub stoch} using the measured value of {delta}B{sub p} and a previously published analytical formula for Q{sub stoch}. Using Helios measurements we estimate the ''empirical'' perpendicular heating rate Q{sub Up-Tack emp} = (k{sub B}/m{sub p}) BV (d/dr) (T{sub Up-Tack p}/B) that is needed to explain the T{sub p} profile. We find that Q{sub stoch} {approx} Q{sub emp}, but only if a key dimensionless constant appearing in the formula for Q{sub stoch} lies within a certain range of values. This range is approximately the same throughout the radial interval that we analyze and is consistent with the results of numerical simulations of the stochastic heating of test particles in reduced magnetohydrodynamic turbulence. These results support the hypothesis that stochastic heating accounts for much of the perpendicular proton heating occurring in low-{beta} fast-wind streams.

79 ASTRONOMY AND ASTROPHYSICS↗