Search NASA⌕ Search

SEARCH · Search NASA

Results for “Markov process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Model reduction methods for population dynamics with fast-switching environments: Reduced master equations, stochastic differential equations, and applications

Here we study stochastic population dynamics coupled to fast external environments and combine expansions in the inverse switching rate of the environment and a Kramers–Moyal expansion in the inverse size of the population. This leads to a series of approximation schemes, capturing both intrinsic and environmental noise. These methods provide a means of efficient simulation and we show how they can be used to obtain analytical results for the fluctuations of population dynamics in switching environments. We place the approximations in relation to existing work on piecewise-deterministic and piecewise-diffusive Markov processes. Finally, we demonstrate the accuracy and efficiency of these model-reduction methods in different research fields, including systems in biology and a model of crack propagation.

59 BASIC BIOLOGICAL SCIENCES↗

Flow Intermittency, Dispersion, and Correlated Continuous Time Random Walks in Porous Media

We study the intermittency of fluid velocities in porous media and its relation to anomalous dispersion. Lagrangian velocities measured at equidistant points along streamlines are shown to form a spatial Markov process. As a consequence of this remarkable property, the dispersion of fluid particles can be described by a continuous time random walk with correlated temporal increments. This new dynamical picture of intermittency provides a direct link between the microscale flow, its intermittent properties, and non-Fickian dispersion.

Environmental Molecular Sciences Laboratory↗

Thermalization of Interacting Quasi-One-Dimensional Systems

Many experimentally relevant systems are quasi-one-dimensional, consisting of nearly decoupled chains. In these systems, there is a natural separation of scales between the strong intrachain interactions and the weak interchain coupling. When the intrachain interactions are integrable, weak interchain couplings play a crucial part in thermalizing the system. Here, we develop a Boltzmann-equation formalism involving a collision integral that is asymptotically exact for any interacting integrable system, and apply it to develop a quantitative theory of relaxation in coupled Bose gases in the experimentally relevant Newton's cradle setup. Here we find that relaxation involves a broad spectrum of timescales. We provide evidence that the Markov process governing relaxation at late times is gapless; thus, the approach to equilibrium is generally nonexponential, even for spatially uniform perturbations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Reliability Analysis of Power Grids Considering Component Failures of Variable Energy Resources

This paper proposes an improved model for the reliability assessment of power systems considering component failures of variable energy resources (VER). The inherent intermittency of VER such as solar photovoltaic (PV) and wind farms, along with their susceptibility to component failures, present significant challenges to reliable system operation. These issues, combined with power grid operation and network constraints, complicate the reliable operation of VER-integrated power systems. Here, to address these concerns, this paper introduces a reliability assessment framework that considers VER input variability, its impact on component availability, and their resulting impact on overall system reliability. Stochastic models based on discrete Markov processes are developed to incorporate variable irradiance, wind speeds, and their effects on PV and wind component failure rates. A next-event and state transition-based approach is then developed to integrate the stochastic models into a mixed-timing sequential Monte Carlo simulation framework for composite reliability assessment. Case studies on the RTS-GMLC system demonstrate the effectiveness of the proposed model in evaluating the reliability of VER-integrated systems.

Pandit, Dilip [Sandia National Laboratories (SNL-N↗

Kullback--Leibler Approximation for Probability Measures on Infinite Dimensional Spaces

In a variety of applications it is important to extract information from a probability measure μ on an infinite dimensional space. Examples include the Bayesian approach to inverse problems and (possibly conditioned) continuous time Markov processes. It may then be of interest to find a measure ν, from within a simple class of measures, which approximates μ. Here, this problem is studied in the case where the Kullback–Leibler divergence is employed to measure the quality of the approximation. A calculus of variations viewpoint is adopted, and the particular case where ν is chosen from the set of Gaussian measures is studied in detail. Basic existence and uniqueness theorems are established, together with properties of minimizing sequences. Furthermore, parameterization of the class of Gaussians through the mean and inverse covariance is introduced, the need for regularization is explained, and a regularized minimization is studied in detail. The calculus of variations framework resulting from this work provides the appropriate underpinning for computational algorithms.

97 MATHEMATICS AND COMPUTING↗

A Stochastic Conceptual Modeling Approach for Examining the Effects of Climate Change on Streamflows in Mountain Basins

Abstract This study presents a modeling approach for examining how changes in climate affect streamflow in mesoscale mountain basins dominated by snowmelt runoff. A conceptual snowmelt-runoff model was developed that is forced by daily time series of temperature and precipitation. The model can be run using either observed climate data or artificial climate data generated from a GCM or a stochastic model. The model was applied to a case-study basin, the north fork of the Clearwater River in Idaho, using stochastically generated climate scenarios. Climate scenarios were generated using a contemporaneous auto-regressive integrated moving average (CARIMA) model for temperature and a precipitation model based on a two-state first-order Markov process. A baseline climate scenario was developed that represents recently observed temperature and precipitation conditions and then 15 additional climate scenarios that represent shifts in recent conditions. For each scenario, model application produced an ensemble of 50 streamflow traces each spanning 30 yr. Results show that an increase in temperature among scenarios leads to a decrease in streamflow and vice versa. Decreases in temperature shift the basin runoff to fully snowmelt dominated, whereas increases in temperature increase the frequency of midwinter runoff events. Increasing precipitation leads to increased runoff in cases where the temperature remains the same as the observed record, but not in cases where the temperature increases. The modeling approach presented here can be used by water managers to examine which types of climate change could require modifications in water planning and operations.

13 HYDRO ENERGY↗

Large Deviation Methods for the Analysis and Design of Monte Carlo Schemes in Physics and Chemistry. Final Technical Report

This proposal is concerned with applications of Monte Carlo to problems in physics and chemistry where rare events degrade the performance of standard Monte Carlo. One class of problems is concerned with computation of various aspects of the equilibrium behavior of some Markov process via time averages. The problem to be overcome is that rare events interfere with the efficient sampling of all relevant parts of phase space. A second class concerns sampling transitions between two or more stable attractors. Here, rare events do not interfere with the sampling of all relevant parts of phase space, but make Monte Carlo inefficient because of the very large number of samples required to obtain variance comparable to the quantity estimated. The project uses large deviation methods for the mathematical analyses of various Monte Carlo techniques, and in particular for algorithmic analysis and design. This is done in the context of relevant application areas, mainly from chemistry and biology.

97 MATHEMATICS AND COMPUTING↗

Realizing the Power of Near-Term Quantum Technologies

This the final report of the LDRD project entitled "Realizing the Power of Near-Term Quantum Technologies", which was tasked with laying a theoretical foundation and computational framework for quantum simulation on quantum devices, to support both future Sandia efforts and the broader academic research effort in this area. The unifying theme of the project has been the desire to delineate more clearly the interface between existent classical computing resources that are vast and reliable with emerging quantum computing resources that will be scarce and unreliable for the foreseeable future. We seek to utilize classical computing resources to judge the efficacy of quantum devices for quantum simulation tasks and determine when they exceed the performance of classical devices, thereby achieving "quantum supremacy". This task was initially pursued by adapting the general concept of "parameter space compression" to quantum simulation. An inability to scale this analysis efficiently to large-scale simulations precipitated a shift in focus to assessing quantum supremacy of a specific quantum device, a 1D Bose gas trapped in an optical lattice, that was more amenable to large-scale analysis. We also seek to reconstruct unobserved information from limited observations of a quantum device to enhance their utility. This task was initially pursued as an application of maximum entropy reconstruction. Initial attempts to improve entropy approximations for direct reconstruction by free energy minimization proved to be more difficult than expected, and the focus shifted to the development of a quantum thermostat to facilitate indirect reconstruction by evolving a quantum Markov process. An efficient quantum thermostat is broadly useful for quantum state preparation in almost any quantum simulation task. In the middle of the project, a small opportunistic investment was made in a high-risk experiment to build an analog quantum simulator out of hole quantum dots in Ge/SiGe heterostructures. While a useful simulator was not produced, hole quantum dots at a Ge/SiGe interface have been successfully observed for the first time.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Defender Policy Evaluation and Resource Allocation against MITRE ATT&CK Data and Evaluations

Protecting against multi-step attacks of uncertain duration and timing forces defenders into an indefinite, always ongoing, resource-intensive response. To effectively allocate resources, a defender must be able to analyze multi-step attacks under assumption of constantly allocating resources against an uncertain stream of potentially undetected attacks. To achieve this goal, we present a novel methodology that applies a game-theoretic approach to the attack, attacker, and defender data derived from MITRE´s ATT&CK ® Framework. Time to complete attack steps is drawn from a probability distribution determined by attacker and defender strategies and capabilities. This constraints attack success parameters and enables comparing different defender resource allocation strategies. By approximating attacker-defender games as Markov processes, we represent the attacker-defender interaction, estimate the attack success parameters, determine the effects of attacker and defender strategies, and maximize opportunities for defender strategy improvements against an uncertain stream of attacks. This novel representation and analysis of multi-step attacks enables defender policy optimization and resource allocation, which we illustrate using the data from MITRE´ s APT3 ATT&CK ® Framework.

97 MATHEMATICS AND COMPUTING↗

Globally optimal interferometry with lossy twin Fock probes

Parity or quadratic spin (e.g., J z 2 ) readouts of a Mach–Zehnder (MZ) interferometer probed with a twin Fock (TF) input state allow saturating the optimal sensitivity attainable among all mode-separable states with a fixed total number of particles but only when the interferometer phase θ is near zero. When more general Dicke state probes are used, the parity readout saturates the quantum Fisher information (QFI) at θ = 0, whereas better-than-standard quantum limit performance of the J z 2 readout is restricted to an o ( N ) occupation imbalance. We show that a method of moments readout of two quadratic spin observables J z 2 and J + 2 + J − 2 is globally optimal for Dicke state probes; i.e., the error saturates the QFI for all θ . In the lossy setting, we derive the time-inhomogeneous Markov process describing the effect of particle loss on TF states, showing that the method of moments readout of four at-most-quadratic spin observables is sufficient for globally optimal estimation of θ when two or more particles are lost. The analysis culminates in a numerical calculation of the QFI matrix for distributed MZ interferometry on the four-mode state | N 4 , N 4 , N 4 , N 4 〉 and its lossy counterparts, showing that an advantage for the estimation of any linear function of the local MZ phases θ 1 and θ 2 (compared to independent probing of the MZ phases by two copies of | N 4 , N 4 〉 ) appears when more than one particle is lost.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Potential of Entropic Force in Markov Systems with Nonequilibrium Steady State, Generalized Gibbs Function and Criticality

In this paper we revisit the notion of the “minus logarithm of stationary probability” as a generalized potential in nonequilibrium systems and attempt to illustrate its central role in an axiomatic approach to stochastic nonequilibrium thermodynamics of complex systems. It is demonstrated that this quantity arises naturally through both monotonicity results of Markov processes and as the rate function when a stochastic process approaches a detrministic limit. We then undertake a more detailed mathematical analysis of the consequences of this quantity, culminating in a necessary and sufficient condition for the criticality of stochastic systems. This condition is then discussed in the context of recent results about criticality in biological systems.

entropy↗

Optimum quantization.

Optimum uniform quantizer structures for digital data with known continuous probability density noting telemetering of stationary Gaussian Markov process functions

Kurtenbach, A. J.↗