Search NASA⌕ Search

SEARCH · Search NASA

Results for “MARKOV PROCESS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

A Bivariate Mixed Distribution with a Heavy-tailed Component and its Application to Single-site Daily Rainfall Simulation

This paper presents an improved brivariate mixed distribution, which is capable of modeling the dependence of daily rainfall from two distinct sources (e.g., rainfall from two stations, two consecutive days, or two instruments such as satellite and rain gauge). The distribution couples an existing framework for building a bivariate mixed distribution, the theory of copulae and a hybrid marginal distribution. Contributions of the improved distribution are twofold. One is the appropriate selection of the bivariate dependence structure from a wider admissible choice (10 candidate copula families). The other is the introduction of a marginal distribution capable of better representing low to moderate values as well as extremes of daily rainfall. Among several applications of the improved distribution, particularly presented here is its utility for single-site daily rainfall simulation. Rather than simulating rainfall occurrences and amounts separately, the developed generator unifies the two processes by generalizing daily rainfall as a Markov process with autocorrelation described by the improved bivariate mixed distribution. The generator is first tested on a sample station in Texas. Results reveal that the simulated and observed sequences are in good agreement with respect to essential characteristics. Then, extensive simulation experiments are carried out to compare the developed generator with three other alternative models: the conventional two-state Markov chain generator, the transition probability matrix model and the semi-parametric Markov chain model with kernel density estimation for rainfall amounts. Analyses establish that overall the developed generator is capable of reproducing characteristics of historical extreme rainfall events and is apt at extrapolating rare values beyond the upper range of available observed data. Moreover, it automatically captures the persistence of rainfall amounts on consecutive wet days in a relatively natural and easy way. Another interesting observation is that the recognized ‘overdispersion’ problem in daily rainfall simulation ascribes more to the loss of rainfall extremes than the under-representation of first-order persistence. The developed generator appears to be a sound option for daily rainfall simulation, especially in particular hydrologic planning situations when rare rainfall events are of great importance.

Singh, Vijay P.↗

A comparison of theoretical and experimental video compression designs

This paper compares theoretical and experimental picture compression designs, for images processed in 8 x 8 blocks using the Walsh-Hadamard transform (WHT). The optimum picture compression design is well known, if the mean-square error (mse) is used as the measure of distortion, and if it is assumed that the video process is a stationary first-order Markov process with a Gaussian distribution. This theoretical design gives useful results when the transform processing is done on full pictures, but gives inferior results (relative to empirical design) when transform processing is done on small 8 x 8 blocks. The use of non-Gaussian distributions for the transform components fails to improve this poor performance, which is due to the nonstationary nature of the video process. An experimentally based design procedure, which considers nonstationarity, yields significantly improved mse and subjective performance.

Jones, H. W., Jr.↗

Growth Optimal Portfolio Selection Under Proportional Transaction Costs with Obligatory Diversification

A continuous time long run growth optimal or optimal logarithmic utility portfolio with proportional transaction costs consisting of a fixed proportional cost and a cost proportional to the volume of transaction is considered. The asset prices are modeled as exponent of diffusion with jumps whose parameters depend on a finite state Markov process of economic factors. An obligatory portfolio diversification is introduced, accordingly to which it is required to invest at least a fixed small portion of our wealth in each asset.

97 MATHEMATICS AND COMPUTING↗

Capacity of a bosonic memory channel with Gauss-Markov noise

We address the classical capacity of a quantum bosonic memory channel with additive noise, subject to an input energy constraint. The memory is modeled by correlated noise emerging from a Gauss-Markov process. Under reasonable assumptions, we show that the optimal modulation results from a 'quantum water-filling' solution above a certain input energy threshold, similar to the optimal modulation for parallel classical Gaussian channels. We also derive analytically the optimal multimode input state above this threshold, which enables us to compute the capacity of this memory channel in the limit of an infinite number of modes. The method can also be applied to a more general noise environment which is constructed by a stationary Gauss process. The extension of our results to the case of broadband bosonic channels with colored Gaussian noise should also be straightforward.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

PULSAR STATE SWITCHING FROM MARKOV TRANSITIONS AND STOCHASTIC RESONANCE

Markov processes are shown to be consistent with metastable states seen in pulsar phenomena, including intensity nulling, pulse-shape mode changes, subpulse drift rates, spin-down rates, and X-ray emission, based on the typically broad and monotonic distributions of state lifetimes. Markovianity implies a nonlinear magnetospheric system in which state changes occur stochastically, corresponding to transitions between local minima in an effective potential. State durations (though not transition times) are thus largely decoupled from the characteristic timescales of various magnetospheric processes. Dyadic states are common but some objects show at least four states with some transitions forbidden. Another case is the long-term intermittent pulsar B1931+24 that has binary radio-emission and torque states with wide, but non-monotonic duration distributions. It also shows a quasi-period of 38 ± 5 days in a 13 yr time sequence, suggesting stochastic resonance in a Markov system with a forcing function that could be strictly periodic or quasi-periodic. Nonlinear phenomena are associated with time-dependent activity in the acceleration region near each magnetic polar cap. The polar-cap diode is altered by feedback from the outer magnetosphere and by return currents from the equatorial region outside the light cylinder that may also cause the neutron star to episodically charge and discharge. Orbital perturbations of a disk or current sheet provide a natural periodicity for the forcing function in the stochastic-resonance interpretation of B1931+24. Disk dynamics may introduce additional timescales in observed phenomena. Future work can test the Markov interpretation, identify which pulsar types have a propensity for state changes, and clarify the role of selection effects.

79 ASTRONOMY AND ASTROPHYSICS↗

Adaptive Sampling of Large Deviations

We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting the probability and pathways of rare events in stochastic processes, as well as for understanding the physics of nonequilibrium systems driven in steady states by external forces and reservoirs. The algorithm uses methods from risk-sensitive and feedback control to estimate from a single trajectory a new process, called the driven process, known to be efficient for importance sampling. Its advantages compared to other simulation techniques, such as splitting or cloning, are discussed and illustrated with simple equilibrium and nonequilibrium diffusion models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Trace distance in stochastic dephasing with initial correlation

The time evolution of the trace distance between quantum states of a qubit which is placed under the influence of stochastic dephasing is investigated within the framework of the stochastic Liouville equation. When stochastic dephasing is subject to the homogeneous Gauss-Markov process, the trace distance is exactly calculated in the presence of the initial correlation between the qubit and the stochastic process, where the stochastic process is inevitably a nonstationary process. It is found that even the initial correlation with the classical environment can make the trace distance greater than the initial value if stochastic dephasing causes the slow modulation of the qubit.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A model capturing novel strand symmetries in bacterial DNA

Highlights: {yields} We propose a simple stochastic model to construct primitive DNA sequences. {yields} The model provide an explanation for Chargaff's second parity rule in primitive DNA sequences. {yields} The model is also used to predict a novel type of strand symmetry in primitive DNA sequences. {yields} We extend the results for bacterial DNA sequences and compare distributional properties intrinsic to the model to statistical estimates from 1049 bacterial genomes. {yields} We find out statistical evidences that the novel type of strand symmetry holds for bacterial DNA sequences. -- Abstract: Chargaff's second parity rule for short oligonucleotides states that the frequency of any short nucleotide sequence on a strand is approximately equal to the frequency of its reverse complement on the same strand. Recent studies have shown that, with the exception of organellar DNA, this parity rule generally holds for double-stranded DNA genomes and fails to hold for single-stranded genomes. While Chargaff's first parity rule is fully explained by the Watson-Crick pairing in the DNA double helix, a definitive explanation for the second parity rule has not yet been determined. In this work, we propose a model based on a hidden Markov process for approximating the distributional structure of primitive DNA sequences. Then, we use the model to provide another possible theoretical explanation for Chargaff's second parity rule, and to predict novel distributional aspects of bacterial DNA sequences.

60 APPLIED LIFE SCIENCES↗

Non-commutative Nash inequalities

A set of functional inequalities—called Nash inequalities—are introduced and analyzed in the context of quantum Markov process mixing. The basic theory of Nash inequalities is extended to the setting of non-commutative L{sub p} spaces, where their relationship to Poincaré and log-Sobolev inequalities is fleshed out. We prove Nash inequalities for a number of unital reversible semigroups.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Coupling sample paths to the thermodynamic limit in Monte Carlo estimators with applications to gene expression

Many biochemical systems appearing in applications have a multiscale structure so that they converge to piecewise deterministic Markov processes in a thermodynamic limit. The statistics of the piecewise deterministic process can be obtained much more efficiently than those of the exact process. We explore the possibility of coupling sample paths of the exact model to the piecewise deterministic process in order to reduce the variance of their difference. We then apply this coupling to reduce the computational complexity of a Monte Carlo estimator. Motivated by the rigorous results in , we show how this method can be applied to realistic biological models with nontrivial scalings.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Calculating alpha Eigenvalues in a Continuous-Energy Infinite Medium with Monte Carlo

The α eigenvalue has implications for time-dependent problems where the system is sub- or supercritical. We present methods and results from calculating the α-eigenvalue spectrum for a continuous-energy infinite medium with a simplified Monte Carlo transport code. We formulate the α-eigenvalue problem, detail the Monte Carlo code physics, and provide verification and results. We have a method for calculating the α-eigenvalue spectrum in a continuous-energy infinite-medium. The continuous-time Markov process described by the transition rate matrix provides a way of obtaining the α-eigenvalue spectrum and kinetic modes. These are useful for the approximation of the time dependence of the system.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Multifractal analysis of time series generated by discrete Ito equations

In this study, we show that discrete Ito equations with short-tail Gaussian marginal distribution function generate multifractal time series. The multifractality is due to the nonlinear correlations, which are hidden in Markov processes and are generated by the interrelation between the drift and the multiplicative stochastic forces in the Ito equation. A link between the range of the generalized Hurst exponents and the mean of the squares of all averaged net forces is suggested.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Barkhausen discontinuities and hysteresis of ferromagnetics: New stochastic approach

The magnetization of ferromagnetic material is considered as periodically inhomogeneous Markov process. The theory assumes both statistically independent and correlated Barkhausen discontinuities. The model, based on the chain evolution-type process theory, assumes that the domain structure of a ferromagnet passes successively the steps of: linear growing, exponential acceleration and domains annihilation to zero density at magnetic saturation. The solution of stochastic differential Kolmogorov equation enables the hysteresis loop calculus.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Comparison of the kinetics of different Markov models for ligand binding under varying conditions

We recently derived a Markov model for macromolecular ligand binding dynamics from few physical assumptions and showed that its stationary distribution is the grand canonical ensemble [J. W. R. Martini, M. Habeck, and M. Schlather, J. Math. Chem. 52, 665 (2014)]. The transition probabilities of the proposed Markov process define a particular Glauber dynamics and have some similarity to the Metropolis-Hastings algorithm. Here, we illustrate that this model is the stochastic analog of (pseudo) rate equations and the corresponding system of differential equations. Moreover, it can be viewed as a limiting case of general stochastic simulations of chemical kinetics. Thus, the model links stochastic and deterministic approaches as well as kinetics and equilibrium described by the grand canonical ensemble. We demonstrate that the family of transition matrices of our model, parameterized by temperature and ligand activity, generates ligand binding kinetics that respond to changes in these parameters in a qualitatively similar way as experimentally observed kinetics. In contrast, neither the Metropolis-Hastings algorithm nor the Glauber heat bath reflects changes in the external conditions correctly. Both converge rapidly to the stationary distribution, which is advantageous when the major interest is in the equilibrium state, but fail to describe the kinetics of ligand binding realistically. To simulate cellular processes that involve the reversible stochastic binding of multiple factors, our pseudo rate equation model should therefore be preferred to the Metropolis-Hastings algorithm and the Glauber heat bath, if the stationary distribution is not of only interest.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Monte Carlo Direct Simulation Method for Initiation Probability Problems

During the early period of a supercritical system, the growth of fission chains shows a significant stochastic feature. In multiplying medium, it is a probability issue of fail-pass type for a single neutron to sponsor a divergent fission chain, and the probability of success is named as single neutron initiation probability. Meanwhile, in the presence of a weak neutron source, the time at which fission burst occurs also exhibits a stochastic nature, which can be observed on experiments of pulsed reactors such as GODIVA I and GODIVA II. The initiation probability and burst waiting time reflect the dynamic feature of a supercritical system, which are very important for nuclear criticality safety concerns. It is desirable that a supercritical system has an initiation probability very close to zero and releases limited energy in case of criticality accidents. The stochastic process of neutron population evolution in early age in a multiplying system is governed by Bell's equation in the form of an adjoint neutron transport equation with a non-linear fission term. In order to solve this stochastic neutron transport equation, the deterministic method discretizing the phase space was proposed long ago and has been implemented in several SN codes such as Partisn, Ardra and PANDA. However, the deterministic method is of limited usage, due to its poor ability to precisely describe real-world 3D complex geometries and continuous energy neutron spectrum. Recently, Monte Carlo methods have gradually gained attention for solving Bell's equation. Greenman from LLNL proposed an analog Monte Carlo forward-transport method for calculating initiation probability in 2007. He implemented this method by introducing the maximum age parameter, the time sub-interval and the neutron progenitor tag into Mercury in time-dependent fixed-source simulation mode. This method is only suitable for initiation probability calculations, however not for analyzing the randomness of burst waiting time. Later, GANG in 2011 developed the GSMP (Generalized Semi-Markov Process method) Monte Carlo method according to Bell's equation. While the GSMP method, which can deal with both initiation probability and burst waiting time, is flexible and powerful for zero-dimensional problems, it is not favorable when extended to 3D and continuous energy problems due to severe lack of computational efficiency. In 2015, a direct Monte Carlo simulation method for stochastic systems problems was implemented in MCATK, yet this method has not been applied specifically to the burst waiting time. In this work, a new and efficient 3D Monte Carlo direct simulation method for calculating both the initiation probability and the burst waiting time is developed. By taking random factors during evolvement of fission chains into account in dynamic Monte Carlo simulation, this new method has the potential of simulating the whole process from source neutron injection to exponential growth of the neutron population, and finally to extinction of the neutron pulse. This capability is useful in criticality accidents evaluation and pulsed reactor experiments explanation. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Calculating infinite-medium {alpha}-eigenvalue spectra with a transition rate matrix method

The time-dependent behavior of the energy spectrum in neutron transport was investigated with a formulation, based on continuous-time Markov processes, for computing {alpha}-eigenvalues and eigenvectors in an infinite medium. For this, a research Monte Carlo code called TORTE was created and used to estimate elements of a transition rate matrix. TORTE is capable of using both multigroup and continuous-energy nuclear data, and verification was performed. Eigenvalue spectra for infinite homogeneous mixtures were obtained and an eigenfunction expansion was used to investigate transient behavior of the neutron energy spectrum. (authors)

97 MATHEMATICS AND COMPUTING↗