Search NASA⌕ Search

SEARCH · Search NASA

Results for “Markov process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Quantum nonunital dynamics of spin-bath-assisted Fisher information

The nonunital non-Markovian dynamics of qubits immersed in a spin bath is studied without any Markovian approximation. The environmental effects on the precisions of quantum parameter estimation are taken into account. The time-dependent transfer matrix and inhomogeneity vector are obtained for the description of the open dynamical process. The dynamical behaviour of one qubit coupled to a spin bath is geometrically described by the Bloch vector. It is found out that the nonunital non-Markovian effects can engender the improvement of the precision of quantum parameter estimation. This result contributes to the environment-assisted quantum information theory.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Environment-dependent dissipation in quantum Brownian motion

The dissipative dynamics of a quantum Brownian particle is studied for different types of environment. We derive analytic results for the time evolution of the mean energy of the system for Ohmic, sub-Ohmic, and super-Ohmic environments, without performing the Markovian approximation. Our results allow one to establish a direct link between the form of the environmental spectrum and the thermalization dynamics. This in turn leads to a natural explanation of the microscopic physical processes ruling the system time evolution both in the short-time non-Markovian region and in the long-time Markovian one. Our comparative study of thermalization for different environments sheds light on the physical contexts in which non-Markovian dissipation effects are dominant.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantum Fisher information flow and non-Markovian processes of open systems

We establish an information-theoretic approach for quantitatively characterizing the non-Markovianity of open quantum processes. Here, the quantum Fisher information (QFI) flow provides a measure to statistically distinguish Markovian and non-Markovian processes. A basic relation between the QFI flow and non-Markovianity is unveiled for quantum dynamics of open systems. For a class of time-local master equations, the exactly analytic solution shows that for each fixed time the QFI flow is decomposed into additive subflows according to different dissipative channels.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Probabilistic Independence Networks for Hidden Markov Probability Models

In this paper we explore hidden Markov models(HMMs) and related structures within the general framework of probabilistic independence networks (PINs). The paper contains a self-contained review of the basic principles of PINs. It is shown that the well-known forward-backward (F-B) and Viterbi algorithms for HMMs are special cases of more general enference algorithms for arbitrary PINs.

random variables pattern recognition signal proces↗

BBGKY kinetic approach for an e{sup -}e{sup +}{gamma} plasma created from the vacuum in a strong laser-generated electric field: The one-photon annihilation channel

In the present work a closed system of kinetic equations is obtained from the truncation of the Bogoliubov-Born-Green-Kirkwood-Yvon hierarchy for the description of the vacuum creation of an electron-positron plasma and secondary photons due to a strong laser field. This truncation is performed in the Markovian approximation for the one-photon annihilation channel which is accessible due to the presence of the strong external field. Estimates of the photon production rate are obtained for different domains of laser field parameters (frequency {nu} and field strength E). A huge quantity of optical photons of the quasiclassical laser field is necessary to satisfy the conservation laws of the energy and momentum of the constituents (e{sup -}, e{sup +} and {gamma}) in this channel. Since the number of these optical photons corresponds to the order of perturbation theory, a vanishingly small photon production rate results for the optical region and strongly subcritical fields E<<E{sub c}. In the {gamma}-ray region {nu} < or approx. m the required number of laser photons is small and the production rate of photons from the one-photon annihilation process becomes accessible to observations for subcritical fields E < or approx. E{sub c}. In the infrared region the photon distribution has a 1/k spectrum typical for flicker noise.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Non-Markovian dynamics of open quantum system with memory

Highlights: • Non-Markovian master equation for open quantum system with power-law memory is proposed. • Non-Markovian dynamics of two-level quantum system with memory is described. • Solutions of non-Markovian quantum master equations are derived. • Complete positivity and bi-positivity in non-Markovian quantum dynamics with memory are described. • Exact solution of non-Markovian equations of system with memory is proposed. In this paper, non-Markovian generalization of master equation for open quantum system is proposed. Non-Markovian dynamics of two-level quantum system with memory and interaction with environment is described. To describe this system, the Gorini–Kossakowski–Sudarshan equation for open quantum states is generalized by taking into account power-law fading memory. The non-Markovian quantum processes with power-law memory are described by using integration and differentiation of non-integer orders. Complete positivity and bi-positivity in non-Markovian quantum dynamics with memory are described. An example of two-level quantum systems with power-law memory is suggested. Exact solution of the non-Markovian master equations of two-level open quantum systems with memory is derived.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Extracting the diffusion tensor from molecular dynamics simulation with Milestoning

We propose an algorithm to extract the diffusion tensor from Molecular Dynamics simulations with Milestoning. A Kramers-Moyal expansion of a discrete master equation, which is the Markovian limit of the Milestoning theory, determines the diffusion tensor. To test the algorithm, we analyze overdamped Langevin trajectories and recover a multidimensional Fokker-Planck equation. The recovery process determines the flux through a mesh and estimates local kinetic parameters. Rate coefficients are converted to the derivatives of the potential of mean force and to coordinate dependent diffusion tensor. We illustrate the computation on simple models and on an atomically detailed system—the diffusion along the backbone torsions of a solvated alanine dipeptide.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Inference, Prediction, & Entropy-Rate Estimation of Continuous-Time, Discrete-Event Processes

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide new methods for inferring, predicting, and estimating them. The methods rely on an extension of Bayesian structural inference that takes advantage of neural network’s universal approximation power. Based on experiments with complex synthetic data, the methods are competitive with the state-of-the-art for prediction and entropy-rate estimation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Stochastic Impulse Control of Non-Markovian Processes

We consider a class of stochastic impulse control problems of general stochastic processes i.e. not necessarily Markovian. Under fairly general conditions we establish existence of an optimal impulse control. We also prove existence of combined optimal stochastic and impulse control of a fairly general class of diffusions with random coefficients. Unlike, in the Markovian framework, we cannot apply quasi-variational inequalities techniques. We rather derive the main results using techniques involving reflected BSDEs and the Snell envelope.

97 MATHEMATICS AND COMPUTING↗

Obtaining phase-optimized states from superpositions of coherent states in phase-sensitive attenuating/amplifying reservoirs

In this paper we present new nonclassical states of a single mode of the electromagnetic field constructed by superpositions of coherent states distributed over a semi-straight line starting from the origin of the phase space. These states have highly concentrated phase distributions and can be useful as approximations of phase states. We propose feasible schemes to prepare such states in microwave high-Q cavities and as traveling modes. We investigate nonclassical properties and determine the Wigner functions of such pure states. Then we consider the system in contact with a reservoir, taking into account dissipation and gain processes in the Markovian approximation, and study the time-evolution of these states by solving the master equation in the Wigner representation. From explicit expressions of the time-dependent Wigner functions, we study the time-dependence of nonclassical properties and use the negativity of the Wigner function to analyze the disappearance of sub-Planck structures as time evolves.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Constant-Length Random Substitutions and Gibbs Measures

This work is devoted to the study of processes generated by random substitutions over a finite alphabet. We prove, under mild conditions on the substitution’s rule, the existence of a unique process which remains invariant under the substitution, and which exhibits a polynomial decay of correlations. For constant-length substitutions, we go further by proving that the invariant state is precisely a Gibbs measure which can be obtained as the projective limit of its natural Markovian approximations. We end up the paper by studying a class of substitutions whose invariant state is the unique Gibbs measure for a hierarchical two-body interaction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Stochastic dynamics of charge fluctuations in dusty plasma: A non-Markovian approach

Dust particles in typical laboratory plasma become charged largely by collecting electrons and/or ions. Most of the theoretical studies in dusty plasma assume that the grain charge remains constant even though it fluctuates due to the discrete nature of the charge. The rates of ions and electrons absorption depend on the grain charge, hence its temporal evolution. Stochastic charging model based on the standard Langevin equation assumes that the underlying process is Markovian. In this work, the memory effect in dust charging dynamics is incorporated using fractional calculus formalism. The resulting fractional Langevin equation is solved to obtain the amplitude and correlation function for the dust charge fluctuation. It is shown that the effects of ion-neutral collisions can be interpreted in phenomenological sense through the nonlocal fractional order derivative.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Excitation energy transfer efficiency: Equivalence of transient and stationary setting and the absence of non-Markovian effects

We analyze efficiency of excitation energy transfer in photosynthetic complexes in transient and stationary setting. In the transient setting, the absorption process is modeled as an individual event resulting in a subsequent relaxation dynamics. In the stationary setting the absorption is a continuous stationary process, leading to the nonequilibrium steady state. We show that, as far as the efficiency is concerned, both settings can be considered to be the same, as they result in almost identical efficiency. We also show that non-Markovianity has no effect on the resulting efficiency, i.e., corresponding Markovian dynamics results in identical efficiency. Even more, if one maps dynamics to appropriate classical rate equations, the same efficiency as in quantum case is obtained.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Statistical Analysis of the First Passage Path Ensemble of Jump Processes

The transition mechanism of jump processes between two different subsets in state space reveals important dynamical information of the processes and therefore has attracted considerable attention in the past years. In this paper, we study the first passage path ensemble of both discrete-time and continuous-time jump processes on a finite state space. The main approach is to divide each first passage path into nonreactive and reactive segments and to study them separately. The analysis can be applied to jump processes which are non-ergodic, as well as continuous-time jump processes where the waiting time distributions are non-exponential. In the particular case that the jump processes are both Markovian and ergodic, our analysis elucidates the relations between the study of the first passage paths and the study of the transition paths in transition path theory. We provide algorithms to numerically compute statistics of the first passage path ensemble. The computational complexity of these algorithms scales with the complexity of solving a linear system, for which efficient methods are available. Several examples demonstrate the wide applicability of the derived results across research areas.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Distribution of tunnelling times for quantum electron transport

In electron transport, the tunnelling time is the time taken for an electron to tunnel out of a system after it has tunnelled in. We define the tunnelling time distribution for quantum processes in a dissipative environment and develop a practical approach for calculating it, where the environment is described by the general Markovian master equation. We illustrate the theory by using the rate equation to compute the tunnelling time distribution for electron transport through a molecular junction. The tunnelling time distribution is exponential, which indicates that Markovian quantum tunnelling is a Poissonian statistical process. The tunnelling time distribution is used not only to study the quantum statistics of tunnelling along the average electric current but also to analyse extreme quantum events where an electron jumps against the applied voltage bias. The average tunnelling time shows distinctly different temperature dependence for p- and n-type molecular junctions and therefore provides a sensitive tool to probe the alignment of molecular orbitals relative to the electrode Fermi energy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multiscale models and stochastic simulation methods for computing rare but key binding events in cell biology

The main difficulty in simulating diffusion processes at a molecular level in cell microdomains is due to the multiple scales involving nano- to micrometers. Few to many particles have to be simulated and simultaneously tracked while there are exploring a large portion of the space for binding small targets, such as buffers or active sites. Bridging the small and large spatial scales is achieved by rare events representing Brownian particles finding small targets and characterized by long-time distribution. These rare events are the bottleneck of numerical simulations. A naive stochastic simulation requires running many Brownian particles together, which is computationally greedy and inefficient. Solving the associated partial differential equations is also difficult due to the time dependent boundary conditions, narrow passages and mixed boundary conditions at small windows. We present here two reduced modeling approaches for a fast computation of diffusing fluxes in microdomains. The first approach is based on a Markov mass-action law equations coupled to a Markov chain. The second is a Gillespie's method based on the narrow escape theory for coarse-graining the geometry of the domain into Poissonian rates. The main application concerns diffusion in cellular biology, where we compute as an example the distribution of arrival times of calcium ions to small hidden targets to trigger vesicular release.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Modeling, Analyzing, and Mitigating Dissonance Between Alerting Systems

Alerting systems are becoming pervasive in process operations, which may result in the potential for dissonance or conflict in information from different alerting systems that suggests different threat levels and/or actions to resolve hazards. Little is currently available to help in predicting or solving the dissonance problem. This thesis presents a methodology to model and analyze dissonance between alerting systems, providing both a theoretical foundation for understanding dissonance and a practical basis from which specific problems can be addressed. A state-space representation of multiple alerting system operation is generalized that can be tailored across a variety of applications. Based on the representation, two major causes of dissonance are identified: logic differences and sensor error. Additionally, several possible types of dissonance are identified. A mathematical analysis method is developed to identify the conditions for dissonance originating from logic differences. A probabilistic analysis methodology is developed to estimate the probability of dissonance originating from sensor error, and to compare the relative contribution to dissonance of sensor error against the contribution from logic differences. A hybrid model, which describes the dynamic behavior of the process with multiple alerting systems, is developed to identify dangerous dissonance space, from which the process can lead to disaster. Methodologies to avoid or mitigate dissonance are outlined. Two examples are used to demonstrate the application of the methodology. First, a conceptual In-Trail Spacing example is presented. The methodology is applied to identify the conditions for possible dissonance, to identify relative contribution of logic difference and sensor error, and to identify dangerous dissonance space. Several proposed mitigation methods are demonstrated in this example. In the second example, the methodology is applied to address the dissonance problem between two air traffic alert and avoidance systems: the existing Traffic Alert and Collision Avoidance System (TCAS) vs. the proposed Airborne Conflict Management system (ACM). Conditions on ACM resolution maneuvers are identified to avoid dynamic dissonance between TCAS and ACM. Also included in this report is an Appendix written by Lee Winder about recent and continuing work on alerting systems design. The application of Markov Decision Process (MDP) theory to complex alerting problems is discussed and illustrated with an abstract example system.

Song, Lixia↗

Finite-Dimensional Representations for Controlled Diffusions with Delay

We study stochastic delay differential equations (SDDE) where the coefficients depend on the moving averages of the state process. As a first contribution, we provide sufficient conditions under which the solution of the SDDE and a linear path functional of it admit a finite-dimensional Markovian representation. As a second contribution, we show how approximate finite-dimensional Markovian representations may be constructed when these conditions are not satisfied, and provide an estimate of the error corresponding to these approximations. These results are applied to optimal control and optimal stopping problems for stochastic systems with delay.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗