Search NASA⌕ Search

SEARCH · Search NASA

Results for “Markov process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Dynamical transitions in a modulated Landau–Zener model with finite driving fields

Highlights: •The rigorous dynamics of a modulated Landau–Zener model is investigated. •Nonadiabatic evolution of the model could realize complete population transfer. •Imperfect effects caused by both the amplitude and phase damping are estimated. -- Abstract: We investigate a special time-dependent quantum model which assumes the Landau–Zener driving form but with an overall modulation of the intensity of the pulsing field. We demonstrate that the dynamics of the system, including the two-level case as well as its multi-level extension, is exactly solvable analytically. Differing from the original Landau–Zener model, the nonadiabatic effect of the evolution in the present driving process does not destroy the desired population transfer. As the sweep protocol employs only the finite driving fields which tend to zero asymptotically, the cutoff error due to the truncation of the driving pulse to the finite time interval turns out to be negligibly small. Furthermore, we investigate the noise effect on the driving protocol due to the dissipation of the surrounding environment. The losses of the fidelity in the protocol caused by both the phase damping process and the random spin flip noise are estimated by solving numerically the corresponding master equations within the Markovian regime.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantum position diffusion and its implications for the quantum linear Boltzmann equation

We derive a quantum linear Boltzmann equation from first principles to describe collisional friction, diffusion, and decoherence in a unified framework. In doing so, we discover that the previously celebrated quantum contribution to position diffusion is not a true physical process, but rather an artifact of the use of a coarse-grained time scale necessary to derive Markovian dynamics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Memory-keeping effects and forgetfulness in the dynamics of a qubit coupled to a spin chain

Using recently proposed measures for non-Markovianity [H.-P. Breuer, E. M. Laine, and J. Piilo, Phys. Rev. Lett. 103, 210401 (2009)], we study the dynamics of a qubit coupled to a spin environment via an energy-exchange mechanism. We show the existence of a point, in the parameter space of the system, where the qubit dynamics is effectively Markovian and that such a point separates two regions with completely different dynamical behaviors. Indeed, our study demonstrates that the qubit evolution can in principle be tuned from a perfectly forgetful one to a deep non-Markovian regime where the qubit is strongly affected by the dynamical backaction of the environmental spins. By means of a theoretical quantum process tomography analysis, we provide a complete and intuitive characterization of the qubit channel.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Evolutionary reinforcement learning of dynamical large deviations

In this work, we show how to bound and calculate the likelihood of dynamical large deviations using evolutionary reinforcement learning. An agent, a stochastic model, propagates a continuous-time Monte Carlo trajectory and receives a reward conditioned upon the values of certain path-extensive quantities. Evolution produces progressively fitter agents, potentially allowing the calculation of a piece of a large-deviation rate function for a particular model and path-extensive quantity. For models with small state spaces, the evolutionary process acts directly on rates, and for models with large state spaces, the process acts on the weights of a neural network that parameterizes the model's rates. This approach shows how path-extensive physics problems can be considered within a framework widely used in machine learning.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Impact of Uncertainty on Calculations for Recovery from Loss of Offsite Power

Uncertainty, both aleatory and epistemic, can have a significant impact on estimated probabilities of recovering from loss of offsite power within a specified time window, and such probabilities are an input to risk-informed decisions as to the significance of inspection findings in the U.S. Nuclear Regulatory Commission’s Reactor Oversight Process. In particular, the choice of aleatory model for offsite power recovery time can have a significant impact on the estimated nonrecovery probability, especially if epistemic uncertainty regarding parameters in the aleatory model is accounted for properly. In past and current analyses, such uncertainty has largely been ignored. This paper examines the impact of both aleatory and epistemic uncertainty on the results, using modern open-source Bayesian inference software, which implements Markov chain Monte Carlo sampling. It includes examples of time-dependent convolution calculations to show the impact that uncertainty can have on this increasingly frequent type of calculation, also. The results show that the “point estimate” result, which is an input to risk-informed decisions, can easily be uncertain by a factor of 10 if both aleatory and epistemic uncertainties are considered. The paper also illustrates the use of Bayesian model selection criteria to aid in the choice of aleatory model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

TH-A-BRF-02: BEST IN PHYSICS (JOINT IMAGING-THERAPY) - Modeling Tumor Evolution for Adaptive Radiation Therapy

Purpose: To develop mathematical models of tumor geometry changes under radiotherapy that may support future adaptive paradigms. Methods: A total of 29 cervical patients were scanned using MRI, once for planning and weekly thereafter for treatment monitoring. Using the tumor volumes contoured by a radiologist, three mathematical models were investigated based on the assumption of a stochastic process of tumor evolution. The “weekly MRI” model predicts tumor geometry for the following week from the last two consecutive MRI scans, based on the voxel transition probability. The other two models use only the first pair of consecutive MRI scans, and the transition probabilities were estimated via tumor type classified from the entire data set. The classification is based on either measuring the tumor volume (the “weekly volume” model), or implementing an auxiliary “Markov chain” model. These models were compared to a constant volume approach that represents the current clinical practice, using various model parameters; e.g., the threshold probability β converts the probability map into a tumor shape (larger threshold implies smaller tumor). Model performance was measured using volume conformity index (VCI), i.e., the union of the actual target and modeled target volume squared divided by product of these two volumes. Results: The “weekly MRI” model outperforms the constant volume model by 26% on average, and by 103% for the worst 10% of cases in terms of VCI under a wide range of β. The “weekly volume” and “Markov chain” models outperform the constant volume model by 20% and 16% on average, respectively. They also perform better than the “weekly MRI” model when β is large. Conclusion: It has been demonstrated that mathematical models can be developed to predict tumor geometry changes for cervical cancer undergoing radiotherapy. The models can potentially support adaptive radiotherapy paradigm by reducing normal tissue dose. This research was supported in part by the Ontario Consortium for Adaptive Interventions in Radiation Oncology (OCAIRO) funded by the Ontario Research Fund (ORF) and the MITACS Accelerate Internship Program.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Influence of modal loss on quantum state generation via cross-Kerr nonlinearity

In this paper we investigate the influence of decoherence effects on quantum states generated as a result of the cross-Kerr nonlinear interaction between two modes. For Markovian losses (both photon loss and dephasing), a region of parameters when losses still do not lead to destruction of nonclassicality is identified. We emphasize the difference in impact of losses in the process of state generation as opposed to those occurring in propagation channel. We show, moreover, that correlated losses in modern realizations of schemes of large cross-Kerr nonlinearity might lead to enhancement of nonclassicality.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantum heat transport of a two-qubit system: Interplay between system-bath coherence and qubit-qubit coherence

We consider a system consisting of two interacting qubits that are individually coupled to separate heat baths at different temperatures. The quantum effects in heat transport are investigated in a numerically rigorous manner with a hierarchial equations of motion (HEOM) approach for non-perturbative and non-Markovian system-bath coupling cases under non-equilibrium steady-state conditions. For a weak interqubit interaction, the total system is regarded as two individually thermostatted systems, whereas for a strong interqubit interaction, the two-qubit system is regarded as a single system coupled to two baths. The roles of quantum coherence (or entanglement) between the two qubits (q-q coherence) and between the qubit and bath (q-b coherence) are studied through the heat current calculated for various strengths of the system-bath coupling and interqubit coupling for high and low temperatures. The same current is also studied using the time convolutionless (TCL) Redfield equation and using an expression derived from the Fermi golden rule (FGR). We find that the HEOM results exhibit turnover behavior of the heat current as a function of the system-bath coupling strength for all values of the interqubit coupling strength, while the results obtained with the TCL and FGR approaches do not exhibit such behavior, because they do not possess the capability of treating the q-b and q-q coherences. The maximum current is obtained in the case that the q-q coherence and q-b coherence are balanced in such a manner that coherence of the entire heat transport process is realized. We also find that the heat current does not follow Fourier’s law when the temperature difference is very large, due to the non-perturbative system-bath interactions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

EMITTING ELECTRONS SPECTRA AND ACCELERATION PROCESSES IN THE JET OF Mrk 421: FROM THE LOW STATE TO THE GIANT FLARE STATE

We investigate the electron energy distributions (EEDs) and the acceleration processes in the jet of Mrk 421 through fitting the spectral energy distributions (SEDs) in different active states in the frame of a one-zone synchrotron self-Compton model. After assuming two possible EEDs formed in different acceleration models: the shock-accelerated power law with exponential cut-off (PLC) EED and the stochastic-turbulence-accelerated log-parabolic (LP) EED, we fit the observed SEDs of Mrk 421 in both low and giant flare states using the Markov Chain Monte Carlo method which constrains the model parameters in a more efficient way. The results from our calculations indicate that (1) the PLC and LP models give comparably good fits for the SED in the low state, but the variations of model parameters from low state to flaring can be reasonably explained only in the case of the PLC in the low state; and (2) the LP model gives better fits compared to the PLC model for the SED in the flare state, and the intra-day/night variability observed at GeV-TeV bands can be accommodated only in the LP model. The giant flare may be attributed to the stochastic turbulence re-acceleration of the shock-accelerated electrons in the low state. Therefore, we may conclude that shock acceleration is dominant in the low state, while stochastic turbulence acceleration is dominant in the flare state. Moreover, our result shows that the extrapolated TeV spectra from the best-fit SEDs from optical through GeV with the two EEDs are different. It should be considered with caution when such extrapolated TeV spectra are used to constrain extragalactic background light models.

79 ASTRONOMY AND ASTROPHYSICS↗

Stochastic quantization of real-time thermal field theory

We use the stochastic quantization method to obtain the free scalar propagator of a finite temperature field theory formulated in the Minkowski space-time. First, we use the Markovian stochastic quantization approach to present the two-point function of the theory. Second, we assume a Langevin equation with a memory kernel and a colored noise. The convergence of the Markovian and non-Markovian stochastic processes in the asymptotic limit of the fictitious time is obtained. Our formalism can be the starting point to discuss systems at finite temperature out of equilibrium.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Equivalence of the measures of non-Markovianity for open two-level systems

Different measures have been presented to depict the deviation of quantum time evolution in open systems from Markovian processes. We demonstrate that the measure proposed by Breuer, Laine, and Piilo [Phys. Rev. Lett. 103, 210401 (2009)] and the two measures proposed by Rivas, Huelga, and Plenio [Phys. Rev. Lett. 105, 050403 (2010)] have exactly the same non-Markovian time-evolution intervals and thus are really equivalent to each other when they are applied to open two-level systems coupled to environments via the Jaynes-Cummings or dephasing models. This equivalence implies that the three measures, in different ways, capture the intrinsic character of the non-Markovianity of quantum evolutional processes. We also show that the maximization in the definition of the first measure can be actually removed for the considered models without influencing the sensibility of the measure to detect non-Markovianity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Non-Markovian autoresonant dynamics of tunneling from discrete to continuum modes

We study the autoresonant dynamics of a discrete level coupled to a continuum, and show that passing adiabatically through a linear resonance, above a well-defined threshold, yields a transition to nonlinear phase locking and linear non-Markovian decay to the continuum. This process results in broadening of the population of the continuum modes beyond its natural linewidth. This concept can be employed to alter spontaneous emission, where driving an atom into phase locking with continuum modes will yield the emission of short pulses.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Recovering entanglement by local operations

We investigate the phenomenon of bipartite entanglement revivals under purely local operations in systems subject to local and independent classical noise sources. We explain this apparent paradox in the physical ensemble description of the system state by introducing the concept of “hidden” entanglement, which indicates the amount of entanglement that cannot be exploited due to the lack of classical information on the system. For this reason this part of entanglement can be recovered without the action of non-local operations or back-transfer process. For two noninteracting qubits under a low-frequency stochastic noise, we show that entanglement can be recovered by local pulses only. We also discuss how hidden entanglement may provide new insights about entanglement revivals in non-Markovian dynamics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Extracting enzyme processivity from kinetic assays

A steady-state analysis for the catalytic turnover of molecules containing two substrate sites is presented. A broad class of Markovian dynamic models, motivated by the action of DNA modifying enzymes and the rich variety of translocation mechanisms associated with these systems (e.g., sliding, hopping, intersegmental transfer, etc.), is considered. The modeling suggests an elementary and general method of data analysis, which enables the extraction of the enzyme’s processivity directly and unambiguously from experimental data. This analysis is not limited to the initial velocity regime. The predictions are validated both against detailed numerical models and by revisiting published experimental data for EcoRI endonuclease acting on DNA.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A data-driven multiscale model for reactive wetting simulations

Here, we describe a data-driven, multiscale technique to model reactive wetting of a silver–aluminum alloy on a Kovar™ (Fe-Ni-Co alloy) surface. We employ molecular dynamics simulations to elucidate the dependence of surface tension and wetting angle on the drop’s composition and temperature. A design of computational experiments is used to efficiently generate training data of surface tension and wetting angle from a limited number of molecular dynamics simulations. The simulation results are used to parameterize models of the material’s wetting properties and compute the uncertainty in the models due to limited data. The data-driven models are incorporated into an engineering-scale (continuum) model of a silver–aluminum sessile drop on a Kovar™ substrate. Model predictions of the wetting angle are compared with experiments of pure silver spreading on Kovar™ to quantify the model-form errors introduced by the limited training data versus the simplifications inherent in the molecular dynamics simulations. The paper presents innovations in the determination of “convergence” of noisy MD simulations before they are used to extract the wetting angle and surface tension, and the construction of their models which approximate physio-chemical processes that are left unresolved by the engineering-scale model. Together, these constitute a multiscale approach that integrates molecular-scale information into continuum scale models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Modeling and evaluating user behavior in exploratory visual analysis

Empirical evaluation methods for visualizations have traditionally focused on assessing the outcome of the visual analytic process as opposed to characterizing how that process unfolds. There are only a handful of methods that can be used to systematically study how people use visualizations, making it difficult for researchers to capture and characterize the subtlety of cognitive and interaction behaviors users exhibit during visual analysis. To validate and improve visualization design, however, it is important for researchers to be able to assess and understand how users interact with visualization systems under realistic scenarios. This paper presents a methodology for modeling and evaluating the behavior of users in exploratory visual analysis. We model visual exploration using a Markov chain process comprising transitions between mental, interaction, and computational states. These states and the transitions between them can be deduced from a variety of sources, including verbal transcripts, videos and audio recordings, and log files. This model enables the evaluator to characterize the cognitive and computational processes that are essential to insight acquisition in exploratory visual analysis, and reconstruct the dynamics of interaction between the user and the visualization system. We illustrate this model with two exemplar user studies, and demonstrate the qualitative and quantitative analytical tools it affords.

97 MATHEMATICS AND COMPUTING↗

Equation of motion for the process matrix: Hamiltonian identification and dynamical control of open quantum systems

We develop a general approach for monitoring and controlling evolution of open quantum systems. In contrast to the master equations describing time evolution of density operators, here, we formulate a dynamical equation for the evolution of the process matrix acting on a system. This equation is applicable to non-Markovian and/or strong-coupling regimes. We propose two distinct applications for this dynamical equation. We first demonstrate identification of quantum Hamiltonians generating dynamics of closed or open systems via performing process tomography. In particular, we argue how one can efficiently estimate certain classes of sparse Hamiltonians by performing partial tomography schemes. In addition, we introduce an optimal control theoretic setting for manipulating quantum dynamics of Hamiltonian systems, specifically for the task of decoherence suppression.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗