SEARCH · Search NASA

Results for “MARKOV CHAIN”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Distance‐based reconstruction of protein quaternary structures from inter‐chain contacts

Abstract Predicting the quaternary structure of protein complex is an important problem. Inter‐chain residue‐residue contact prediction can provide useful information to guide the ab initio reconstruction of quaternary structures. However, few methods have been developed to build quaternary structures from predicted inter‐chain contacts. Here, we develop the first method based on gradient descent optimization (GD) to build quaternary structures of protein dimers utilizing inter‐chain contacts as distance restraints. We evaluate GD on several datasets of homodimers and heterodimers using true/predicted contacts and monomer structures as input. GD consistently performs better than both simulated annealing and Markov Chain Monte Carlo simulation. Starting from an arbitrarily quaternary structure randomly initialized from the tertiary structures of protein chains and using true inter‐chain contacts as input, GD can reconstruct high‐quality structural models for homodimers and heterodimers with average TM‐score ranging from 0.92 to 0.99 and average interface root mean square distance from 0.72 Å to 1.64 Å. On a dataset of 115 homodimers, using predicted inter‐chain contacts as restraints, the average TM‐score of the structural models built by GD is 0.76. For 46% of the homodimers, high‐quality structural models with TM‐score ≥ 0.9 are reconstructed from predicted contacts. There is a strong correlation between the quality of the reconstructed models and the precision and recall of predicted contacts. Only a moderate precision or recall of inter‐chain contact prediction is needed to build good structural models for most homodimers. Moreover, GD improves the quality of quaternary structures predicted by AlphaFold2 on a Critical Assessment of Techniques for Protein Structure Prediction–Critical Assessments of Predictions of Interactions dataset.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

A Note on the Effects of Linear Topology Preservation in Monte Carlo Simulations of Knotted Proteins

Monte Carlo simulations are a powerful technique and are widely used in different fields. When applied to complex molecular systems with long chains, such as those in synthetic polymers and proteins, they have the advantage of providing a fast and computationally efficient way to sample equilibrium ensembles and calculate thermodynamic and structural properties under desired conditions. Conformational Monte Carlo techniques employ a move set to perform the transitions in the simulation Markov chain. While accepted conformations must preserve the sequential bonding of the protein chain model and excluded volume among its units, the moves themselves may take the chain across itself. We call this a break in linear topology preservation. In this manuscript, we show, using simple protein models, that there is no difference in equilibrium properties calculated with a move set that preserves linear topology and one that does not. However, for complex structures, such as those of deeply knotted proteins, the preservation of linear topology provides correct equilibrium results but only after long relaxation. In any case, to analyze folding pathways, knotting mechanisms and folding kinetics, the preservation of linear topology may be an unavoidable requirement.

Especial, João N. C. (ORCID:0000000254765370)↗

NASA NTRS2005

Bidirectional Classical Stochastic Processes with Measurements and Feedback

A measurement on a quantum system is said to cause the "collapse" of the quantum state vector or density matrix. An analogous collapse occurs with measurements on a classical stochastic process. This paper addresses the question of describing the response of a classical stochastic process when there is feedback from the output of a measurement to the input, and is intended to give a model for quantum-mechanical processes that occur along a space-like reaction coordinate. The classical system can be thought of in physical terms as two counterflowing probability streams, which stochastically exchange probability currents in a way that the net probability current, and hence the overall probability, suitably interpreted, is conserved. The proposed formalism extends the . mathematics of those stochastic processes describable with linear, single-step, unidirectional transition probabilities, known as Markov chains and stochastic matrices. It is shown that a certain rearrangement and combination of the input and output of two stochastic matrices of the same order yields another matrix of the same type. Each measurement causes the partial collapse of the probability current distribution in the midst of such a process, giving rise to calculable, but non-Markov, values for the ensuing modification of the system's output probability distribution. The paper concludes with an analysis of a classical probabilistic version of the so-called grandfather paradox.

Hahne, G. E.↗

DOE OSTI2022

Searching for the origin of the rare-earth peak with precision mass measurements across Ce–Eu isotopic chains

A nuclear mass survey of rare-earth isotopes has been conducted with the Canadian Penning Trap mass spectrometer using the most neutron-rich nuclei thus far extracted from the CARIBU facility. Here, we present a collection of 12 nuclear masses determined with a precision of ≤ 10 keV/c 2 for Z = 58-63 nuclei near N = 100. Independently, a detailed study exploring the role of nuclear masses in the formation of the r-process rare-earth abundance peak has been performed. Employing a Markov chain Monte Carlo (MCMC) technique, mass predictions of lanthanide isotopes have been made which uniquely reproduce the observed solar abundances near A = 164 under three distinct astrophysical outflow conditions. We demonstrate that the mass surface trends thus far mapped out by our measurements are most consistent with MCMC mass predictions given an r process that forms the rare-earth peak during an extended (n, γ) ⇌ (γ, n) equilibrium.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS1990

Three real-time architectures - A study using reward models

Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the evolutionary behavior of the computer system by a continuous-time Markov chain, and a reward rate is associated with each state. In reliability/availability models, upstates have reward rate 1, and down states have reward rate zero associated with them. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Steady-state expected reward rate and expected instantaneous reward rate are clearly useful measures which can be extracted from the Markov reward model. The diversity of areas where Markov reward models may be used is illustrated with a comparative study of three examples of interest to the fault tolerant computing community.

Sjogren, J. A.↗

NASA NTRS1991

Markov reward processes

Numerous applications in the area of computer system analysis can be effectively studied with Markov reward models. These models describe the behavior of the system with a continuous-time Markov chain, where a reward rate is associated with each state. In a reliability/availability model, upstates may have reward rate 1 and down states may have reward rate zero associated with them. In a queueing model, the number of jobs of certain type in a given state may be the reward rate attached to that state. In a combined model of performance and reliability, the reward rate of a state may be the computational capacity, or a related performance measure. Expected steady-state reward rate and expected instantaneous reward rate are clearly useful measures of the Markov reward model. More generally, the distribution of accumulated reward or time-averaged reward over a finite time interval may be determined from the solution of the Markov reward model. This information is of great practical significance in situations where the workload can be well characterized (deterministically, or by continuous functions e.g., distributions). The design process in the development of a computer system is an expensive and long term endeavor. For aerospace applications the reliability of the computer system is essential, as is the ability to complete critical workloads in a well defined real time interval. Consequently, effective modeling of such systems must take into account both performance and reliability. This fact motivates our use of Markov reward models to aid in the development and evaluation of fault tolerant computer systems.

Smith, R. M.↗

DOE OSTI2022

Combining biomarker and virus phylogenetic models improves HIV-1 epidemiological source identification

To identify and stop active HIV transmission chains new epidemiological techniques are needed. Here, we describe the development of a multi-biomarker augmentation to phylogenetic inference of the underlying transmission history in a local population. HIV biomarkers are measurable biological quantities that have some relationship to the amount of time someone has been infected with HIV. To train our model, we used five biomarkers based on real data from serological assays, HIV sequence data, and target cell counts in longitudinally followed, untreated patients with known infection times. The biomarkers were modeled with a mixed effects framework to allow for patient specific variation and general trends, and fit to patient data using Markov Chain Monte Carlo (MCMC) methods. Subsequently, the density of the unobserved infection time conditional on observed biomarkers were obtained by integrating out the random effects from the model fit. This probabilistic information about infection times was incorporated into the likelihood function for the transmission history and phylogenetic tree reconstruction, informed by the HIV sequence data. To critically test our methodology, we developed a coalescent-based simulation framework that generates phylogenies and biomarkers given a specific or general transmission history. Testing on many epidemiological scenarios showed that biomarker augmented phylogenetics can reach 90% accuracy under idealized situations. Under realistic within-host HIV-1 evolution, involving substantial within-host diversification and frequent transmission of multiple lineages, the average accuracy was at about 50% in transmission clusters involving 5–50 hosts. Realistic biomarker data added on average 16 percentage points over using the phylogeny alone. Using more biomarkers improved the performance. Shorter temporal spacing between transmission events and increased transmission heterogeneity reduced reconstruction accuracy, but larger clusters were not harder to get right. More sequence data per infected host also improved accuracy. We show that the method is robust to incomplete sampling and that adding biomarkers improves reconstructions of real HIV-1 transmission histories. The technology presented here could allow for better prevention programs by providing data for locally informed and tailored strategies.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1996

Discrete Deterministic and Stochastic Petri Nets

Petri nets augmented with timing specifications gained a wide acceptance in the area of performance and reliability evaluation of complex systems exhibiting concurrency, synchronization, and conflicts. The state space of time-extended Petri nets is mapped onto its basic underlying stochastic process, which can be shown to be Markovian under the assumption of exponentially distributed firing times. The integration of exponentially and non-exponentially distributed timing is still one of the major problems for the analysis and was first attacked for continuous time Petri nets at the cost of structural or analytical restrictions. We propose a discrete deterministic and stochastic Petri net (DDSPN) formalism with no imposed structural or analytical restrictions where transitions can fire either in zero time or according to arbitrary firing times that can be represented as the time to absorption in a finite absorbing discrete time Markov chain (DTMC). Exponentially distributed firing times are then approximated arbitrarily well by geometric distributions. Deterministic firing times are a special case of the geometric distribution. The underlying stochastic process of a DDSPN is then also a DTMC, from which the transient and stationary solution can be obtained by standard techniques. A comprehensive algorithm and some state space reduction techniques for the analysis of DDSPNs are presented comprising the automatic detection of conflicts and confusions, which removes a major obstacle for the analysis of discrete time models.

MATHEMATICAL MODELS↗

DOE OSTI2023

Diffusion growth mechanism of penta-twinned Ag nanocrystals from decahedral seeds

Crystals with penta-twinned structures can be produced from diverse fcc metals, but the mechanisms that control the final product shapes are still not well understood. By using the theory of absorbing Markov chains to account for the growth of penta-twinned decahedral seeds via atom deposition and surface diffusion, we predicted the formation of various types of products: decahedra, nanorods, and nanowires. We showed that the type of product depends on the morphology of the seed and that small differences between various seed morphologies can lead to significantly different products. For the case of uncapped decahedra seeds, we compared predictions from our model to nanowire morphologies obtained in two different experiments and obtained favorable agreement. Finally, possible extensions of our model are indicated.

36 MATERIALS SCIENCE↗

DOE OSTI2021

A Detailed Characterization of HR 8799's Debris Disk with ALMA in Band 7

The exoplanetary system of HR 8799 is one of the rare systems in which multiple planets have been directly imaged. Its architecture is strikingly similar to that of the solar system, with the four imaged giant planets surrounding a warm dust belt analogous to the Asteroid Belt, and themselves being surrounded by a cold dust belt analog to the Kuiper Belt. Previous observations of this cold belt with ALMA in Band 6 (1.3 mm) revealed its inner edge, but analyses of the data differ on its precise location. It was therefore unclear whether or not the outermost planet HR 8799 b was dynamically sculpting it. We present here new ALMA observations of this debris disk in Band 7 (340 GHz, 880 μm). These are the most detailed observations of this disk obtained so far, with a resolution of 1″ (40 au) and sensitivity of 9.8 μJy beam{sup −1}, which allowed us to recover the disk structure with high confidence. In order to constrain the disk morphology, we fit its emission using radiative transfer models combined with a Markov Chain Monte Carlo procedure. We find that this disk cannot be adequately represented by a single power law with sharp edges. It exhibits a smoothly rising inner edge and smoothly falling outer edge, with a peak in between, as expected from a disk that contains a high-eccentricity component, hence confirming previous findings. Whether this excited population and inner edge shape stem from the presence of an additional planet remains, however, an open question.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

TIC 168789840: A Sextuply Eclipsing Sextuple Star System

We report the discovery of a sextuply eclipsing sextuple star system from TESS data, TIC 168789840, also known as TYC 7037-89-1, the first known sextuple system consisting of three eclipsing binaries. The target was observed in Sectors 4 and 5 during Cycle 1, with lightcurves extracted from TESS Full Frame Image data. It was also previously observed by the WASP survey and ASAS-SN. The system consists of three gravitationally bound eclipsing binaries in a hierarchical structure of an inner quadruple system with an outer binary subsystem. Follow-up observations from several different observatories were conducted as a means of determining additional parameters. The system was resolved by speckle interferometry with a 0.″42 separation between the inner quadruple and outer binary, inferring an estimated outer period of ∼2 kyr. It was determined that the fainter of the two resolved components is an 8.217 day eclipsing binary, which orbits the inner quadruple that contains two eclipsing binaries with periods of 1.570 days and 1.306 days. Markov Chain Monte Carlo (MCMC) analysis of the stellar parameters has shown that the three binaries of TIC 168789840 are “triplets,” as each binary is quite similar to the others in terms of mass, radius, and T {sub eff}. As a consequence of its rare composition, structure, and orientation, this object can provide important new insight into the formation, dynamics, and evolution of multiple star systems. Future observations could reveal if the intermediate and outer orbital planes are all aligned with the planes of the three inner eclipsing binaries.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

The Anatomy of an Unusual Edge-on Protoplanetary Disk. I. Dust Settling in a Cold Disk

As the earliest stage of planet formation, massive, optically thick, and gas-rich protoplanetary disks provide key insights into the physics of star and planet formation. When viewed edge-on, high-resolution images offer a unique opportunity to study both the radial and vertical structures of these disks and relate this to vertical settling, radial drift, grain growth, and changes in the midplane temperatures. In this work, we present multi-epoch Hubble Space Telescope and Keck scattered light images, and an Atacama Large Millimeter/submillimeter Array 1.3 mm continuum map for the remarkably flat edge-on protoplanetary disk SSTC2DJ163131.2–242627, a young solar-type star in ρ Ophiuchus. We model the 0.8 μm and 1.3 mm images in separate Markov Chain Monte Carlo (MCMC) runs to investigate the geometry and dust properties of the disk using the MCFOST radiative transfer code. In scattered light, we are sensitive to the smaller dust grains in the surface layers of the disk, while the submillimeter dust continuum observations probe larger grains closer to the disk midplane. An MCMC run combining both data sets using a covariance-based log-likelihood estimation was marginally successful, implying insufficient complexity in our disk model. The disk is well characterized by a flared disk model with an exponentially tapered outer edge viewed nearly edge-on, though some degree of dust settling is required to reproduce the vertically thin profile and lack of apparent flaring. A colder than expected disk midplane, evidence for dust settling, and residual radial substructures all point to a more complex radial density profile to be probed with future, higher-resolution observations.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Orbits and Masses of Binaries from Speckle Interferometry at SOAR

We present results from Speckle inteferometric observations of 15 visual binaries and one double-line spectroscopic binary, carried out with the HRCam Speckle camera of the SOAR 4.1 m telescope. These systems were observed as a part of an on-going survey to characterize the binary population in the solar vicinity, out to a distance of 250 pc. We obtained orbital elements and mass sums for our sample of visual binaries. The orbits were computed using a Markov Chain Monte Carlo algorithm that delivers maximum likelihood estimates of the parameters, as well as posterior probability density functions that allow us to evaluate their uncertainty. Their periods cover a range from 5 yr to more than 500 yr; and their spectral types go from early A to mid M, implying total system masses from slightly more than 4M{sub ⊙} down to 0.2M {sub ⊙}. They are located at distances between approximately 12 and 200 pc, mostly at low Galactic latitude. For the double-line spectroscopic binary YSC8, we present the first combined astrometric/radial-velocity orbit resulting from a self-consistent fit, leading to individual component masses of 0.897 ± 0.027 M {sub ⊙} and 0.857 ± 0.026 M {sub ⊙}; and an orbital parallax of 26.61 ± 0.29 mas, which compares very well with the Gaia DR2 trigonometric parallax (26.55 ± 0.27 mas). In combination with published photometry and trigonometric parallaxes, we place our objects on an H-R diagram and discuss their evolutionary status. We also present a thorough analysis of the precision and consistency of the photometry available for them.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2020

Moderate-resolution K-band Spectroscopy of Substellar Companion κ Andromedae b

We present moderate-resolution (R ∼ 4000) K-band spectra of the “super-Jupiter,” κ Andromedae b. The data were taken with the OSIRIS integral field spectrograph at Keck Observatory. The spectra reveal resolved molecular lines from H{sub 2}O and CO, and are compared to a custom PHOENIX atmosphere model grid appropriate for young planetary-mass objects. We fit the data using a Markov chain Monte Carlo forward-modeling method. Using a combination of our moderate-resolution spectrum and low-resolution, broadband data from the literature, we derive an effective temperature of T {sub eff} = 1950–2150 K, a surface gravity of logg=3.5--4.5, and a metallicity of [M/H] = −0.2–0.0. These values are consistent with previous estimates from atmospheric modeling and the currently favored young age of the system (<50 Myr). We derive a C/O ratio of 0.70{sub −0.24}{sup +0.09} for the source, broadly consistent with the solar C/O ratio. This, coupled with the slightly subsolar metallicity, implies a composition consistent with that of the host star, and is suggestive of formation by a rapid process. The subsolar metallicity of κ Andromedae b is also consistent with predictions of formation via gravitational instability. Further constraints on formation of the companion will require measurement of the C/O ratio of κ Andromedae A. We also measure the radial velocity of κ Andromedae b for the first time, with a value of −1.4 ± 0.9 km s{sup −1} relative to the host star. We find that the derived radial velocity is consistent with the estimated high eccentricity of κ Andromedae b.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Low-mass Group Environments Have No Substantial Impact on the Circumgalactic Medium Metallicity

We explore how environment affects the metallicity of the circumgalactic medium (CGM) using 13 low-mass galaxy groups (two to five galaxies) at &lang;z{sub abs}&rang;=0.25 identified near background quasars. Using quasar spectra from the Hubble Space Telescope/COS and from Keck/HIRES or the Very Large Telescope/UVES, we measure column densities of or determine limits on CGM absorption lines. We use a Markov Chain Monte Carlo approach with Cloudy to estimate metallicities of cool (T ~ 10{sup 4} K) CGM gas within groups and compare them to CGM metallicities of 47 isolated galaxies. Both group and isolated CGM metallicities span a wide range (-2 < [Si/H] < 0), where the mean group (-0.54 ± 0.22) and isolated (-0.77 ± 0.14) CGM metallicities are similar. Group and isolated environments have similar distributions of H I column densities as a function of impact parameter. However, contrary to isolated galaxies, we do not find an anticorrelation between H I column density and the nearest group galaxy impact parameter. We additionally divided the groups by member luminosity ratios (i.e., galaxy–galaxy and galaxy–dwarf groups). While there was no significant difference in their mean metallicities, a modest increase in sample size should allow one to statistically identify a higher CGM metallicity in galaxy–dwarf groups compared to galaxy–galaxy groups. We conclude that either environmental effects have not played an important role in the metallicity of the CGM at this stage and expect that this may only occur when galaxies are strongly interacting or merging or that some isolated galaxies have higher CGM metallicities due to past interactions. Thus, environment does not seem to be the cause of the CGM metallicity bimodality.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Precise Dynamical Masses and Orbital Fits for β Pic b and β Pic c

We present a comprehensive orbital analysis to the exoplanets β Pictoris b and c that resolves previously reported tensions between the dynamical and evolutionary mass constraints on β Pic b. We use the Markov Chain Monte Carlo orbit code orvara to fit 15 years of radial velocities and relative astrometry (including recent GRAVITY measurements), absolute astrometry from Hipparcos and Gaia, and a single relative radial velocity measurement between β Pic A and b. We measure model-independent masses of 9.3{sub −2.5}{sup +2.6} M {sub Jup} for β Pic b and 8.3 ± 1.0 M {sub Jup} for β Pic c. These masses are robust to modest changes to the input data selection. We find a well-constrained eccentricity of 0.119 ± 0.008 for β Pic b, and an eccentricity of 0.21{sub −0.09}{sup +0.16} for β Pic c, with the two orbital planes aligned to within ∼05. Both planets’ masses are within ∼1σ of the predictions of hot-start evolutionary models and exclude cold starts. We validate our approach on N-body synthetic data integrated using REBOUND. We show that orvara can account for three-body effects in the β Pic system down to a level ∼5 times smaller than the GRAVITY uncertainties. Systematics in the masses and orbital parameters from orvara’s approximate treatment of multiplanet orbits are a factor of ∼5 smaller than the uncertainties we derive here. Future GRAVITY observations will improve the constraints on β Pic c’s mass and (especially) eccentricity, but improved constraints on the mass of β Pic b will likely require years of additional radial velocity monitoring and improved precision from future Gaia data releases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2024

Probabilistic Discrete‐Time Models for Spreading Processes in Complex Networks: A Review

Abstract Research into network dynamics of spreading processes typically employs both discrete and continuous time methodologies. Although each approach offers distinct insights, integrating them can be challenging, particularly when maintaining coherence across different time scales. This review focuses on the Microscopic Markov Chain Approach (MMCA), a probabilistic f ramework originally designed for epidemic modeling. MMCA uses discrete dynamics to compute the probabilities of individuals transitioning between epidemiological states. By treating each time step—usually a day—as a discrete event, the approach captures multiple concurrent changes within this time frame. The approach allows to estimate the likelihood of individuals or populations being in specific states, which correspond to distinct epidemiological compartments. This review synthesizes key findings from the application of this approach, providing a comprehensive overview of its utility in understanding epidemic spread.

Granell, Clara↗

DOE OSTI2023

Deep generative models for vehicle speed trajectories

Generating realistic vehicle speed trajectories is a crucial component in evaluating vehicle fuel economy and in predictive control of self-driving cars. Traditional generative models rely on Markov chain methods and can produce accurate synthetic trajectories but are subject to the curse of dimensionality. They do not allow to include conditional input variables into the generation process. In this paper, we show how extensions to deep generative models allow accurate and scalable generation. Proposed architectures involve recurrent and feed-forward layers and are trained using adversarial techniques. Our models are shown to perform well on generating vehicle trajectories using a model trained on GPS data from Chicago metropolitan area.

33 ADVANCED PROPULSION SYSTEMS↗