Search NASA⌕ Search

SEARCH · Search NASA

Results for “Markov Chain”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Performability analysis using semi-Markov reward processes

Beaudry (1978) proposed a simple method of computing the distribution of performability in a Markov reward process. Two extensions of Beaudry's approach are presented. The method is generalized to a semi-Markov reward process by removing the restriction requiring the association of zero reward to absorbing states only. The algorithm proceeds by replacing zero-reward nonabsorbing states by a probabilistic switch; it is therefore related to the elimination of vanishing states from the reachability graph of a generalized stochastic Petri net and to the elimination of fast transient states in a decomposition approach to stiff Markov chains. The use of the approach is illustrated with three applications.

Ciardo, Gianfranco↗
NASA NTRS1990

Efficient parametric analysis of performance measures for communication networks

Efficient techniques for estimating performance measures in communication networks in a steady-state or transient setting are developed. These techniques may be used in a simulation environment or in connection with real-time observations. For Markov chain models, the recently proposed standard clock approach is extended, and a class of real-time algorithms for simultaneously generating multiple sample paths under different parameter sets is presented. Attention is focused on the link crash time estimation problem, where a 'crash' is defined as the first time a buffer overflows, given some initial conditions. An algorithm for estimating crash times under various traffic shocks is derived, where all estimates are obtained in parallel to an actual network's normal operation. An algorithm for crash time estimation of a G/D/1 link model is also derived using a different (perturbation-analysis-based) approach. Finally, extensive simulation results are provided to validate the proposed algorithms and compare them to brute-force simulation.

Cassandras, Christos G.↗
NASA NTRS1992

Origins of the rings of Uranus and Neptune. I - Statistics of satellite disruptions

The origin of the rings of Uranus and Neptune is considered by performing two types of stochastic simulations of the collisional history of small moons: Monte Carlo simulations in which only the largest surviving fragments from each disruption is followed, and a Markov chain approach which makes it possible to follow the size distribution from each disruption to arbitrarily small sizes. Results indicate that the population of small satellites around Uranus and Neptune have evolved through catastrophic fragmentation since the end of planet and satellite formation 3 to 4 billion years ago.

Colwell, Joshua E.↗
NASA NTRS1992

SO2 on Venus: A final cross-calibration with Pioneer Venus

In our previous report, we noted that we had successfully completed all of the IUE observations which were proposed. A total of 7 Venus spectra were obtained. In the present reporting period, essentially all of the associated data reduction and analysis activities were completed, and Drs. Stern, Barker, and Na met to collaborate on data interpretation. The model atmosphere used in this analysis is similar to the one used in the analysis of the Pioneer Venus observations (Esposito, et al. 1979, 1988) and the previous IUE observations (Na, et al. 1990). In this model, sulfuric acid aerosols with a radius of about 1 micron are mixed uniformly with Rayleigh scattering gases throughout the cloud layer. There are two wavelength-independent absorbers. First, the aerosols are assumed to have a single scattering albedo of 0.98, and second a pure absorbing layer with an optical depth of 0.2 is added at an altitude of 75 mbar. The variable parameters in this model are the mixing ratios of SO2 at the cloud top (40 mbar level), and the scale height of SO2 at the same altitude. Model spectra were calculated using a radiative transfer code utilizing a Markov Chain method. Each model calculation takes into account the multiple scattering and the vertical inhomogeneity of the atmosphere. We reported those initial results at the 1992 meeting of the AAS Division of Planetary Sciences (Barker, Stern, and Na 1992) The important finding we have reached is that the 1991 IUE observations indicate that the long-term decline in Venus SO2 abundance has either halted or reversed. Our simultaneous groundbased measurements made on the McDonald Observatory 2.7 m corroborate this result. We are now preparing a paper describing these IUE results for publication in Icarus. With the IUE results reduced, we are also beginning a project to compare the 1991 IUE results to Pioneer Venus UV spectra made on the same dates.

Stern, S. Alan↗
NASA NTRS1989

Performance evaluation of automated manufacturing systems using generalized stochastic Petri Nets

The main objective of this research is to develop a generic modeling methodology with a flexible and modular framework to aid in the design and performance evaluation of integrated manufacturing systems using a unified model. After a thorough examination of the available modeling methods, the Petri Net approach was adopted. The concurrent and asynchronous nature of manufacturing systems are easily captured by Petri Net models. Three basic modules were developed: machine, buffer, and Decision Making Unit. The machine and buffer modules are used for modeling transfer lines and production networks. The Decision Making Unit models the functions of a computer node in a complex Decision Making Unit Architecture. The underlying model is a Generalized Stochastic Petri Net (GSPN) that can be used for performance evaluation and structural analysis. GSPN's were chosen because they help manage the complexity of modeling large manufacturing systems. There is no need to enumerate all the possible states of the Markov Chain since they are automatically generated from the GSPN model.

Al-Jaar, Robert Y.↗
NASA NTRS1993

Parallelizing Timed Petri Net simulations

The possibility of using parallel processing to accelerate the simulation of Timed Petri Nets (TPN's) was studied. It was recognized that complex system development tools often transform system descriptions into TPN's or TPN-like models, which are then simulated to obtain information about system behavior. Viewed this way, it was important that the parallelization of TPN's be as automatic as possible, to admit the possibility of the parallelization being embedded in the system design tool. Later years of the grant were devoted to examining the problem of joint performance and reliability analysis, to explore whether both types of analysis could be accomplished within a single framework. In this final report, the results of our studies are summarized. We believe that the problem of parallelizing TPN's automatically for MIMD architectures has been almost completely solved for a large and important class of problems. Our initial investigations into joint performance/reliability analysis are two-fold; it was shown that Monte Carlo simulation, with importance sampling, offers promise of joint analysis in the context of a single tool, and methods for the parallel simulation of general Continuous Time Markov Chains, a model framework within which joint performance/reliability models can be cast, were developed. However, very much more work is needed to determine the scope and generality of these approaches. The results obtained in our two studies, future directions for this type of work, and a list of publications are included.

Nicol, David M.↗
NASA NTRS1995

Discrete-time Markovian stochastic Petri nets

We revisit and extend the original definition of discrete-time stochastic Petri nets, by allowing the firing times to have a 'defective discrete phase distribution'. We show that this formalism still corresponds to an underlying discrete-time Markov chain. The structure of the state for this process describes both the marking of the Petri net and the phase of the firing time for each transition, resulting in a large state space. We then modify the well-known power method to perform a transient analysis even when the state space is infinite, subject to the condition that only a finite number of states can be reached in a finite amount of time. Since the memory requirements might still be excessive, we suggest a bounding technique based on truncation.

Ciardo, Gianfranco↗
NASA NTRS1997

Parametric State Space Structuring

Structured approaches based on Kronecker operators for the description and solution of the infinitesimal generator of a continuous-time Markov chains are receiving increasing interest. However, their main advantage, a substantial reduction in the memory requirements during the numerical solution, comes at a price. Methods based on the "potential state space" allocate a probability vector that might be much larger than actually needed. Methods based on the "actual state space", instead, have an additional logarithmic overhead. We present an approach that realizes the advantages of both methods with none of their disadvantages, by partitioning the local state spaces of each submodel. We apply our results to a model of software rendezvous, and show how they reduce memory requirements while, at the same time, improving the efficiency of the computation.

Ciardo, Gianfranco↗
NASA NTRS1999

In Pursuit of Abundance Anomalies and the FIP Effect in Late-Type Stellar Coronae

Key EUVE and ASCA data have been retrieved from their respective archives. New software has been written in the IDL language to carry out data analysis and to interface with the relevant atomic physics databases. During the analysis of ASCA spectra, it was found that the abundances of elements other than Fe could not be constrained very well, and Fe abundances were not constrained unless the underlying emission measure distribution model was reasonably well-determined. Consequently, the study has concentrated on the quantity Fe/H. A method has been developed as a means of deriving Fe/H based on fitting the continuum to EUVE spectra, thereby using the Fe lines to determine the Fe abundance. A Monte Carlo Markov Chain algorithm was also developed to determine the emission measure distribution based on observed spectral lines. This is the first application of this type of monte carlo approach to this scientific problem. This work has resulted in three scientific publications, one of which published, one of which is now ready for submission and the other of which is still in preparation:

Drake, Jeremy↗
NASA NTRS2002

High Resolution Soil Water from Regional Databases and Satellite Images

This viewgraph presentation provides information on the ways in which plant growth can be inferred from satellite data and can then be used to infer soil water. There are several steps in this process, the first of which is the acquisition of data from satellite observations and relevant information databases such as the State Soil Geographic Database (STATSGO). Then probabilistic analysis and inversion with the Bayes' theorem reveals sources of uncertainty. The Markov chain Monte Carlo method is also used.

Morris, Robin D.↗
NASA NTRS2003

Package for Interactive Analysis of Line Emission (Analysis of UV-X-Ray High-Resolution Emission Spectra)

PINTofALE is an IDL based package to analyze high-resolution grating spectra. The first version was made available to the public on 3 February 2001. Since then we have carried out numerous changes, and the current release is version 1.5, released on 9 October 2002. The changes include upgrades to handle higher versions of IDL, the new version of the CHIANTI database (v4), major enhancements in user-friendliness, improved handling of response matrices, the ability to handle 24-bit color, access to the Atomic Plasma Emission Database (APED), and beta releases of Markov Chain Monte Carlo (MCMC) based DEM fitting routines. Plans for the future include: inclusion of MCMC techniques in the fitting programs, enhanced graphics capabilities, an overhaul of the line and continuum database structure, and bug fixes. In September 2002, we hired a data analyst (LiWei Lin) to work on PINTofALE. Mr.Lin is concentrating on incorporating MCMC as well as simpler Monte-Carlo techniques, fast RMF convolution, etc., into the code base, as well as reviewing the existing documentation and searching for bugs. A detailed description of the package, together with fairly detailed documentation, example walks-throughs, and downloadable tar files, are available on-line from http://hea-www. harvard.edu/PINTofALE/

Kashyap, Vinay↗
NASA NTRS2002

Measuring the Resilience of Advanced Life Support Systems

Despite the central importance of crew safety in designing and operating a life support system, the metric commonly used to evaluate alternative Advanced Life Support (ALS) technologies does not currently provide explicit techniques for measuring safety. The resilience of a system, or the system s ability to meet performance requirements and recover from component-level faults, is fundamentally a dynamic property. This paper motivates the use of computer models as a tool to understand and improve system resilience throughout the design process. Extensive simulation of a hybrid computational model of a water revitalization subsystem (WRS) with probabilistic, component-level faults provides data about off-nominal behavior of the system. The data can then be used to test alternative measures of resilience as predictors of the system s ability to recover from component-level faults. A novel approach to measuring system resilience using a Markov chain model of performance data is also developed. Results emphasize that resilience depends on the complex interaction of faults, controls, and system dynamics, rather than on simple fault probabilities.

Bell, Ann Maria↗
NASA NTRS2003

Stochastic Optimal Control via Bellman's Principle

This paper presents a method for finding optimal controls of nonlinear systems subject to random excitations. The method is capable to generate global control solutions when state and control constraints are present. The solution is global in the sense that controls for all initial conditions in a region of the state space are obtained. The approach is based on Bellman's Principle of optimality, the Gaussian closure and the Short-time Gaussian approximation. Examples include a system with a state-dependent diffusion term, a system in which the infinite hierarchy of moment equations cannot be analytically closed, and an impact system with a elastic boundary. The uncontrolled and controlled dynamics are studied by creating a Markov chain with a control dependent transition probability matrix via the Generalized Cell Mapping method. In this fashion, both the transient and stationary controlled responses are evaluated. The results show excellent control performances.

Crespo, Luis G.↗
NASA NTRS2004

Determination of Cluster Distances from Chandra Imaging Spectroscopy and Sunyaev-Zeldovich Effect Measurements: Analysis Methods and Initial Results - I

X-ray and Sunyaev-Zeldovich Effect data ca,n be combined to determine the distance to galaxy clusters. High-resolution X-ray data are now available from the Chandra Observatory, which provides both spatial and spectral information, and interferometric radio measurements of the Sunyam-Zeldovich Effect are available from the BIMA and 0VR.O arrays. We introduce a Monte Carlo Markov chain procedure for the joint analysis of X-ray and Sunyaev-Zeldovich Effect data. The advantages of this method are the high computational efficiency and the ability to measure the full probability distribution of all parameters of interest, such as the spatial and spectral properties of the cluster gas and the cluster distance. We apply this technique to the Chandra X-ray data and the OVRO radio data for the galaxy cluster Abell 611. Comparisons with traditional likelihood-ratio methods reveal the robustness of the method. This method will be used in a follow-up paper to determine the distance of a large sample of galaxy clusters for which high-resolution Chandra X-ray and BIMA/OVRO radio data are available.

Bonamente, Massimiliano↗
NASA NTRS1996

On the Use of Kronecker Operators for the Solution of Generalized Stochastic Petri Nets

We discuss how to describe the Markov chain underlying a generalized stochastic Petri net using Kronecker operators on smaller matrices. We extend previous approaches by allowing both an extensive type of marking-dependent behavior for the transitions and the presence of immediate synchronizations. The derivation of the results is thoroughly formalized, including the use of Kronecker operators in the treatment of the vanishing markings and the computation of impulse-based reward measures. We use our techniques to analyze a model whose solution using conventional methods would fail because of the state-space explosion. In the conclusion, we point out ideas to parallelize our approach.

Ciardo, Gianfranco↗
NASA NTRS1992

Long-range correlations in nucleotide sequences

DNA sequences have been analysed using models, such as an n-step Markov chain, that incorporate the possibility of short-range nucleotide correlations. We propose here a method for studying the stochastic properties of nucleotide sequences by constructing a 1:1 map of the nucleotide sequence onto a walk, which we term a 'DNA walk'. We then use the mapping to provide a quantitative measure of the correlation between nucleotides over long distances along the DNA chain. Thus we uncover in the nucleotide sequence a remarkably long-range power law correlation that implies a new scale-invariant property of DNA. We find such long-range correlations in intron-containing genes and in nontranscribed regulatory DNA sequences, but not in complementary DNA sequences or intron-less genes.

NASA Discipline Cardiopulmonary↗
NASA NTRS2001

End-to-End QoS for Differentiated Services and ATM Internetworking

The Internet was initially design for non real-time data communications and hence does not provide any Quality of Service (QoS). The next generation Internet will be characterized by high speed and QoS guarantee. The aim of this paper is to develop a prioritized early packet discard (PEPD) scheme for ATM switches to provide service differentiation and QoS guarantee to end applications running over next generation Internet. The proposed PEPD scheme differs from previous schemes by taking into account the priority of packets generated from different application. We develop a Markov chain model for the proposed scheme and verify the model with simulation. Numerical results show that the results from the model and computer simulation are in close agreement. Our PEPD scheme provides service differentiation to the end-to-end applications.

Su, Hongjun↗
NASA NTRS2005

Package for Interactive Analysis of Line Emission

PINTofALE is an IDL based package to analyze high-resolution grating spectra. The first version was made available to the public on 3 February 2001. Since then we have carried out numerous changes and subsidiary releases. The current release is version 2.0 (released 6 Apr 2004), and we are preparing to release v2.1 within the next month. The changes include bug fixes, upgrades to handle higher versions of IDL and the CHIANTI database, enhancements in user-friendliness, handling of instrument response matrices, and the release of a Markov Chain Monte Carlo based DEM fitting routines. A detailed description of the package, together with fairly detailed documentation, example walk-throughs, and downloadable tar files, are available on-line from http://hea.harvard.edu/PINTofALE/ The website also lists papers that have used PINTofALE in their analysis.

Kashyap, Vinay↗