Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic transition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Improving Sensorimotor Function and Adaptation using Stochastic Vestibular Stimulation

Astronauts experience sensorimotor changes during adaption to G-transitions that occur when entering and exiting microgravity. Post space flight, these sensorimotor disturbances can include postural and gait instability, visual performance changes, manual control disruptions, spatial disorientation, and motion sickness, all of which can hinder the operational capabilities of the astronauts. Crewmember safety would be significantly increased if sensorimotor changes brought on by gravitational changes could be mitigated and adaptation could be facilitated. The goal of this research is to investigate and develop the use of electrical stochastic vestibular stimulation (SVS) as a countermeasure to augment sensorimotor function and facilitate adaptation. For this project, SVS will be applied via electrodes on the mastoid processes at imperceptible amplitude levels. We hypothesize that SVS will improve sensorimotor performance through the phenomena of stochastic resonance, which occurs when the response of a nonlinear system to a weak input signal is optimized by the application of a particular nonzero level of noise. In line with the theory of stochastic resonance, a specific optimal level of SVS will be found and tested for each subject [1]. Three experiments are planned to investigate the use of SVS in sensory-dependent tasks and performance. The first experiment will aim to demonstrate stochastic resonance in the vestibular system through perception based motion recognition thresholds obtained using a 6-degree of freedom Stewart platform in the Jenks Vestibular Laboratory at Massachusetts Eye and Ear Infirmary. A range of SVS amplitudes will be applied to each subject and the subjectspecific optimal SVS level will be identified as that which results in the lowest motion recognition threshold, through previously established, well developed methods [2,3,4]. The second experiment will investigate the use of optimal SVS in facilitating sensorimotor adaptation to system disturbances. Subjects will adapt to wearing minifying glasses, resulting in decreased vestibular ocular reflex (VOR) gain. The VOR gain will then be intermittently measured while the subject readapts to normal vision, with and without optimal SVS. We expect that optimal SVS will cause a steepening of the adaptation curve. The third experiment will test the use of optimal SVS in an operationally relevant aerospace task, using the tilt translation sled at NASA Johnson Space Center, a test platform capable of recreating the tilt-gain and tilt-translation illusions associated with landing of a spacecraft post-space flight. In this experiment, a perception based manual control measure will be used to compare performance with and without optimal SVS. We expect performance to improve in this task when optimal SVS is applied. The ultimate goal of this work is to systematically investigate and further understand the potential benefits of stochastic vestibular stimulation in the context of human space flight so that it may be used in the future as a component of a comprehensive countermeasure plan for adaptation to G-transitions.

Galvan, R. C.↗
NASA NTRS2014

Improving Sensorimotor Function Using Stochastic Vestibular Stimulation

Astronauts experience sensorimotor changes during spaceflight, particularly during G-transition phases. Post flight sensorimotor changes may include postural and gait instability, spatial disorientation, and visual performance decrements, all of which can degrade operational capabilities of the astronauts and endanger the crew. Crewmember safety would be improved if these detrimental effects of spaceflight could be mitigated by a sensorimotor countermeasure and even further if adaptation to baseline could be facilitated. The goal of this research is to investigate the potential use of stochastic vestibular stimulation (SVS) as a technology to improve sensorimotor function. We hypothesize that low levels of SVS will improve sensorimotor performance through stochastic resonance (SR). The SR phenomenon occurs when the response of a nonlinear system to a weak input signal is optimized by the application of a particular nonzero level of noise. Two studies have been initiated to investigate the beneficial effects and potential practical usage of SVS. In both studies, electrical vestibular stimulation is applied via electrodes on the mastoid processes using a constant current stimulator. The first study aims to determine the repeatability of the effect of vestibular stimulation on sensorimotor performance and perception in order to better understand the practical use of SVS. The beneficial effect of low levels of SVS on balance performance has been shown in the past. This research uses the same balance task repeated multiple times within a day and across days to study the repeatability of the stimulation effects. The balance test consists of 50 sec trials in which the subject stands with his or her feet together, arms crossed, and eyes closed on compliant foam. Varying levels of SVS, ranging from 0-700 micro A, are applied across different trials. The subject-specific optimal SVS level is that which results in the best balance performance as measured by inertial measurement units placed on the upper and lower torso of the subjects. Additionally, each individual’s threshold for illusory motion perception of suprasensory electrical vestibular stimulation is measured multiple times within and across days to better understand how multiple SVS test methods compare. The second study aims to demonstrate stochastic resonance in the vestibular system using a perception based motion recognition task. This task measures an individual’s velocity threshold of motion recognition using a 6-degree of freedom Stewart platform and a 3-down/1-up staircase procedure. For this study, thresholds are determined using 150 trials in the upright, head-centered roll tilt motion direction at a 0.2 Hz frequency. We aim to demonstrate the characteristic bell shaped curve associated with stochastic resonance with each subject’s motion recognition thresholds at varying SVS levels ranging from 0 to 1500 micro A. The curve includes the individual’s baseline threshold with no SVS, optimal or minimal threshold at some mid-level of SVS, and finally degraded or increased threshold at a high SVS level. An additional aim is to formally retest each subject at his or her individual optimal SVS level on a different day than the original testing for additional validity. The overall purpose of this research is to further quantify the effects of SVS on various sensorimotor tasks and investigate the practical implications of its use in the context of human space flight so that it may be implemented in the future as a component of a comprehensive countermeasure plan for adaptation to G-transitions.

Galvan, R. C.↗
NASA NTRS1991

A distributed Petri Net controller for a dual arm testbed

This thesis describes the design and functionality of a Distributed Petri Net Controller (DPNC). The controller runs under X Windows to provide a graphical interface. The DPNC allows users to distribute a Petri Net across several host computers linked together via a TCP/IP interface. A sub-net executes on each host, interacting with the other sub-nets by passing a token vector from host to host. One host has a command window which monitors and controls the distributed controller. The input to the DPNC is a net definition file generated by Great SPN. Thus, a net may be designed, analyzed and verified using this package before implementation. The net is distributed to the hosts by tagging transitions that are host-critical with the appropriate host number. The controller will then distribute the remaining places and transitions to the hosts by generating the local nets, the local marking vectors and the global marking vector. Each transition can have one or more preconditions which must be fulfilled before the transition can fire, as well as one or more post-processes to be executed after the transition fires. These implement the actual input/output to the environment (machines, signals, etc.). The DPNC may also be used to simulate a Great SPN net since stochastic and deterministic firing rates are implemented in the controller for timed transitions.

Bjanes, Atle↗
NASA NTRSDate not supplied

Monte Carlo simulations of neutrino and charged lepton propagation in the Earth with nuPyProp

An accurate modeling of neutrino flux attenuation and the distribution of leptons they produce in transit through the Earth is an essential component to determine neutrino flux sensitivities of underground, sub-orbital and space-based detectors. Through neutrino oscillations over cosmic distances, astrophysical neutrino sources are expected to produce nearly equal fluxes of electron, muon and tau neutrinos. Of particular interest are tau neutrinos that interact in the Earth at modest slant depths to produce leptons. Some leptons emerge from the Earth and decay in the atmosphere to produce extensive air showers. Future balloon-borne and satellite-based opticalCherenkov neutrino telescopes will be sensitive to upward air showers from tau neutrino induced lepton decays. We present nuPyProp, a python code that is part of the nuSpaceSim package. nuPyProp generates look-up tables for exit probabilities and energy distributions for (see paper for proper equation) propagation in the Earth. This flexible code runs with either stochastic or continuous electromagnetic energy losses for the lepton transit through the Earth. Current neutrino cross section models and energy loss models are included along with templates for user input of other models. Results from nuPyProp are compared with other recent simulation packages for neutrino and charged lepton propagation. Sources of modeling uncertainties are described and quantified.

Yosui Akaike↗
NASA NTRS2016

Exhibition of Stochastic Resonance in Vestibular Perception

Astronauts experience sensorimotor changes during spaceflight, particularly during G-transitions. Post flight sensorimotor changes include spatial disorientation, along with postural and gait instability that may degrade operational capabilities of the astronauts and endanger the crew. A sensorimotor countermeasure that mitigates these effects would improve crewmember safety and decrease risk. The goal of this research is to investigate the potential use of stochastic vestibular stimulation (SVS) as a technology to improve sensorimotor function. We hypothesize that low levels of SVS will improve sensorimotor perception through the phenomenon of stochastic resonance (SR), when the response of a nonlinear system to a weak input signal is enhanced by the application of a particular nonzero level of noise. This study aims to advance the development of SVS as a potential countermeasure by 1) demonstrating the exhibition of stochastic resonance in vestibular perception, a vital component of sensorimotor function, 2) investigating the repeatability of SR exhibition, and 3) determining the relative contribution of the semicircular canals (SCC) and otolith (OTO) organs to vestibular perceptual SR. A constant current stimulator was used to deliver bilateral bipolar SVS via electrodes placed on each of the mastoid processes, as previously done. Vestibular perceptual motion recognition thresholds were measured using a 6-degree of freedom MOOG platform and a 150 trial 3-down/1-up staircase procedure. In the first test session, we measured vestibular perceptual thresholds in upright roll-tilt at 0.2 Hz (SCC+OTO) with SVS ranging from 0-700 μA. In a second test session a week later, we re-measured roll-tilt thresholds with 0, optimal (from test session 1), and 1500 μA SVS levels. A subset of these subjects, plus naive subjects, participated in two additional test sessions in which we measured thresholds in supine roll-rotation at 0.2 Hz (SCC) and upright y-translation at 1 Hz (OTO) with SVS up to 700 μA. A sinusoidal galvanic vestibular stimulation (GVS) perceptual threshold was also measured on each test day and used to normalize the SVS levels across subjects. In roll-tilt thresholds with SVS, the characteristic SR curve was qualitatively exhibited in 10 of 12 subjects, and the improvement in motion threshold was significant in 6 subjects, indicating that optimal SVS improved passive body motion perception in a way that is consistent with classical SR theory. A probabilistic comparison to numeric simulations further validated these experimental results. On the second test session, 4 out of the 10 SR exhibitors showed repeated improvement with SVS compared to the no SVS condition. Data collection is ongoing for the last two test sessions in which SCC and OTO only perceptual motion recognition thresholds are being measured with SVS. The final results of these test sessions will give insight into whether vestibular perceptual SR can occur when only one type of vestibular sensor is sensing motion or if it is more evident when sensory integration between the SCC and OTO is occurring during the motion. The overall purpose of this research is to further quantify the effects of SVS on various sensorimotor tasks and to gain a more fundamental understanding of how SVS causes SR in the vestibular system. In the context of human space flight, results from this research will help in understanding how SVS may be practically implemented in the future as a component of a comprehensive countermeasure plan for G-transition adaptation.

Galvan-Garza, R. C.↗
NASA NTRS1988

Electronic excitation and quenching of atoms at insulator surfaces

A trajectory-based semiclassical method is used to study electronically inelastic collisions of gas atoms with insulator surfaces. The method provides for quantum-mechanical treatment of the internal electronic dynamics of a localized region involving the gas/surface collision, and a classical treatment of all the nuclear degrees of freedom (self-consistently and in terms of stochastic trajectories), and includes accurate simulation of the bath-temperature effects. The method is easy to implement and has a generality that holds promise for many practical applications. The problem of electronically inelastic dynamics is solved by computing a set of stochastic trajectories that on thermal averaging directly provide electronic transition probabilities at a given temperature. The theory is illustrated by a simple model of a two-state gas/surface interaction.

Swaminathan, P. K.↗
NASA NTRS1989

Gravitational radiation from primordial solitons and soliton-star binaries

The possibility that both the formation of nontopological solitons in a primordial second-order phase transition and binary systems of soliton stars could generate a stochastic gravitational-wave background is examined. The present contribution of gravitational radiation to the energy density of the universe from these processes is estimated for a number of different models. The detectability of such contributions from the timing measurements of the millisecond pulsar and spaceborne laser interferometry is briefly discussed and compared to other cosmological and local sources of background gravitational waves.

Gleiser, Marcelo↗
NASA NTRS1994

Stochastic Modeling of Length of Day

We propose a general stochastic model for the UT1-LOD system and derive the corresponding Kalman filter model.

stochastic model autoregressive moving average tra↗
NASA NTRS1986

Modeling of transition and surface roughness effects in boundary-layer flows

Experiments were carried out to examine the influence of three-dimensional, stochastic roughness on the growth of incompressible turbulent boundary layers, as well as the effect of streamwise pressure gradients and freestream turbulence intensity on smooth-wall boundary-layer transition. The modeling of these effects in a two-dimensional boundary-layer computation program was examined with the help of the experiments. A model for surface roughness was developed that relates directly measurable statistical parameters quantifying the roughness geometry to the aerodynamic effects. This model should be valid for a limited class of surfaces found on turbomachinery blading and in other engineering applications. Commonly used criteria for the transition onset performed poorly and presumably need to be modified to account for other factors influencing the process.

Feiereisen, W. J.↗
NASA NTRS1993

Adaptive nonlinear polynomial neural networks for control of boundary layer/structural interaction

The acoustic pressures developed in a boundary layer can interact with an aircraft panel to induce significant vibration in the panel. Such vibration is undesirable due to the aerodynamic drag and structure-borne cabin noises that result. The overall objective of this work is to develop effective and practical feedback control strategies for actively reducing this flow-induced structural vibration. This report describes the results of initial evaluations using polynomial, neural network-based, feedback control to reduce flow induced vibration in aircraft panels due to turbulent boundary layer/structural interaction. Computer simulations are used to develop and analyze feedback control strategies to reduce vibration in a beam as a first step. The key differences between this work and that going on elsewhere are as follows: that turbulent and transitional boundary layers represent broadband excitation and thus present a more complex stochastic control scenario than that of narrow band (e.g., laminar boundary layer) excitation; and secondly, that the proposed controller structures are adaptive nonlinear infinite impulse response (IIR) polynomial neural network, as opposed to the traditional adaptive linear finite impulse response (FIR) filters used in most studies to date. The controllers implemented in this study achieved vibration attenuation of 27 to 60 dB depending on the type of boundary layer established by laminar, turbulent, and intermittent laminar-to-turbulent transitional flows. Application of multi-input, multi-output, adaptive, nonlinear feedback control of vibration in aircraft panels based on polynomial neural networks appears to be feasible today. Plans are outlined for Phase 2 of this study, which will include extending the theoretical investigation conducted in Phase 2 and verifying the results in a series of laboratory experiments involving both bum and plate models.

Parker, B. Eugene, Jr.↗
NASA NTRS1996

Discrete Deterministic and Stochastic Petri Nets

Petri nets augmented with timing specifications gained a wide acceptance in the area of performance and reliability evaluation of complex systems exhibiting concurrency, synchronization, and conflicts. The state space of time-extended Petri nets is mapped onto its basic underlying stochastic process, which can be shown to be Markovian under the assumption of exponentially distributed firing times. The integration of exponentially and non-exponentially distributed timing is still one of the major problems for the analysis and was first attacked for continuous time Petri nets at the cost of structural or analytical restrictions. We propose a discrete deterministic and stochastic Petri net (DDSPN) formalism with no imposed structural or analytical restrictions where transitions can fire either in zero time or according to arbitrary firing times that can be represented as the time to absorption in a finite absorbing discrete time Markov chain (DTMC). Exponentially distributed firing times are then approximated arbitrarily well by geometric distributions. Deterministic firing times are a special case of the geometric distribution. The underlying stochastic process of a DDSPN is then also a DTMC, from which the transient and stationary solution can be obtained by standard techniques. A comprehensive algorithm and some state space reduction techniques for the analysis of DDSPNs are presented comprising the automatic detection of conflicts and confusions, which removes a major obstacle for the analysis of discrete time models.

MATHEMATICAL MODELS↗
NASA NTRS2010

Visual Performance Challenges to Low-Frequency Perturbations After Long-Duration Space Flight, and Countermeasure Development

Astronauts experience sensorimotor disturbances after long-duration space flight. After a water landing, crewmembers may need to egress the vehicle within a few minutes for safety and operational reasons in various sea state conditions. Exposure to even low-frequency motions induced by sea conditions surrounding a vessel can cause significant motor control problems affecting critical functions. The first objective of this study was to document human visual performance during simulated wave motion below 2.0 Hz. We examined the changes in accuracy and reaction time when subjects performed a visual target acquisition task in which the location of the target was offset vertically during horizontal rotation at an oscillating frequency of 0.8 Hz. The main finding was that both accuracy and reaction time varied as a function of target location, with greater performance decrements occurring when vertical targets were acquired at perturbing frequencies of 0.8 Hz in the horizontal plane. A second objective was to develop a countermeasure, base d on stochastic resonance (SR), to enhance sensorimotor capabilities with the aim of facilitating rapid adaptation to gravitational transitions after long-duration space flight. SR is a mechanism by which noise can enhance the response of neural systems to relevant sensory signals. Recent studies have shown that applying imperceptible stochastic electrical stimulation to the vestibular system (SVS) significantly improved balance and oculomotor responses. This study examined the effectiveness of SVS on improving balance performance. Subjects performed a standard balance task while bipolar SVS was applied to the vestibular system using constant current stimulation through electrodes placed over the mastoid process. The main finding of this study was that balance performance with the application of SR showed significant improvement in the range of 10%-25%. Ultimately an SR-based countermeasure might be fielded either as preflight training to enhance adaptability, or as a miniature patch-type stimulator worn post flight.

Mulavara, Ajitkumar↗
NASA NTRS1992

Stochasticity of comet P/Slaughter-Burnham

Three comets are now known to be at or near the 1/1 resonance with Jupiter: P/Slaughter-Burnham, P/Boethin and the newly discovered P/Ge-Wang. Although details of the individual orbits differ, the three comets have very similar dynamical behavior: their orbits show many transitions between the different types of resonant motion (satellite libration, anti-satellite libration, and circulating motion). The stochastic character of such cometary orbits, mainly due to encounters with Jupiter is investigated using Lyapunov Characteristic Indicators. For each comet of the group, we study the influences on the stochasticity of initial eccentricity, inclination, longitude of node, and l-l(sub J) (mean longitude of comet minus mean longitude of Jupiter). We present here our first results for P/Slaughter-Burnham.

Benest, Daniel↗
NASA NTRS1996

Structure Identification Within a Transitioning Swept-Wing Boundary Layer

Extensive measurements are made in a transitioning swept-wing boundary layer using hot-film, hot-wire and cross-wire anemometry. The crossflow-dominated flow contains stationary vortices that breakdown near mid-chord. The most amplified vortex wavelength is forced by the use of artificial roughness elements near the leading edge. Two-component velocity and spanwise surface shear-stress correlation measurements are made at two constant chord locations, before and after transition. Streamwise surface shear stresses are also measured through the entire transition region. Correlation techniques are used to identify stationary structures in the laminar regime and coherent structures in the turbulent regime. Basic techniques include observation of the spatial correlations and the spatially distributed auto-spectra. The primary and secondary instability mechanisms are identified in the spectra in all measured fields. The primary mechanism is seen to grow, cause transition and produce large-scale turbulence. The secondary mechanism grows through the entire transition region and produces the small-scale turbulence. Advanced techniques use Linear Stochastic Estimation (LSE) and Proper Orthogonal Decomposition (POD) to identify the spatio-temporal evolutions of structures in the boundary layer. LSE is used to estimate the instantaneous velocity fields using temporal data from just two spatial locations and the spatial correlations. Reference locations are selected using maximum RMS values to provide the best available estimates. POD is used to objectively determine modes characteristic of the measured flow based on energy. The stationary vortices are identified in the first laminar modes of each velocity component and shear component. Experimental evidence suggests that neighboring vortices interact and produce large coherent structures with spanwise periodicity at double the stationary vortex wavelength. An objective transition region detection method is developed using streamwise spatial POD solutions which isolate the growth of the primary and secondary instability mechanisms in the first and second modes, respectively. Temporal evolutions of dominant POD modes in all measured fields are calculated. These scalar POD coefficients contain the integrated characteristics of the entire field, greatly reducing the amount of data to characterize the instantaneous field. These modes may then be used to train future flow control algorithms based on neural networks.

Chapman, Keith↗
NASA NTRS1989

Soliton and strong Langmuir turbulence in solar flare processes

The occurrence of modulational instability in the current sheet of a solar flare is investigated. Special attention is given to the plasma microinstability in this sheet and its relation to the flare process. It is found that solitons or strong Langmuir turbulence are likely to occur in the diffusion region under solar flare conditions in which the electric resistivity could be enhanced by several orders of magnitude in the region, resulting in significant heating and stochastic acceleration of particles. A numerical example is used to demonstrate the transition of the magnetic field velocity and plasma density from the outer MHD region into the diffusive region and then back out again with the completion of the energy conversion process. This is all made possible by an increase in resistivity of four to five orders of magnitude over the classical value.

Song, M. T.↗
NASA NTRS1994

Advanced data assimilation in strongly nonlinear dynamical systems

Advanced data assimilation methods are applied to simple but highly nonlinear problems. The dynamical systems studied here are the stochastically forced double well and the Lorenz model. In both systems, linear approximation of the dynamics about the critical points near which regime transitions occur is not always sufficient to track their occurrence or nonoccurrence. Straightforward application of the extended Kalman filter yields mixed results. The ability of the extended Kalman filter to track transitions of the double-well system from one stable critical point to the other depends on the frequency and accuracy of the observations relative to the mean-square amplitude of the stochastic forcing. The ability of the filter to track the chaotic trajectories of the Lorenz model is limited to short times, as is the ability of strong-constraint variational methods. Examples are given to illustrate the difficulties involved, and qualitative explanations for these difficulties are provided. Three generalizations of the extended Kalman filter are described. The first is based on inspection of the innovation sequence, that is, the successive differences between observations and forecasts; it works very well for the double-well problem. The second, an extension to fourth-order moments, yields excellent results for the Lorenz model but will be unwieldy when applied to models with high-dimensional state spaces. A third, more practical method--based on an empirical statistical model derived from a Monte Carlo simulation--is formulated, and shown to work very well. Weak-constraint methods can be made to perform satisfactorily in the context of these simple models, but such methods do not seem to generalize easily to practical models of the atmosphere and ocean. In particular, it is shown that the equations derived in the weak variational formulation are difficult to solve conveniently for large systems.

Miller, Robert N.↗
NASA NTRS2019

Electron Scattering by Low-frequency Whistler Waves at Earth’s Bow Shock

Electrons are accelerated to nonthermal energies at shocks in space and astrophysical environments. While shock drift acceleration (SDA) has been considered a key process of electron acceleration at Earth’s bow shock, it has also been recognized that SDA needs to be combined with an additional stochastic process to explain the observed power-law energy spectra. Here, we show mildly energetic (∼0.5 keV) electrons are locally scattered (and accelerated while being confined) by magnetosonic-whistler waves within the shock transition layer, especially when the shock angle is large (θ(sub Bn) approximately equal or greater than 70°). When measured by the Magnetospheric Multiscale mission at a high cadence, ∼0.5 keV electron flux increased exponentially in the shock transition layer. However, the flux profile was not entirely smooth and the fluctuation showed temporal/spectral association with large-amplitude (δB/B ~ 0.3), low-frequency (approximately equal or less than 0.1 Ω(sub ce) where Ω(sub ce) is the cyclotron frequency), obliquely propagating (θ(sub kB) ~ 30°–60°, where θ(sub kB) is the angle between the wave vector and background magnetic field) whistler waves, indicating that the particles were interacting with the waves. Particle simulations demonstrate that, although linear cyclotron resonances with ∼0.5 keV electrons are unlikely due to the obliquity and low frequencies of the waves, the electrons are still scattered beyond 90° pitch angle by (1) resonant mirroring (transit-time damping), (2) non-resonant mirroring, and (3) subharmonic cyclotron resonances. Such coupled nonlinear scattering processes are likely to provide the stochasticity needed to explain the power-law formation.

Oka, M.↗
NASA NTRSDate not supplied

Markov Decision Process based Trajectory Planning for UAVs under Uncertain Wind Conditions

In this paper we propose a Markov Decision Process (MDP) algorithm for path-planning of Unmanned Aviation Vehicles (UAVs) under varying wind conditions. Solutions to path-planning for UAVs are becoming increasingly necessary as autonomous UAVs continue to enter commercial and government spaces. Path-planning is inherently challenging, as UAVs needs to account for dynamically changing flying conditions such as weather, obstacle or no-fly zones, degraded vehicle health and off-nominal battery power consumption. Machine learning methods such as Markov Decision Process (MDPs) have the potential to revolutionize how vehicles navigate in such uncertain environments. Previous papers have demonstrated the use of MDPs to optimize UAV path-planning for energy consumption under time-varying wind distribution. In this study, UAV trajectories from a pre-determined waypoint to target cell, will be computed on a 7X7 grid environment by optimizing parameters for mission assurance and safety limits in addition to the energy consumption, and operation time. The UAV navigates the grid by taking actions to move in either of the eight cardinal and intercardinal directions, under constant thrust profile. The next state of the UAV is calculated by considering its action, transition probability, obstacle cells and the wind speed magnitude and direction. Both constant and stochastic wind will be considered in this paper, the parameters being extracted from real wind measurements in proximity to an experimental UAV flight. One of the studies to be demonstrated in this paper is that as the unmanned airspace gets more complex with multiple vehicles and environmental uncertainties, trade-offs between energy consumption, operation time, risk tolerance, and mission assurance needs to be made. Further, MDPs are capable of fast computation of UAV trajectories under varying wind, hence making them suitable for in-flight path planners.

decision-making↗