Search NASA⌕ Search

SEARCH · Search NASA

Results for “Stochastic differential equations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1973

Solution of the stochastic control problem in unbounded domains.

Bellman's dynamic programming equation for the optimal index and control law for stochastic control problems is a parabolic or elliptic partial differential equation frequently defined in an unbounded domain. Existing methods of solution require bounded domain approximations, the application of singular perturbation techniques or Monte Carlo simulation procedures. In this paper, using the fact that Poisson impulse noise tends to a Gaussian process under certain limiting conditions, a method which achieves an arbitrarily good approximate solution to the stochastic control problem is given. The method uses the two iterative techniques of successive approximation and quasi-linearization and is inherently more efficient than existing methods of solution.

Robinson, P.↗
NASA NTRS1975

Stochastic stability and instability of model ecosystems

In this work, we initiate a stability study of multispecies communities in stochastic environment by using Ito's differential equations as community models. By applying the direct method of Liapunov, we obtain sufficient conditions for stability and instability in the mean of the equilibrium populations. The conditions are expressed in terms of the dominant diagonal property of community matrices, which is a suitable mechanism for resolving the central problem of 'complexity vs stability' in model ecosystems. As a by-product of this analysis we exhibit important structural properties of the stochastic density-dependent models, and establish tolerance of community stability to a broad class of nonlinear time-varying perturbations.

Ladde, G. S.↗
DOE OSTI2025

Adaptive Uncertainty Quantification for Stochastic Hyperbolic Conservation Laws

Here, we propose a predictor-corrector adaptive method for the study of hyperbolic partial differential equations (PDEs) under uncertainty. Constructed around the framework of stochastic finite volume (SFV) methods, our approach circumvents sampling schemes or simulation ensembles while also preserving fundamental properties, in particular hyperbolicity of the resulting systems and conservation of the discrete solutions. Furthermore, we augment the existing SFV theory with a priori convergence results for statistical quantities, in particular push-forward densities, which we demonstrate through numerical experiments. By linking refinement indicators to regions of the physical and stochastic spaces, we drive anisotropic refinements of the discretizations, introducing new degrees of freedom where deemed profitable. To illustrate our proposed method, we consider a series of numerical examples for nonlinear hyperbolic PDEs based on Burgers’ and Euler’s equations.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1971

Differential geometric methods in system theory.

Discussion of certain problems in system theory which have been or might be solved using some basic concepts from differential geometry. The problems considered involve differential equations, controllability, optimal control, qualitative behavior, stochastic processes, and bilinear systems. The main goal is to extend the essentials of linear theory to some nonlinear classes of problems.

Brockett, R. W.↗
NASA NTRS1984

Non-Gaussian approach for parametric random vibration of non-linear structures

The dynamic response of a nonlinear, single degree of freedom structural system subjected to a physically white noise parametric excitation is investigated. The Ito stochastic calculus is employed to derive a general differential equation for the moments of the response coordinates. The differential equations of moments of any order are found to be coupled with higher order moments. A non-Gaussian closure scheme is developed to truncate the moment equations up to fourth order. The statistical of the stationary response are computed numerically and compared with analytical solutions predicted by a Gaussian closure scheme and the stochastic averaging method. It is found that the computed results exhibit the jump phenomenon which is typical of the characteristics of deterministic nonlinear systems. In addition, the numerical algorithm leads to multiple solutions all of which give positive mean squares. However, two of these solutions are found to violate the properties of high order moments. One solution preserves the moments properties and demonstrates that the system achieves a stationary response.

Ibrahim, R. A.↗
NASA NTRS1983

Singular Perturbations in Systems and Control

The application of singular perturbation theory to problems in systems and control is addressed. The types of systems considered include linear and nonlinear, discrete and continuous, and stochastic and deterministic. Both ordinary and partial differential equations are covered.

Ardema, M. D.↗
NASA NTRS1969

Optimal stochastic control.

Optimal stochastic control, discussing dynamic mathematical models described by differential equations

Wonham, W. M.↗
NASA NTRS1968

Optimal stochastic control.

Optimal stochastic control of small dynamic systems described by random differential equations, noting selective bibliography on several subjects

Wonham, W. M.↗
NASA NTRS1993

A Discrete Probability Function Method for the Equation of Radiative Transfer

A discrete probability function (DPF) method for the equation of radiative transfer is derived. The DPF is defined as the integral of the probability density function (PDF) over a discrete interval. The derivation allows the evaluation of the PDF of intensities leaving desired radiation paths including turbulence-radiation interactions without the use of computer intensive stochastic methods. The DPF method has a distinct advantage over conventional PDF methods since the creation of a partial differential equation from the equation of transfer is avoided. Further, convergence of all moments of intensity is guaranteed at the basic level of simulation unlike the stochastic method where the number of realizations for convergence of higher order moments increases rapidly. The DPF method is described for a representative path with approximately integral-length scale-sized spatial discretization. The results show good agreement with measurements in a propylene/air flame except for the effects of intermittency resulting from highly correlated realizations. The method can be extended to the treatment of spatial correlations as described in the Appendix. However, information regarding spatial correlations in turbulent flames is needed prior to the execution of this extension.

Sivathanu, Y. R.↗
DOE OSTI2025

Voltage Probability Density Function Shaping Control Strategy Considering Grid Operational Uncertainties

It is well-known that power systems operation always affected by various uncertainties which make the bus voltage a random process that can be characterized by its probability density function (PDF) at any time instant. In this context, this paper presents a novel PDF-based voltage control framework for power systems. By modeling voltage as a stochastic process, we formulate a stochastic differential equationthat captures grid uncertainties. The associated Fokker-Planck-Kolmogorov equation is derived to describe the evolution of the voltage PDF, which enables the formulation of a PDF-shaping control strategy. To simplify the PDF control formulation, a B-spline neural network is introduced for real-time estimation and regulation of the voltage distribution. The proposed PDF control law updates voltage references for energy storage systems and synchronous generators using real-time PDF measurements and feedback signals. The proposed method is validated on a modified Kundur’s two-area system. Simulation results demonstrate that the controller can significantly improve the voltage stability under stochastic conditions, highlighting its effectiveness in modern inverter-rich grids.

Gui, Yonghao [ORNL] (ORCID:0000000250435534)↗
NASA NTRS1987

Active stability augmentation of large space structures: A stochastic control problem

A problem in SCOLE is that of slewing an offset antenna on a long flexible beam-like truss attached to the space shuttle, with rather stringent pointing accuracy requirements. The relevant methodology aspects in robust feedback-control design for stability augmentation of the beam using on-board sensors is examined. It is framed as a stochastic control problem, boundary control of a distributed parameter system described by partial differential equations. While the framework is mathematical, the emphasis is still on an engineering solution. An abstract mathematical formulation is developed as a nonlinear wave equation in a Hilbert space. That the system is controllable is shown and a feedback control law that is robust in the sense that it does not require quantitative knowledge of system parameters is developed. The stochastic control problem that arises in instrumenting this law using appropriate sensors is treated. Using an engineering first approximation which is valid for small damping, formulas for optimal choice of the control gain are developed.

Balakrishnan, A. V.↗
DOE OSTI2024

Stochastic finite volume method for uncertainty quantification of transient flow in gas pipeline networks

We develop a weakly intrusive framework to simulate the propagation of uncertainty in solutions of generic hyperbolic partial differential equation systems on graph-connected domains with nodal coupling and boundary conditions. The method is based on the Stochastic Finite Volume (SFV) approach and can be applied for uncertainty quantification (UQ) of the dynamical state of fluid flow over actuated transport networks. The numerical scheme has specific advantages for modeling intertemporal uncertainty in time-varying boundary parameters, which cannot be characterized by strict upper and lower (interval) bounds. We describe the scheme for a single pipe, and then formulate the controlled junction Riemann problem (JRP) that enables the extension to general network structures. In conclusion, we demonstrate the method's capabilities and performance characteristics using a standard benchmark test network.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2008

Simulation of Stochastic Processes by Coupled ODE-PDE

A document discusses the emergence of randomness in solutions of coupled, fully deterministic ODE-PDE (ordinary differential equations-partial differential equations) due to failure of the Lipschitz condition as a new phenomenon. It is possible to exploit the special properties of ordinary differential equations (represented by an arbitrarily chosen, dynamical system) coupled with the corresponding Liouville equations (used to describe the evolution of initial uncertainties in terms of joint probability distribution) in order to simulate stochastic processes with the proscribed probability distributions. The important advantage of the proposed approach is that the simulation does not require a random-number generator.

Zak, Michail↗
NASA NTRS2010

Turbulence and the Stabilization Principle

Further results of research, reported in several previous NASA Tech Briefs articles, were obtained on a mathematical formalism for postinstability motions of a dynamical system characterized by exponential divergences of trajectories leading to chaos (including turbulence). To recapitulate: Fictitious control forces are introduced to couple the dynamical equations with a Liouville equation that describes the evolution of the probability density of errors in initial conditions. These forces create a powerful terminal attractor in probability space that corresponds to occurrence of a target trajectory with probability one. The effect in ordinary perceived three-dimensional space is to suppress exponential divergences of neighboring trajectories without affecting the target trajectory. Con sequently, the postinstability motion is represented by a set of functions describing the evolution of such statistical quantities as expectations and higher moments, and this representation is stable. The previously reported findings are analyzed from the perspective of the authors Stabilization Principle, according to which (1) stability is recognized as an attribute of mathematical formalism rather than of underlying physics and (2) a dynamical system that appears unstable when modeled by differentiable functions only can be rendered stable by modifying the dynamical equations to incorporate intrinsic stochasticity.

Zak, Michail↗
DOE OSTI2025

Accelerating multilevel Markov Chain Monte Carlo using machine learning models

Here, this work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian inference often substitute computationally expensive high-fidelity models with machine learning models, thereby introducing approximation errors, our approach offers a computationally efficient alternative by augmenting high-fidelity models with low-fidelity ones within a hierarchical framework. The multilevel approach utilizes the low-fidelity machine learning model (MLM) for inexpensive evaluation of proposed samples thereby improving the acceptance of samples by the high-fidelity model. The hierarchy in our multilevel algorithm is derived from geometric multigrid hierarchy. We utilize an MLM to accelerate the coarse level sampling. Training machine learning model for the coarsest level significantly reduces the computational cost associated with generating training data and training the model. We present an MCMC algorithm to accelerate the coarsest level sampling using MLM and account for the approximation error introduced. We provide theoretical proofs of detailed balance and demonstrate that our multilevel approach constitutes a consistent MCMC algorithm. Additionally, we derive the expression for cost reduction due to machine learning model to facilitate cost analysis of the hierarchical sampling algorithm. Our technique is demonstrated on a standard benchmark inference problem in groundwater flow, where we estimate the probability density of a quantity of interest using a four-level MCMC algorithm. Our proposed algorithm accelerates multilevel sampling by a factor of two while achieving similar accuracy compared to sampling using the standard multilevel algorithm.

97 MATHEMATICS AND COMPUTING↗