Search NASA⌕ Search

SEARCH · Search NASA

Results for “Stochastic System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Identification and stochastic control of helicopter dynamic modes

A general treatment of parameter identification and stochastic control for use on helicopter dynamic systems is presented. Rotor dynamic models, including specific applications to rotor blade flapping and the helicopter ground resonance problem are emphasized. Dynamic systems which are governed by periodic coefficients as well as constant coefficient models are addressed. The dynamic systems are modeled by linear state variable equations which are used in the identification and stochastic control formulation. The pure identification problem as well as the stochastic control problem which includes combined identification and control for dynamic systems is addressed. The stochastic control problem includes the effect of parameter uncertainty on the solution and the concept of learning and how this is affected by the control's duel effect. The identification formulation requires algorithms suitable for on line use and thus recursive identification algorithms are considered. The applications presented use the recursive extended kalman filter for parameter identification which has excellent convergence for systems without process noise.

Molusis, J. A.↗

On the adaptive control of linear systems using the open-loop-feedback-optimal approach.

This paper considers the suboptimal stochastic control of linear discrete-time dynamical systems with unknown or stochastically varying parameters. The suboptimal scheme is based upon the use of the open-loop-feedback-optimal (O.L.F.O.) method. The state and parameter estimates are generated by an extended Kalman filter algorithm. Numerical results for first order systems are presented.

Ku, R.↗

Stochastic estimation of tropospheric path delays in global positioning system geodetic measurements

Water vapor radiometric and surface meteorological measurements taken during three GPS geodetic experiments are used to calculate process noise levels for random walk and first-order Gauss-Markov temporal models of tropospheric path delays. Entire wet and combined wet and dry zenith delays at each network site are estimated simultaneously with the geodetic parameters without prior calibration. The path delays and corresponding baseline estimates are compared to those obtained with calibrated data and stochastic residual delays. In this manner, the marginal utility of a priori tropospheric calibration is assessed given the ability to estimate the path delays directly using only the GPS data. Estimation of total zenith path delays with appropriate random walk or Gauss-Markov models yields baseline repeatabilities of a few parts in 100 million. Results suggest that GPS data alone have sufficient strength to resolve centimeter-level zenith path delay fluctuations over periods of a few minutes.

Tralli, David M.↗

On the adaptive control of linear systems using the open-loop-feedback-optimal approach.

This paper considers the suboptimal stochastic control of linear discrete-time dynamical systems with uncertain or stochastically varying parameters. The suboptimal scheme is based upon the use of the open-loop-feedback-optimal (OLFO) method. The state and parameter estimates are generated by an extended Kalman filter algorithm. Numerical results for first-order systems are presented.

Ku, R.↗

On-orbit parametric identification methodology

On-orbit system identification (ID) of large space systems is essential for various reasons. For example, the complex composite structure of such systems cannot be ground-tested; their structural dynamic characteristics must be known accurately in order to accomplish active control. Furthermore, such capability can be used to characterize/identify various disturbances. The identification process is consisted of four principal elements: (1) modeling, (2) the estimation algorithm, (3) input system, and (4) measurement system. These elements are highly correlated and all togerher determine the success of the identification problem. Accurate modeling of large space systems is the most important element of the identification process. Large flexible structures are non-linear and infinite dimensional systems with highly coupled parameters and low frequency packed modes. In addition, these systems are subject to stochastic and time-varying disturbances, they have structural parameters which can vary due to on-orbit assembly deployment, and operations. These systems are generally; however, represented by constant coefficient, finite order differential equations. The non-linearities, coupling and noise effects are also often neglected. Moreover, identification experiment designs which lead to highly complex optimization problems usually require the simultaneous choice of ID algorithm, sensor, and actuator type and placement. On-orbit bandwidth and power restrictions on excitation, limited data window, and restrictions on sensor/actuator type, placement and number, has led to practical questions of implementations.

Hadaegh, Fred Y.↗

Resilient Distributed Frequency Regulation of Renewable Generators under Communication Interruptions

Modern power systems (MPSs) face significant challenges due to the high penetration of renewable energy sources (RESs) and new types of loads such as electric vehicles (EVs). Traditional load frequency control (LFC) methods struggle with the intermittent, stochastic nature of RESs, the near-zero inertia of power-electronics-based generators, and the mobility of controllable loads and battery systems. This paper introduces a novel resilient distributed frequency regulation method to address these issues. The proposed method employs a state space model to represent the dynamic behavior of participating power sources while accounting for stochastic switching processes to model structural and parameter variations caused by disruptions such as generator connection/disconnection, communication interruptions, and physical faults. By integrating these dynamic and stochastic components, the method treats power grids as a comprehensive stochastic hybrid system. Our method enhances conventional frequency control by incorporating local stability control, neighborhood control decoupling, and coordination feedback. Theoretical analyses establish the stability, convergence, and resilience of the proposed method, and its effectiveness is validated through case studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Improving noisy free-energy measurements by adding more noise

Estimating free-energy differences using nonequilibrium work relations, such as the Jarzynski equality, is hindered by poor convergence when work fluctuations are large. For systems governed by overdamped Langevin dynamics, we propose the counterintuitive approach of adding noise in order to increase the precision of such calculations. Here, by introducing additional stochastic fluctuations to the system and rescaling its potential energy accordingly, we leave the thermodynamics of the system unchanged while increasing its relaxation rate. For a given time-dependent protocol this modification reduces the dissipated reduced work, leading to more accurate free-energy estimates. The method is designed to be used in experiment, and we illustrate its operation using computer simulations applied to two model systems. However, the regime of applicability of this strategy is likely limited, because it requires control of the system's potential energy in a way that is feasible in only a few experimental settings.

Whitelam, Stephen [Lawrence Berkeley National Labo↗

Differential geometric methods in system theory.

Discussion of certain problems in system theory which have been or might be solved using some basic concepts from differential geometry. The problems considered involve differential equations, controllability, optimal control, qualitative behavior, stochastic processes, and bilinear systems. The main goal is to extend the essentials of linear theory to some nonlinear classes of problems.

Brockett, R. W.↗

Set-point control of nonlinear systems

A method of nonlinear stochastic control is applied to the problem of providing set-point control. The procedure is illustrated for a nonlinear second-order plant. The controller design uses a variation of the 'multiple-model adaptive control' approach. Specific problems related to the design are investigated, including learning time and set-point accuracy dependence on the number of approximating models, chord versus tangent approximations, and the a priori Markov switching parameter values. Simulations are provided for different situations under various levels of measurement noise.

Vanlandingham, H. F.↗

Research of Stochastic Robustness: Results and conclusions

With stochastic robustness we are creating tools to design robust compensators for practical systems. During this year, the stochastic robustness research achieved the following results: refined the search tools needed for synthesis; successfully designed robust compensators for the American Controls Conference benchmark problem; and successfully designed robust compensators for a nonlinear hypersonic aircraft model with uncertainties in 28 parameters.

Marrison, Chris↗

Co-Optimization of Navigation System Requirements and Trajectory Design Using a Sweeping Gradient Method and Linear Covariance Analysis

We describe the application of a sweeping gradient method for ordinary differential equations with events (SGM) and linear covariance analysis (LinCov) to the co-optimization of navigation system requirement generation and robust trajectory design. SGM is a method for computing the gradient of trajectory analyses defined by performance indices over initial value problems with events with respect to static parameters. LinCov is an analytic technique for predicting stochastic behavior of dynamical systems. By combining SGM and LinCov, it is possible use efficient, off-the-shelf, gradient-based optimizers to solve a combined robust optimal trajectory and navigation system design problem. In this paper, we formulate the required models to apply the combined SGM and LinCov techniques to a Near-Rectilinear Halo Orbit rendezvous approach scenario and show results for several intermediate problems.

Benjamin W L Margolis↗

Introduction: Neuromorphic Materials

The explosive growth in data collection and the need to process it efficiently, as well as the desire to automate increasingly complex tasks in transportation, medical care, manufacturing, security and many other fields have motivated a growing interest in neuromorphic computing. Unlike the binary, transistorbased ON/OFF logic gates and separate logic and memory functionalities employed in digital computing, neuromorphic computing is inspired by animal brains that use interconnected synapses and neurons to perform processing, storage and transmission of information at the same location, while only consuming ~20 W or less of power. Motivated by the brain’s efficiency, adaptability, self-learning and resiliency qualities, neuromorphic computing can be broadly defined as an approach to processing and storing information using hardware and algorithms inspired by models of biological neural systems. Present research in neuromorphic computing encompasses approaches that vary significantly in their degree of neuro-inspiration, from systems that only incorporate features such as asynchronous, event-driven operation or use crossbar arrays of non-volatile memory (NVM) elements to accelerate deep neural networks (DNNs), to designs that embrace the extreme parallelism, sparsity, reconfigurability, adaptability, complexity and stochasticity observed in nervous systems. The term ‘neuromorphic’ computing is often credited to Carver Mead, who in the 1980s investigated Si-based analog electronics to replicate functions of the animal retina. Earlier important advances in this field include the work of Frank Rosenblatt, who proposed the concept of the perceptron, Bernard Widrow, who used this concept to build one of the first analog neural networks, the Adaline and many other researchers (see ref. 6 for an historical perspective on neuromorphic computing). With the recent increase in the use of artificial intelligence and large language models, and rising concerns over the associated energy costs, interest in neuromorphic hardware has expanded rapidly. According to some estimates, driven largely by the drastic growth in the training use of artificial intelligence (AI) models using the current computing architectures, the energy cost of computing is projected to reach the energy supply worldwide by 2045. Furthermore, while this is not a realistic outcome, it means that, if more efficient computing technologies are not developed -- soon -- the world will soon become one where demand for energy and market constraints limit the continued increase of societal access to AI and cloud services from data centers. Data centers used for training and use of these models consume hundreds of terawatt hours of electricity, already past 4% of the US electricity demand.

Circuits↗

Structural Aspects of System Identification

The problem of identifying linear dynamical systems is studied by considering structural and deterministic properties of linear systems that have an impact on stochastic identification algorithms. In particular considered is parametrization of linear systems so that there is a unique solution and all systems in appropriate class can be represented. It is assumed that a parametrization of system matrices has been established from a priori knowledge of the system, and the question is considered of when the unknown parameters of this system can be identified from input/output observations. It is assumed that the transfer function can be asymptotically identified, and the conditions are derived for the local, global and partial identifiability of the parametrization. Then it is shown that, with the right formulation, identifiability in the presence of feedback can be treated in the same way. Similarly the identifiability of parametrizations of systems driven by unobserved white noise is considered using the results from the theory of spectral factorization.

Glover, Keith↗

Differential Equation Approximation Using Gradient-Boosted Quantile Regression

The operation of cyber-physical-human (CPH) systems is subject to various epistemic and aleatory uncertainties. Overall trustworthiness of CPH systems relies on the trustworthiness of its components and their interactions. It is important that computational models comprising the cyber component of CPH provide predictions accompanied by a measure of confidence in model outcomes. Uncertainty quantification (UQ) and propagation are especially important in safety critical CPH systems. Gradient-boosted trees is a modeling approach capable both of learning the dynamics of a system and performing UQ. In this paper, we devise a method for using gradient boosting to learn the dynamics of a second order differential equation and estimate uncertainty at the same time. We do this by creating a custom loss function that trains the model to approximate the second derivative of a noisy time series, and to penalize based on a parameter that corresponds to the desired quantile. The resulting gradient boosting model can simulate stochastic trajectories of the system given a single starting point, that is, it can estimate both the expected trajectory and its uncertainty. We show that the uncertainty estimation is well calibrated and that the model can learn the dynamics even in the presence of noise. We demonstrate the approach on a simple cartpole system.

Autonomous systems↗

Probabilistic structural analysis algorithm development for computational efficiency

The PSAM (Probabilistic Structural Analysis Methods) program is developing a probabilistic structural risk assessment capability for the SSME components. An advanced probabilistic structural analysis software system, NESSUS (Numerical Evaluation of Stochastic Structures Under Stress), is being developed as part of the PSAM effort to accurately simulate stochastic structures operating under severe random loading conditions. One of the challenges in developing the NESSUS system is the development of the probabilistic algorithms that provide both efficiency and accuracy. The main probability algorithms developed and implemented in the NESSUS system are efficient, but approximate in nature. In the last six years, the algorithms have improved very significantly.

Wu, Y.-T.↗

Transient anisotropic kernel for probabilistic learning on manifolds

PLoM (Probabilistic Learning on Manifolds) is a method introduced in 2016 for handling small training datasets by projecting an Itô equation from a stochastic dissipative Hamiltonian dynamical system, acting as the MCMC generator, for which the KDE-estimated probability measure with the training dataset is the invariant measure. PLoM performs a projection on a reduced-order vector basis related to the training dataset, using the diffusion maps (DMAPS) basis constructed with a time-independent isotropic kernel. In this paper, we propose a new ISDE projection vector basis built from a transient anisotropic kernel, providing an alternative to the DMAPS basis to improve statistical surrogates for stochastic manifolds with heterogeneous data. The construction ensures that for times near the initial time, the DMAPS basis coincides with the transient basis. For larger times, the differences between the two bases are characterized by the angle of their spanned vector subspaces. The optimal instant yielding the optimal transient basis is determined using an estimation of mutual information from Information Theory, which is normalized by the entropy estimation to account for the effects of the number of realizations used in the estimations. Consequently, this new vector basis better represents statistical dependencies in the learned probability measure for any dimension. Three applications with varying levels of statistical complexity and data heterogeneity validate the proposed theory, showing that the transient anisotropic kernel improves the learned probability measure.

Diffusion maps↗