Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluating the Risk of Enabling Energy Storage Systems to Provide Multiple Services

Battery energy storage systems (BESS) are emerging as a promising, versatile technology for modern power grids due to their inherent distributed nature, their ability to inject bidirectional power flows and to provide multiple grid services. With the proliferation of intermittent renewable energy resources, the BESS procurement is also expected to increase, thereby creating systematic and strategic opportunities for BESS to various revenue streams for providing multiple grid services. Utilizing a co-simulation architecture, this work presents evaluation framework for enabling Utility-scale BESS with simultaneous provision of multiple services. The proposed framework is implemented on a real-life feeder modeled in GridLAB-D, leveraging multi-service grid support. A Risk-Aware control strategy is also implemented in this work that that takes into account the uncertain nature of some of the stochastic services and ensures the BESS to deliver their service commitments. This promotes overall grid reliability and encourages BESS implementation through the revenue streams from providing multiple grid services.

Theisen, John↗
NASA NTRS2004

Probabilistic Residual Strength Model Developed for Life Prediction of Ceramic Matrix Composites

For the next generation of reusable launch vehicles, NASA is investigating introducing ceramic matrix composites (CMCs) in place of current superalloys for structural propulsion applications (e.g., nozzles, vanes, combustors, and heat exchangers). The higher use temperatures of CMCs will reduce vehicle weight by eliminating and/or reducing cooling system requirements. The increased strength-to-weight ratio of CMCs relative to superalloys further enhances their weight savings potential. However, in order to provide safe designs for components made of these new materials, a comprehensive life prediction methodology for CMC structures needs to be developed. A robust methodology for lifing composite structures has yet to be adopted by the engineering community. Current industry design practice continues to utilize deterministic empirically based models borrowed from metals design for predicting material life capabilities. The deterministic nature of these models inadequately addresses the stochastic character of brittle composites, and their empirical reliance makes predictions beyond the experimental test conditions a risky extrapolation. A team of engineers at the NASA Glenn Research Center has been developing a new life prediction engineering model. The Probabilistic Residual Strength (PRS) model uses the residual strength of the composite as its damage metric. Expected life and material strength are both considered probabilistically to account for the observed stochastic material response. Extensive experimental testing has been carried out on C/SiC (a candidate aerospace CMC material system) in a controlled 1000 ppm O2/argon environment at elevated temperatures of 800 and 1200 C. The test matrix was established to allow observation of the material behavior, characterization of the model, and validation of the model's predictive capabilities. Sample results of the validation study are illustrated in the graphs.

Thomas, David J.↗
NASA NTRS1985

An Overview of Latest Model Reduction and Control Methods of Large Flexible Space Structures

The latest trends and theoretical developments involved with the modeling and control of Large Flexible Space Structures (LFSS) are described. The paper addresses first the basic problems, characteristics, and difficulties inherent in modeling and control of LFSS. Major sources of difficulties and errors are the stiffness and damping operators of the dynamic model. Extensions of Linear Quadratic Gaussian (LQG) theory as applied to LFSS are presented, including frequency-shaped cost functionals and perturbation methods. The minimum data/maximum entropy approach which uses a stochastic design model to overcome difficulties found in the LQG-based methods is described. Latest trends in system theory including balanced realization and singular-value analysis are used to determine reduced order controllers and models. Ad hoc methods such as component cost analysis and modal cost analysis are discussed in context with the closed-loop reduction problem of controller order versus performance. The minimum data/maximum entropy approach also addresses controller order versus performance. Those areas of control science and large scale systems that appear to have an important role in understanding and solving LFSS modeling and control are also identified.

Santiago, J. M.↗
DOE OSTI2024

Tunneling current-controlled spin states in few-layer van der Waals magnets

Abstract Effective control of magnetic phases in two-dimensional magnets would constitute crucial progress in spintronics, holding great potential for future computing technologies. Here, we report a new approach of leveraging tunneling current as a tool for controlling spin states in CrI 3 . We reveal that a tunneling current can deterministically switch between spin-parallel and spin-antiparallel states in few-layer CrI 3 , depending on the polarity and amplitude of the current. We propose a mechanism involving nonequilibrium spin accumulation in the graphene electrodes in contact with the CrI 3 layers. We further demonstrate tunneling current-tunable stochastic switching between multiple spin states of the CrI 3 tunnel devices, which goes beyond conventional bi-stable stochastic magnetic tunnel junctions and has not been documented in two-dimensional magnets. Our findings not only address the existing knowledge gap concerning the influence of tunneling currents in controlling the magnetism in two-dimensional magnets, but also unlock possibilities for energy-efficient probabilistic and neuromorphic computing.

Science & Technology - Other Topics↗
DOE OSTI2020

Stochastic DC optimal power flow with reserve saturation

We propose an optimization framework for stochastic optimal power flow with uncertain loads and renewable generator capacity. Our model follows previous work in assuming that generator outputs respond to load imbalances according to an affine control policy, but introduces a model of saturation of generator reserves by assuming that when a generator’s target level hits its limit, it abandons the affine policy and produces at that limit. This is a particularly interesting feature in models where wind power plants, which have uncertain upper generation limits, are scheduled to provide reserves to balance load fluctuations. Here, the resulting model is a nonsmooth nonconvex two-stage stochastic program, and we use a stochastic approximation method to find stationary solutions to a smooth approximation. Computational results on 6-bus and 118-bus test instances demonstrate that by considering the effects of saturation, our model can yield solutions with lower expected generation costs (at the same target line violation probability level) than those obtained from a model that enforces the affine policy to stay within generator limits with high probability.

17 WIND ENERGY↗
DOE OSTI2020

Generation and representation of synthetic smart meter data

Advanced energy algorithms running at big-data scale will be necessary to identify, realize, and verify energy savings to meet government and utility goals of building energy efficiency. Any algorithm must be well characterized and validated before it is trusted to run at these scales. Smart meter data from real buildings will ultimately be required for the development, testing, and validation of these energy algorithms and processes. However, for initial development and testing, smart meter data are difficult to work with due to privacy restrictions, noise from unknown sources, data accessibility, and other concerns which can complicate algorithm development and validation. This paper describes a new methodology to generate synthetic smart meter data of electricity use in buildings using detailed building energy modeling, which aims to capture the variability and stochastics of real energy use in buildings. The methodology can create datasets tailored to represent specific scenarios with known truth and controllable amounts of synthetic noise. Knowledge of ground truth also allows the development and validation of enhanced processes which leverage building metadata, such as building type or size (floor area), in addition to smart meter data. The methodology described in this paper includes the key influencing factors of real-world building energy use including weather data, occupant-driven loads, building operation and maintenance practices, and special events. Data formats to support workflows leveraging both synthetic meter data and associated metadata are proposed and discussed. Finally, example use cases of the synthetic meter data are described to illustrate potential applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Projective Integral Updates for High-Dimensional Variational Inference

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing model variations that remain consistent with training data enables more robust predictions by reducing parameter sensitivity. This work introduces a fixed-point optimization for variational inference that is applicable when every feasible log density can be expressed as a linear combination of functions from a given basis. In such cases, the optimizer becomes a fixed-point of projective integral updates. When the basis spans univariate quadratics in each parameter, the feasible distributions are Gaussian mean-fields and the projective integral updates yield quasi-Newton variational Bayes (QNVB). Other bases and updates are also possible. Since these updates require high-dimensional integration, this work begins by proposing an efficient quasirandom sequence of quadratures for mean-field distributions. Each iterate of the sequence contains two evaluation points that combine to correctly integrate all univariate quadratic functions and, if the mean-field factors are symmetric, all univariate cubics. More importantly, averaging results over short subsequences achieves periodic exactness on a much larger space of multivariate polynomials of quadratic total degree. The corresponding variational updates require four loss evaluations with standard (not second-order) backpropagation to eliminate error terms from over half of all multivariate quadratic basis functions. Furthermore, this integration technique is motivated by first proposing stochastic blocked mean-field quadratures, which may be useful in other contexts. A PyTorch implementation of QNVB allows for better control over model uncertainty during training than competing methods. Experiments demonstrate superior generalizability for multiple learning problems and architectures.

Gaussian mean-field↗
NASA NTRS1972

On the determination of optimal costly measurement strategies for linear stochastic systems.

This paper presents the formulation of a class of optimization problems dealing with selecting, at each instant of time, one measurement provided by one out of many sensors. Each measurement has an associated measurement cost. The basic problem is then to select an optimal measurement policy, during a specified observation time interval, so that a weighted combination of prediction accuracy and accumulated observation cost is optimized. The current analysis is limited to the class of linear stochastic dynamic systems and measurement subsystems. The problem of selecting the optimal measurement strategy can be transformed into a deterministic optimal control problem. It is shown that the optimal measurement policy and the associated matched Kalman-type filter can be precomputed.

Athans, M.↗
NASA NTRS1995

Research of Stochastic Robustness: Results and conclusions

With stochastic robustness we are creating tools to design robust compensators for practical systems. During this year, the stochastic robustness research achieved the following results: refined the search tools needed for synthesis; successfully designed robust compensators for the American Controls Conference benchmark problem; and successfully designed robust compensators for a nonlinear hypersonic aircraft model with uncertainties in 28 parameters.

Marrison, Chris↗
NASA NTRS1986

Control design for robust stability in linear regulators: Application to aerospace flight control

Time domain stability robustness analysis and design for linear multivariable uncertain systems with bounded uncertainties is the central theme of the research. After reviewing the recently developed upper bounds on the linear elemental (structured), time varying perturbation of an asymptotically stable linear time invariant regulator, it is shown that it is possible to further improve these bounds by employing state transformations. Then introducing a quantitative measure called the stability robustness index, a state feedback conrol design algorithm is presented for a general linear regulator problem and then specialized to the case of modal systems as well as matched systems. The extension of the algorithm to stochastic systems with Kalman filter as the state estimator is presented. Finally an algorithm for robust dynamic compensator design is presented using Parameter Optimization (PO) procedure. Applications in a aircraft control and flexible structure control are presented along with a comparison with other existing methods.

Yedavalli, R. K.↗
NASA NTRS2016

Hybrid Differential Dynamic Programming with Stochastic Search

Differential dynamic programming (DDP) has been demonstrated as a viable approach to low-thrust trajectory optimization, namely with the recent success of NASAs Dawn mission. The Dawn trajectory was designed with the DDP-based Static Dynamic Optimal Control algorithm used in the Mystic software. Another recently developed method, Hybrid Differential Dynamic Programming (HDDP) is a variant of the standard DDP formulation that leverages both first-order and second-order state transition matrices in addition to nonlinear programming (NLP) techniques. Areas of improvement over standard DDP include constraint handling, convergence properties, continuous dynamics, and multi-phase capability. DDP is a gradient based method and will converge to a solution nearby an initial guess. In this study, monotonic basin hopping (MBH) is employed as a stochastic search method to overcome this limitation, by augmenting the HDDP algorithm for a wider search of the solution space.

Aziz, Jonathan↗
NASA NTRS2016

Hybrid Differential Dynamic Programming with Stochastic Search

Differential dynamic programming (DDP) has been demonstrated as a viable approach to low-thrust trajectory optimization, namely with the recent success of NASA's Dawn mission. The Dawn trajectory was designed with the DDP-based Static/Dynamic Optimal Control algorithm used in the Mystic software.1 Another recently developed method, Hybrid Differential Dynamic Programming (HDDP),2, 3 is a variant of the standard DDP formulation that leverages both first-order and second-order state transition matrices in addition to nonlinear programming (NLP) techniques. Areas of improvement over standard DDP include constraint handling, convergence properties, continuous dynamics, and multi-phase capability. DDP is a gradient based method and will converge to a solution nearby an initial guess. In this study, monotonic basin hopping (MBH) is employed as a stochastic search method to overcome this limitation, by augmenting the HDDP algorithm for a wider search of the solution space.

Aziz, Jonathan↗
DOE OSTI2026

Integrated Strategies for Overcoming Resolution Limits in Electron Beam Lithography of Chemically Amplified Resists

Electron beam lithography (EBL) of chemically amplified resists (CARs) faces fundamental challenges, including stochastic electron scattering and acid diffusion, that limit resolution and reproducibility. Using SU-8 as a model CAR, this study systematically investigated complementary strategies to address these challenges, combining multipass exposure, proximity effect correction (PEC) with midrange correction factors, base quencher incorporation, and post-exposure bake (PEB) suppression. Monte Carlo simulations and calibrated PEC modeling revealed that extending the point spread function to include a midrange scattering component significantly improved critical dimension (CD) control across varying pattern densities, correcting deviations that conventional two-term PEC failed to capture. Multipass exposure, particularly 4-pass writing with a 25% offset, redistributed the dose to average stochastic beam and scattering fluctuations, reducing line-width roughness by more than 50% and yielding more uniform nanoscale features. Photoacid confinement was investigated by adding urea as a base quencher, which successfully reduced acid diffusion but introduced substantial sensitivity penalties without improving ultimate resolution or Z-factor performance, underscoring the trade-offs of chemical versus physical confinement. Suppressing PEB most directly minimized acid diffusion, resulting in improved Z-factors and reproducible 30 nm half-pitch dense line/space patterns. Overall, these results demonstrated that PEC with midrange correction, multipass strategies, quencher additives, and PEB-free processing addresses different aspects of the EBL process window and that their integration provides a comprehensive framework for managing stochastic scattering, diffusion, and chemical amplification effects. This framework advances dense nanoscale patterning in CARs and establishes guiding principles for optimizing resist design and process strategies in high-resolution EBL and potentially other advanced lithographies, such as extreme ultraviolet (EUV) lithography.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Model Predictive Fault-Tolerant Tracking Control for PDF Control Systems With Packet Losses

In this article, a fault-tolerant tracking control strategy is investigated for nonlinear probability density function (PDF) control systems with the actuator fault, uncertainties, unknown disturbance, and random packet losses. The control input signal dropout and measurement signal dropouts are described as the independent Bernoulli distribution. An adaptive fault diagnosis (FD) observer based on the Lyapunov function is given to simultaneously estimate the fault, disturbance, and state with packet losses. Furthermore, different from the traditional robust fault-tolerant control (FTC), a new active fault-tolerant tracking controller is designed based on the model predictive control framework, which has better adaptive fault-tolerant performance. Finally, the validity of the proposed FTC method has been proved by a simulation study of a papermaking process.

42 ENGINEERING↗
NASA NTRS1976

Linear and nonlinear analysis of orbital telescope/space shuttle dynamics and control

Work completed on the design and study of an annular suspension and pointing (ASP) system for the space shuttle was presented. This system makes use of a magnetically suspended vernier pointing assembly. The following objectives were pursued in this study: (1) development of a detailed mathematical model of the Space Shuttle/ASP system, (2) design of control laws in order to obtain the desired pointing performance, and (3) prediction of the statistical pointing accuracies in the presence of stochastic disturbances such as crew-motion, and sensor and actuator noise. The first two of these objectives are documented in this report.

Roberts, A. S., Jr.↗
NASA NTRS1990

Integrated system identification and modal state estimation for control of flexible space structures

A novel approach of integrated system identification and modal state estimation is proposed for control of linear dynamical systems including flexible space structures. There are four steps involved in this approach. First, the relation between a stochastic state space model of a dynamical system and the coefficients of its autoregressive model with exogenous input is derived. Second, an adaptive least-squares transversal predictor is used to estimate the coefficients of the model. Third, a state space model and a steady state Kalman filter gain of the dynamical system are then identified from the coefficients of the model by using the eigensystem realization algorithm. Fourth, a modal state estimator is constructed using the modal parameters of the identified model. On-line implementation of this algorithm can continually improve the modal parameters and the filter gain. It can also gradually update the system model when the system characteristics are slowly changing. A numerical example is used to illustrate the feasibility of the new approach.

Chen, Chung-Wen↗
DOE OSTI2021

Modeling and simulation of vascular tumors embedded in evolving capillary networks

Here in this work, we present a coupled 3D–1D model of solid tumor growth within a dynamically changing vascular network to facilitate realistic simulations of angiogenesis. Additionally, the model includes erosion of the extracellular matrix, interstitial flow, and coupled flow in blood vessels and tissue. We employ continuum mixture theory with stochastic Cahn–Hilliard type phase-field models of tumor growth. The interstitial flow is governed by a mesoscale version of Darcy’s law. The flow in the blood vessels is controlled by Poiseuille flow, and Starling’s law is applied to model the mass transfer in and out of blood vessels. The evolution of the network of blood vessels is orchestrated by the concentration of the tumor angiogenesis factors (TAFs); blood vessels grow towards the increasing TAFs concentrations. This process is not deterministic, allowing random growth of blood vessels and, therefore, due to the coupling of nutrients in tissue and vessels, makes the growth of tumors stochastic. We demonstrate the performance of the model by applying it to a variety of scenarios. Numerical experiments illustrate the flexibility of the model and its ability to generate satellite tumors. Simulations of the effects of angiogenesis on tumor growth are presented as well as sample-independent features of cancer.

3D–1D coupled blood flow models↗
NASA NTRS1976

On the optimal minimum order observer-based compensator and the limited state variable feedback controller

Four design problems are considered: two on the optimal minimum order observer-based compensator design and two on the optimal limited state variable feedback controller. The problem of designing an optimal discrete time linear time-invariant observer-based compensator for the regulation of an n dimensional linear discrete time time-invariant plant with m independent outputs is considered. This is a stochastic design problem to the extent that the initial plant state is assumed to be a random vector with known first and second order statistics. The compensator parameters are obtained by minimizing the expectation, with respect to the initial conditions, of the standard cost, quadratic in the state and control vectors with the inclusion of cross terms.

Llorens-Ortiz, B.↗