Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Dynamics Informed Optimization for Resilient Energy Systems

Optimal mitigation planning for highly disruptive contingencies to a transmission-level power system requires optimization with dynamic power system constraints, due to the key role of dynamics in system stability to major perturbations. We formulate a generalized disjunctive program to determine optimal grid component hardening choices for protecting against major failures, with differential algebraic constraints representing system dynamics (specifically, differential equations representing generator and load behavior and algebraic equations representing instantaneous power balance over the transmission system). We optionally allow stochastic optimal pre-positioning across all considered failure scenarios, and optimal emergency control within each scenario. This novel formulation allows, for the first time, analyzing the resilience interdependencies of mitigation planning, preventive control, and emergency control. Using all three strategies in concert is particularly effective at maintaining robust power system operation under severe contingencies, as we demonstrate on the Western System Coordinating Council (WSCC) 9-bus test system using synthetic multi-device outage scenarios. Towards integrating our modeling framework with real threats and more realistic power systems, we explore applying hybrid dynamics to power systems. Our work is applied to basic RL circuits with the ultimate goal of using the methodology to model protective tripping schemes in the grid. Finally, we survey mitigation techniques for HEMP threats and describe a GIS application developed to create threat scenarios in a grid with geographic detail.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Data-Driven Preemptive Voltage Monitoring and Control Using Probabilistic Voltage Sensitivities

Increased penetration levels of distributed variable renewable generation can cause random voltage fluctuations and violations at multiple nodes. Traditional methods of voltage control typically involve reactionary responses of capacitor banks, tap changers, and recently even smart inverters. But because of the lack of foresight in voltage violations, these controls are ineffective to completely mitigate the issue. Therefore, new methods of predicting voltage violations subject to random power injection changes in the distribution network are needed, which can be used to guide optimal and dynamic methods of voltage control. This work lays the foundation for such preemptive voltage monitoring and control by proposing an analytical and sensor data-driven voltage sensitivity analysis method. Driven by stochastic data and forecasts, the method can be used to develop probabilistic voltage sensitivities and consequently to predict system nodes with high likelihood of voltage limit violations. The effectiveness of this method is tested on IEEE 69-node distribution system integrated with distributed solar. The results demonstrate the proposed method's ability to successfully predict nodes with high probability of voltage violations for a specific time-series simulation. The results also demonstrate the ability to guide timely power injection control actions to mitigate future voltage violations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Flexible Resource Scheduler for FAST-DERMS (FRS-FASTDERMS) v0.9

The Flexible Resource Scheduler is a hierarchical controller that manages the distributed energy resources in a distribution substation or distribution feeder to provide a firm commitment of power flow at the substation or feeder head to be scheduled in transmission-level markets as an aggregated demand resource. It is the reference controller for the FAST-DERMS Architecture, developed in tandem with the architecture under the DOE FAST-DERMS project. It is comprised of a day-ahead stochastic optimization, which schedules substation power flow and reserves, a intra-hour MPC, which generates dispatch base points for DER, and a real-time PID controller maintaining that dispatches DER to maintain the substation power around the base points. The repository also includes a representative aggregator controller, and all of the necessary components to run a simulation using PNNL's GridAPPS-D software with the controller.

MacDonald, Jason [Lawrence Berkeley National Labor↗
DOE OSTI2021

Occupant Preference-Aware Load Scheduling for Resilient Communities

The load scheduling of resilient communities in the islanded mode is subject to many uncertainties such as weather forecast errors and occupant behavior stochasticity. To date, it remains unclear how occupant preferences affect the effectiveness of the load scheduling of resilient communities. This paper proposes an occupant thermal preference-aware load scheduler for resilient communities operating in the islanded mode. First, key resilience indicators are selected to quantify its impacts on the load scheduling of a resilient community. A deterministic model predictive control-based load scheduling framework is adopted as the baseline. Then, a chance-constrained controller is proposed to address the occupant-induced uncertainty in room temperature setpoints. Finally, the chance-constrained controller is compared with the deterministic controller on a virtual community testbed based on a real-world net-zero energy community in Florida, U.S. Results have shown that the proposed chance-constrained controller performs better in terms of serving occupants’ thermal preference and the required battery sizes compared to the deterministic controller with the presence of the assumed stochastic occupant behavior. This work indicates that it is necessary to consider the stochasticity of the occupant behavior when designing optimal load schedulers for resilient communities.

Wang, Jing↗
DOE OSTI2021

A Stochastic Multi-Criteria Decision-Making Algorithm for Dynamic Load Prioritization in Grid-Interactive Efficient Buildings

Increasing deployment of advanced sensing, controls, and communication infrastructure enables buildings to provide services to the power grid, leading to the concept of grid-interactive efficient buildings. Since occupant activities and preferences primarily drive the availability and operational flexibility of building devices, there is a critical need to develop occupant-centric approaches that prioritize devices for providing grid services, while maintaining the desired end-use quality of service. In this paper, we present a decision-making framework that facilitates a building owner/operator to effectively prioritize loads for curtailment service under uncertainties, while minimizing any adverse impact on the occupants. The proposed framework uses a stochastic (Markov) model to represent the probabilistic behavior of device usage from power consumption data, and a load prioritization algorithm that dynamically ranks building loads using a stochastic multi-criteria decision-making algorithm. The proposed load prioritization framework is illustrated via numerical simulations in a residential building use-case, including plug-loads, air-conditioners, and plug-in electric vehicle chargers, in the context of load curtailment as a grid service. Suitable metrics are proposed to evaluate the closed-loop performance of the proposed prioritization algorithm under various scenarios and design choices. Scalability of the proposed algorithm is established via computational analysis, while time-series plots are used for intuitive explanation of the ranking choices.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Identification of hot water end-use process of electric water heaters from energy measurements

This paper presents an algorithm for the identification of parameters for a stochastic hot water end-use process that drives a homogeneous population of thermostatically controlled electric water heaters (EWH). Usually, only metered interval consumption data (kWh) is collected and the hot water end-use process is unobservable to utility and aggregators. However, the availability of EWHs for demand response (DR) is closely coupled with the hot water end-use process. In this context, the hot water end-use process is modeled as a two-state Markov chain (Use / No use), which causes the thermostatic ON-OFF switching process to behave as a Markov renewal process (MRP). A set of first passage-time problems is developed to obtain the moments of the transition probability densities of the MRP. These problems are addressed by establishing a system of coupled partial differential equations characterizing the temperature evolution of the EWH population. A key quantity in the methodology for estimating the parameters is the total time an EWH is ON within a period of interest. It is referred to as the total busy time. Total busy time in this approach is a random variable for which analytical expressions of the moments are developed as a function of the metered window length. The latter expressions become the basis of a hot water demand model identification algorithm which is validated using agent-based simulations of EWHs.

42 ENGINEERING↗
DOE OSTI2024

Efficient prediction of attosecond two-colour pulses from an X-ray free-electron laser with machine learning

Abstract X-ray free-electron lasers are sources of coherent, high-intensity X-rays with numerous applications in ultra-fast measurements and dynamic structural imaging. Due to the stochastic nature of the self-amplified spontaneous emission process and the difficulty in controlling injection of electrons, output pulses exhibit significant noise and limited temporal coherence. Standard measurement techniques used for characterizing two-coloured X-ray pulses are challenging, as they are either invasive or diagnostically expensive. In this work, we employ machine learning methods such as neural networks and decision trees to predict the central photon energies of pairs of attosecond fundamental and second harmonic pulses using parameters that are easily recorded at the high-repetition rate of a single shot. Using real experimental data, we apply a detailed feature analysis on the input parameters while optimizing the training time of the machine learning methods. Our predictive models are able to make predictions of central photon energy for one of the pulses without measuring the other pulse, thereby leveraging the use of the spectrometer without having to extend its detection window. We anticipate applications in X-ray spectroscopy using XFELs, such as in time-resolved X-ray absorption and photoemission spectroscopy, where improved measurement of input spectra will lead to better experimental outcomes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Computational Modeling, Simulation, and Potential Applications of Optical Stochastic Cooling

With the rising demand for intense particles beams, much research is being conducted in the area of particle beam cooling. One of these methods, called Stochastic Cooling (SC) (developed at CERN in the 1970's), delivered a feedback method to improve the quality and lifetime of circulating proton beams by reducing their 6D phase-space and has been widely implemented in a number of hadron machines. However, traditional stochastic cooling schemes are limited by the bandwidth of microwave frequency systems. Optical Stochastic Cooling (OSC) is a promising extension of the stochastic cooling beam cooling technique. OSC instead uses optical wavelengths which allows for improved control and increased cooling but creates its own technical challenges. This lays out work conducted toward the experimental demonstration of OSC at Fermilab's Integrable Optics Test Accelerator (IOTA) storage ring. This includes the design and characterization of parts of the optical delay system, the development and validation of a high-fidelity computational model of the OSC process, and the investigations into possible applications of the OSC mechanism to advanced beam manipulations.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Reshaping the Quantum Arrow of Time

While the microscopic laws of physics are often symmetric under time reversal, most natural processes that we observe are not. The emergent asymmetry between typical and time-reversed processes is referred to as the arrow of time. In quantum physics, an arrow of time emerges when a sequence of measurements is performed on a system. We introduce quantum control tools that can yield dynamics more consistent with time flowing backward than forward. The control tools are based on the explicit construction of a Hamiltonian that can replicate the stochastic trajectories of a monitored quantum system. Such a Hamiltonian can reverse the effect of monitoring and, via a feedback process, generate trajectories consistent with a reversed arrow of time. It can also be used to simulate the backward-in-time dynamics of an open quantum system. Finally, we design a feedback-driven continuous measurement engine powered by the energy pumped into the system by the monitoring process. We show that the engine can operate under experimentally realizable conditions with feedback delay and finite-efficiency measurements.

Entropy production↗
DOE OSTI2019

Quasi-Stochastic Approximation and Off-Policy Reinforcement Learning: Preprint

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning and often an efficient approach to solving (or approximating the solution to) complex optimal control problems. In many cases, however, practitioners are unable to apply these techniques because of an inherent high variance. This paper aims to provide a general foundation for 'quasi-stochastic approximation,' in which all of the processes under consideration are deterministic, much like quasi-Monte Carlo for variance reduction in simulation. The variance reduction can be substantial, subject to tuning of pertinent parameters in the algorithm. This paper introduces a new coupling argument to establish the optimal rate of convergence provided the gain is sufficiently large. These results are established for linear models and tested also in nonideal settings. A major application of these general results is a new class of reinforcement learning algorithms for deterministic state space models. In this setting, the main contribution is a class of algorithms for approximating the value function for a given policy, using a different policy designed to introduce exploration.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Polynomial Chaos Surrogate Construction for Random Fields with Parametric Uncertainty

Engineering and applied science rely on computational experiments to rigorously study physical systems. The mathematical models used to probe these systems are highly complex, and sampling-intensive studies often require prohibitively many simulations for acceptable accuracy. Surrogate models provide a means of circumventing the high computational expense of sampling such complex models. In particular, polynomial chaos expansions (PCEs) have been successfully used for uncertainty quantification studies of deterministic models where the dominant source of uncertainty is parametric. We discuss an extension to conventional PCE surrogate modeling to enable surrogate construction for stochastic computational models that have intrinsic noise in addition to parametric uncertainty. We develop a PCE surrogate on a joint space of intrinsic and parametric uncertainty, enabled by Rosenblatt transformations, which are evaluated via kernel density estimation of the associated conditional cumulative distributions. Furthermore, we extend the construction to random field data via the Karhunen–Loève expansion. We then take advantage of closed-form solutions for computing PCE Sobol indices to perform a global sensitivity analysis of the model which quantifies the intrinsic noise contribution to the overall model output variance. Additionally, the resulting joint PCE is generative in the sense that it allows generating random realizations at any input parameter setting that are statistically approximately equivalent to realizations from the underlying stochastic model. The method is demonstrated on a chemical catalysis example model and a synthetic example controlled by a parameter that enables a switch from unimodal to bimodal response distributions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Coupled Thermo-Hydro-Mechanical Processes in Fractured Rocks: Some Past Scientific Highlights and Future Research Directions

Abstract Coupled thermo-hydro-mechanical (THM) processes in fractured rocks have been a topic of intense scientific research for more than 30 years. The present paper takes a look into the past and highlights some scientific advances which are of an unusual “out-of-the-box” nature, and then looks forward and discusses possible directions of future research in this interesting field of study. Concerning future research directions, we see a trend from a focus on coupled THM processes in single fractures or a few interacting fractures, to the study of coupled THM behavior in complex fracture network systems where the fractures act collectively giving rise to local stress concentration points and points of large pressure gradients. Three examples of future research directions are presented. First is an effort towards identifying characterizing parameters of a fracture network that play a direct controlling role in major coupled THM phenomena (such as induced seismicity and flow channeling), rather than parameters of stochastic distributions of fractures in the network. The second example of research direction is accounting for the heterogeneity and hierarchy of fractures in a fault or fracture zone which has been associated with major THM events in a number of geo-energy projects. The third example is at the opposite end of the first; here it is recognized that in some cases, the coupled THM processes in fractured rocks may be controlled dominantly by only a few key bridges. Identification, characterization, and evaluation of these key bridges should be one of the important research directions in the coming days.

58 GEOSCIENCES↗
DOE OSTI2024

Online Learning of Effective Turbine Wind Speed in Wind Farms

To develop better wind farm controllers that can meet more complex objectives, methods of modeling the wind turbine wakes at low computational expense are needed. Gaussian process (GP) regression offers a computationally inexpensive framework for learning complex functions from noisy measurements with very few datapoints. In this work, an online learning approach is presented to learn the rotor-averaged wind velocity at downstream wind turbines with GPs, using the available datastream of wind field measurements and wind turbine control set-points. This framework can readily be integrated into model-based controls methods because the model a) is updated online at low computational expense, b) assumes a mathematically favorable Gaussian form, and c) explicitly quantifies the stochastic nature of the wake field so that the trade-off between exploration and exploitation, and the uncertainty in the prediction, can be utilized. We show that a GP-learned model can match true values with errors within 0.5% on average, with as few as 5 training data points.

Gaussian process↗
DOE OSTI2021

Computational Math Problems for a Clean Energy Future

Cutting edge computational mathematics are ubiquitous in renewable energy research. Problems in resilient and reliable electric grid operations, infrastructure planning, wind farm yaw control, and more demand sophisticated and scalable computational tools that enable the transition of renewable energy technologies from proof of concept to deployment into our energy system. The mission of the Computational Science Center at NREL is to lead the lab's efforts to solve energy challenges using high-performance computing (HPC), computational science, applied mathematics, scientific data management, visualization, and informatics. In this poster, we provide a short overview of three areas of computational mathematics research at NREL: wind power scenario generation for stochastic grid operations and infrastructure planning, improved rational function approximations for electromagnetic transients codes, and wind farm yaw control using a combination of the Alternating Direction Method of Multipliers (ADMM) and reinforcement learning (RL). Increasing penetrations of renewable energy into power grids motivate the investigation of new approaches to characterizing uncertainty for five-minute economic dispatch problems. Similarly, as the penetration of distributed energy resources on power grids increases, it becomes important to revisit our methods of modelling transient phenomena, i.e. electromagnetic transients programs. Finally, the combination of ADMM and RL for wind farm yaw control presented here can potentially increase the efficiency of the deployed distributed controllers by orders of magnitude.

ADMM↗
DOE OSTI2022

Simulation-based assessment on stochastic load scheduling for building cooling systems

Here, to fill knowledge gaps related to stochastic load scheduling, we performed a comprehensive evaluation of the stochastic load scheduling for building cooling systems. Specifically, we studied the common uncertain variables in the load scheduling process for building cooling systems and categorized those variables based on their dynamic patterns. We then developed a generic stochastic load scheduling framework and applied it to building cooling systems that served a simulated community. This community consists of 100 heterogeneous houses and serves as a virtual testbed for evaluating the performance of stochastic load scheduling. In this evaluation, we considered representatives of uncertain variables with different dynamic patterns and included 100 realizations of the considered uncertainty in the evaluation to better catch the probability distribution of the control performance. The evaluation results suggest that deterministic load scheduling can reduce the operating energy cost by 18% but its performance can be affected by uncertainty. Stochastic load scheduling can further decrease the operating energy cost under uncertainty compared to deterministic load scheduling. We also found that the effectiveness of stochastic load scheduling in handling uncertainty is not directly associated with the number of uncertainty scenarios that are considered in its formulation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Stochastic reconstruction of fracture network pattern using spatial point processes

Fracture spatial patterns can strongly affect fluid flow in the subsurface. Proximity and distribution of fractures control reservoir flow behavior over various length scales. In many studies, however, simplified geometrical patterns are generated for fractures which may lead to unrealistic subsurface models. Here we introduce a new method for characterization and modeling of fracture spatial patterns based on outcrop observations. We use Ripley's K-function to characterize the arrangement of fracture barycenters and intersection points over various length scales. In addition, we use semivariograms to quantify spatial correlation in fracture intensity maps. Using this information, we develop a stochastic algorithm that generates two-dimensional fracture network realizations with spatial properties similar to those of a real fracture network measured in the field. Numerical simulation models indicate that the generated fracture realizations exhibit similar flow behaviors as that of the original fracture network. Furthermore, such modeling tools expand and improve our capability in building representative fracture models and in quantification of uncertainty in naturally and hydraulically fractured reservoirs.

58 GEOSCIENCES↗
DOE OSTI2022

An optoelectronic heterostructure for neuromorphic computing: CdS/V 3 O 5

Nonvolatile resistive switching is one of the key phenomena for emerging applications in optoelectronics and neuromorphic computing. In most of the cases, an electric field is applied to a two terminal dielectric material device and leads to the formation of a low resistance filament due to ion migration. However, the stochastic nature of the ion migration can be an impediment for the device robustness and controllability, with uncontrolled variations of high and low resistance states or threshold voltages. Here, we report an optically induced resistive switching based on a CdS/V 3 O 5 heterostructure which can overcome this issue. V 3 O 5 is known to have a second order insulator to metal transition around T c ≈ 415 K, with an electrically induced threshold switching at room temperature. Upon illumination, the direct transfer of the photoinduced carriers from the CdS into V 3 O 5 produces a nonvolatile resistive switching at room temperature. The initial high resistance can be recovered by reaching the high temperature metallic phase, i.e., temperatures above T c . Interestingly, this resistive switching becomes volatile around the T c . In conclusion, by locally manipulating the volatile and nonvolatile resistive switching using electric field and light, this system is a promising platform for hardware based neuromorphic computing implementations.

97 MATHEMATICS AND COMPUTING↗