Stochastic Linearization of Feedback Systems With Multivariate Nonlinearities and Systems With State-Multiplicative Noise
Not provided.
Automation & Control Systems↗
SEARCH · Search NASA
Results for “stochastic control”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system
Both model predictive control (MPC) and deep reinforcement learning control (DRL) have been presented as a way to approximate the true optimality of a dynamic programming problem, and these two have shown significant operational cost saving potentials for building energy systems. Furthermore, there is still a lack of in-depth quantitative studies on their approximation levels to the true optimality, especially in the building energy domain. To fill in the gap, this paper provides a numerical framework that enables the evaluation of the optimality levels of different controllers for building energy systems. This framework is then used to comprehensively compare the optimal control performance of both MPC and DRL controllers with given computation budgets for a single zone fan coil unit system. Note the optimality is estimated based on a user-specific selection of trade-off weights among energy costs, thermal comfort and control slew rates. Compared with the best optimality we can find through expensive optimization simulations, the best DRL agent can maximally approximate the optimality by 96.54%, which outperforms the best MPC whose optimality level is 90.11%. However, due to the stochasticity, the DRL agent is only expected to approximate the optimality by 90.42%, which is almost equivalent to the best MPC. Except for Proximal Policy Optimization (PPO), all DRL agents can have a better approximation to the optimality than the best MPC, and are expected to have better approximation than the MPC with a prediction horizon of 32 steps (15 min per step). In terms of reducing energy cost and thermal discomfort, MPC can outperform the rule-based control (RBC) by 18.47%–25.44%. DRL can be expected to outperform RBC by 18.95%–25.65% ,and the best DRL control policy can outperform RBC by 20.29%–29.72%. Although the comparison of the optimality level is performed in a perfect setting, e.g., MPC assumes perfect models, and DRL assumes a perfect offline training process and online deployment process, this can shed insight on their capabilities of approximating to the original dynamic programming problem.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Elucidation of Local Ordering and Atomic-Scale Structure in Polymer-Derived SiOC
Silicon oxycarbide (SiOC) is a versatile ceramic material with tunable microstructure and compositions that can be modulated through precursor chemistry and processing conditions. Though there are several noteworthy uses of SiOC across a range of application spaces, the difficulties in elucidating the short- to medium-range order within these materials have limited the maturation of strategies to precisely control SiC x O 4–x compositions for user-tailored applications. In this contribution, we implement a range of synchrotron scattering and spectroscopy methods coupled with stochastic modeling techniques to elucidate changes in local chemistry and structure associated with the pyrolysis of a commercially available SiOC polymer precursor. Stochastic modeling approaches provide valuable insights into decoupling local Si–O and Si–C environments while confirming predominate heterogeneous phases in materials. Using pyrolysis temperatures between 250 to 800 °C results in a heterogeneous material predominately composed of SiOC and amorphous SiO 2 domains. At 1100 °C, redistribution of Si–C pairs in the SiOC network and Si–O from the SiO 2 domains create a more ordered SiOC phase with local cubic SiC-like ordering. In addition, residual carbon leads to a detectable carbon phases at 1100 °C that persist at higher temperatures. These efforts address the difficulties of obtaining atomic-scale insights into the local structure and nanoscale heterogeneities in SiOC, providing pathways toward establishing structure–property relationships for future materials development.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Preliminary study of auto-differentiation algorithm in beam dynamics with stochastic process
Modern particle accelerator optimization requires sophisticated computational methods to address the inherently stochastic nature of beam dynamics. This research develops a framework applying AD to SDEs that specifically addresses beam dynamics challenges in particle accelerators, focusing on accurately modeling and optimizing beam behavior in regimes dominated by stochastic processes. By incorporating key physical phenomena such as synchrotron radiation, wakefield effects, and quantum excitation, the framework aims to provide auto differentiation on the figure of merit of the phase space evolution and beam dynamics. The methodology will enable effective optimization method in a dynamic system with stochastic process.
Accelerator Physics↗
Process Optimization
Process optimization is the discipline of adjusting a process to optimize a specified set of parameters without violating engineering constraints. This article reviews data-driven optimization methods based on genetic algorithms and stochastic models and demonstrates their use in powder-bed fusion and directed energy deposition processes. In the latter case, closed-loop feedback is used to control melt pool temperature and cooling rate in order to achieve desired microstructure.
Sprayberry, Michael↗
Fast ion confinement in the presence of core magnetic islands in Wendelstein 7-X
The effect of magnetic islands in the core region of Wendelstein 7-X (W7-X) on fast ion confinement is explored through simulations with the BEAMS3D code. A magnetic configuration where the n/m = 5/5 island chain is shifted to r/a ~ 0.7 allows the exploration of core island physics in W7-X. The control coil system on W7-X allows the tuning of the island size either increasing the island width or decreasing it. A coupling of the BEAMS3D code to the FIELDLINES code provides a versatile mechanism for incorporating magnetic islands and stochastic regions into the BEAMS3D code. Collisionless simulations suggest that the presence of core islands degrade the confinement of passing particles in the region of the island chain. Full neutral beam simulations of W7-X show a similar behavior with confinement decreasing as the island width is increased. Comparisons between a vacuum magnetic field and low beta HINT2 simulation are made showing similar fast ion behavior. Measurements of lost fast ions in W7-X confirm this trend with the control coil suppressed island configuration showing lower losses than that with no control coils applied. Simulations of fast ion wall loads are performed suggesting no drastic change in loss pattern and a slight reduction in losses with minimized islands.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Periodic Porous 3D Electrodes Mitigate Gas Bubble Traffic during Alkaline Water Electrolysis at High Current Densities
We report alkaline water electrolysis at high current densities is plagued by gas bubble generation and trapping in stochastic porous electrodes (e.g., Ni foams), which causes a significant reduction in the number of electrolyte accessible catalyst active sites. Here, 3D printed Ni (3DPNi) electrodes with highly controlled, periodic structures are reported that suppress gas bubble coalescence, jamming, and trapping and, hence, result in rapid bubble release. The 3DPNi electrodes decorated with carbon-doped NiO achieve a high current density of 1000 mA cm -2 in 1.0 m KOH electrolyte at hydrogen evolution reaction and oxygen evolution reaction overpotentials of 245 and 425 mV, respectively. This work demonstrates a new approach to the deterministic design of 3D electrodes to facilitate rapid bubble transport and release to enhance the total electrode catalytic activity at commercially relevant current densities.
08 HYDROGEN↗
Release a public version of HERON (HERON 2.0) with improved algorithms for the treatment of energy storage
Integrated energy systems (IESs) are essential for decarbonizing electricity and industrial sectors and fully exploiting these systems requires sophisticated planning, scheduling, and dispatching tools to maximize their socio-economic benefits. The Holistic Energy Resource Optimization Network (HERON) is a generic software plugin for the Risk Analysis Virtual Environment (RAVEN) to perform stochastic technoeconomic analysis of IES with economic drivers. This report summarizes the updates made to HERON 2.0. Particularly, we demonstrate one of the added features, Function-based Control Mechanics, by comparing a price-based dispatch strategy with the original perfect foresight baselines. Our case studies successfully demonstrate that the model is capable to incorporate artificial control algorithm into the dispatch of IES components. In addition, our results from the price-based strategy indicate that the control strategies of IES components are key to the economic and temporal performance of our model; therefore, more sophisticated dispatch strategies are required to improve the model performance.
25 ENERGY STORAGE↗
Model Validation and Uncertainty Quantification on the KRUSTY Microreactor Design Using GRIFFIN Neutron Transport Code [Poster]
Argonne National Laboratory (ANL) and INL have developed a GRIFFIN steady state neutronics model for the multiphysics simulations of the Kilopower Reactor Using Sterling TechnologY (KRUSTY) microreactor in the Multiphysics Object Oriented Simulation Environment (MOOSE). The reliability of such deterministic neutronics models can be validated by comparing with computations from Monte Carlo codes (e.g. MCNP, SERPENT, OpenMC, Shift, etc). Furthermore, potential modeling/design improvements can be identified by incorporating uncertainty quantification (UQ), which can be performed by MOOSE’s Stochastic Tools Module (STM). KRUSTY is a prototype for a 5-kW thermal nuclear-powered space reactor. Its primary components consist of nuclear fuel, heat pipes, a control rod, a reflector, and the shielding. The fuel consists of 3 stacked U-7.65Mo cylinders with a hole in the center for the control rod. 8 liquid sodium heat pipes transfer fission energy from the solid fuel block to the Sterling power conversion system where the energy is extracted, and the cooled sodium flows back to the core via capillary action . The movable Boron Carbide control rod regulates the neutron population during startup or when a reactor temperature boost is needed . The beryllium oxide reflector is in 3 places in the reactor; it surrounds the core axially, it lies beneath the core on a platen, and it is present in the shim. The axial and lower reflectors rest on an adjustable stainless-steel platen that moves upward to cover the fuel and help the reactor reach criticality. Lastly, radial stainless steel surrounds the core offering protection from radiation exposure .
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Optimal filtering and filter stability of linear stochastic delay systems
Optimal filtering equations are obtained for very general linear stochastic delay systems. Stability of the optimal filter is studied in the case where there are no delays in the observations. Using the duality between linear filtering and control, asymptotic stability of the optimal filter is proved. Finally, the cascade of the optimal filter and the deterministic optimal quadratic control system is shown to be asymptotically stable as well.
Kwong, R. H.-S.↗
Response of Thematic Mapper bands to plant water stress
Changes in leaf reflectance as water content decreases have been hypothesized to occur in the 1.55-1.75 and 2.08-2.35 micron wavelength regions. To evaluate this hypothesis, studies were conducted on ryegrass (Lolium multiflorum Lam.) and oats (Avena sativa L.), which were grown in a controlled, outdoor situation. Both fully-watered control beds and water-stressed beds were periodically examined with a spectroradiometer calibrated against a reflectance reference of polytetrafluoroethylene. The observed changes correspond to those predicted by stochastic leaf models employed by other investigators (leaf reflection increases in the 1.55-1.75 micron region as leaf water content decreases). Although the percentage changes in TM bands 1-3 are nearly as great as those found in TM bands 5 and 7, the absolute values of reflectance change are much lower. It is believed that these patterns are probably characteristic of a broad range of vegetation types. In terms of phenomena detection, these patterns should be considered in any practical remote sensing sensor scenario.
Cibula, W. G.↗
Improved Predictability of the Indian Ocean Dipole Using a Stochastic Dynamical Model Compared to the North American Multimodel Ensemble Forecast
This study assesses the predictive skill of eight North American Multimodel Ensemble (NMME) models in predicting the Indian Ocean dipole (IOD). We find that the forecasted ensemble-mean IOD–El Niño–Southern Oscillation (ENSO) relationship deteriorates away from the observed relationship with increasing lead time, which might be one reason that limits the IOD predictive skill in coupled models. We are able to improve the IOD predictive skill using a recently developed stochastic dynamical model (SDM) forced by forecasted ENSO conditions. The results are consistent with the previous result that operational IOD predictability beyond persistence at lead times beyond one season is mostly controlled by ENSO predictability and the signal-to-noise ratio of the Indo-Pacific climate system. The multimodel ensemble (MME) investigated here is found to be of superior skill compared to each individual model at most lead times. Importantly, the skill of the SDM IOD predictions forced with forecasted ENSO conditions were either similar or better than those of the MME IOD forecasts. Moreover, the SDM forced with observed ENSO conditions exhibits significantly higher IOD prediction skill than the MME at longer lead times, suggesting the large potential skill increase that could be achieved by improving operational ENSO forecasts. We find that both cold and warm biases of the predicted Niño-3.4 index may cause false alarms of negative and positive IOD events, respectively, in NMME models. Many false alarms for IOD forecasts at lead times longer than one season in the original forecasts disappear or are significantly reduced in the SDM forced by forecasted ENSO conditions.
54 ENVIRONMENTAL SCIENCES↗
Gradient-Based Aeroservoelastic Optimization with Static Output Feedback
Static output feedback considers an optimal low-order feedback matrix which directly connects the sensors to the control inputs. This work demonstrates the numerical techniques needed to compute the analytical gradient of the optimal feedback matrix with respect to design variables, which may then be used for gradient-based optimization. The derivatives are demonstrated for aeroservoelastic optimization under a series of closed- loop gust load alleviation constraints, considering a continuous stochastic gust load applied to a transport vehicle configuration, among other design constraints such as utter and maneuver loads. The optimal trade-o s between passive load alleviation and active load alleviation for static output feedback are compared with those from full-state feedback, which may be considered an upper-bound for effective sensor-based control.
Stanford, Bret K.↗
An adaptive Hessian approximated stochastic gradient MCMC method
Bayesian approaches have been successfully integrated into training deep neural networks. One popular family is stochastic gradient Markov chain Monte Carlo methods (SG-MCMC), which have gained increasing interest due to their ability to handle large datasets and the potential to avoid overfitting. Although standard SG-MCMC methods have shown great performance in a variety of problems, they may be inefficient when the random variables in the target posterior densities have scale differences or are highly correlated. Here, we present an adaptive Hessian approximated stochastic gradient MCMC method to incorporate local geometric information while sampling from the posterior. The idea is to apply stochastic approximation (SA) to sequentially update a preconditioning matrix at each iteration. The preconditioner possesses second-order information and can guide the random walk of a sampler efficiently. Instead of computing and saving the full Hessian of the log posterior, we use limited memory of the samples and their stochastic gradients to approximate the inverse Hessian-vector multiplication in the updating formula. Moreover, by smoothly optimizing the preconditioning matrix via SA, our proposed algorithm can asymptotically converge to the target distribution with a controllable bias under mild conditions. To reduce the training and testing computational burden, we adopt a magnitude-based weight pruning method to enforce the sparsity of the network. Our method is user-friendly and demonstrates better learning results compared to standard SG-MCMC updating rules. The approximation of inverse Hessian alleviates storage and computational complexities for large dimensional models. Numerical experiments are performed on several problems, including sampling from 2D correlated distribution, synthetic regression problems, and learning the numerical solutions of heterogeneous elliptic PDE. The numerical results demonstrate great improvement in both the convergence rate and accuracy.
97 MATHEMATICS AND COMPUTING↗
Deep Reinforcement Scheduling of Energy Storage Systems for Real-time Voltage Regulation in Unbalanced LV Networks with High PV Penetration
The ever-growing higher penetration of distributed energy resources (DERs) in low-voltage (LV) distribution systems brings both opportunities and challenges to voltage support and regulation. This paper proposes a deep reinforcement learning (DRL)-based scheduling scheme of energy storage systems (ESSs) to mitigate system voltage deviations in unbalanced LV distribution networks. The ESS-based voltage regulation problem is formulated as a multi-stage quadratic stochastic program, with the objective of minimizing the expected total daily voltage regulation cost while satisfying operational constraints. While existing voltage regulation methods are mostly focused on onetime- step control, this paper explores a day-horizon systemwide voltage regulation problem. In other words, the size of action and state spaces are extremely high-dimensional and need to be delicately handled. Furthermore, in order to overcome the difficulty of modeling uncertainties and develop a realtime solution, a learn-to-schedule feedback control framework is proposed by adapting the problem to a model-free DRL setting. The proposed algorithm is tested on a customized 6-bus system and a modified IEEE 34-bus system. Simulation results validate the effectiveness and near-optimality of voltage regulation by ESS in comparison with a deterministic quadratic program solution.
Wang, Shengyi↗
Unit-Sphere Multiaxial Stochastic-Strength Model Applied to Anisotropic and Composite Materials
Models that predict the failure probability of brittle materials under multiaxial loading have been developed by authors such as Batdorf, Evans, and Matsuo. These "unit-sphere" models assume that the strength-controlling flaws are randomly oriented, noninteracting planar microcracks of specified geometry but of variable size. This methodology has been extended to predict the multiaxial strength response of transversely isotropic brittle materials, including polymer matrix composites (PMCs), by considering (1) flaw-orientation anisotropy, whereby a preexisting microcrack has a higher likelihood of being oriented in one direction over another direction, and (2) critical strength, or K (sub Ic) orientation anisotropy, whereby the level of critical strength or fracture toughness for mode I crack propagation, K (sub Ic), changes with regard to the orientation of the microstructure. In this report, results from finite element analysis of a fiber-reinforced-matrix unit cell were used with the unit-sphere model to predict the biaxial strength response of a unidirectional PMC previously reported from the World-Wide Failure Exercise. Results for nuclear-grade graphite materials under biaxial loading are also shown for comparison. This effort was successful in predicting the multiaxial strength response for the chosen problems. Findings regarding stress-state interactions and failure modes also are provided.
Nemeth, Noel, N.↗
A Novel Simulation-Based Framework for Sensor Error Impact Analysis in Smart Building Systems: A Case Study for a Demand-Controlled Ventilation System
Sensors are one of the fundamental components for sensor-rich controls in buildings but are prone to different errors. Existing studies show that sensor errors hold a place among top-priority faults in building systems. Before we take countermeasures to mitigate the sensor errors, it is vital to prioritize key sensors and quantify the collective impacts of concurrent sensor errors. In response to this, a simulation-based methodology is introduced to conduct a comprehensive sensor error impact analysis in building systems, which adds a stochastic sensor prioritization through a sensitivity analysis on top of a commonly used deterministic sensor error quantification. The synergies of these two parts help better interpret the sensor error impacts on building energy consumption, ventilation performance, thermal comfort, etc. A sensor-rich CO2-based Demand-Controlled Ventilation system is used as a case study to demonstrate the viability of the methodology as a proof-of-the-concept. The results show that the energy savings potential and ventilation performance are mostly influenced by the accuracy of the AHU outdoor airflow sensors. The accuracy of zone level airflow sensors has a negligible impact on both energy savings and ventilation performance. The accuracy of zone CO2 sensors has more influence on the ventilation performance compared with the accuracy of zone airflow sensors. Compared with the baseline case with zero errors, the largest deviation percentages could reach 16.90% and 94.32%, respectively, in terms of the Heating, Ventilation, and Air-Conditioning (HVAC) annual energy consumption and the Outdoor Air Ratio (OAR) when multiple key sensors suffer from normal error intensities simultaneously.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
On Building Predictive Digital Twin Incorporating Wave Predicting Capabilities: Case Study on UMaine Experimental Campaign - FOCAL
The response of floating wind turbines (FWT) are susceptible to stochastic wave variations. For the optimal operation of FWT, a comprehensive understanding of the phaseresolved wave dynamics and the consequential system response is crucial for real-time monitoring and control. A multi-variate, multi-step, long short term memory (MLSTM), a type of recurrent neural network (RNN) is used to capture complex system dynamics for real-time application. Results indicate that the integration of a wave prediction-reconstruction (WRP) model substantially enhances prediction accuracy by 50% on average relative to the baseline model. The improvement is consistent across various wave extremity and prediction horizons, thereby significantly broadening the scope for timely and precise predictive capabilities.
17 WIND ENERGY↗