Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Priors on red galaxy stochasticity from hybrid effective field theory

ABSTRACT We investigate the stochastic properties of typical red galaxy samples in a controlled numerical environment. We use halo occupation distribution (HOD) modelling to create mock realizations of three separate bright red galaxy samples consistent with data sets used for clustering and lensing analyses in modern galaxy surveys. Second-order Hybrid Effective Field Theory (HEFT) is used as a field-level forward model to describe the full statistical distribution of these tracer samples, and their stochastic power spectra are directly measured and compared to the Poisson shot-noise prediction. While all of the galaxy samples we consider are hosted within haloes with sub-Poisson stochasticity, we observe that the galaxy samples themselves possess stochasticities that range from sub-Poisson to super-Poisson, in agreement with predictions from the halo model. As an application of our methodology, we place priors on the expected degree of non-Poisson stochasticity in cosmological analyses using such samples. We expect these priors will be useful in reducing the complexity of the full parameter space for future analyses using second-order Lagrangian bias models. More generally, the techniques outlined here present the first application of HEFT methods to characterize models of the galaxy–halo connection at the field level, revealing new connections between once-disparate modelling frameworks.

79 ASTRONOMY AND ASTROPHYSICS↗

Adaptive anomaly detection for identifying attacks in cyber-physical systems: A systematic literature review

Modern cyberattacks in cyber-physical systems (CPS) rapidly evolve and cannot be deterred effectively with most current methods, which focus on characterizing past threats. Adaptive anomaly detection (AAD) is among the most promising techniques to detect evolving cyberattacks, with an emphasis on fast data processing and model adaptation. AAD has been researched extensively; however, to the best of our knowledge, our work is the first systematic literature review (SLR) on current research in this field. We present a comprehensive SLR, gathering 397 relevant papers and systematically analyzing 65 of them (47 research and 18 survey papers) on AAD in CPS from 2013 to November 2023. We introduce a novel taxonomy considering attack types, CPS application, learning paradigm, data management, and algorithms. Our findings show that most studies addressed either model adaptation or data processing, but rarely both simultaneously. This indicates a research gap in fully adaptive solutions. We also categorize algorithms, datasets, and attack characteristics, and summarize strengths and weaknesses across the literature. Our review provides a structured and accessible reference for researchers and practitioners, offering insights into key trends and highlighting limitations in current approaches. Finally, we outline several future research directions, including the need for integrated real-time processing and adaptive learning, explainability, and uncertainty quantification in AAD for CPS.

Adaptation↗

Multi-Agent Control Planes for Quantum Networks: A Scalable Architecture for Autonomous Quantum Internet Management

Quantum networks are expected to enable distributed quantum computing, secure communication, and global entanglement distribution. However, operating such networks presents significant challenges, including stochastic quantum processes, fragile entanglement resources, dynamic topology, and cross-layer control requirements. Current quantum network control architectures largely rely on centralized or hierarchical controllers inspired by classical software-defined networking (SDN). While effective for small testbeds, these approaches face scalability, latency, and reliability limitations as quantum networks grow. This paper proposes a multi-agent control plane architecture for quantum networks. In this design, intelligent software agents operate at quantum nodes, repeaters, and orchestration layers, collectively managing entanglement generation, routing, purification, and scheduling. The distributed intelligence of the agent system allows the network to adapt dynamically to quantum hardware variability and environmental noise. We argue that multi-agent systems provide significant advantages over centralized control approaches, including scalability, resilience, local autonomy, and real-time adaptation. The paper discusses architectural design principles, agent coordination mechanisms, and research challenges in deploying multi-agent control planes for the emerging quantum Internet.

Alnajjar, Anees [ORNL] (ORCID:0000000237101601)↗

Demand response event simulator and risk-aware bidding tool for industrial customers

Incentive Based Demand Response (IBDR) program participation delivers financial benefits to the consumers and resiliency benefits to the electricity grid. Effectively participating in these programs as an industrial consumer requires bidding strategies that balance financial risk with operational constraints. Existing bidding tools tend not to fully incorporate stochastic IBDR event modeling, program specific baseline and payment/penalty calculations, or demand reduction process control schemes that account for the cascading impacts of shutdown in complex facilities. Here, this work presents an IBDR event simulator and risk-aware bidding framework tool integrating three key components: a flexible, parameterized demand response event generator that rigorously accounts for program structures and stochasticity, a demand response operational simulation model that generates explicit control strategies for load reduction, and a Monte Carlo simulator to evaluate financial risk for varied capacity bids. A case study at a wastewater treatment plant participating in PG&E's Capacity Bidding Program demonstrates the framework's utility. In the peak capacity price month of August, optimal bidding by the wastewater treatment plant nets a mean IBDR benefit of $101,000 (67% of the August electricity bill) with 0.4% probability of a financial loss. This framework enables industrial operators to make informed bidding decisions, negotiate better program terms with demand response load aggregators, and analyze energy flexibility investments at their facilities. Ultimately, this work reduces participation barriers in IBDR programs and supports the broader goal of enhancing grid reliability and renewable energy integration.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Unified, Geometric Framework for Nonequilibrium Protocol Optimization

Controlling thermodynamic cycles to minimize the dissipated heat is a long-standing goal in thermodynamics, and more recently, a central challenge in stochastic thermodynamics for nanoscale systems. Here, we introduce a theoretical and computational framework for optimizing nonequilibrium control protocols that can transform a system between two distributions in a minimally dissipative fashion. These protocols optimally transport a system along paths through the space of probability distributions that minimize the dissipative cost of a transformation. Furthermore, we show that the thermodynamic metric—determined via a linear response approach—can be directly derived from the same objective function that is optimized in the optimal transport problem, thus providing a unified perspective on thermodynamic geometries. As a result, we investigate this unified geometric framework in two model systems and observe that our procedure for optimizing control protocols is robust beyond linear response.

36 MATERIALS SCIENCE↗

Utilizing computer vision and artificial intelligence algorithms to predict and design the mechanical compression response of direct ink write 3D printed foam replacement structures

Additive Manufacturing (AM) of porous polymeric materials, such as foams, recently became a topic of intensive research due their unique combination of low density, impressive mechanical properties, and stress dissipation capabilities. Conventional methods for fabricating foams rely on complex and stochastic processes, making it challenging to achieve precise architectural control of structured porosity. In contrast, AM provides access to a wide range of printable materials, where precise spatial control over structured porosity can be modulated during the fabrication process enabling the production of foam replacement structures (FRS). Current approaches for designing FRS are based on intuitive understanding of their properties or an extensive number of finite element method (FEM) simulations. These approaches, however, are computationally expensive and time consuming. As such, in this work, we present a novel methodology for determining the mechanical compression response of direct ink write (DIW) 3D printed FRS using a simple cross-sectional image. By obtaining measurement data for a relatively small number of samples, an artificial neural network (ANN) was trained, and a computer vision algorithm was used to make inferences about foam compression characteristics from a single cross-sectional image. Finally, a genetic algorithm (GA) was used to solve the inverse design problem, generating the AM printing parameters that an engineer should use to achieve a desired compression response from a DIW printed FRS. The methods developed herein present an avenue for entirely autonomous design and analysis of additively manufactured structures using artificial intelligence.

36 MATERIALS SCIENCE↗

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗

H ∞ Control for Energy Dispatch in Autonomous Nanogrid With Communication Delays

This paper proposes an optimal controller and estimator for energy dispatch to balance the power supply and demand considering communication delays. The proposed algorithm involves modeling an autonomous nanogrid (ANG) consisting of distributed energy resources, energy storage systems, loads, an $H$ ∞ controller with a reference power modulation technique, and a state estimator. The ANG was developed to express the dynamic supply-demand energy balance of a nanogird system. Reference power modulation was designed to generate the desired ESS power based on the imbalanced energy. Random communication delays were modeled using a stochastic variable satisfying the Bernoulli random binary distribution. The optimal $H$ ∞ controller and estimator were developed using a linear matrix inequality approach to exponentially stabilize the closed-loop system. Simulations were performed using real daily demand forecasts obtained from the Korea Meteorological Administration to demonstrate the effectiveness of the proposed real-time optimization algorithm.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Real Time Predictive and Adaptive Hybrid Powertrain Control Development via Neuroevolution

The real-time application of powertrain-based predictive energy management (PrEM) brings the prospect of additional energy savings for hybrid powertrains. Torque split optimal control methodologies have been a focus in the automotive industry and academia for many years. Their real-time application in modern vehicles is, however, still lagging behind. While conventional exact and non-exact optimal control techniques such as Dynamic Programming and Model Predictive Control have been demonstrated, they suffer from the curse of dimensionality and quickly display limitations with high system complexity and highly stochastic environment operation. This paper demonstrates that Neuroevolution associated drive cycle classification algorithms can infer optimal control strategies for any system complexity and environment, hence streamlining and speeding up the control development process. Neuroevolution also circumvents the integration of low fidelity online plant models, further avoiding prohibitive embedded computing requirements and fidelity loss. This brings the prospect of optimal control to complex multi-physics system applications. The methodology presented here covers the development of the drive cycles used to train and validate the neurocontrollers and classifiers, as well as the application of the Neuroevolution process.

33 ADVANCED PROPULSION SYSTEMS↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING↗

Photoinduced correlations in stochastic dynamics of a solid-state ionic conductor

Photoexcitation by ultrashort laser pulses plays a crucial role in controlling reaction pathways, creating nonequilibrium material properties, and probing complex molecular dynamics. The photoresponse following a laser pulse is generally nonidentical between exposures due to spatiotemporal fluctuations or the stochastic nature of dynamical pathways. However, most ultrafast pump-probe experiments struggle to distinguish intrinsic sample fluctuations from extrinsic apparatus noise, often missing deviations from the averaged response. Leveraging the stability and high photon flux of time-resolved X-ray micro-diffraction at a synchrotron, we characterized stochastic photoinduced dynamics in a solid-state ionic conductor. By analyzing temporal evolutions of the lattice parameter of a single grain, we found that shot-to-shot fluctuations are not independent. Instead, correlations exist between nonequilibrium lattice trajectories following adjacent shots, with a characteristic correlation length of approximately 1500 shots, corresponding to an energy barrier of 0.4 ± 0.1 eV, close to the activation energy of lithium-ion diffusion.

36 MATERIALS SCIENCE↗

A Novel Deep Reinforcement Learning Approach to Traffic Signal Control with Connected Vehicles

The advent of connected vehicle (CV) technology offers new possibilities for a revolution in future transportation systems. With the availability of real-time traffic data from CVs, it is possible to more effectively optimize traffic signals to reduce congestion, increase fuel efficiency, and enhance road safety. The success of CV-based signal control depends on an accurate and computationally efficient model that accounts for the stochastic and nonlinear nature of the traffic flow. Without the necessity of prior knowledge of the traffic system’s model architecture, reinforcement learning (RL) is a promising tool to acquire the control policy through observing the transition of the traffic states. In this paper, we propose a novel data-driven traffic signal control method that leverages the latest in deep learning and reinforcement learning techniques. By incorporating a compressed representation of the traffic states, the proposed method overcomes the limitations of the existing methods in defining the action space to include more practical and flexible signal phases. The simulation results demonstrate the convergence and robust performance of the proposed method against several existing benchmark methods in terms of average vehicle speeds, queue length, wait time, and traffic density.

42 ENGINEERING↗

Volt-Var Curve Reactive Power Control Requirements and Risks for Feeders with Distributed Roof-Top Photovoltaic Systems

The benefits and risks associated with Volt-Var Curve (VVC) control for management of voltages in electric feeders with distributed, roof-top photovoltaic (PV) can be defined using a stochastic hosting capacity analysis methodology. Although past work showed that a PV inverter’s reactive power can improve grid voltages for large PV installations, this study adds to the past research by evaluating the control method’s impact (both good and bad) when deployed throughout the feeder within small, distributed PV systems. The stochastic hosting capacity simulation effort iterated through hundreds of load and PV generation scenarios and various control types. The simulations also tested the impact of VVCs with tampered settings to understand the potential risks associated with a cyber-attack on all of the PV inverters scattered throughout a feeder. The simulation effort found that the VVC can have an insignificant role in managing the voltage when deployed in distributed roof-top PV inverters. This type of integration strategy will result in little to no harm when subjected to a successful cyber-attack that alters the VVC settings.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Stochastic boundary condition effects on supersonic leading edge blowing

The present manuscript studies the robustness of leading edge blowing for active control of the upstream bow shock and overall aerothermal characteristics of a supersonic airfoil subject to variability in the injection conditions. The injection boundary conditions were considered stochastic and their randomness was propagated to the flow topology and aerothermal quantities of interest by means of non-intrusive Polynomial Chaos Expansions. The evaluations needed to build these expansions were carried out via steady two-dimensional Reynolds-Averaged Navier Stokes simulations. Two different injection port sizes were considered, with the smallest promoting a Coanda effect that gives rise to non-symmetric flow topologies. The uncertain boundary conditions lead to significant variations in the flow topology, particularly at the injection exit and the bow shock position, with variations of up to 75% of the nominal value. Here this study identifies the key operating conditions to ensure the optimal application of leading-edge injection for active control of supersonic airfoils.

97 MATHEMATICS AND COMPUTING↗

Stochasticity in microbiology: managing unpredictability to reach the Sustainable Development Goals

Pure (single) cultures of microorganisms and mixed microbial communities (microbiomes) have been important for centuries in providing renewable energy, clean water and food products to human society and will continue to play a crucial role to pursue the Sustainable Development Goals. To use microorganisms effectively, microbial engineered processes require adequate control. Microbial communities are shaped by manageable deterministic processes, but also by stochastic processes, which can promote unforeseeable variations and adaptations. Here, we highlight the impact of stochasticity in single culture and microbiome engineering. First, we discuss the concepts and mechanisms of stochasticity in relation to microbial ecology of single cultures and microbiomes. Second, we discuss the consequences of stochasticity in relation to process performance and human health, which are reflected in key disadvantages and important opportunities. Third, we propose a suitable decision tool to deal with stochasticity in which monitoring of stochasticity and setting the boundaries of stochasticity by regulators are central aspects. Stochasticity may give rise to some risks, such as the presence of pathogens in microbiomes. We argue here that by taking the necessary precautions and through clever monitoring and interpretation, these risks can be mitigated.

59 BASIC BIOLOGICAL SCIENCES↗

Impact of model predictive control-enabled home energy management on large-scale distribution systems with photovoltaics

Residential customers use more than one-quarter of the electricity in the world. Optimally managing home energy consumption is an effective way of easing the operational challenges facing the electric grid with increasing solar photovoltaics (PV). This paper studies the impact of the future proliferation of home energy management systems (HEMS) in the presence of PV on large-scale distribution systems. First, we present a stochastic HEMS model that minimizes residential customers' thermal discomfort and energy costs under uncertainty. The HEMS model schedules the optimal operations of residential appliances in the presence of PV within a mixed-integer linear programming-based model predictive control framework that links the proposed HEMS to a quasi-steady-state time-series simulation tool. Additionally, extensive simulations are conducted for a stand-alone residential home using two tariff structures and for 1977 homes on an 8,500-node distribution feeder. Simulation results quantify the impact of the future proliferation of HEMS on the large-scale distribution system with PV.

14 SOLAR ENERGY↗

Analysis of leading edge protection application on wind turbine performance through energy and power decomposition approaches

Abstract Wind power production is driven by, and varies with, the stochastic yet uncontrollable wind and environmental inputs. To compare a wind turbine's performance, a direct comparison on power outputs is always confounded by the stochastic effect of weather inputs. It is therefore crucial to control for the weather and environmental influence. Toward that objective, our study proposes an energy decomposition approach. We start with comparing the change in the total energy production and refer to the change in total energy as delta energy. On this delta energy, we apply our decomposition method, which is to separate the portion of energy change due to weather effects from that due to the turbine itself. We derive a set of mathematical relationships allowing us to perform this decomposition and examine the credibility and robustness of the proposed decomposition approach through extensive cross‐validation and case studies. We then apply the decomposition approach to Supervisory Control and Data Acquisition data associated with several wind turbines to which leading‐edge protection was carried out. Our study shows that the leading‐edge protection applied on blades may cause a small decline to the power production efficiency in the short term, although we expect the leading‐edge protection to benefit the blade's reliability in the long term.

17 WIND ENERGY↗