Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Robust Parameter Design on Dual Stochastic Response Models With Constrained Bayesian Optimization

In engineering system design, minimizing the variations of the quality measurements while guaranteeing their overall quality up to certain levels, namely the robust parameter design (RPD), is crucial. Recent works have dealt with the design of a system whose response-control variables relationship is a deterministic function with a complex shape and function evaluation is expensive. In this work, we propose a Bayesian optimization method for the RPD of stochastic functions. Dual stochastic response models are carefully designed for stochastic functions. The heterogeneous variance of the sample mean is addressed by the predictive mean of the log variance surrogate model in a two-step approach. We establish an acquisition function that favors exploration across the feasible and optimality-improvable regions to effectively and efficiently solve the stochastic constrained optimization problem. Further, the performance of our proposed method is demonstrated by the extensive numerical and case studies. Note to Practitioners-Many manufacturing processes involve undesirable variations, which create variations in the final products. For example, many emerging manufacturing processes, such as nanomanufacturing, involve complex physical and chemical dynamics and transformation, creating variations in the manufacturing output. In such processes, it is crucial to design the manufacturing processes or products so that they have minimum variations in their quality. Meanwhile, it is also important to maintain the overall quality of the designed processes or products. Furthermore, acquiring data from many advanced manufacturing processes is often very costly, especially in the designing stage. In this work, we propose a data-driven method that automatically finds the best setting of manufacturing processes or products with the minimum variations of quality and a given constraint on the average quality satisfied. Our proposed method is used before conducting every experiment; It analyzes the historical data from previous experiments and provides a setting to be used in the next experiment. Our proposed method efficiently utilizes the historical data, and thus finds the best robust setting by conducting only a small number of experiments.

42 ENGINEERING↗
DOE OSTI2023

Stochastic transition in synchronized spiking nanooscillators

This work reports that synchronization of Mott material-based nanoscale coupled spiking oscillators can be drastically different from that in conventional harmonic oscillators. We investigated the synchronization of spiking nanooscillators mediated by thermal interactions due to the close physical proximity of the devices. Controlling the driving voltage enables in-phase 1:1 and 2:1 integer synchronization modes between neighboring oscillators. Transition between these two integer modes occurs through an unusual stochastic synchronization regime instead of the loss of spiking coherence. In the stochastic synchronization regime, random length spiking sequences belonging to the 1:1 and 2:1 integer modes are intermixed. The occurrence of this stochasticity is an important factor that must be taken into account in the design of large-scale spiking networks for hardware-level implementation of novel computational paradigms such as neuromorphic and stochastic computing.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2021

Stochastic Pricing Game for Aggregated Demand Response Considering Comfort Level

In recent years, demand response (DR) has been explored as a fundamental strategy for demand-side management due to its advantages in mediating intermittency of renewable energy generation, load shifting, etc. To engage customers in DR programs, several deterministic price-based DR strategies have been developed and implemented. However, the stochastic weather conditions and occupants' consumption behaviors often make the deterministic solution less robust to uncertainties. In this paper, with the consideration of the uncertainties, a stochastic Stackelberg game is proposed to model the price-demand negotiation between a distributed system operator and load aggregators, where the virtual battery constraints are extracted from the building thermostatically controlled loads (TCLs)‘ characteristics to guarantee comfortable TCLs' levels. Following the negotiation, a priority-based control method is used to allocate the optimal aggregated power DR profile at the building level and track the power signal. Several groups of experiments have demonstrated the effectiveness and robustness of the stochastic solutions.

Chen, Yang↗
DOE OSTI2021

Mechanisms of Dynamic Near-Wake Modulation of a Utility-Scale Wind Turbine

The current study uses large eddy simulations to investigate the transient response of a utility-scale wind turbine wake to dynamic changes in atmospheric and operational conditions, as observed in previous field-scale measurements. Most wind turbine wake investigations assume quasi-steady conditions, but real wind turbines operate in a highly stochastic atmosphere, and their operation (e.g. blade pitch, yaw angle) changes constantly in response. Furthermore, dynamic control strategies have been recently proposed to optimize wind farm power generation and longevity. Therefore, improved understanding of dynamic wake behaviours is essential. First, changes in blade pitch are investigated and the wake expansion response is found to display hysteresis as a result of flow inertia. The time scales of the wake response to different pitch rates are quantified. Next, changes in wind direction with different time scales are explored. Under short time scales, the wake deflection is in the opposite direction of that observed under quasi-steady conditions. Finally, yaw changes are implemented at different rates, and the maximum inverse wake deflection and time scale are quantified, showing a clear dependence on yaw rate. To gain further physical understanding of the mechanism behind the inverse wake deflection, the streamwise vorticity in different parts of the wake is quantified. The results of this study provide guidance for the design of advanced wake flow control algorithms. The lag in wake response observed for both blade pitch and yaw changes shows that proposed dynamic control strategies must implement turbine operational changes with a time scale of the order of the rotor time scale or slower.

flow-structure interactions↗
DOE OSTI2022

Designing Monte Carlo Simulation and an Optimal Machine Learning to Optimize and Model Space Missions

This paper investigates applying artificial intelligence (AI) algorithms to attitude control system of satellites to optimally tune the controller using high performance computing. This methodology is applied to the Virtual Telescope for X-ray Observation mission, which is a precise formation of two separate spacecraft observing multiple objects in the space in the X-ray domain. The mission is divided into phases based on the instrumentation and the mission goal. To reach an stable precise formation robust to stochastic slew and slew rate (i.e., Euler angles and angular velocities) in a minimal constrained time T , consumed energy of the attitude control system, denoted as E, and root-mean-square state error of attitude control system, denoted as e, are minimized. Monte-Carlo simulation is used for the sensitivity analysis of optimization and designing a controller. Deep neural networks (DNN), Gaussian processes (GP), and support vector regression (SVR) learn this optimization as a surrogate model, while their hyperparameters are optimized in a novel approach. THETA supercomputer at Argonne Leadership Computing Facility (ALCF) is used for optimizing the hyperparameters of DNN. The surrogate model meets the requirements of the mission, and it shows a better performance over the optimization and Monte-Carlo. The optimal DNN can satisfy the mission requirements e and T while reducing E for 90% compared to the other given methods.

42 ENGINEERING↗
DOE OSTI2020

Efficient Ensemble-Based Stochastic Gradient Methods for Optimization Under Geological Uncertainty

Ensemble-based stochastic gradient methods, such as the ensemble optimization (EnOpt) method, the simplex gradient (SG) method, and the stochastic simplex approximate gradient (StoSAG) method, approximate the gradient of an objective function using an ensemble of perturbed control vectors. These methods are increasingly used in solving reservoir optimization problems because they are not only easy to parallelize and couple with any simulator but also computationally more efficient than the conventional finite-difference method for gradient calculations. In this work, we show that EnOpt may fail to achieve sufficient improvement of the objective function when the differences between the objective function values of perturbed control variables and their ensemble mean are large. On the basis of the comparison of EnOpt and SG, we propose a hybrid gradient of EnOpt and SG to save on the computational cost of SG. We also suggest practical ways to reduce the computational cost of EnOpt and StoSAG by approximating the objective function values of unperturbed control variables using the values of perturbed ones. We first demonstrate the performance of our improved ensemble schemes using a benchmark problem. Results show that the proposed gradients saved about 30–50% of the computational cost of the same optimization by using EnOpt, SG, and StoSAG. As a real application, we consider pressure management in carbon storage reservoirs, for which brine extraction wells need to be optimally placed to reduce reservoir pressure buildup while maximizing the net present value. Results show that our improved schemes reduce the computational cost significantly.

58 GEOSCIENCES↗
DOE OSTI2021

A Multi-Stage Stochastic Risk Assessment With Markovian Representation of Renewable Power

Probabilistic forecasts provide a distribution of possible outputs and so can capture the uncertainty and variability of Variable Renewable Energy (VRE). However, taking advantage of uncertainty information has practical challenges that make it difficult to integrate probabilistic forecasting into control room decision-making. This paper proposes a novel use-case for probabilistic forecasts by incorporating them into the hour-ahead operations for situational awareness via a risk-averse multi-stage stochastic program. We employ a Markovian representation of the probabilistic forecasts that enables the formulation of the multi-stage problem and avoids a scenario generation phase. We test the model on a realistically sized system to assess risk and showcase the capability of using probabilistic renewable forecast as input to produce probabilistic output forecasts of future system states. The results show that the model can capture time consistency in the reserves and Area Control Error (ACE) forecast. The solution times are adequate for risk profiling in hour-ahead timescales.

forecasting↗
DOE OSTI2024

True random number generation using the spin crossover in LaCoO 3

While digital computers rely on software-generated pseudo-random number generators, hardware-based true random number generators (TRNGs), which employ the natural physics of the underlying hardware, provide true stochasticity, and power and area efficiency. Research into TRNGs has extensively relied on the unpredictability in phase transitions, but such phase transitions are difficult to control given their often abrupt and narrow parameter ranges (e.g., occurring in a small temperature window). Here we demonstrate a TRNG based on self-oscillations in LaCoO 3 that is electrically biased within its spin crossover regime. The LaCoO 3 TRNG passes all standard tests of true stochasticity and uses only half the number of components compared to prior TRNGs. Assisted by phase field modeling, we show how spin crossovers are fundamentally better in producing true stochasticity compared to traditional phase transitions. As a validation, by probabilistically solving the NP-hard max-cut problem in a memristor crossbar array using our TRNG as a source of the required stochasticity, we demonstrate solution quality exceeding that using software-generated randomness.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

MASTODON: An Open-Source Software for Seismic Analysis and Risk Assessment of Critical Infrastructure

Seismic analysis and risk assessment of safety-critical infrastructure like hospitals, nuclear power plants, dams, and facilities handling radioactive materials involve computationally intensive numerical models and coupled multiphysics scenarios. They are also performed in a strict regulatory environment that requires high software quality assurance standards, and in the case of safety-related nuclear facilities, a conformance to the American Society of Mechanical Engineers Nuclear Quality Assurance (NQA-1) standard. This paper introduces the open-source finite-element software, MASTODON (Multi-hazard Analysis of Stochastic Time-Domain Phenomena), which implements state-of-the-art seismic analysis and risk assessment tools in a quality-controlled environment. MASTODON is built on MOOSE (Multi-physics Object-Oriented Simulation Environment), which is a highly parallelizable, NQA-1 conforming, coupled multiphysics, finite-element framework developed at Idaho National Laboratory. MASTODON is capable of fault rupture and source-to-site wave propagation using the domain reduction method, nonlinear site response, and soil-structure interaction analysis, implicit and explicit time integration, automated stochastic simulations, and seismic probabilistic risk assessment. When coupled with other MOOSE applications, MASTODON can also solve strongly and weakly coupled multiphysics problems. This paper presents a summary of the capabilities of MASTODON and some demonstrative examples.

42 ENGINEERING↗
DOE OSTI2020

Adaptive Recovery Model: Designing Systems for Testing Tracing and Vaccination to Support COVID-19 Recovery Planning.

This report documents a new approach to designing disease control policies that allocate scarce testing, contact tracing, and vaccination resources to better control community transmission of COVID19 or similar diseases. The Adaptive Recovery Model (ARM) combines a deterministic compartmental disease model with a stochastic network disease propagation model to enable us to simulate COVID-19 community spread through the lens of two complementary modeling motifs. ARM contact networks are derived from cell-phone location data that have been anonymized and interpreted as individual arrivals to specic public locations. Modeling disease spread over these networks allows us to identify locations within communities conducive to rapid disease spread. ARM applies this model- and data-derived abstractions of community transmission to evaluate the effectiveness of disease control measures including targeted social distancing, contact tracing, testing and vaccination. The architecture of ARM provides a unique capacity to help decision makers understand how best to deploy scarce testing, tracing and vaccination resources to minimize disease-spread potential in a community. This document details the novel mathematical formulations underlying ARM, presents a dynamical stability analysis of the deterministic model components, a sensitivity analysis of control parameters and network structure, and summarizes a process for deriving contact networks from cell-phone location data. An example use case steps through applying ARM to evaluate three targeted social distancing policies using Bernalillo County, New Mexico as an exemplar test locale. This step-by-step analysis demonstrates how ARM can be used to measure the relative performance of competing public health policies. Initial scenario tests of ARM shows that ARMs design focus on resource utilization rather than simple incidence prediction can provide decision makers with additional quantitative guidance for managing ongoing public health emergencies and planning future responses.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Controlling the breakdown delay time in pulsed gas discharge

Abstract In experiment and 2D3V PIC MCC simulations, the breakdown development in a pulsed discharge in helium is studied for U = 3.2 kV and 10 kV and P = 100 Torr. The breakdown process is found to have a stochastic nature, and the electron avalanche develops in different experimental and simulation runs with time delays ranging from 0.3 to 8 μ s. Nevertheless our experiments demonstrate that the breakdown delay time distribution can be controlled with a change of the pulse discharge frequency. The simulation results show that the breakdown process can be distinguished in three stages with (a) the ionization by seed electrons, (b) the ions drift to the cathode and (c) the enhanced ionization within the cathode sheath by the electrons emitted from the cathode. The effects of variation of seed electron concentrations, voltage rise times, voltage amplitudes and ion–electron emission coefficients on the breakdown development in the pulsed gas discharge are reported.

Schweigert, I. V. (ORCID:0000000223641228)↗
DOE OSTI2025

Uncontrolled Learning: Codesign of Neuromorphic Hardware Topology for Neuromorphic Algorithms

Neuromorphic computing has the potential to revolutionize future technologies and our understanding of intelligence, yet it remains challenging to realize in practice. The learning-from-mistakes algorithm, inspired by the brain's simple learning rules of inhibition and pruning, is one of the few brain-like training methods. This algorithm is implemented in neuromorphic memristive hardware through a codesign process that evaluates essential hardware trade-offs. While the algorithm effectively trains small networks as binary classifiers and perceptrons, performance declines significantly with increasing network size unless the hardware is tailored to the algorithm. This work investigates the trade-offs between depth, controllability, and capacity—the number of learnable patterns—in neuromorphic hardware. This highlights the importance of topology and governing equations, providing theoretical tools to evaluate a device's computational capacity based on its measurements and circuit structure. The findings show that breaking neural network symmetry enhances both controllability and capacity. Additionally, by pruning the circuit, neuromorphic algorithms in all-memristive circuits can utilize stochastic resources to create local contrasts in network weights. Through combined experimental and simulation efforts, the parameters are identified that enable networks to exhibit emergent intelligence from simple rules, advancing the potential of neuromorphic computing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

De Sitter diagrammar and the resummation of time

Light scalars in inflationary spacetimes suffer from logarithmic infrared divergences at every order in perturbation theory. This corresponds to the scalar field values in different Hubble patches undergoing a random walk of quantum fluctuations, leading to a simple toy “landscape” on superhorizon scales, in which we can explore questions relevant to eternal inflation. However, for a sufficiently long period of inflation, the infrared divergences appear to spoil computability. Some form of renormalization group approach is thus motivated to resum the log divergences of conformal time. Such a resummation may provide insight into De Sitter holography. We present here a novel diagrammatic analysis of these infrared divergences and their resummation. Basic graph theory observations and momen- tum power counting for the in-in propagators allow a simple and insightful determination of the leading-log contributions. One thus sees diagrammatically how the superhorizon sector consists of a semiclassical theory with quantum noise evolved by a first-order, interacting classical equation of motion. This rigorously leads to the “Stochastic Inflation” ansatz developed by Starobinsky to cure the scalar infrared pathology nonperturbatively. Our approach is a controlled approximation of the underlying quantum field theory and is systematically improvable.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Enabling scientific machine learning in MOOSE using Libtorch

A neural-network-based machine learning interface has been developed for the Multiphysics Object-Oriented Simulation Environment (MOOSE). The interface relies on Libtorch, the C++ front-end of PyTorch, and enables an online interaction between modern machine learning algorithms and all the existing simulation, modeling, and analysis processes available in MOOSE. New capabilities in MOOSE include the native generation and training of artificial neural networks together with options to load pretrained neural networks in TorchScript format. Furthermore, the MOOSE stochastic tools module (MOOSE-STM) has been enhanced with neural network-based surrogate and reduced-order model generation options for efficient stochastic analyses. Lastly, a reinforcement learning capability has been added to MOOSE-STM for the interactive control and optimization of complex multiphysics problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Enhancing Distribution System Resilience: A First-Order Meta-RL Algorithm for Critical Load Restoration

The increasing frequency of extreme events and the integration of distributed energy resources (DERs) into modern grids have elevated the need for resilient and efficient critical load restoration strategies in distribution systems. However, the stochastic nature of renewable DERs, limited energy resource availability and the intricate nonlinearities inherent in complex grid control problem make the problem challenging. Although reinforcement learning (RL) and warm-start RL methods have shown promising results, their performance often falls short in rapidly adapting to new, unseen situations and typically requires exhaustive problem-specific tuning. To address these gaps, we propose a First-Order Meta-based RL (FOM-RL) algorithm within an online framework for adaptive and robust critical load restoration. By harnessing local DERs as the enabling technology, FOM-RL allows the RL agent to swiftly adapt to new unseen scenarios by leveraging previously acquired knowledge of different tasks. Experimental results provide evidence that proposed algorithm learns more efficiently and showcases generalization capabilities across diverse set of operational scenarios. Moreover, a rigorous theoretical analysis yields a tight sublinear regret bound, sensitive to temporal variability, with a task-averaged optimality gap bounded by O(VM+D*/(Tsquare root(M))). These results suggest that optimality improves with task similarity and an increased number of tasks M, reaffirming the efficacy and scalability of the proposed approach in addressing the complexities of critical load restoration in distribution systems.

complexity theory↗
DOE OSTI2021

Differential structure and functional gene response to geochemistry associated with the suspended and attached shallow aquifer microbiomes from the Illinois Basin, IL

Despite the clear ecological significance of the microbiomes inhabiting groundwater and connected ecosystems, our current understanding of their habitats, functionality, and the ecological processes controlling their assembly have been limited. In this study, an efficient pipeline combining geochemistry, high-throughput Fluidigm TM functional gene amplification and sequencing was developed to analyze the suspended and attached microbial communities inhabiting five groundwater monitoring wells in the Illinois Basin, USA. The dominant taxa in the suspended and the attached microbial communities exhibited significantly different spatial and temporal changes in both alpha- and beta-diversity. Further analyses of representative functional genes affiliated with N 2 fixation (nifH), methane oxidation (pmoA), and sulfate reduction (dsrB, and aprA), suggested functional redundancy within the shallow aquifer microbiomes. While more diversified functional gene taxa were observed for the suspended microbial communities than the attached ones except for pmoA, different levels of changes over time and space were observed between these functional genes. Notably, deterministic and stochastic ecological processes shaped the assembly of microbial communities and functional gene reservoirs differently. While homogenous selection was the prevailing process controlling assembly of microbial communities, the neutral processes (e.g., dispersal limitation, drift and others) were more important for the functional genes. The results suggest complex and changing shallow aquifer microbiomes, whose functionality and assembly vary even between the spatially proximate habitats and fractions. As a result, this research underscored the importance to include all the interface components for a more holistic understanding of the biogeochemical processes in aquifer ecosystems, which is also instructive for practical applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Optimal Control of Differentially Private EV Charging: A Scalable Learning Approach Under Uncertainty

Internet of Things (IoT)-enabled electric vehicles (IoEVs) enable intelligent charging coordination that accounts for grid congestion. However, increased data exchange raises privacy concerns, as charging patterns can reveal sensitive driver behavior to grid operators. Here, we propose a differentially private (DP) EV charging framework that enables coordinated control while protecting driver data with theoretical privacy guarantees. Nevertheless, integrating DP inevitably introduces uncertainty into the control strategy for EVs, which can lead to infeasible solutions. To tackle this challenge, we develop a feasible and scalable control algorithm based on constrained reinforcement learning (CRL) and convex hulls. While our framework is designed to handle the uncertainty introduced by DP, it is general and also applicable to other sources of uncertainty in EV charging, such as the stochastic nature of driver behavior and renewable variability. This ensures feasible and privacy-preserving coordination of EV charging at scale. Our method constructs convex hulls within the action space to guarantee feasibility under stochastic constraints and incorporates constraint reduction techniques to improve scalability. Case studies based on IEEE benchmark systems demonstrate that the proposed approach effectively balances feasibility under uncertainty, scalability, and privacy in large-scale EV charging control.

Engineering - Power transmission and distribution↗