Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Data-Consistent Inversion for Stochastic Input-to-Output Maps

Data-consistent inversion is a recently developed measure-theoretic framework for solving a stochastic inverse problem involving models of physical systems. The goal is to construct a probability measure on model inputs (i.e., parameters of interest) whose associated push-forward measure matches (i.e., is consistent with) a probability measure on the observable outputs of the model (i.e., quantities of interest). Previous implementations required the map from parameters of interest to quantities of interest to be deterministic. This work generalizes this framework for maps that are stochastic, i.e., contain uncertainties and variation not explainable by variations in uncertain parameters of interest. Generalizations of previous theorems of existence, uniqueness, and stability of the data-consistent solution are provided while new theoretical results address the stability of marginals on parameters of interest. A notable aspect of the algorithmic generalization is the ability to query the solution to generate independent identically distributed samples of the parameters of interest without requiring knowledge of the so-called stochastic parameters. This work therefore extends the applicability of the data-consistent inversion framework to a much wider class of problems. This includes those based on purely experimental and field data where only a subset of conditions are either controllable or can be documented between experiments while the underlying physics, measurement errors, and any additional covariates are either uncertain or not accounted for by the researcher. Finally, numerical examples demonstrate application of this approach to systems with stochastic sources of uncertainties embedded within the modeling of a system and a numerical diagnostic is summarized that is useful for determining if a key assumption is verified among competing choices of stochastic maps.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Correlation Between Microscopic Current Fluctuations Observed at Ultra-Microelectrodes and Macroscopic Bulk Electrolysis Performance in Redox-Active Microemulsions

Microemulsions (μEs) have been proposed as redox flow battery (RFB) electrolytes that maximize ionic conductivity and charge capacity by synergizing two immiscible phases. However, charge transfer during electrolysis in μEs is poorly understood. Here, we show that ultramicroelectrode electrolysis of ferrocene-loaded μEs –20%, 60%, and 90% water - reveals stochastic current fluctuations. These are differentiated in the scanning electrochemical microscopy (SECM) geometry, where power spectral density analysis showed distinct changes in the frequency contributions. SECM in the substrate generation-tip collection mode showed that fluctuations arise under mass-transfer control. Significant differences in the diffusion coefficient of ferrocene species were deducted from SECM approach curves, suggesting phase transfer behavior. Using bulk electrolysis, we calculated the charge accessibility and cycling behavior in the μEs. A decrease in the stochastic behavior of the μEs seems to correlate to a higher accessibility and cycling performance, with the 90% water μE displaying the best reversibility and the 60% the lowest. Altogether, these results suggest that Marangoni-type convection driven by concentration gradients and/or μE restructuring during charge transfer play a role in the electrochemical performance of μEs. This presents opportunities for screening and diagnosing the performance of these emerging RFB electrolytes.

25 ENERGY STORAGE↗
DOE OSTI2023

Evaluating the Risk of Enabling Energy Storage Systems to Provide Multiple Services

Battery energy storage systems (BESS) are emerging as a promising, versatile technology for modern power grids due to their inherent distributed nature, their ability to inject bidirectional power flows and to provide multiple grid services. With the proliferation of intermittent renewable energy resources, the BESS procurement is also expected to increase, thereby creating systematic and strategic opportunities for BESS to various revenue streams for providing multiple grid services. Utilizing a co-simulation architecture, this work presents evaluation framework for enabling Utility-scale BESS with simultaneous provision of multiple services. The proposed framework is implemented on a real-life feeder modeled in GridLAB-D, leveraging multi-service grid support. A Risk-Aware control strategy is also implemented in this work that that takes into account the uncertain nature of some of the stochastic services and ensures the BESS to deliver their service commitments. This promotes overall grid reliability and encourages BESS implementation through the revenue streams from providing multiple grid services.

Theisen, John↗
DOE OSTI2024

Tunneling current-controlled spin states in few-layer van der Waals magnets

Abstract Effective control of magnetic phases in two-dimensional magnets would constitute crucial progress in spintronics, holding great potential for future computing technologies. Here, we report a new approach of leveraging tunneling current as a tool for controlling spin states in CrI 3 . We reveal that a tunneling current can deterministically switch between spin-parallel and spin-antiparallel states in few-layer CrI 3 , depending on the polarity and amplitude of the current. We propose a mechanism involving nonequilibrium spin accumulation in the graphene electrodes in contact with the CrI 3 layers. We further demonstrate tunneling current-tunable stochastic switching between multiple spin states of the CrI 3 tunnel devices, which goes beyond conventional bi-stable stochastic magnetic tunnel junctions and has not been documented in two-dimensional magnets. Our findings not only address the existing knowledge gap concerning the influence of tunneling currents in controlling the magnetism in two-dimensional magnets, but also unlock possibilities for energy-efficient probabilistic and neuromorphic computing.

Science & Technology - Other Topics↗
DOE OSTI2020

Stochastic DC optimal power flow with reserve saturation

We propose an optimization framework for stochastic optimal power flow with uncertain loads and renewable generator capacity. Our model follows previous work in assuming that generator outputs respond to load imbalances according to an affine control policy, but introduces a model of saturation of generator reserves by assuming that when a generator’s target level hits its limit, it abandons the affine policy and produces at that limit. This is a particularly interesting feature in models where wind power plants, which have uncertain upper generation limits, are scheduled to provide reserves to balance load fluctuations. Here, the resulting model is a nonsmooth nonconvex two-stage stochastic program, and we use a stochastic approximation method to find stationary solutions to a smooth approximation. Computational results on 6-bus and 118-bus test instances demonstrate that by considering the effects of saturation, our model can yield solutions with lower expected generation costs (at the same target line violation probability level) than those obtained from a model that enforces the affine policy to stay within generator limits with high probability.

17 WIND ENERGY↗
DOE OSTI2020

Generation and representation of synthetic smart meter data

Advanced energy algorithms running at big-data scale will be necessary to identify, realize, and verify energy savings to meet government and utility goals of building energy efficiency. Any algorithm must be well characterized and validated before it is trusted to run at these scales. Smart meter data from real buildings will ultimately be required for the development, testing, and validation of these energy algorithms and processes. However, for initial development and testing, smart meter data are difficult to work with due to privacy restrictions, noise from unknown sources, data accessibility, and other concerns which can complicate algorithm development and validation. This paper describes a new methodology to generate synthetic smart meter data of electricity use in buildings using detailed building energy modeling, which aims to capture the variability and stochastics of real energy use in buildings. The methodology can create datasets tailored to represent specific scenarios with known truth and controllable amounts of synthetic noise. Knowledge of ground truth also allows the development and validation of enhanced processes which leverage building metadata, such as building type or size (floor area), in addition to smart meter data. The methodology described in this paper includes the key influencing factors of real-world building energy use including weather data, occupant-driven loads, building operation and maintenance practices, and special events. Data formats to support workflows leveraging both synthetic meter data and associated metadata are proposed and discussed. Finally, example use cases of the synthetic meter data are described to illustrate potential applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Projective Integral Updates for High-Dimensional Variational Inference

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing model variations that remain consistent with training data enables more robust predictions by reducing parameter sensitivity. This work introduces a fixed-point optimization for variational inference that is applicable when every feasible log density can be expressed as a linear combination of functions from a given basis. In such cases, the optimizer becomes a fixed-point of projective integral updates. When the basis spans univariate quadratics in each parameter, the feasible distributions are Gaussian mean-fields and the projective integral updates yield quasi-Newton variational Bayes (QNVB). Other bases and updates are also possible. Since these updates require high-dimensional integration, this work begins by proposing an efficient quasirandom sequence of quadratures for mean-field distributions. Each iterate of the sequence contains two evaluation points that combine to correctly integrate all univariate quadratic functions and, if the mean-field factors are symmetric, all univariate cubics. More importantly, averaging results over short subsequences achieves periodic exactness on a much larger space of multivariate polynomials of quadratic total degree. The corresponding variational updates require four loss evaluations with standard (not second-order) backpropagation to eliminate error terms from over half of all multivariate quadratic basis functions. Furthermore, this integration technique is motivated by first proposing stochastic blocked mean-field quadratures, which may be useful in other contexts. A PyTorch implementation of QNVB allows for better control over model uncertainty during training than competing methods. Experiments demonstrate superior generalizability for multiple learning problems and architectures.

Gaussian mean-field↗
DOE OSTI2026

Integrated Strategies for Overcoming Resolution Limits in Electron Beam Lithography of Chemically Amplified Resists

Electron beam lithography (EBL) of chemically amplified resists (CARs) faces fundamental challenges, including stochastic electron scattering and acid diffusion, that limit resolution and reproducibility. Using SU-8 as a model CAR, this study systematically investigated complementary strategies to address these challenges, combining multipass exposure, proximity effect correction (PEC) with midrange correction factors, base quencher incorporation, and post-exposure bake (PEB) suppression. Monte Carlo simulations and calibrated PEC modeling revealed that extending the point spread function to include a midrange scattering component significantly improved critical dimension (CD) control across varying pattern densities, correcting deviations that conventional two-term PEC failed to capture. Multipass exposure, particularly 4-pass writing with a 25% offset, redistributed the dose to average stochastic beam and scattering fluctuations, reducing line-width roughness by more than 50% and yielding more uniform nanoscale features. Photoacid confinement was investigated by adding urea as a base quencher, which successfully reduced acid diffusion but introduced substantial sensitivity penalties without improving ultimate resolution or Z-factor performance, underscoring the trade-offs of chemical versus physical confinement. Suppressing PEB most directly minimized acid diffusion, resulting in improved Z-factors and reproducible 30 nm half-pitch dense line/space patterns. Overall, these results demonstrated that PEC with midrange correction, multipass strategies, quencher additives, and PEB-free processing addresses different aspects of the EBL process window and that their integration provides a comprehensive framework for managing stochastic scattering, diffusion, and chemical amplification effects. This framework advances dense nanoscale patterning in CARs and establishes guiding principles for optimizing resist design and process strategies in high-resolution EBL and potentially other advanced lithographies, such as extreme ultraviolet (EUV) lithography.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Model Predictive Fault-Tolerant Tracking Control for PDF Control Systems With Packet Losses

In this article, a fault-tolerant tracking control strategy is investigated for nonlinear probability density function (PDF) control systems with the actuator fault, uncertainties, unknown disturbance, and random packet losses. The control input signal dropout and measurement signal dropouts are described as the independent Bernoulli distribution. An adaptive fault diagnosis (FD) observer based on the Lyapunov function is given to simultaneously estimate the fault, disturbance, and state with packet losses. Furthermore, different from the traditional robust fault-tolerant control (FTC), a new active fault-tolerant tracking controller is designed based on the model predictive control framework, which has better adaptive fault-tolerant performance. Finally, the validity of the proposed FTC method has been proved by a simulation study of a papermaking process.

42 ENGINEERING↗
DOE OSTI2021

Modeling and simulation of vascular tumors embedded in evolving capillary networks

Here in this work, we present a coupled 3D–1D model of solid tumor growth within a dynamically changing vascular network to facilitate realistic simulations of angiogenesis. Additionally, the model includes erosion of the extracellular matrix, interstitial flow, and coupled flow in blood vessels and tissue. We employ continuum mixture theory with stochastic Cahn–Hilliard type phase-field models of tumor growth. The interstitial flow is governed by a mesoscale version of Darcy’s law. The flow in the blood vessels is controlled by Poiseuille flow, and Starling’s law is applied to model the mass transfer in and out of blood vessels. The evolution of the network of blood vessels is orchestrated by the concentration of the tumor angiogenesis factors (TAFs); blood vessels grow towards the increasing TAFs concentrations. This process is not deterministic, allowing random growth of blood vessels and, therefore, due to the coupling of nutrients in tissue and vessels, makes the growth of tumors stochastic. We demonstrate the performance of the model by applying it to a variety of scenarios. Numerical experiments illustrate the flexibility of the model and its ability to generate satellite tumors. Simulations of the effects of angiogenesis on tumor growth are presented as well as sample-independent features of cancer.

3D–1D coupled blood flow models↗
DOE OSTI2023

Simple Monomers for Precise Polymer Functionalization During Ring-Opening Metathesis Polymerization

Controlling the monomer sequence of synthetic polymers is a grand challenge in polymer science. Conventional sequence control has been achieved in dispersed polymers by exploiting the kinetic tendencies of monomers and their order of addition. While the sequence of blocks in multiblock copolymers can be readily tuned using sequential addition of monomers (SAM), control over the sequence distribution is eroded as the targeted block size approaches a single monomer unit (i.e., X n ~ 1) due to the stochastic nature of chain-growth reactions. Thus, unique monomers are needed to ensure precise single additions. Herein, we investigate common classes of cyclic olefin monomers for ring-opening metathesis polymerization (ROMP) to identify monomers for single unit addition during sequential monomer addition synthesis. Through careful analysis of polymerization kinetics, we find that easily synthesized oxanorbornene imide monomers are suitable for single-addition reactions. With the identified monomers, we demonstrate the synthesis of multiblock copolymers containing up to three precise functionalization sites and singly cross-linked four-armed star copolymers. In conclusion, we envision that expanded kinetic analyses of monomer reactivities in ROMP reactions will enable novel polymer synthesis capabilities such as the autonomous synthesis of sequence-defined polymers or one-shot multiblock copolymer syntheses.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Grid-based diffusion Monte Carlo for fermions without the fixed-node approximation

A diffusion Monte Carlo algorithm is introduced that can determine the correct nodal structure of the wave function of a few-fermion system and its ground-state energy without an uncontrolled bias. This is achieved by confining signed random walkers to the points of a uniform infinite spatial grid, allowing them to meet and annihilate one another to establish the nodal structure without the fixed-node approximation. An imaginary-time propagator is derived rigorously from a discretized Hamiltonian, governing a non-Gaussian, sign-flipping, branching, and mutually annihilating random walk of particles. The accuracy of the resulting stochastic representations of a fermion wave function is limited only by the grid and imaginary-time resolutions and can be improved in a controlled manner. Here, the method is tested for a series of model problems including fermions in a harmonic trap as well as the He atom in its singlet or triplet ground state. For the latter case, the energies approach from above with increasing grid resolution and converge within 0.015 E h of the exact basis-set-limit value for the grid spacing of 0.08 a.u. with a statistical uncertainty of 10 –5 E h without an importance sampling or Jastrow factor.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2024

Optimal Zeno Dragging for Quantum Control: A Shortcut to Zeno with Action-Based Scheduling Optimization

The quantum Zeno effect asserts that quantum measurements inhibit simultaneous unitary dynamics when the “collapse” events are sufficiently strong and frequent. This applies in the limit of strong continuous measurement or dissipation. It is possible to implement a dissipative control that is known as “Zeno dragging” by dynamically varying the monitored observable, and hence also the eigenstates, which are attractors under Zeno dynamics. This is similar to adiabatic processes, in that the Zeno-dragging fidelity is highest when the rate of eigenstate change is slow compared to the measurement rate. We demonstrate here two theoretical methods for using such dynamics to achieve control of quantum systems. The first, which we shall refer to as “shortcut to Zeno,” is analogous to the shortcuts to adiabaticity (counterdiabatic driving) that are frequently used to accelerate unitary adiabatic evolution. In the second approach, we apply the Chantasri-Dressel-Jordan stochastic action [PRA 88, 042110 (2013)], and demonstrate that the extremal-probability readout paths derived from this are well suited to setting up a Pontryagin-style optimization of the Zeno-dragging schedule. A fundamental contribution of the latter approach is to show that an action suitable for measurement-driven control optimization can be derived quite generally from statistical arguments. Implementing these methods on the Zeno dragging of a qubit, we find that both approaches yield the same solution, namely, that the optimal control is a unitary that matches the motion of the Zeno-monitored eigenstate. We then show that such a solution can be more robust than a unitary-only operation and we comment on solvable generalizations of our qubit example embedded in larger systems. These methods open up new pathways toward systematically developing dynamic control of Zeno subspaces to realize dissipatively stabilized quantum operations. Published by the American Physical Society 2024

Physics↗
DOE OSTI2024

Multistage Stochastic optimization for mid-term integrated generation and maintenance scheduling of cascaded hydroelectric system with renewable energy uncertainty

The uncertainties resulting from the escalating penetration of renewable energy resources pose severe challenges to the efficient operation of modern power systems. Hydroelectricity is characterized by its flexibility, controllability, and reliability, and thus becomes one of the most ideal energy resources to hedge against such uncertainties. This paper studies the mid-term integrated generation and maintenance scheduling of a cascaded hydroelectric system (CHS) consisting of multiple cascaded reservoirs and hydroelectric units. To precisely describe the mid-term water regulation policies, the hydraulic coupling relationship and water-energy nexus of CHS are incorporated into the proposed optimization model. The uncertainties of natural water inflow and the power outputs of wind/solar energy generation are taken into consideration and captured via a stochastic process modeled by a scenario tree. A multistage stochastic optimization (MSO) approach is developed to coordinate the complementary operations of multiple energy resources, by optimizing the mid-term water resource management, generation scheduling, and maintenance scheduling of CHS. The proposed MSO model is formulated as a large-scale mixed-integer linear program that presents significant computational intractability. To address this issue, a tailored Benders decomposition algorithm is developed. Two real-world case studies are conducted to demonstrate the capability and characteristics of the proposed model and algorithm. The computational results show that the proposed MSO model can exploit the flexibility of hydroelectricity to efficiently respond to variable wind and solar power, and reserve water resources for the generation in peak months to reduce the consumption of fossil fuel. Furthermore, the proposed solution approach also exhibits promising computational efficiency when handling large-scale models.

13 HYDRO ENERGY↗
DOE OSTI2023

Nucleation-mediated reshaping of facetted metallic nanocrystals: Breakdown of the classical free energy picture

Shape stability is key to avoiding degradation of performance for metallic nanocrystals synthesized with facetted non-equilibrium shapes to optimize properties for catalysis, plasmonics, and so on. Reshaping of facetted nanocrystals is controlled by the surface diffusion-mediated nucleation and growth of new outer layers of atoms. Here, Kinetic Monte Carlo (KMC) simulation of a realistic stochastic atomistic-level model is applied to precisely track the reshaping of Pd octahedra and nanocubes. Unexpectedly, separate constrained equilibrium Monte Carlo analysis of the free energy profile during reshaping reveals a fundamental failure of the classical nucleation theory (CNT) prediction for the reshaping barrier and rate. Why? Nucleation barriers can be relatively low for these processes, so the system is not locally equilibrated before crossing the barrier, as assumed in CNT. This claim is supported by an analysis of a first-passage problem for reshaping within a master equation framework for the model that reasonably captures the behavior in KMC simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Network Reconfiguration for Enhanced Operational Resilience Using Reinforcement Learning

This paper proposes a reinforcement learning-based approach for distribution network reconfiguration(DNR) to enhance the resilience of the electric power supply. Resilience enhancements usually require solving large-scale stochastic optimization problems that are computationally expensive and sometimes infeasible. The exceptional performance of reinforcement learning techniques has encouraged their adoption in various power system control studies, specifically resilience-based real-time applications. In this paper, a single agent framework is developed using an Actor-Critic algorithm (ACA) to determine statuses of tie-switches in a distribution feeder impacted by an extreme weather event. The proposed approach provides a fast-acting control algorithm that reconfigures the feeder topology to reduce or even avoid load shedding. The problem is formulated as a discrete Markov decision process in such a way that a system state captures the system topology and its operational characteristics. An action is made to open or close a specific set of tie-switches after which a reward is calculated to evaluate the practicality and advantage of that action. The iterative Markov process is used to train the proposed ACA under diverse failure scenarios and is demonstrated on the 33-node distribution feeder system. Results show the capability of the proposed ACA to determine proper switching action of tie-switches with accuracy exceeding 93%.

actor critic↗
DOE OSTI2025

Realizing Steady-State Microbunching with Optical Stochastic Crystallization

Optical Stochastic Cooling (OSC) is a state-of-the-art beam cooling technology first demonstrated in 2021 at the IOTA storage ring at Fermilab's FAST facility. A second phase of the research program is planned to run in 2026 and will incorporate an optical amplifier to enable significantly increased cooling rates and greater operational flexibility. In addition to beam cooling, an OSC system can be configured to enable advanced control over the phase space of the beam. An example operational mode could enable crystallization, where the particles in a bunch are locked into a self-reinforcing, regular microstructure at the OSC fundamental wavelength; we refer to this as Optical Stochastic Crystallization (OSX). OSX represents a new path toward Steady-State Microbunching (SSMB), which may enable light sources combining the high brightness of a free-electron laser with the high repetition rate of a storage ring. Such a source has applications from the terahertz to the extreme ultraviolet (EUV), including high-power EUV generation for semiconductor lithography. This contribution will discuss the integration of OSX development as part of the OSC program at IOTA. The design of an accelerator lattice to enable the mechanism and associated high fidelity simulations will be shown, and a path to realizing an experimental demonstration will be discussed.

Wallbank, Michael James [Fermilab]↗
DOE OSTI2025

Steady-State Microbunching using Optical Stochastic Cooling

Optical Stochastic Cooling (OSC) is a state-of-the-art beam cooling technology first demonstrated in 2021 at the IOTA storage ring at Fermilab's FAST facility. A second phase of the research program is planned to run in 2026 and will incorporate an optical amplifier to enable significantly increased cooling rates and greater operational flexibility. In addition to beam cooling, an OSC system can be configured to enable advanced control over the phase space of the beam. An example operational mode could enable crystallization, where the particles in a bunch are locked into a self-reinforcing, regular microstructure at the OSC fundamental wavelength; we refer to this as Optical Stochastic Crystallization (OSX). OSX represents a new path toward Steady-State Microbunching (SSMB), which may enable light sources combining the high brightness of a free-electron laser with the high repetition rate of a storage ring. Such a source has applications from the terahertz to the extreme ultraviolet (EUV), including high-power EUV generation for semiconductor lithography. This contribution will discuss the integration of OSX development as part of the OSC program at IOTA. The design of an accelerator lattice to enable the mechanism and associated high fidelity simulations demonstrating the beam dynamics will be shown, and a path to realizing an experimental demonstration will be discussed.

Wallbank, Michael James [Fermilab]↗