Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A stochastic scan strategy for grain structure control in complex geometries using electron beam powder bed fusion

Spatial control of microstructure within a three-dimensional component has been a dream of materials scientists for centuries. However, limitations in traditional manufacturing processes prevent detailed control over the distribution of microstructures in a single part. Here, we demonstrate the ability to control grain structure and crystallographic texture during metal additive manufacturing for arbitrary cross-sections of a practical size, with profound implications for the design and optimization of next-generation products. The key to this advance is a new geometry agnostic scan path algorithm that manipulates the spatial distribution of solidification conditions. Utilizing a fundamental understanding of solidification dynamics and a model of the heat transfer during processing, we have designed this algorithm to manipulate the natural competition between epitaxial dendrite growth and grain nucleation. With this algorithm, we successfully controlled the grain structure of Ni-based superalloy IN718 in the shape of the Mona Lisa.

36 MATERIALS SCIENCE↗
DOE OSTI2023

High Performance Adaptive Deep-Reinforcement-Learning-based Real-time Emergency Control (HADREC) to Enhance Power Grid Resilience in Stochastic Environment (Final Report)

The HADREC technology developed in this project features real-time, validated, and predictive emergency control capabilities needed to effectively safeguard the grid against costly disturbances from extreme weather and other disruptive events. It has the potential to revolutionize the emergency control by providing faster and more effective solution for power grid emergency control. The technology can reduce the grid emergency control action time from minutes to seconds and mitigate the impact of outages and reduce system recovery time. The evaluation results using the models and data from PacifiCorp system have shown ~20% improvement in responding time and 70% improved in tripped generator output, comparing against today’s industrial application. This performance can help reduce preventive measurements and improve network utilization and market efficiency, and help lead to a more reliable and resilient power grid with renewable integration. The project has generated significant interest from industry, academic and commercial companies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

A New Simple-to-Configure Self-Perturbing Multivariable Extremum-Seeking Controller

This paper presents a new stochastic relay-based extremum-seeking controller (ESC) for multi-input-single-output (MISO) systems. The algorithm was developed with the goal of simplifying configuration to enable easier deployment to real-world problems. A solution is developed first for a static map and then adapted for a general class of dynamic systems. The number of configurable parameters is one per input channel for the static case and only one additional parameter is needed for the dynamic version. The problem of gradient identifiability is solved via the use of stochastic relay gains and a simple stability proof for the static case is presented. Simulation tests demonstrate the performance of the strategy for optimizing both static and dynamic systems.

Salsbury, Timothy [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2023

Stochastic scheduling for commercial building cooling systems: considering uncertainty in zone temperature prediction

Here, this paper presents the first attempt to address the uncertainty in zone temperature prediction with stochastic optimization. The uncertain zone temperature is a process uncertainty and has not been considered in the existing stochastic optimization for building control. To fill this gap, we proposed a novel formulation of stochastic optimization to handle process uncertainty in building control. Specifically, we first examined the accuracy of a typical linear model for predicting zone temperature. We then formulated the scheduling of the building cooling system as a stochastic optimization problem over a 24-hour look-ahead period to minimize the electricity cost of the studied building cooling system. After that, we applied the proposed stochastic load scheduling (SLS) to a direct expansion (DX) cooling system that serves a medium office building. Through simulation with a detailed building energy simulation software, EnergyPlus, we evaluated the operational cost and the thermal comfort compared with a deterministic load scheduling. The operation cost of scheduling was found to vary with the level of zone temperature prediction uncertainty. The proposed SLS can mitigate the impacts of uncertain zone temperature predictions on both operational cost and thermal comfort. The evaluation results indicate that the proposed SLS works better when the uncertainty level is more significant.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

An Introduction to the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS)

Deployment and capability of distributed energy resources (DER) in power systems is growing rapidly. These resources present an opportunity for low-cost provision of energy and grid services. The Federal Energy Regulatory Commission recently provided rulings to enable market participation of these distribution-connected resources, but the prevailing strategies for their management may not scale well to meet future needs. This paper introduces the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS) which was designed to address this need. In it we describe the architectural features of the approach, and a reference controls implementation employing a hierarchical coordination that includes stochastic optimization, model predictive control, and a simple real-time management scheme. Sample results from simulation show firm transmission-level service provision measured at the distribution substation.

grid architecture↗
DOE OSTI2024

An Introduction to the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS): Preprint

Deployment and capability of distributed energy resources (DER) in power systems is growing rapidly. These resources present an opportunity for low-cost provision of energy and grid services. The Federal Energy Regulatory Commission recently provided rulings to enable market participation of these distribution-connected resources, but the prevailing strategies for their management may not scale well to meet future needs. This paper introduces the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FASTDERMS) which was designed to address this need. In it we describe the architectural features of the approach, and a reference controls implementation employing a hierarchical coordination that includes stochastic optimization, model predictive control, and a simple real-time management scheme. Sample results from simulation show firm transmission-level service provision measured at the distribution substation.

DERMS↗
DOE OSTI2024

Binary Quantum Control Optimization with Uncertain Hamiltonians

Optimizing the controls of quantum systems plays a crucial role in advancing quantum technologies. The time-varying noises in quantum systems and the widespread use of inhomogeneous quantum ensembles raise the need for high-quality quantum controls under uncertainties. In this paper, we consider a stochastic discrete optimization formulation of a discretized binary optimal quantum control problem involving Hamiltonians with predictable uncertainties. We propose a sample-based reformulation that optimizes both risk-neutral and risk-averse measurements of control policies, and solve these with two gradient-based algorithms using sum-up-rounding approaches. Furthermore, we discuss the differentiability of the objective function and prove upper bounds of the gaps between the optimal solutions to binary control problems and their continuous relaxations. We conduct numerical simulations on various sized problem instances based on two applications of quantum pulse optimization; we evaluate different strategies to mitigate the impact of uncertainties in quantum systems. In conclusion, we demonstrate that the controls of our stochastic optimization model achieve significantly higher quality and robustness compared with the controls of a deterministic model.

conditional value-at-risk (CVaR)↗
DOE OSTI2022

Stochastic fluctuation and transport of tokamak edge plasmas with the resonant magnetic perturbation field

Here we present that a statistical method known as the complexity–entropy analysis is useful to characterize a state of plasma turbulence and flux in the resonant magnetic perturbation (RMP) edge localized mode (ELM) control experiment. The stochastic pedestal top temperature fluctuation in the RMP ELM suppression phase is distinguished from the chaotic fluctuation in the natural ELM-free phase. It is discussed that the stochastic temperature fluctuation can be originated from the narrow layer of the field penetration on the pedestal top. The forced magnetic island can emit the resonant drift wave of comparable sizes (relatively low-k) in the RMP ELM suppression phase, and it can result in the generation of stochastic higher wavenumber fluctuations coupled to tangled fields around the island. The analysis of the ion saturation current measurement around the major outer striking point on the divertor shows that it also becomes more stochastic as the stronger plasma response to the RMP field is expected.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Stochastic Home Energy Management Systems with Varying Controllable Resources

This paper studies the performance of a model predictive control (MPC) algorithm in a home energy management system (HEMS) as the set of controllable resources varies and under both a constant and a time-of-use (TOU) electricity price structure. The set of controllable resources includes residentially-owned photovoltaic (PV) panels, a home battery system (HBS), an electric vehicle (EV), and a home heating, ventilation, and air conditioning (HVAC) system. The HEMS optimally schedules the set of controllable resources given user preferences such as indoor thermal comfort and electricity cost sensitivity. The home energy management system is built on a chance constrained, MPC-based algorithm, where the chance constraint ensures the indoor thermal comfort is satisfied with a high probability given uncertainty in the outdoor temperature and solar irradiance forecasts. Simulation results for varying sets of controllable resources under two different electricity price structures demonstrate the variation in the HEMS control with respect to HBS operation, electricity cost, and grid power usage.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Efficient Probabilistic Computing with Stochastic Perovskite Nickelates

Probabilistic computing has emerged as a viable approach to solve hard optimization problems. Devices with inherent stochasticity can greatly simplify their implementation in electronic hardware. In this report we demonstrate intrinsic stochastic resistance switching controlled via electric fields in perovskite nickelates doped with hydrogen. The ability of hydrogen ions to reside in various metastable configurations in the lattice leads to a distribution of transport gaps. With experimentally characterized p-bits, a shared-synapse p-bit architecture demonstrates highly parallelized and energy-efficient solutions to optimization problems such as integer factorization and Boolean satisfiability. The results introduce perovskite nickelates as scalable potential candidates for probabilistic computing and showcase the potential of light-element dopants in next-generation correlated semiconductors.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2020

Optimal control of coupled quantum systems based on the first-order Magnus expansion: Application to multiple dipole-dipole-coupled molecular rotors

This paper presents a method for performing approximate optimal control simulations for quantum systems with multiple coupled degrees of freedom. In this work, the time evolution is simulated using the first-order Magnus expansion in the interaction picture, where the couplings between different degrees of freedom are treated as the perturbation. A numerical implementation procedure is presented that leverages upon pairwise couplings and the separability of the zeroth-order time evolution operator to achieve a reduced computational cost, which is analyzed with respect to the number of degrees of freedom. The formulation is compatible with gradient-free methods to optimize the control field, and a stochastic hill climbing algorithm is adopted for this purpose. As illustrations, optimal control simulations are performed for systems of two and three dipole-dipole-coupled molecular rotors under the influence of a control field. For the two-rotor system, the field is optimized to achieve either orientation or entanglement objectives. For the three-rotor system, the field is optimized either to orient all three rotors in the same direction or to orient one rotor in a particular direction while the other two rotors point in the opposite direction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Nonlinear power flow control for networked AC/DC microgrids

A method for designing feedforward and feedback controllers for integration of stochastic sources and loads into a nonlinear networked AC/DC microgrid system is provided. A reduced order model for general networked AC/DC microgrid systems is suitable for HSSPFC control design. A simple feedforward steady state solution is utilized for the feedforward controls block. Feedback control laws are provided for the energy storage systems. A HSSPFC controller design is implemented that incorporates energy storage systems that provides static and dynamic stability conditions for both the DC random stochastic input side and the AC random stochastic load side. Transient performance was investigated for the feedforward/feedback control case. Numerical simulations were performed and provided power and energy storage profile requirements for the networked AC/DC microgrid system overall performance. The HSSPFC design can be implemented in the Matlab/Simulink environment that is compatible with real time simulation/controllers.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Next-Cycle Optimal Fuel Control for Cycle-to-Cycle Variability Reduction in EGR-Diluted Combustion

In this simulation study, cycle-to-cycle fuel control was used to reduce CCV by injecting additional fuel in operating conditions with sporadic misfires and partial burns. An optimal control policy was proposed that utilizes 1) a physics-based model that tracks in-cylinder gas composition and 2) a one-step-ahead prediction of the combustion efficiency based on a kernel density estimator. The optimal solution, however, presents a tradeoff between the reduction in combustion CCV and the increase in fuel injection quantity required to stabilize the charge. Such a tradeoff can be ad- just by a single parameter embedded in the cost function.

Maldonado, BryanP. [Oak Ridge National Lab. (ORNL)↗
DOE OSTI2025

Derivative-free stochastic optimization via adaptive sampling strategies

In this paper, we present a novel derivative-free framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning to quantum computing involve settings where only stochastic function values are obtained via a zeroth-order oracle, which has no available gradient information and necessitates the usage of derivative-free optimization methodologies. Our approach includes estimating gradients using stochastic function evaluations and integrating adaptive sampling techniques to control the accuracy in these stochastic approximations. Our framework encapsulates several gradient estimation techniques, including standard finite-difference, Gaussian smoothing, sphere smoothing, randomized coordinate finite-difference, and randomized subspace finite-difference methods. We provide theoretical convergence guarantees for our framework and analyze the worst-case iteration and sample complexities associated with each gradient estimation method. Finally, we demonstrate the empirical performance of the methods on logistic regression and nonlinear least squares problems.

Adaptive sampling↗
DOE OSTI2025

A Predictive Deep-Reinforcement-Learning-Based Connected Automated Vehicle Anticipatory Longitudinal Control in a Mixed Traffic Lane Change Condition

Maintaining safety and efficiency for mixed traffic consisting of connected automated vehicles (CAVs) and human-driven vehicles (HDVs) is an arduous task due to the inherent HDVs’ stochasticity. Especially for longitudinal control, which is the basic function of vehicle automation, prevailing research primarily considers CAV’s car-following control merely the acceleration and deceleration of leading vehicles. However, this approach overlooks the potential disruptions caused by surrounding vehicles executing lane changes, which can significantly impact the control vehicle’s stability and overall safety. Hence, our study introduces a predictive deep reinforcement learning (DRL) longitudinal CAV controller. This innovative approach leverages prediction from a physics-informed neural network as well as the control capability of DRL to better anticipate and mitigate issues arising from lane-changing, enhancing the safety and efficiency of CAVs in such scenarios. Finally, validated by the numerical simulations embedded with the real-world data, the results indicate that the proposed controller significantly enhances the safety and efficiency of CAVs in situations involving lane changes by other vehicles, showcasing its potential as a valuable tool in advancing CAV technology in mixed traffic.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Noise-canceling quantum feedback: Non-Hermitian dynamics with applications to state preparation and magic state distillation

Time-continuous quantum measurement allows for the tracking of a quantum system in real time via sequences of short, and individually weak, measurement intervals. Such measurements are necessarily invasive, imparting backaction to the system, and allowing the observer to update their state estimate based on stochastic measurement outcomes. Feedback control then involves real-time interventions by an observer, conditioned on the time-continuous measurement signal that they receive. Here, we consider here diffusive quantum trajectories and focus on the “noise-canceling” subset of feedback protocols that aim to minimize the degree of stochasticity in the dynamics. We derive such a class of feedback operations, showing that under the idealized assumptions of pure states, unit measurement efficiency, and zero time delay in implementing feedback operations, perfectly noise-canceling feedback always exists. We consider the resulting noise-canceled dynamics generated by an effective non-Hermitian Hamiltonian; while non-Hermitian Hamiltonians from continuous monitoring generally describe rare dynamics (accessible by costly postselection), the use of noise-canceling feedback here leads to non-Hermitian dynamics that occur deterministically. We demonstrate this via examples of entangled state preparation and stabilization. We then illustrate the potential for the application of noise cancellation to boost success rates in magic state distillation protocols. We show that adding feedback based on noise cancellation into a time-continuous five-to-one distillation protocol leads to higher probabilities of successful distillation across a range of input errors and increases the threshold on input errors for which the protocol is effective. Our results highlight the efficacy of noise-canceling feedback-aided protocols for quantum state preparation and stabilization tasks.

Karmakar, Tathagata [University of California, Ber↗
DOE OSTI2025

PowderJet: Spherical metal powder production via multi-orifice droplet-on-demand metal jetting

Leading metal additive manufacturing techniques, such as laser powder bed fusion and directed energy deposition, rely on high-quality spherical metal powders. However, traditional powder production methods like gas atomization face limitations, including low in-spec yield, asphericity, and internal porosity. We introduce PowderJet, a powder production platform that uses electromagnetic pulses to eject liquid metal droplets from a multi-orifice nozzle. Unlike stochastic methods, PowderJet tightly controls powder size, distribution, and purity through a droplet-on-demand approach. We detail the system’s design, operation, and performance using a combined experimental and computational fluid dynamics (CFD) framework. Initial results with Al4008 and Cu110 alloys demonstrate successful production, yielding unsieved aluminum powder batches with a mean diameter of 200 µm and a narrow size distribution (15 µm standard deviation). The produced powders are highly spherical, achieving a roundness > 0.95. PowderJet operates with a small melt volume (3 mL) and supports continuous refilling, enabling production rates between 30 and 140 cm³/hr depending on jetting frequency, number of orifices and particle size. CFD simulations show that future systems could achieve rates exceeding 1000 cm³/hr for particle sizes as small as 40 µm. PowderJet’s high yield of in-spec powder makes it ideal for producing precious or hazardous materials that are inefficient to manufacture using conventional methods. This platform offers a scalable, precise, and efficient solution for producing high-quality powders tailored for advanced manufacturing applications.

Atomization↗
DOE OSTI2023

Vibrational heat-bath configuration interaction with semistochastic perturbation theory using harmonic oscillator or VSCF modals

Vibrational heat-bath configuration interaction (VHCI)—a selected configuration interaction technique for vibrational structure theory—has recently been developed in two independent works [J. H. Fetherolf and T. C. Berkelbach, J. Chem. Phys. 154, 074104 (2021); A. U. Bhatty and K. R. Brorsen, Mol. Phys. 119, e1936250 (2021)], where it was shown to provide accuracy on par with the most accurate vibrational structure methods with a low computational cost. Here, we eliminate the memory bottleneck of the second-order perturbation theory correction using the same (semi)stochastic approach developed previously for electronic structure theory. This allows us to treat, in an unbiased manner, much larger perturbative spaces, which are necessary for high accuracy in large systems. Stochastic errors are easily controlled to be less than 1 cm−1. We also report two other developments: (i) we propose a new heat-bath criterion and an associated exact implicit sorting algorithm for potential energy surfaces expressible as a sum of products of one-dimensional potentials; (ii) we formulate VHCI to use a vibrational self-consistent field (VSCF) reference, as opposed to the harmonic oscillator reference configuration used in previous reports. Our tests are done with quartic and sextic force fields, for which we find that with VSCF, the minor improvements to accuracy are outweighed by the higher computational cost associated the matrix element evaluations. We expect VSCF-based VHCI to be important for more general potential representations, for which the harmonic oscillator basis function integrals are no longer analytic.

Chemistry↗