Search NASA⌕ Search

SEARCH · Search NASA

Results for “Optimal control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

An Introduction to the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS)

Deployment and capability of distributed energy resources (DER) in power systems is growing rapidly. These resources present an opportunity for low-cost provision of energy and grid services. The Federal Energy Regulatory Commission recently provided rulings to enable market participation of these distribution-connected resources, but the prevailing strategies for their management may not scale well to meet future needs. This paper introduces the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS) which was designed to address this need. In it we describe the architectural features of the approach, and a reference controls implementation employing a hierarchical coordination that includes stochastic optimization, model predictive control, and a simple real-time management scheme. Sample results from simulation show firm transmission-level service provision measured at the distribution substation.

grid architecture↗
DOE OSTI2025

Coordination of Energy Storage and Distributed Generation for Voltage Control and Peak-valley Filling

The increasing penetration of distributed energy resources (DERs) in distribution network (DN) poses challenges on voltage control. In addition, the growing integration of DERs also reshapes the traditional load profile. To comprehensively address the voltage control and peak-valley filling in DN, this paper proposes a model predictive control (MPC) based optimization framework. The proposed method can achieve coordinated voltage control and peak-valley filling by adjusting the reactive power output from distributed generations (DGs) and the charging/discharging of energy storage systems (ESS). The performance of the proposed method is demonstrated by simulations on a modified IEEE-123 bus system.

Zhang, Zhengfa [University of Tennessee, Knoxville↗
DOE OSTI2024

An Introduction to the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FAST-DERMS): Preprint

Deployment and capability of distributed energy resources (DER) in power systems is growing rapidly. These resources present an opportunity for low-cost provision of energy and grid services. The Federal Energy Regulatory Commission recently provided rulings to enable market participation of these distribution-connected resources, but the prevailing strategies for their management may not scale well to meet future needs. This paper introduces the Federated Architecture for Secure and Transactive Distributed Energy Management Solutions (FASTDERMS) which was designed to address this need. In it we describe the architectural features of the approach, and a reference controls implementation employing a hierarchical coordination that includes stochastic optimization, model predictive control, and a simple real-time management scheme. Sample results from simulation show firm transmission-level service provision measured at the distribution substation.

DERMS↗
DOE OSTI2024

A safe reinforcement learning algorithm for supervisory control of power plants

Traditional control theory-based methods require tailored engineering for each system and constant fine-tuning. In power plant control, one often needs to obtain a precise representation of the system dynamics and carefully design the control scheme accordingly. Model-free Reinforcement learning (RL) has emerged as a promising solution for control tasks due to its ability to learn from trial-and-error interactions with the environment. It eliminates the need for explicitly modeling the environment’s dynamics, which is potentially inaccurate. However, the direct imposition of state constraints in power plant control raises challenges for standard RL methods. To address this, we propose a chance-constrained RL algorithm based on Proximal Policy Optimization for supervisory control. Our method employs Lagrangian relaxation to convert the constrained optimization problem into an unconstrained objective, where trainable Lagrange multipliers enforce the state constraints. In conclusion, our approach achieves the smallest distance of violation and violation rate in a load-follow maneuver for an advanced Nuclear Power Plant design.

constrained optimization↗
DOE OSTI2024

Nonlinear control of the minimum safety factor in tokamaks by optimal allocation of spatially moving electron cyclotron current drive

The minimum value of the safety factor profile is related to the magnetohydrodynamic (MHD) stability of the plasma confined in a tokamak. Therefore, active control of the minimum safety factor may mitigate MHD instabilities that can degrade or even terminate plasma confinement. Typically, in most tokamak scenarios, the minimum safety factor evolves spatially with time, i.e., the location at which the safety factor achieves the minimum value changes with time. In addition to the inherent nonlinearities in the minimum safety factor evolution, its spatial variation makes the control design challenging. In particular, complexity in control design may arise from the need for time-dependent nonlinear models that account for spatial variation of the minimum safety factor. Furthermore, the minimum safety factor may drift to locations where the actuator authority is low. The problem of minimum safety factor control with target location tracking and moving electron cyclotron current drive (ECCD) is addressed in this work. A nonlinear time-dependent model that incorporates the spatial variation of the minimum safety factor is presented. A nonlinear controller based on optimal feedback linearization is developed to track a target minimum safety factor. The proposed controller treats the ECCD position as a controllable variable. In other words, the controller prescribes the ECCD position (in addition to the non-inductive powers) in real time based on an optimal criterion that is defined a priori. This work also presents the steps necessary to integrate the minimum safety factor controller with a total energy controller to achieve multiple control objectives simultaneously. In conclusion, the proposed integrated control algorithm is tested using nonlinear simulations in the Control Oriented Transport SIMulator (COTSIM) for a DIII-D tokamak scenario.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Laser Powder Directed Energy Deposition of Steels for Nuclear Applications

This comprehensive investigation examines the structure–property relationships in two nuclear alloy systems—Alloy 709 (A709) austenitic stainless steel and Grade 92 (G-92) ferritic/martensitic (F/M) steel—manufactured via directed energy deposition (DED) for sodium-cooled fast reactor applications. This study establishes the fundamental mechanisms for controlling microstructures for optimizing the mechanical performance of additively manufactured nuclear materials through systematic heat treatment optimization and multiscale characterization. As-deposited A709 steel develops a complex multiscale strengthening architecture consisting of a fine cellular solidification structure with diameter of 2-3 µm within10–50 µm grains, elevated dislocation densities from rapid thermal cycling, and grain boundary precipitates that activate concurrent Hall–Petch, dislocation, and precipitation hardening mechanisms to achieve exceptional properties [yield strength (YS): 603 MPa, ultimate tensile strength (UTS): 844 MPa, Vickers hardness: 220 HV] that achieve a 44% superior strength compared to that of the wrought material. Heat treatments produce different results. Solution annealing (SA) dissolves the cellular structure and reduces the hardness to 190 HV. Precipitation treatment (PT) keeps the cellular structure but adds carbides, allowing the hardness to reach 205 HV. The best approach combines both treatments (SA+PT) and creates uniform precipitate distributions with M 23 C 6 carbides at the grain boundaries and MX carbonitrides in the matrix, achieving a hardness of 195 HV. However, directional differences persist, with a 12%–15% strength variation between orientations due to the inherited layered microstructural architecture that survives aggressive heat treatment. While tensile testing at 550°C demonstrates 40%–50% thermal softening with dynamic strain aging, DED A709 steel still maintains a 71% higher YS than that of the wrought material. Ion irradiation studies (100–400 dpa) of DED A709 steel reveal progressive radiation damage with increasing void density and radiation-induced segregation causing nickel enrichment and chromium depletion, which will ultimately compromise mechanical properties. As-deposited G-92 exhibits exceptional strength (UTS: 1650–1700 MPa, 430 HV) through a complex microstructure containing both ferrite and martensite phases, a high geometrically necessary dislocation (GND) density (17.04×10 14 /m 2 ), and fine carbides. Heat treatments create distinct changes. Normalizing produces fresh martensite with the highest hardness (460 HV) and an increased GND density (20.23×10 14 /m 2 ). Tempering develops dual precipitation systems and reduces the hardness to 290 HV. The optimal approach uses sequential normalizing plus tempering, achieving balanced properties with the lowest hardness (250 HV) and a reduced GND density (11.01×10 14 /m 2 ). A processing-dependent anisotropy is observed: horizontal specimens achieve superior ductile behavior, while vertical specimens exhibit brittle failure. A tempering heat treatment successfully mitigates this anisotropic behavior by transforming the hard martensitic as-deposited structure into tempered martensite enabling both horizontal and vertical specimens to exhibit similar stress–strain characteristics with visible necking behavior. Remarkably, testing at 550°C reveals a reversal in the anisotropy, where as-deposited specimens achieve near isotropy with superior thermal stability (a 15%–20% strength reduction), while tempered specimens develop an orientation dependence with a 25%–30% strength reduction. Both alloy systems demonstrate that DED processing creates specimens with a superior strength through refined microstructural features, though with distinct strengthening mechanisms—austenitic through cellular structures and precipitates versus F/M through phase transformations and precipitates. Heat treatment optimization requires alloy-specific approaches, with A709 benefiting from controlled precipitation while G-92 requires careful phase transformation control. The results show that DED manufacturing can produce nuclear materials with exceptional performance, but directional effects and temperature-dependent behavior must be carefully considered for reactor component design and qualification.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Control-Affine Schrödinger Bridge and Generalized Bohm Potential

From a stochastic control perspective, the Schrödinger bridge is a density-valued continuous curve parameterized by time that connects a given pair of initial and terminal probability densities via minimum effort controlled Brownian motion. The control-affine Schrödinger bridge extends this idea to a generic control-affine Itô diffusion, possibly with an additive state cost. Here, in this letter, we recast the necessary conditions of optimality for the control-affine Schrödinger bridge problem as a two point boundary value problem for a quantum mechanical Schrödinger PDE with complex potential. This complex-valued potential is a generalization of the real-valued Bohm potential in quantum mechanics. Our derived potential is akin to the optical potential in nuclear physics where the real part of the potential encodes elastic scattering (transmission of wave function), and the imaginary part encodes inelastic scattering (absorption of wave function). The key takeaway is that the process noise that drives the evolution of probability densities induces an absorbing medium in the evolution of wave function. These results make new connections between control theory and non-equilibrium statistical mechanics through the lens of quantum mechanics.

Markov processes↗
DOE OSTI2025

Multistage economic MPC for systems with a cyclic steady state: A gas network case study

Multistage model predictive control (MPC) provides a robust control strategy for dynamic systems with uncertainties and a setpoint tracking objective. Moreover, extending MPC to minimize an economic cost instead of tracking a pre-calculated optimal setpoint improves controller performance. This paper presents a novel multistage economic nonlinear model predictive control (E-NMPC) framework for dynamic systems operating under uncertainty, with specific application to natural gas transmission networks. A key innovation lies in the integration of cyclic steady-state (CSS) constraints within the multistage MPC formulation, enabling the controller to manage periodic operating conditions commonly observed in energy systems. A Lyapunov-based descent condition is enforced to ensure robust stability of the controller. The multistage economic MPC framework is validated on two gas pipeline case studies, where it successfully minimizes net energy consumption, respects operational constraints under uncertain demand profiles, and guides the network to optimal cyclic operation. The Lyapunov function remains bounded in both case studies, validating the robust stability of multistage E-NMPC.

03 NATURAL GAS↗
DOE OSTI2026

Quantum Computing in Next-Generation Transportation Optimization

We explore how quantum computing (QC) can advance transportation optimization, with a focus on two high-impact areas: traffic signal control and vehicle electrification with grid integration. As transportation systems grow in complexity, classical optimization methods increasingly struggle to deliver scalable and efficient solutions, particularly for real-time, data-rich environments. This work identifies key challenges within these two domains where QC may offer advantages, particularly in handling combinatorial decision spaces and dynamic constraints. We begin by outlining the limitations of classical approaches for traffic signal control optimization and electric vehicle charging coordination, highlighting where computational limitations arise. Previous quantum formulations are presented and new formulations are proposed to demonstrate how emerging quantum algorithms, including quantum annealing and the Quantum Approximation Optimization Algorithm, could be leveraged to reformulate and address these problems. We also evaluate the suitability of current quantum hardware and discuss recent trends that indicate when QC may become a viable tool for transportation applications. While acknowledging the present limitations of QC technologies, this poster emphasizes the importance of preparing quantum-compatible models today. By reviewing and establishing formulations that align with the strengths of quantum algorithms, researchers and practitioners can better position themselves to take advantage of QC advancements as they occur. This work aims to provide a practical, forward-looking perspective on the near-term potential of quantum computing in transportation optimization.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Transient Optimization of the Cryogenic Moderator System Controller at the Spallation Neutron Source for Improved Performance

The high-energy neutron beam generated at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory is moderated to use cold (slow) neutrons for scientific discoveries. The Cryogenic Moderator System (CMS) removes heat from the neutron beam using cryogenic hydrogen (H 2 ) moderators connected via heat exchangers to a helium (He) refrigeration loop that dissipates heat using a compressor-brake system. However, the CMS is affected by sporadic losses in beam power, referred to as "beam trips," as these events generate significant disturbances in cooling requirements. To accommodate the heat load transients during beam trips, the CMS uses a decentralized control strategy consisting of four flow valves and one electric heater adjusted by independent proportional-integral (PI) controllers. During the CMS’s initial commissioning, the PI gains were calibrated based only on tracking performance, overlooking their effectiveness in disturbance rejection. A data-driven, control-oriented closed-loop model was developed to recalibrate the PI gains and minimize the transient disturbances caused by beam trips. The model consists of three main components: (1) a physics-based model of the He refrigeration loop, (2) a machine-learning model of the cryogenic H 2 cooling trains, and (3) the control logic used for feedback set-point tracking. Experimental results showed that the recalibrated gains obtained in this study improved the CMS’s transient response during beam trips.

Maldonado Puente, Bryan↗
DOE OSTI2026

Effects of plasma squareness on RMP response in MAST-U

The effect of the squareness of the plasma boundary shape on the plasma response to the applied n = 2 (n is the toroidal mode number) resonant magnetic perturbation, and consequently on controlling the edge-localized mode (ELM) in MAST-U in the double-null configuration, is numerically systematically investigated. The modeling is performed utilizing three different plasma response models: the single-fluid model, the two-fluid model and the magnetohydrodynamic-kinetic hybrid model. The effect of the plasma squareness on ELM control is found to depend on the equilbrium kinetic profiles. Fixing the equilibrium radial profiles to that from a recent MAST-U discharge, the experimental plasma shape is found to be close to optimal for ELM control in terms of squareness. The optimal coil phasing does not significantly vary with varying plasma squareness. These findings robustly hold with (i) two figures of merit (FoMs) defined for predicting the ELM control feasibility, and (ii) three plasma response models employed for evaluating these FoMs.

MAST-U↗
DOE OSTI2026

Automated Signal Timing Plan Reconstruction Using High-Resolution Event-Based Controller Data for Digital Twins

Transportation digital twins are essential tools for evaluating emerging technologies such as connected and automated vehicles, adaptive traffic signal control, and mobility optimization strategies. Realistic digital twins require accurate emulation of real-world signal controllers and detailed signal timing plans. However, signal timing plans are often unavailable or difficult to access, forcing researchers and modelers to rely on assumed fixed timings or halt their analysis. To overcome this challenge, we present a method that directly estimates signal timing plan parameters using high-resolution, event-based data from traffic signal controllers. The proposed method extracts key parameters, including cycle length, offset, phase sequence, coordinated phases, phase-specific minimum and maximum green durations, vehicle extensions, and splits under coordination. A rule-based deterministic signal timing reconstruction algorithm based on traffic signal operation rules, such as those outlined in the Signal Timing Manual, is developed and validated. We evaluate this method, which uses high-resolution controller event logs and verified signal timing plans, on 94 signalized intersections in Nashville, Tennessee, demonstrating their ability to generate accurate, simulation-ready signal timing plans for tools such as SUMO and Vissim.

Saroj, Abhilasha [ORNL] (ORCID:0000000191178063)↗
DOE OSTI2025

Deep Reinforcement Learning Based Control of Wind Turbines for Fast Frequency Response

In order to fulfill vital auxiliary grid services, such as load regulation, spin and non-spin reserve provision, and frequency support during emergencies, there is often a requirement for certain wind farms to operate in de-loaded modes. Leveraging the swift response capabilities of wind farms, this study demonstrates that reserving power in de-loaded modes can significantly enhance power grid stability and reliability during system contingencies. Controlling wind farms optimally for frequency support is intricate due to the nonlinearity of models and controllers and the complexity of wind farm interactions with power systems. Here, to address this challenge, this paper introduces a novel approach that integrates wind turbines into reinforcement learning-based solutions for frequency response. This innovative methodology utilizes the state-of-the-art reinforcement learning algorithm known as the surrogate-gradient-based evolutionary strategy. The proposed learning-based algorithm provides continuous control of wind farm output to rapidly stabilize system frequency and prevent unnecessary trips of under-frequency load shedding relays. To facilitate efficient training, parallel computing techniques are employed. The proposed methodology is evaluated on a modified IEEE-39 bus system, and simulation results reveal its efficacy in reliably supporting power system frequency and preventing the need for unnecessary load shedding.

Gao, Wei [Argonne National Laboratory (ANL), Argon↗
DOE OSTI2025

Data-Driven Mean-Corrected Recursive Estimation-Based Optimal DER Dispatch for Distribution System Voltage Control

Recent advances in smart inverters offer opportunities to mitigate adverse grid impacts caused by high penetrations of distributed photovoltaics (PV) in distribution grids, such as voltage violations. Here, this paper proposes a novel measurement-driven optimal power flow (OPF)-based distributed energy resource management system (DERMS) voltage regulation via recursive sensitivity estimation informed coordinated control of distributed PV inverters. The proposed approach leverages available grid and controllable DER measurements, eliminating reliance on system model information while being adaptive and robust to volatile operating conditions. A mean-corrected recursive ridge regression (MCRRR) algorithm is proposed for sensitivity estimation, continuously refining the sensitivity model through a closed-form solution. It effectively manages varying grid operating conditions, such as changes in power injections and topology reconfiguration, to facilitate a time-varying update of the Load Sensitivity Factors (LSF). The proposed approach is formulated as a linear programming (LP) problem and is thus scalable to larger-scale distribution systems. Its effectiveness and efficiency are demonstrated on a realistic distribution feeder with high PV penetrations in Southern California, USA.

14 SOLAR ENERGY↗
DOE OSTI2024

Innovating the next generation of commercial smart building software

Nearly 30% of commercial building energy use is wasted due to equipment faults and HVAC controls problems. The result is increased emissions, compromised comfort and productivity, and less reliable coordination of building power needs with a clean grid. The energy impact alone represents $17 billion in potential savings. Today’s smart building software provides a robust solution to address these operational deficiencies. Energy management and information systems (EMIS) are saving up to 9% on average, with two-year paybacks. They are being incorporated into energy management processes, commissioning services, and utility programs. As effective as they are, two barriers prevent even deeper benefits; limited personnel to fix problems once they are identified, and the expense and time to manually implement changes in control systems. In partnership with the research community, the EMIS industry is developing new capabilities to overcome these barriers. Moving beyond siloed products for either fault detection and diagnostics, or optimal control, these new capabilities empower users to not only automatically identify faults, but also to push corrective action, and control improvements to their buildings. In this paper, several areas for enhancements are documented: ‘one-time’ correction of faults such as setpoints, schedules, and economizer lockouts; short-term active testing for automated proportional integral derivative (PID) loop tuning and functional testing; and continuous supervisory control for demand flexibility and year-round efficiency. Results are presented from a pair of partner implementations out of a dozen providers integrating these enhancements into their products, including field tests from across the country, and insights into operator acceptance and integration into operations and maintenance practices.

Casillas, Armando↗
DOE OSTI2026

Control Algorithms for Dual-wavefront Sensor Single-conjugate Adaptive Optics

High-contrast imaging systems using active control with adaptive optics (AO) are often limited by non-common path (NCP) aberrations that are seen only at the final science image. AO systems employing focal-plane wavefront sensors (FP-WFSs) are able to simultaneously correct NCP aberrations and measure science images, but they typically require a second stage of control that adds system cost and complexity. We present control algorithms to augment AO systems with FP-WFSs within their existing control setup. We demonstrate inter-arm NCP aberration transfer can be mitigated through temporal filtering, present frequency- and time-domain validation of controller stability and performance, and discuss the optimality of the chosen controllers. This work will enable the development, testing, and installation of FP-WFS technologies for direct imaging of exoplanets.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Precise Motion Control of Hybrid Hydraulic Electric Architecture (HHEA)

Off-highway heavy-duty vehicles have been long-standing users of hydraulic systems for power transmission and control. However, traditional hydraulic systems suffer from significant energy losses which lead to increased operating costs and a larger carbon footprint due to higher CO2 emissions. Improving the efficiency of these mobile machines is crucial not only for reducing their environmental impact but also for saving billions of dollars in operating costs. Currently, the state-of-the-art Load Sensing Architecture uses throttling valves for control, which significantly reduces its efficiency and does not recuperate energy from over-running loads. Researchers have developed several architectures such as Common Pressure Rail systems, Displacement Control, STEAM, and Electrohydraulic Architecture to improve the efficiency of off-road mobile machines. However, each of these architectures has its drawbacks. To increase system efficiency and take advantage of electrification benefits, our research group has developed a novel Hybrid Hydraulic-Electric Architecture (HHEA). The HHEA can significantly improve efficiency, decrease the size of electrical components, and maintain control performance. This new architecture has the potential to revolutionize the off-highway mobile machine industry and lead to a more sustainable future. The HHEA uses a set of common pressure rails to provide the majority of power to the actuators via power-dense hydraulics and uses electric motors for precise control and power modulation. In the context of off-road mobile machines, energy savings are undoubtedly important but it is equally important to consider the machines’ ability to perform tasks with precision and accuracy according to given commands. Therefore, precise motion control is of utmost importance to maintain the utility of Hybrid Hydraulic-Electric Architecture (HHEA). The HHEA presents a unique challenge to motion control due to the discrete pressure changes that occur when the system switches between selected pressure rails. These changes are made to minimize system inefficiencies or to keep the system within the torque capability of the electric motor. Hence, it is important to solve the motion control challenges for HHEA. This thesis aims at developing an effective motion control strategy for HHEA. The dissertation presents a two-tiered control strategy for HHEA, comprising a high-level and a low-level controller. The primary responsibility of the high- level controller is to optimize energy efficiency by making informed pressure rail selections. On the other hand, the low-level controller is focused on achieving precise motion control of the HHEA, which is crucial for realizing the desired reference trajectories. To achieve this, the low-level controller utilizes a passivity-based backstepping integral controller as the nominal control, which handles the motion control between two pressure rail switches. Additionally, a separate least norm controller is utilized as a transition controller to manage motion control during pressure rail transitions. The effectiveness of the combined control strategy is demonstrated through experiments conducted on two hardware-in-the-loop testbeds. Furthermore, the HHEA is installed on the boom and stick actuators of a backhoe arm to build a Human-in-the-Loop system that a human operator can control. A real-time rail switching algorithm is developed to determine pressure rail switching based on present duty cycle information from the operator. Modifications have been made to the human-machine interface to achieve more intuitive control. Modifications include performing control in the task-oriented coordinates, incorporating pressure feedback to enhance control with physical interaction, and using velocity field control to simplify multi-degree-of-freedom tasks and to enable novice operators to perform them with reduced risk, improved efficiency, and productivity. The research in this dissertation makes significant contributions to the field of off-road mobile machine control, providing a novel and effective control strategy for the HHEA, and demonstrating the potential for simplified machine operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗