SEARCH · Search NASA

Results for “controller”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Deep Reinforcement Learning-Based Control of Energy Storage for Interarea Oscillation Damping

With the increasing electricity consumption and lack of transmission investment, today's power systems are operated much closer to their limits, raising concerns of inter-area oscillations that deteriorate the system stability. Here, this article presents a novel energy storage placement and control approach for enhanced damping of interarea oscillations. Combining the residual analysis and dominant mode analysis, we are able to identify the advantageous locations for placing energy storage that achieve improved damping performance. To overcome the challenges, such as fixed control parameters and insufficient damping, we propose to use a deep reinforcement learning-based approach for energy storage control. A state-of-the-art guided surrogate-gradient-based evolutionary strategy is used to train a learning agent in a robust, efficient, and reproducible manner. Parallel computing is also adopted to speed up the training process. The proposed strategy has been tested on both medium and large-scale systems. The proposed methods have demonstrated their effectiveness in mitigating various interarea oscillations within a timeframe of 20 s, thereby averting system collapse and enhancing power grid stability effectively.

25 ENERGY STORAGE↗

DOE OSTI2025

Safe Reinforcement Learning-Based Transient Stability Control for Islanded Microgrids With Topology Reconfiguration

This paper proposes a safe reinforcement learning (RL)-based transient stability emergency control (TSEC) method for islanded microgrids. RL requires extensive interaction with the environment to learn control strategies, hence, a data-driven approach is used as a substitute for time-consuming time-domain simulation calculations. Deep sigma point processes (DSPP), which is a Gaussian process model, is utilized to predict the normal distribution of transient stability of microgrids and to construct a transient stability chance constraint. Reward-constrained policy optimization (RCPO) can simultaneously achieve objective prediction, policy learning, and constraint cost coefficient update across multiple timescales. RCPO interacts with the DSPP-based microgrid environment through a multi-process parallel manner, greatly increasing the training speed. Case studies on a real islanded microgrid demonstrate that the proposed method can efficiently and quickly obtain the optimal emergency control strategy while adhering to all hard constraints.

14 SOLAR ENERGY↗

DOE OSTI2024

Review and Gap Analysis of Heliostat Components and Controls

This investigation provides a comprehensive literature review pertaining to heliostat components and controls as part of the U.S. Department of Energy (DOE), Heliostat Consortium (Heliocon) program. Here, this work presents a detailed assessment of subcomponents, controls and wireless communications elements that comprise various designs of helisotats within concentrating solar power (CSP) installations. Additionally, this work also provides the results of an industry survey, intended to compliment the literature discussion, to provide a gap analysis of the primary technology and cost areas that need to be addressed to help improved to spur concentrating solar power (CSP) bankability. Although the results of the study determined several key areas for development, three strategic areas identified were: (1) the use of advanced composite materials to replace a need for expensive steel within the structure and mirror substrate, (2) employment of closed-loop controls for automated calibration, reduction of commissioning time and O&M hours, reduction of drive requirements, as well as overall cost reduction, and (3) the need for more Heliostat-centric codes and standards to facilitate engineering confidence in the development of new features, cost reductions, or other design iterations to be seamlessly introduced without optical performance problems.

14 SOLAR ENERGY↗

DOE OSTI2025

Covariance-Free Bifidelity Control Variates Importance Sampling for Rare Event Reliability Analysis

Multifidelity modeling has been steadily gaining attention as a tool to address the problem of exorbitant model evaluation costs that makes the estimation of failure probabilities a significant computational challenge for complex real-world problems, particularly when failure is a rare event. To implement multifidelity modeling, estimators that efficiently combine information from multiple models/sources are necessary. In past works, the variance reduction techniques of control variates (CV) and importance sampling (IS) have been leveraged for this task. In this paper, we present the CVIS framework—a creative take on a coupled CV and IS estimator for bifidelity reliability analysis. The framework addresses some of the practical challenges of the CV method by using an estimator for the control variate mean and sidestepping the need to estimate the covariance between the original estimator and the control variate through a clever choice for the tuning constant. Furthermore, the task of selecting an efficient IS distribution is also considered, with a view towards maximally leveraging the bifidelity structure and maintaining expressivity. Additionally, a diagnostic is provided that indicates both the efficiency of the algorithm as well as the relative predictive quality of the models utilized. Finally, the behavior and performance of the framework is explored through analytical and numerical examples.

Markov chain Monte Carlo↗

DOE OSTI2025

Domain Decomposition for Integer Optimal Control with Total Variation Regularization

Total variation integer optimal control problems admit solutions and necessary optimality conditions via geometric variational analysis. In spite of the existence of said solutions, algorithms which solve the discretized objective suffer from high numerical cost associated with the combinatorial nature of integer programming. Hence, such methods are often limited to small and medium-sized problems. We propose a globally convergent, coordinate descent–inspired algorithm that allows tractable subproblem solutions restricted to a partition of the domain. Our decomposition method solves relatively small trust-region subproblems that modify the control variable on a subdomain only. Given nontrivial subdomain overlap, we prove that a global first-order necessary optimality condition is equivalent to a first-order necessary optimality condition per subdomain. We additionally show that a sufficient decrease is achieved on a single subdomain by way of a trust-region subproblem solver using geometric measure–theoretic arguments, which we integrate with a greedy patch selection to prove convergence of our algorithm. In conclusion, we demonstrate the practicality of our algorithm on a benchmark large-scale, PDE-constrained integer optimal control problem and find that our method is faster than the state of the art.

domain decomposition↗

DOE OSTI2025

Closing the loop: model-predictive control for a closed-circuit reverse osmosis system

This article presents a model-predictive controller (MPC) for the maximization of the energy efficiency of a closed-circuit desalination reverse osmosis (CCRO) system. CCRO is a process for producing drinking water that is based on a cyclic operation with the following two phases: (a) filtration and (b) drain. In this article, we test model predictive control for optimal control of this process. The most important features of our approach are as follows: (a) the selection of a model structure that enables reliable forecasts of the filtration phase (up to 3 h), (b) an on-line model calibration strategy that ensures model forecast reliability, and (c) the satisfaction of equipment safety and operational constraints on the selected setpoints. We challenge this through deliberate introduction of changes in the unmeasured feed concentration and the applied constraints. Our results indicate that frequent model parameter updates are critical to maintain model reliability for MPC purposes. In addition, we illustrate that parameter identifiability is not guaranteed and that deliberate variation in flow rates is necessary even though the process never operates in steady state. Finally, MPC can compute flow rate setpoints that maximize the energy efficiency of the CCRO process while satisfying the applicable equipment and safety constraints.

closed-circuit reverse osmosis↗

DOE OSTI2024

End-Use Savings Shapes Measure Documentation: Thermostat Control for Load Shifting in Large Offices

This documentation focuses on a single end-use savings shape measure - thermostat control for load shifting. The thermostat control for load shifting measure applies heating and cooling temperature setpoint adjustment for pre-conditioning before the peak window. The measure takes daily peak load schedule inputs generated by the method "Dispatch Schedule Generation" described in the "Supplemental Documentation: Dispatch Schedule Generation for Demand Flexibility Measures" to determine the start time of the peak window, and then adjusts the thermostat cooling or heating setpoints by a specified offset value from original schedules to precool or preheat the space , for a specified length of time before the start of peak window, and thus shifts load in the peak window to the pre-conditioning period. The measure is flexible and allows users to adjust the heating and cooling offset values and length of pre-conditioning period, but for this study, the load shifting strategy is applied as pre-cooling only (adjusting only cooling setpoints). The default adjustment for cooling setpoints is set to -1 degrees Celsius , and the default duration of pre-cooling is 1 hour. This measure is applicable to large offices equipped with electric HVAC system, which account for approximately 8.72% of the ComStock floor area. The thermostat control for load shifting measure demonstrates -1% daily peak demand reduction and 0% total site energy savings (0 trillion British thermal units [TBtu]) for the U.S. commercial building stock modeled in ComStock.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

eGridGPT: Trustworthy AI in the Control Room

This report outlines the synergy between human decision making and generative artificial intelligence (GenAI), where GenAI supports power system operators by analyzing procedures, suggesting actions, simulating scenarios with physics-based digital twins, and recommending optimal decisions. This report is the first research effort to apply large language models (LLMs), a type of GenAI, in the power grid control room. The authors describe the Electric Grid Generative Pretrained Transformer (eGridGPT), an LLM that virtually assists system operators. Developed with cybersecurity and regulatory requirements in mind, eGridGPT represents an opportunity to responsibly evolve control room technologies to meet the needs of a rapidly changing grid. As an innovative concept, eGridGPT seeks to spearhead productive discussions about the advanced technologies in the control room of the future amid the transition to clean energy.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Reinforcement Learning Control for Enhancing Marine Hydrokinetic Turbine Energy Generation

This paper proposes a reinforcement learning-based method to maximize power generation for a direct-drive marine hydrokinetic turbine. A high levelized cost of energy (LCOE) is preventative in the widespread adoption of many marine energy conversion technologies. A straightforward way to reduce LCOE is to increase conversion efficiency and ensure maximum energy generation. The proposed method utilizes a damping control methodology, varying applied generator torque via a linear relationship between the applied damping coefficient and rotor speed. A state-action-reward-state-action (SARSA) algorithm has been used to learn the optimal control action for a given flow velocity. The proposed SARSA methodology uses Gaussian radial basis functions to create a three-dimensional surface to estimate the relationship between damping coefficient, incoming flow velocity, and coefficient of power (C p ). Here, the SARSA algorithm was compared against a baseline optimal tip speed ratio controller over a year-long flow velocity case profile while considering the effects of biofouling on the turbine system, where the proposed RL method generated 0.92% more energy than the baseline.

Damp↗

DOE OSTI2026

Prediction of non-intuitive metabolic targets with bayesian metabolic control analysis to improve 3-hydroxypropionic acid production in Aspergillus niger

Development of efficient bioconversion processes is limited by the ability to predictably improve metabolic flux. Here we deployed Bayesian Metabolic Control Analysis as a platform to integrate multi-omics data with metabolic modeling and evaluated its ability to predict genetic interventions that improve metabolic flux. Global Metabolomics and proteomics data was collected from 17 Aspergillus niger strains engineered to produce the platform biochemical 3-hydroxypropionic acid from which seven actional genetic interventions were predicted from significant flux control coefficients. Of the suggested genetic interventions, two were present within the intuitively designed strains used for training (malonic semialdehyde dehydrogenase and pyruvate carboxylase) while five predicted targets were present within non-intuitive areas of the metabolic network including 5-formyltetrahydrofolate deformylase and four mitochondrial enzymes, alcohol dehydrogenase, succinyl-CoA ligase, aspartate aminotransferase, and malate dehydrogenase. Six of the targets were validated in the highest performing 3-HP strain used for multi-omics data generation which contained a prior disruption of the highest scoring target malonic semialdehyde dehydrogenase. Predicted directional perturbation of five of the six tested targets significantly improved titer and rate of 3-HP production and two significantly improved yield. The greatest improvements were observed following disruption of the non-intuitive target succinyl-CoA ligase which increased titer by 39% and yield by 29% (to 20.4 g/L 3-HP and 0.31 g 3-HP/g glucose) over the strains used for training. This study demonstrates the utility of Bayesian Metabolic Control Analysis and highlights the ability to predict meaningful genetic targets in unexpected areas of metabolism to improve engineered strains for bioconversion.

3-hydroxypropionic acid↗

DOE OSTI2026

Multibody for Everybody (M4E): A Symbolic Dynamics Modeling Tool with Applications in Simulation, Control, and Optimization

Developing the analytical model of a multibody system is often the initial step in control and optimization. The analytical model (equations of motion) describes a system’s time evolution under specified forcing conditions. Although developing these equations is easy for simple systems, this process becomes more complex for systems composed of multiple bodies. Deriving equations of motion for complex multibody systems requires specialized expertise in multibody dynamics, is time-consuming, and is susceptible to error. To address this issue, this paper presents an open-source, easy-to-use, systematic framework to derive symbolic equations of motion in both Python and MATLAB using the joint coordinate formulation. This formulation results in a set of ordinary differential equations that use the minimum set of coordinates needed to model a system. The symbolic representation provides better insight into the influence of design parameters on system performance, facilitates sensitivity analysis and parameter studies, and supports direct implementation of control and optimization routines. The tool enables numerical simulation for specified parameter sets, is modular for straightforward integration with other tools and libraries, and allows incorporation of hydrodynamics, mooring, and other external forces. The result is a reproducible, extensible pipeline for modeling, simulation, and design of complex multibody systems. The proposed tool is versatile and can be applied to domains such as robotics, control, and design. In addition, we integrated external libraries that provide capabilities for modeling offshore systems such as underwater robots and marine energy converters.

16 TIDAL AND WAVE POWER↗

DOE OSTI2025

Refining Control, Charging, and Battery Chemistry for CO 2 e Savings in Heavy-Duty Off-Road Plug-In Series Hybrid

With current and future regulations continuing to drive reductions in carbon dioxide equivalent (CO 2 e) emissions in the on-road industry, the off-road industry is also likely to be regulated for fuel and CO 2 e savings. This work focuses on converting a heavy-duty off-road material handler from a conventional diesel powertrain to a plug-in series hybrid, achieving a 49% fuel reduction and 29% CO 2 e reduction via simulation. Control strategies were refined for energy savings, including a regenerative braking strategy to increase regenerative braking and a load-following hydraulic strategy to decrease electrical energy consumption. The load-following hydraulic control shuts off the hydraulic electric machine when it is not needed—an approach not previously seen in a load-sensing, pressure-compensated system. Furthermore, these strategies achieved a 24.1% fuel savings, resulting in total savings of 61% in fuel and 41% in CO 2 e in the plug-in series compared to the conventional machine. Beyond control strategies, this study evaluated battery chemistry and charging strategy refinements for total cost of ownership (TCO) and lifetime CO 2 e. LFP batteries emerged as the most cost-effective and least emitting due to their longer lifespan, which reduced replacement frequency. Charging comparisons showed that Level 2 charging (L2C) typically resulted in lower TCO but higher lifetime CO 2 e than DC fast charging (DCFC). DCFC costs were heavily influenced by local demand charges, and DCFC emissions were heavily influenced by local grid emissions.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2026

Multibody for Everybody (M4E) - A Linearization Approach to Enable Frequency Domain Analysis, Time Integration and Control Co-Design

1.1 Background/Objectives: Marine energy represents a promising yet underexploited source of power. To increase the harvested power, significant efforts have been made to improve wave energy converter (WEC) modeling capabilities and optimize power take-off (PTO) performance; however, these efforts have often treated WEC dynamics, PTO design, and controller development sequentially. In contrast, control co-design (CCD) is emerging as a promising strategy to address these issues directly, creating a growing need for fast analysis tools suitable for repeated simulation and parametric studies [1]. To support this need, this work presents the Multibody for Everybody (M4E) [2] linearization module, which employs a symbolic toolbox to provide deeper insight of WEC design parameters. The objective is to demonstrate that a minimal-coordinate linearization of articulated WEC dynamics can provide accurate wave response predictions and substantial computational savings relative to nonlinear time-domain simulation, while preserving compatibility with broader wave-energy analysis workflows, enabling CCD. 1.2 Approach/Activities: The proposed approach linearizes the equations of motion, generated by M4E, in minimal coordinates about a selected operating point and combines the resulting system with frequencydomain hydrodynamic terms to incorporate the reduced mass, damping, stiffness, and forcing operators. The linearized model is used for both impedance-based response amplitude operator (RAO) prediction and rapid regular-wave time integration. The methodology is demonstrated on a single-flap device and a FOSWEC configuration, with linearized M4E responses compared against the corresponding nonlinear M4E simulations and WEC-Sim results. Regular-wave time histories, RAO trends, and runtime differences are assessed. The framework is also compatible with broader wave-energy workflows, including coupling to WecOptTool, although that capability is not the focus of this work [3]. 1.3 Results/Lessons: The linearized M4E model reproduces key regularwave response characteristics such as integration and Response Amplitude over multiple frequencies. This module matches nonlinear M4E and WEC-Sim results while substantially reducing integration cost. Thus, the proposed framework can serve as a rapid analysis layer for articulated WEC design, parameter studies, and controls-oriented workflows. The analysis is most appropriate in the near-equilibrium regime, about the linearization point.

16 TIDAL AND WAVE POWER↗

DOE OSTI2024

Digital Twin + AI: Control Room of the Future

A digital twin enhances power grid control room operations by providing real-time monitoring, predictive insights, simulation capabilities, remote control, training opportunities, data integration, and decision support. This technology empowers control room operators to effectively manage the grid, optimize performance, and ensure reliable and efficient energy distribution.

control room of the future↗

DOE OSTI2024

Power Sharing-Based Framework for Allocating Automatic Generation Control in Distributed Energy Resources: Preprint

The recent proliferation of distributed energy resources (DERs) in the power network along with the retirement of conventional generators has made it challenging to regulate system frequency. In this paper, we present a centralized control framework to leverage the potential of DERs in the distribution network in provisioning secondary frequency control services to the grid. The proposed framework is based on network volt-watt sensitivity analysis and takes into account DER operational and network-imposed constraints to allocate the automatic generation control (AGC) request among the aggregated units. The proposed framework was implemented on the IEEE 8500-node test feeder and results were validated against a standard linear programming-based scheme. Numerical results indicate that the proposed framework can successfully utilize the available power production headroom of the network to meet the AGC request while maintaining nodal voltages within acceptable limits.

distributed energy resources↗

DOE OSTI2024

High Penetration Microgrids Providing Grid Stability Using Frequency-Watt Control Presentation

The U.S. grid is rapidly transitioning towards utilizing inverter-based renewable energy resources such as solar, wind, and batteries, reducing the carbon emission footprint.Inverter-based microgrid control architectures remain a critical focus to address power system stability issues in future high penetration markets lacking spinning generation assets. Idaho National Laboratory (INL) is researching an active layered inverter based frequency-Watt control scheme that provides distribution level stability in high-penetration markets where grid inertia is lacking. Hardware in the loop case study was implemented using INL’s Microgrid Testbed to combat scalable frequency deviations ranging from 60 Hz down to 50 Hz initialized by a hydropower model implementing step loads using a 540-kW grid emulator. Our research findings demonstrate the importance of distribution level, inverter-based active frequency-Watt controls utilizing a battery energy storage system (BESS) to provide adequate frequency support at the point of common coupling without major power infrastructure upgrades.

13 HYDRO ENERGY↗

DOE OSTI2024

Adaptive Fault Current-Limiting Control of MMC for Protection of Multiterminal HVDC Systems: Preprint

For the development of multi-terminal high voltage DC (MTDC) transmission, it is critical to design the protection system that can selectively isolate the faulty area from the healthy part of the dc grid using DC circuit breakers (DCCBs) while ensuring continuous operation of converter stations in the healthy part. However, because of the lack of fault current blocking capability in half-bridge (HB) modular multilevel converters (MMCs), when a dc fault occurs, the rising fault currents can quickly reach the blocking threshold within a few milliseconds and disrupt the operation of MMCs in the healthy part. Large DC reactors are often considered in series with DCCBs to reduce the rate of rise of fault currents and prevent blocking of MMCs in the healthy part of the grid. However, large DC reactors can prohibitively increase the cost of the system, particularly when they are considered in an offshore environment, for instance in offshore wind projects. Large dc reactors can also introduce stability issues and create post-fault oscillations. This paper presents an adaptive fault current limiting control method for MMCs to avoid their blocking and enable continuous operation of MTDC systems. It contains two parts: The first part is based on circulating current feedforward control that emulates virtual reactors in each arm of an MMC, which is immediately activated when the fault current starts to increase, to reduce the rate of rise of the fault current; the second part is triggered when the fault current exceeds a preset threshold by temporarily bypassing the SMs, serving as a complement to the fault current limiting effect of the first part. Both parts do not require fault detection signal and they are activated automatically during faults. Simulation case studies of a four-terminal bipolar MMC-HVDC system are presented to demonstrate the effectiveness of the proposed control methods.

active fault current limiting↗

DOE OSTI2024

Dynamically Learning Incentives for Load Control

As electrical generation becomes more distributed and volatile, and loads become more uncertain, controllability of distributed energy resources (DERs), regardless of their ownership status, will be necessary for grid reliability. Grid operators lack direct control over end-users' grid interactions, such as energy usage, but incentives can influence behavior -- for example, an end-user that receives a grid-driven incentive may adjust their consumption or expose relevant control variables in response. A key challenge in studying such incentives is the lack of data about human behavior, which usually motivates strong assumptions, such as distributional assumptions on compliance or rational utility-maximization. In this paper, we propose a general incentive mechanism in the form of a constrained optimization problem -- our approach is distinguished from prior work by modeling human behavior (e.g., reactions to an incentive) as an arbitrary unknown function. We propose feedback-based optimization algorithms to solve this problem that each leverage different amounts of information and/or measurements. We show that each converges to an asymptotically stable incentive with (near)-optimality guarantees given mild assumptions on the problem. Finally, we evaluate our proposed techniques in voltage regulation simulations on standard test beds. We test a variety of settings, including those that break assumptions required for theoretical convergence (e.g., convexity, smoothness) to capture realistic settings. In this evaluation, our proposed algorithms are able to find near-optimal incentives even when the reaction to an incentive is modeled by a theoretically difficult (yet realistic) function.

demand response↗