Search NASA⌕ Search

SEARCH · Search NASA

Results for “Optimal Control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Asynchronous quadratic control for constrained hidden markov jump linear systems with incomplete MTPM and MOCPM

Abstract This paper investigates the quadratic optimal control problem for constrained Markov jump linear systems with incomplete mode transition probability matrix (MTPM). Considering original system mode is not accessible, observed mode is utilized for asynchronous controller design where mode observation conditional probability matrix (MOCPM), which characterizes the emission between original modes and observed modes is assumed to be partially known. An LMI optimization problem is formulated for such constrained hidden Markov jump linear systems with incomplete MTPM and MOCPM. Based on this, a feasible state-feedback controller can be designed with the application of free-connection weighting matrix method. The desired controller, dependent on observed mode, is an asynchronous one which can minimize the upper bound of quadratic cost and satisfy restrictions on system states and control variables. Furthermore, clustering observation where observed modes recast into several clusters, is explored for simplifying the computational complexity. Numerical examples are provided to illustrate the validity.

Zhu, Jin↗
DOE OSTI2021

Adaptive critic design-based reinforcement learning approach in controlling virtual inertia-based grid-connected inverters

In this report, an adaptive critic design (ACD) approach is proposed to control the phase and voltage of a grid-connected virtual synchronous generator (VSG). The penetration of fast responding inertia-less power converters significantly affect the stability of the power system, especially weak systems such as micro grids. The concept of virtual inertia addresses this concern by virtually emulating the behavior of a synchronous generator. However, the conventional VSG is designed based on two conditions: (i) fixed operating point and (ii) inductive grid connections. The performance of VSGs in low-voltage semi-resistive microgrids is far from optimal. To overcome the aforementioned concerns, a heuristic dynamic programing (HDP) approach is proposed to optimally control grid-connected VSGs. The neural-network-based inherence of the HDP enables the proposed technique to adapt to any impedance angle. The HDP controller includes two subnetworks: (i) the action network that controls the system optimally and (ii) the critic network, which evaluates the effectiveness of the action network. The simulation and experimental results are provided to evaluate the effectiveness of the proposed technique. As shown, the HDP-based approach illustrates a better performance in comparison with the conventional PI-based VSG in various operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

HHL algorithm with mapping function and enhanced sampling for model predictive control in microgrids

Here, this paper presents a refined quantum Harrow Hassidim Lloyd (HHL) algorithm for microgrid control. The first novelty of the developed method is that a mapping shift function enables the original HHL algorithm to handle general linear equations with non-singular and indefinite matrix. Second, a method of Matrix Extension for Amplifying Sampling Probabilities of Intended Solution (ME-ASPI) is proposed to design the reformulated linear algebraic equations, allowing for improved sampling efficiency of the quantum tomography in the refined HHL algorithm. Then, we applied the method to solve the model predictive control (MPC) problem in nonlinear dynamical microgrids. Specifically, with the ME-ASPI method, the refined HHL algorithm can effectively obtain the intended partial optimal control inputs for MPC. The optimization of quadratic programming problem in each time step of MPC is transformed into a linear system problem, which is addressed by the proposed quantum solver through using only partial information, with the time complexity improved from $\mathscr{O}(\mathscr{N}^{2.37286})$ classically to $\mathscr{O}(\mathscr{N}^{2} log \mathscr{N}$ x $p$ log $p)$ in quantum. Numerical examples have validated the effectiveness of the refined HHL algorithm with the proposed mapping function and the ME-ASPI method. By leveraging quantum properties, the proposed method provides a hybrid quantum–classical framework for microgrid control. This generic method can also potentially tackle many other challenges in analyzing and controlling general complex engineered systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Juqbox.jl

The Juqbox.jl package implements functionality for solving the quantum optimal control problem for realizing logical gates in closed quantum systems. The dynamics of the quantum system is modeled by Schroedinger's equation, which takes to form of a linear system of ordinary differential equations (ODE). Juqbox.jl solves this ODE by numerical time stepping and applies a gradient-based optimization technique to determine control pulses for driving an initial state to a final state, according to the desired logical gate transformation. To evaluate the gradient, Juqbox.jl applies the ``first discretize, then optimize'' approach based on a discrete adjoint time stepping technique. The actual optimization is performed by the open source Ipopt libaray. Juqbox.jl is written in the Julia programming language which, among many other features, provides a convenient interface to the Ipopt library.

PETERSSON, NILSA.↗
DOE OSTI2022

Differentiable Predictive Control with Safety Guarantees: A Control Barrier Function Approach

In this paper, we develop a novel form of differentiable predictive control (DPC) with safety and robustness guarantees. DPC is a form of approximate model predictive control (MPC), wherein the control policy is a neural network that learns a receding horizon, optimal control law. The proposed approach exploits a new form of sampled-data barrier function to enforce safety, while only interrupting the neural network-based controller near the boundary of the safe set. The effectiveness of the proposed approach is demonstrated in simulation.

Shaw Cortez, Wenceslao E.↗
DOE OSTI2025

Powering the Woods Hole X-Spar Buoy with Ocean Wave Energy—A Control Co-Design Feasibility Study

Despite its success in measuring air–sea exchange, the Woods Hole Oceanographic Institution’s (WHOI) X-Spar Buoy faces operational limitations due to energy constraints, motivating the integration of an energy harvesting apparatus to improve its deployment duration and capabilities. This work explores the feasibility of an augmented, self-powered system in two parts. Part 1 presents the collaborative design between X-Spar developers and wave energy researchers translating user needs into specific functional requirements. Based on requirements like desired power levels, deployability, survivability, and minimal interference with environmental data collection, unsuitable concepts are pre-eliminated from further feasibility study consideration. In part 2, we focus on one of the promising concepts: an internal rigid body wave energy converter. We apply control co-design methods to consider commercial of the shelf hardware components in the dynamic models and investigate the concept’s power conversion capabilities using linear 2-port wave-to-wire models with concurrently optimized control algorithms that are distinct for every considered hardware configuration. During this feasibility study we utilize two different control algorithms, the numerically optimal (but acausal) benchmark and the optimized damping feedback. We assess the sensitivity of average power to variations in drive-train friction, a parameter with high uncertainty, and analyze stroke limitations to ensure operational constraints are met. Our results indicate that a well-designed power take-off (PTO) system could significantly extend the WEC-Spar’s mission by providing additional electrical power without compromising data quality.

autonomous systems↗
DOE OSTI2019

Framework for Multi Layer Control in Python (FMLC) v1.0

This package is developed as a backend for multi-layer and multi-time domain controller. One example are controller based on [Model Predictive Control] (MPC) where different modules with different time constants have to be coordinated to allow optimal control. In a simple example, the Weather Forecast must be acquired and processed, the MPC is computed, and finally the control is applied. All these modules typically run on the same time step (Time step: 5 minutes), but are different instances within the framework. The framework allows parallelization using the `multiprocessing` module. However, another real-time controller (Time step: 1 second) must be applied to react on instant system disturbances beyond the MPC time step. Last, a supervisory MPC controller (Time step: 1 hour) might be added to ensure global optimality.

Gehbauer, Christoph↗
DOE OSTI2024

Developing an Energy-Conscious Traffic Signal Control System for Optimized Fuel Consumption in Connected Vehicle Environments

The project titled “Developing an Energy-Conscious Traffic Signal Control System for Optimized Fuel Consumption in Connected Vehicle Environments” addresses energy-related challenges associated with adaptive traffic control systems by integrating connected vehicles (CV) and connected infrastructure (CI). The system developed in this project, a CV-based adaptive traffic control system, aims to improve fuel consumption in mixed traffic environments by capitalizing on emerging CV and CI communication technologies, as well as leveraging recent advances in Artificial Intelligence (AI), optimization, and edge computing. The system was tested at the MLK Smart Corridor, an urban testbed managed by the University of Tennessee at Chattanooga (UTC) and the City of Chattanooga. The system was validated through extensive simulations, both Software-in-the-Loop (SILS) and Hardware-in-the-Loop (HILS), and was further implemented and tested in real-world conditions at several intersections along the corridor. The Fuel Consumption Performance Index (FC-PI) and the Ecological Performance Index (Eco-PI) were developed as the key components for evaluating the system’s impact on fuel consumption and emissions. These metrics provided a comprehensive means of understanding the impact of traffic signal control optimization in mixed traffic environments. The report presents an in-depth analysis of the Eco-PI, FC-PI, adaptive traffic control system integration, and the testing and field implementation of the system. The results demonstrate significant reductions in fuel consumption and emissions, showcasing the system’s capability to contribute to more sustainable urban traffic management. The report also documents the challenges encountered and recommendations for scaling and further improving the system.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Improving convergence of the Matrix Power Control Algorithm for random vibration testing

Herein, this paper describes modifications to the Matrix Power Control Algorithm (MPCA) to improve convergence for Random Vibration Control (RVC) testing. In particular, this paper presents Multiple-Input Multiple-Output (MIMO) implementations of MPCA in simulation and experiment. An Euler–Bernoulli beam model was simulated with applied base excitations and the Box Assembly with Removable Component (BARC) was used in experiment to validate results. The Bayesian optimization package Dragonfly was used to optimize control parameters. Additionally, a moving-average was employed and optimized to improve the measured response feedback for MPCA, reduce the number of averages needed to be taken between control updates, and further improve convergence. The key results of this paper show that the performance of MPCA can be improved by tuning the control parameters and by applying an optimized moving-average. Furthermore, it is demonstrated that convergence can be achieved within 12 drive-frames, which greatly enhances vibration control capability.

42 ENGINEERING↗
DOE OSTI2017

Balancing Power Absorption Against Structural Loads With Viscous Drag and Power-Takeoff Efficiency Considerations

The focus of this paper is to balance power absorption against structural loading for a novel fixed-bottom oscillating surge wave energy converter in both regular and irregular wave environments. The power-to-load ratio will be evaluated using pseudospectral control (PSC) to determine the optimum power-takeoff (PTO) torque based on a multiterm objective function. This paper extends the pseudospectral optimal control problem to not just maximize the time-averaged absorbed power but also include measures for the surge-foundation force and PTO torque in the optimization. The objective function may now potentially include three competing terms that the optimizer must balance. Separate weighting factors are attached to the surge-foundation force and PTO control torque that can be used to tune the optimizer performance to emphasize either power absorption or load shedding. To correct the pitch equation of motion, derived from linear hydrodynamic theory, a quadratic-viscous-drag torque has been included in the system dynamics; however, to continue the use of quadratic programming solvers, an iteratively obtained linearized drag coefficient was utilized that provided good accuracy in the predicted pitch motion. Furthermore, the analysis considers the use of a nonideal PTO unit to more accurately evaluate controller performance. The PTO efficiency is not directly included in the objective function but rather the weighting factors are utilized to limit the PTO torque amplitudes, thereby reducing the losses resulting from the bidirectional energy flow through a nonideal PTO. Furthermore, results from PSC show that shedding a portion of the available wave energy can lead to greater reductions in structural loads, peak-to-average power ratio, and reactive power requirement.

16 TIDAL AND WAVE POWER↗
DOE OSTI2017

Power-to-load balancing for asymmetric heave wave energy converters with nonideal power take-off

The aim of this study is to maximize the power-to-load ratio for asymmetric heave wave energy converters. Linear hydrodynamic theory was used to calculate bounds of the expected time-averaged power (TAP) and corresponding surge-restraining force, pitch-restraining torque, and power take-off (PTO) control force with the assumption of sinusoidal displacement. This paper formulates an optimal control problem to handle an objective function with competing terms in an attempt to maximize power capture while minimizing structural and actuator loads in regular and irregular waves. Penalty weights are placed on the surge-restraining force, pitch-restraining torque, and PTO actuation force, thereby allowing the control focus to concentrate on either power absorption or load mitigation. The penalty weights are used to control peak structural and actuator loads that were found to curb the additional losses in power absorption associated with a nonideal PTO. Thus, in achieving these goals, a per-unit gain in TAP would not lead to a greater per-unit demand in structural strength, hence yielding a favorable benefit-to-cost ratio. Demonstrative results for 'The Berkeley Wedge' in the form of output TAP, reactive TAP needed to drive WEC motion, and the amplitudes of the surge-restraining force, pitch-restraining torque, and PTO control force are shown.

16 TIDAL AND WAVE POWER↗
DOE OSTI2015

Optimal shielding design for minimum materials cost or mass

The mathematical underpinnings of cost optimal radiation shielding designs based on an extension of optimal control theory are presented, a heuristic algorithm to iteratively solve the resulting optimal design equations is suggested, and computational results for a simple test case are discussed. A typical radiation shielding design problem can have infinitely many solutions, all satisfying the problem's specified set of radiation attenuation requirements. Each such design has its own total materials cost. For a design to be optimal, no admissible change in its deployment of shielding materials can result in a lower cost. This applies in particular to very small changes, which can be restated using the calculus of variations as the Euler-Lagrange equations. Furthermore, the associated Hamiltonian function and application of Pontryagin's theorem lead to conditions for a shield to be optimal.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2016

Predictive Scheduling for Electric Vehicles Considering Uncertainty of Load and User Behaviors

Un-coordinated Electric Vehicle (EV) charging can create unexpected load in local distribution grid, which may degrade the power quality and system reliability. The uncertainty of EV load, user behaviors and other baseload in distribution grid, is one of challenges that impedes optimal control for EV charging problem. Previous researches did not fully solve this problem due to lack of real-world EV charging data and proper stochastic model to describe these behaviors. In this paper, we propose a new predictive EV scheduling algorithm (PESA) inspired by Model Predictive Control (MPC), which includes a dynamic load estimation module and a predictive optimization module. The user-related EV load and base load are dynamically estimated based on the historical data. At each time interval, the predictive optimization program will be computed for optimal schedules given the estimated parameters. Only the first element from the algorithm outputs will be implemented according to MPC paradigm. Current-multiplexing function in each Electric Vehicle Supply Equipment (EVSE) is considered and accordingly a virtual load is modeled to handle the uncertainties of future EV energy demands. This system is validated by the real-world EV charging data collected on UCLA campus and the experimental results indicate that our proposed model not only reduces load variation up to 40% but also maintains a high level of robustness. Finally, IEC 61850 standard is utilized to standardize the data models involved, which brings significance to more reliable and large-scale implementation.

Wang, Bin↗
DOE OSTI2023

Lower and upper threshold limit for artificial neural network based chilled and condenser water temperatures set-point control in a chilled water system

In this study, an ANN (artificial neural network) based real-time optimized control algorithm for a chilled water cooling system was developed and applied in an actual building to analyze its cooling energy saving effects through in-situ application and actual measurements. For this purpose, the cooling tower’s CndWT (condenser water temperature) and the chiller’s ChWT (chilled water temperature) were set as system control variables. To evaluate algorithm performance, the electric consumption and the COP (coefficient of performance) were compared and analyzed when ChWT and CndWTs were controlled conventionally and controlled based on the ANN. During the analysis, unexpected abnormal data was observed due to insufficient training data and limited consideration of OWBT (outdoor air wet-bulb temperature) when determining the CndWT set-point. Therefore, it is necessary to further build training data from a wider range of conditions and to set the lower limit of CndWT set-point to at least +3.6 °C above OWBT when the OWBT is higher than 23 °C, so that further energy savings can be achieved.

42 ENGINEERING↗
DOE OSTI2022

Harnessing deep reinforcement learning to construct time-dependent optimal fields for quantum control dynamics

Here, we present an efficient deep reinforcement learning (DRL) approach to automatically construct time-dependent optimal control fields that enable desired transitions in dynamical chemical systems. Our DRL approach gives impressive performance in constructing optimal control fields, even for cases that are difficult to converge with existing gradient-based approaches. We provide a detailed description of the algorithms and hyperparameters as well as performance metrics for our DRL-based approach. Our results demonstrate that DRL can be employed as an effective artificial intelligence approach to efficiently and autonomously design control fields in quantum dynamical chemical systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Building thermal model development of typical house in U.S. for virtual storage control of aggregated building loads based on limited available information

A building thermal model is an essential component for achieving optimal control of a building’s heating, ventilation, and air conditioning (HVAC). A self-learning grey-box model has been developed by implementing data-driven techniques and utilizing limited available information about the building. In previous research, detailed foreknown knowledge/information, e.g. physical and thermal properties of building materials, as well as sufficient number of observation points, e.g. indoor temperature sensors in different zones, are available for making the decision of model structure and parameters searching range easier. The availability of measured data and a narrowed searching range of model parameters, e.g. resistance and capacity for each wall, made the adopted algorithms quickly achieve near optimal values, which closely approximate the actual heat transfer of a building. Meanwhile, the details of pre-processing of the key inputs were seldom explained. Compared to the previous research, in this study, the available information is assumed to be limited which can fill the requirement for large scale virtual storage control of real residential community in near future, where it may be impractically or over time-consuming to acquire the detailed information for each single house. The developed model is validated by comparing the results to measured data in a recently-built home typical of the southeastern United States.

Cui, Borui↗
DOE OSTI2026

Toward real-time optimization through model reduction and model discrepancy sensitivities

Optimization problems arise in a range of scenarios, from optimal control to model parameter estimation. In many applications, such as the development of digital twins, it is essential to solve these optimization problems within wall-clock-time limitations. However, this is often unattainable for complex systems, such as those modeled by nonlinear partial differential equations. One strategy for mitigating this issue is to construct a reduced-order model (ROM) that enables more rapid optimization. In particular, the use of nonintrusive ROMs—those that do not require access to the full-order model at evaluation time—is popular because they facilitate the computation of optimization solutions within the wall-clock time requirements. However, the optimization solution will be unreliable if the iterates move outside the ROM training data. This article proposes the use of hyper-differential sensitivity analysis with respect to model discrepancy (HDSA-MD) as a computationally efficient tool to augment ROM-constrained optimization and improve its reliability. The proposed approach consists of two phases: (i) an offline phase where several full-order model evaluations are computed to train the ROM, and (ii) an online phase where a ROM-constrained optimization problem is solved, a limited number of full-order model evaluations are computed, and HDSA-MD is used to enhance the optimization solution. Numerical results are demonstrated for two examples, atmospheric contaminant control and wildfire ignition location estimation, in which a ROM is trained offline using inaccurate atmospheric data. In conclusion, the HDSA-MD update yields a significant improvement in the ROM-constrained optimization solution using only one full-order model evaluation online with corrected atmospheric data.

PDE-constrained optimization↗
DOE OSTI2022

Metal-organic framework supported single-site nickel catalysts for butene dimerization

Homotopic sites in a well-controlled environment are not only ideal systems for mechanistic studies, but also allow optimal control of catalytic transformations. Sites having only a single metal cation and sites consisting of metal oxo complexes with few nickel (Ni) cations supported on the nodes of UiO-66 metal-organic framework (Ni-UiO-66) are studied for 1-butene dimerization. Monomeric Ni sites, which bind to the Zr 6 node via two Zr-OH(µ3) linkages, are active and selective for the dimerization of 1-butene to linear and mono-branched C 8 isomers. Ni oxo complexes with few Ni cations show lower activity and promote the oligomerization of transiently formed C 8 isomers. In conclusion, Kohn-Sham density function theory calculations combined with spectroscopic measurements and kinetic analyses indicate that dimerization follows a Cossee-Arlman reaction mechanism.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗