Search NASA⌕ Search

SEARCH · Search NASA

Results for “control algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

A Hierarchical Multi-Agent Based Anomaly Detection for Wide-Area Protection in Smart Grid

Future smart grid capabilities provide assurance to expand the advanced information and communication technologies to evolve into densely interconnected cyber physical system. Remedial Action Scheme (RAS), widely used for wide-area protection, relies on the interconnected networks and data sharing devices, which are exposed to the multitude of vulnerabilities. This paper presents our proposed approach to developing multi-agent based RAS scheme against the system-aware stealthy cyber-attacks. Specifically, we propose the two-level hierarchical architecture which consists of distributed local RAS controllers (RAScs) as local agents, operating at different zones/ areas, which are constantly monitored by an overseer, the central agent. The local controllers receive local and randomly changing outside zonal measurements and cyclically forwards to the overseer. The overseer identifies the corrupted controller using the anomaly detection algorithm which processes the measurements coming from the local controllers, compute measurement errors using local and outside zonal measurements, perform validation checks, and finally detect anomalies based on the two-step verification. Next, as a proof of concept, we have implemented and validated the proposed methodology in cyber physical environment at Iowa State’s PowerCyber testbed. We have also implemented the coordinated attack vectors which involve corrupting the local controller and later performing stealthy attacks on the system’s generator. We have evaluated its performance during the online testing in terms of detection rate and Iatency. The experimental results show that it is efficient in detecting different classes of attacks, including ramp and pulse attacks.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Real-Time Distributed Control of Smart Inverters for Network-level Optimization

The limitations of centralized optimization methods in managing electric power distribution systems operations have led to the distributed paradigm of computing and decision-making. Unfortunately, the existing distributed optimization algorithms are limited in their applicability to managing fast varying phenomena such as those resulting from highly variable Distributed Energy Resource (DER) generation patterns. They require a large number of communication rounds (in the order of 10 2 to 10 3 ) among the computing agents to solve one instance of the optimization problem. Related real-time distributed control methods are equally limited in their applications to power distribution systems with fast-changing DER generation; they require hundreds of rounds of communication and thus are slow in tracking the network-level optimal solutions. In this paper, we propose a novel distributed voltage controller that provides a fast-tracking of rapidly varying DER generation profiles while simultaneously converging to network-level optimal solutions within a few communication rounds. The proposed control algorithm leverages the radial topology of the system, which reduces the required communication rounds to reach the network-level optimum solution by order of magnitude. The novelty lies in carefully reducing the electrical network model from the perspective of each distributed controller and enabling appropriate data sharing among upstream and downstream nodes to achieve fast convergence. The simulation results demonstrate the effectiveness of the proposed approach in minimizing the feeder losses while maintaining the node voltage within the pre-specified limits.

voltage control, optimization, reactive power, inv↗
DOE OSTI2021

Model-based and Model-free Designs for an Extended Continuous-time LQR with Exogenous Inputs

We present an extended linear quadratic regulator (LQR) design for continuous-time linear time-invariant (LTI) systems in the presence of exogenous inputs. We first propose a model-based solution with cost minimization guarantees for states and inputs using dynamic programming (DP). The control law consists of a combination of the optimal state feedback and an additional optimal term dependent on the exogenous inputs. The control gains for the two components are obtained by solving a set of matrix differential equations. We provide these solutions for both finite horizons and steady-state cases. In the second part of the paper, we formulate a reinforcement learning (RL) based algorithm which does not need any model information except the input matrix, and can compute an approximate steady-state LQR gain using measurements of the states, the control inputs, and the exogenous inputs. Both model-based and data-driven optimal control algorithms are tested with a numerical example under different exogenous inputs showcasing the effectiveness of the designs.

Mukherjee, Sayak↗
DOE OSTI2019

Learning Behavior of Distribution System Discrete Control Devices for Cyber-Physical Security

Conventional cyber-security intrusion detection systems monitor network traffic for malicious activity and indications that an adversary has gained access to the system. The approach discussed here expands the idea of a traditional intrusion detection system within electrical power systems, specifically power distribution networks, by monitoring the physical behavior of the grid. This is achieved through the use of high-rate distribution Phasor Measurement Units (PMUs), alongside SCADA packets analysis, for the purpose of monitoring the behavior of discrete control devices. In this work we present a set of algorithms for passively learning the control logic of voltage regulators and switched capacitor banks. Upon detection of an abnormal operation, the operator is alerted and further action can be taken. Finally, the proposed learning algorithms are validated on both simulated data and on measured PMU data from a utility pilot deployment site.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Microgrid Service Restoration Incorporating Unmonitored Automatic Voltage Controllers and Net Metered Loads

Islanded microgrids may experience voltage and frequency instability due to uncontrolled state changes of voltage regulation devices and inaccurate demand forecasts. Uncontrolled state changes can occur if optimal microgrid restoration and dispatch algorithms, used for generating control commands for distributed energy resources, do not incorporate the behavior of automatic controllers of voltage regulation devices. Inaccurate demand forecasts may be encountered since post-outage demand of behind-the-meter net metered (NM) loads can vary significantly from their historical NM profiles. Here, this paper proposes an optimization formulation which allows optimal control of voltage regulators and capacitor banks without remote control and communication capabilities. A generalized demand model for NM loads is proposed which incorporates the cold load pickup phenomenon and their time varying post-outage demand in accordance with the IEEE 1547 standard. The time dependent optimal control formulation and the NM demand model are integrated in a sequential microgrid restoration algorithm by linearization of the involved logic propositions. A detailed case study on the unbalanced IEEE 123-node test system in OpenDSS validates the effectiveness of the proposed approach.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2023

Optimal Traffic Signal Control Using Priority Metric Based on Real-Time Measured Traffic Information

Optimizing traffic control systems at traffic intersections can reduce network-wide fuel consumption as well as improve traffic flow. While traffic signals have conventionally been controlled based on predetermined schedules, various adaptive control systems have been developed recently using advanced sensors such as cameras, radars, and LiDARs. By utilizing rich traffic information enabled by the advanced sensors, more efficient or optimal traffic signal control is possible in response to varying traffic conditions. This paper proposes an optimal traffic signal control method to minimize network-wide fuel consumption utilizing real-time traffic information provided by advanced sensors. This new method employs a priority metric calculated by a weighted sum of various factors, including the total number of vehicles, total vehicle speed, vehicle waiting time, and road preference. Genetic Algorithm (GA) is used as a global optimization method to determine the optimal weights in the priority metric. In order to evaluate the effectiveness of the proposed method, a traffic simulation model is developed in a high-fidelity traffic simulation environment called SUMO, based on a real-world traffic network. The traffic flow within this model is simulated using actual measured traffic data from the traffic network, enabling a comprehensive assessment of the novel optimal traffic signal control method in realistic conditions. The simulation results show that the proposed priority metric-based real-time traffic signal control algorithm can significantly reduce network-wide fuel consumption compared to the conventional fixed-time control and coordinated actuated control methods that are currently used in the modeled network. Additionally, incorporating truck priority in the priority metric leads to further improvements in fuel consumption reduction.

47 OTHER INSTRUMENTATION↗
DOE OSTI2018

Development of Integrated Biomimetic Framework with Intelligent Monitoring, Cognition and Decision Capabilities for Control of Advanced Energy Plants

The objective of the project entitled “Development of Integrated Biomimetic Framework with Intelligent Monitoring, Cognition, and Decision Capabilities for Control of Advanced Energy Plants” is to develop algorithms and methodologies for designing a biomimetic control system for optimal control of advanced energy plants. Traditionally, control systems have been designed based on assumed a priori knowledge of the process system. A number of variables are manipulated to accomplish disturbance rejection and/or servo control performance. While it is possible to adapt the process model based on available data, the control structure and the controllers rarely change. Thus, the knowledge learnt during process operation is lost or remains underutilized. In addition, the business models of today, especially for power plants, are rapidly changing. The power plant operators are being pushed to the edge due to the penetration of renewable energy derived power to the grid, the demand for high efficiency, ever-tightening environmental regulations, and requirements for increased plant availability. Thus, power plant operations need to be agile and should adapt quickly to the dynamic requirements. A number of characteristics distinguish biological systems from the traditional process control systems. Self-organization, distributed intelligence, adaptability, intelligent monitoring, cognition, and decision capabilities are some of the powerful characteristics of the biological world that can be effectively utilized in process control. At the top, the central nervous system (CNS) integrates the information from and coordinates the activities of all parts of the bodies (for bilaterian animals). Inspired by these distinct characteristics, this project seeks to develop methodologies and algorithms to accomplish: (i) self-organization of the control structure for maximizing the plant’s operating profit by mimicking the function of the cortical areas in the human brain, (ii) distributed and adaptive controllers that mimic the rule of pursuit present in ants, (iii) intelligent monitoring of the controllers powered with cognition and decision capabilities that mimic the artificial immune systems, and (iv) seamless coordination and integration in the control system that mimics the CNS.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2019

Distributed Barrier Certificates for Safe Operation of Inverter-Based Microgrids

Inverter-interfaced microgrids differ from the traditional power systems due to their lack of inertia. Vanishing timescale separation between voltage and frequency dynamics makes it critical that faster-timescale stabilizing control laws also guarantee by-construction the satisfaction of voltage limits during transients. In this article, we apply a barrier functions method to compute distributed active and reactive power setpoint control laws that certify satisfaction of voltage limits during transients. Using sum-of-squares optimization tools, we propose an algorithmic construction of these control laws. Numerical simulations are provided to illustrate the proposed method.

Kundu, Soumya↗
DOE OSTI2020

Comparison of Optimal Energy Management Strategies Using Dynamic Programming, Model Predictive Control, and Constant Velocity Prediction

Due to the recent advancements in autonomous vehicle technology, future vehicle velocity predictions are becoming more robust which allows fuel economy (FE) improvements in hybrid electric vehicles through optimal energy management strategies (EMS). A real- world highway drive cycle (DC) and a controls-oriented 2017 Toyota Prius Prime model are used to study potential FE improvements. We proposed three important metrics for comparison: (1) perfect full drive cycle prediction using dynamic programming, (2) 10-second prediction horizon model predictive control (MPC), and (3) 10-second constant velocity prediction. These different velocity predictions are put into an optimal EMS derivation algorithm to derive optimal engine torque and engine speed. The results show that the constant velocity prediction algorithm outperformed the baseline control strategy but underperformed the MPC strategy with an average 1.58% and 2.45% of FE improvement with highway and city-highway DC. Also, using a 10-second prediction window MPC strategy provided FE improvement results close to the full drive cycle prediction case. MPC has the potential to achieve 60%-65% and 70% - 80% of global FE improvement over highway and city-highway DC respectively.

Patel, Amol Arvind↗
DOE OSTI2020

Comparison of Optimal Energy Management Strategies Using Dynamic Programming, Model Predictive Control, and Constant Velocity Prediction

Due to the recent advancements in autonomous vehicle technology, future vehicle velocity predictions are becoming more robust which allows fuel economy (FE) improvements in hybrid electric vehicles through optimal energy management strategies (EMS). A realworld highway drive cycle (DC) and a controls-oriented 2017 Toyota Prius Prime model are used to study potential FE improvements. We proposed three important metrics for comparison: (1) perfect full drive cycle prediction using dynamic programming, (2) 10-second prediction horizon model predictive control (MPC), and (3) 10-second constant velocity prediction. These different velocity predictions are put into an optimal EMS derivation algorithm to derive optimal engine torque and engine speed. The results show that the constant velocity prediction algorithm outperformed the baseline control strategy but underperformed the MPC strategy with an average 1.58% and 2.45% of FE improvement with highway and city-highway DC. Also, using a 10-second prediction window MPC strategy provided FE improvement results close to the full drive cycle prediction case. MPC has the potential to achieve 60%-65% and 70% - 80% of global FE improvement over highway and city-highway DC respectively.

Patel, Amol Arvind↗
DOE OSTI2018

Highway Eco-Driving of an Electric Vehicle Based on Minimum Principle

The digital map in the on-board navigation system on passenger vehicles nowadays gives controllers access to detailed information of a planned route. Connected automated vehicles equipped with high computing power, are able to process data and leverage high control freedom available through automation. This paper proposes a fast optimization algorithm for eco-driving of electric vehicles in highway cruising scenarios. The algorithm is based on optimal control theory and takes into account road grades as well as state constraints imposed by speed limits and safe headway to the preceding car. Using Autonomie, the proposed algorithm is evaluated by simulating two example scenarios. The first result demonstrates an energy saving potential of 4.4%.

connected automated vehicle↗
DOE OSTI2023

Performance Evaluation of an Occupancy-Based HVAC Control System in an Office Building

As new algorithms incorporate occupancy count information into more sophisticated HVAC control, these technologies offer great potential for reductions in energy costs while enhancing flexibility. This study presents results from a two-year field evaluation of an occupancy-based HVAC control system installed in an office building. Two wings on each of the building’s 2–11 floors were equipped with occupancy counters to learn occupancy patterns. In combination with proprietary machine learning algorithms and thermal modeling, the occupancy data were leveraged to implement optimized start, early closure, and adjustments to fan operation at the air handling unit (AHU) level. This study conducted a holistic evaluation of technical performance, cost-effectiveness analysis, and user satisfaction. Results show the platform reduced weekday AHU run times by 2 h and 35 min per AHU per day during the pandemic time period. Simulation shows that 6.1% annual whole-building savings can be achieved when the building is fully occupied. The results are compared with prior studies, and potential drivers are discussed for future opportunities. The assessment results shed light on the expected in-the-field performance for researchers and industry stakeholders and enabled practical considerations as the technology strives to move beyond research-grade pilot trials into product-grade deployment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Neural Networks-Based Inverter Control: Modeling and Adaptive Optimization for Smart Distribution Networks

The optimal voltage control of inverter-based resources, especially under the high penetration of solar photovoltaics, is critical to the stability of the distribution power system. However, the computational complexity as well as the coordinated operation performance of the voltage control optimization in the distribution power system limits the real-time applications. To mitigate this issue, a model-free based adaptive optimal control scheme for the smart inverter is proposed to maximize the active power generation, minimize the power loss, and maintain the bus voltages in smart distribution networks. An inverter-based optimization model for coordinated operation is first established, considering the uncertainties of renewable power generation. Subsequently, by collecting the data and control strategies, the neural networks (NNs) based algorithm is proposed to efficiently predict the best possible control strategy. The main objective of this scheme is to accurately predict candidate optimal solutions with near-negligible feasibility and optimization gaps, with the advantage of avoiding complicated iteration-based numerical algorithms. Thereafter, the co-simulation among OpenDSS, MATLAB, and Python is set up to fully take advantage of the three individual software. Experiments are conducted based on different control parameter characteristics and structures of NNs. Finally, the results reveal that an average mean squared error of 0.013 and 1 ms response time are achieved, which is lower than some state-of-the-art methods.

42 ENGINEERING↗
DOE OSTI2020

Agent-Based Coordination Scheme for PV Integration (ABC4PV)

Renewables and especially photovoltaics (PV) have benefitted significantly from a host of incentives and policies targeted toward enhanced integration and adoption of specific energy technologies. However, with the push to move forward into a subsidy-free market framework, behind-the-meter residential PV applications have generally struggled to retain their value (unlike utility scale and commercial projects) [1]. This project focused on developing control-theoretic solutions aimed at improving the integration and interaction of behind-the-meter residential PV with other distribution system assets (controllable and non-controllable) to enhance the integrated value of residential PV. To this end, a suite of decentralized control methodologies have been developed to enable effective coordination and control of behind-the-meter residential load customers’ PV, battery storage systems (BSS), controllable loads and other similar assets within a distribution feeder. This interaction aims at procuring energy savings and, thus, energy bill savings. The main source of savings is drawn from reducing the effect of demand charge pricing and is realized at the feeder level, assuming community level interaction and management among the aforementioned assets. Optimal control of the assets is implemented with a distributed optimization methodology, leveraging consensus-based algorithms. The results gathered from the optimal control simulations demonstrates that the savings can be duly achieved and the algorithm decision times (to dynamically control asset set points, for example) are fast. As for the overall efficiency of PV+BSS systems, to procure energy savings from curtailment of the demand charge pricing effects, the optimal control is set up so as to minimize the variance of the load for all customers, throughout a feeder and throughout time in a rolling horizon scheduling with model predictive control. The control takes into account inter-temporal electrochemical storage (battery) degradation costs: specifically, we have developed a long-term lifetime model for the BSS that weighs in the effect of the degradation factor in the dispatch formulations, thus, a considerable operating cost that affects energy decision making. The levelized cost of energy (LCOE – redefined for the purpose of quantifying asset integration effectiveness through the customers’ energy cost) is shown to be below the threshold set for the combined PV+BSS topology of $ 0.14/kWh for multiple cases of PV penetration all the way up to 50%, provided that a policy of shared ownership of and savings is in place. Further, the LCOE calculated for the case before the deployment PV+BSS systems is also achievable, i.e. the deployment of PV+BSS, if planned and scheduled optimally. will have no effect on customers’ energy costs. From the control methodology viewpoint, the developed consensus-based algorithms are shown to converge for a wide range of problem cases (spanning normal operating scenarios and contingencies), guaranteeing dispatch solutions under forecasting errors, communication break-downs and cyber-security attacks. The proposed control solutions are scalable and real-time implementable, with dispatch computations and device set-point updates converging in less than 2s in most practical instances of the above events.

14 SOLAR ENERGY↗
DOE OSTI2014

Synthesis of the unmanned aerial vehicle remote control augmentation system

Medium size Unmanned Aerial Vehicle (UAV) usually flies as an autonomous aircraft including automatic take-off and landing phases. However in the case of the on-board control system failure, the remote steering is using as an emergency procedure. In this reason, remote manual control of unmanned aerial vehicle is used more often during take-of and landing phases. Depends on UAV take-off mass and speed (total energy) the potential crash can be very danger for airplane and environment. So, handling qualities of UAV is important from pilot-operator point of view. In many cases the dynamic properties of remote controlling UAV are not suitable for obtaining the desired properties of the handling qualities. In this case the control augmentation system (CAS) should be applied. Because the potential failure of the on-board control system, the better solution is that the CAS algorithms are placed on the ground station computers. The method of UAV handling qualities shaping in the case of basic control system failure is presented in this paper. The main idea of this method is that UAV reaction on the operator steering signals should be similar - almost the same - as reaction of the 'ideal' remote control aircraft. The model following method was used for controller parameters calculations. The numerical example concerns the medium size MP-02A UAV applied as an aerial observer system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2017

CYCLE MODELING AND OPTIMIZATION OF AN INTEGRALLY GEARED sCO2 COMPANDER

This paper presents the selection of a system configuration and off-design control method for an integrally geared compander based on cycle modeling and optimization. The goal of the cycle modeling was to determine a cycle configuration that would reach an efficiency of 50% at design conditions and to optimize off-design control to maintain high efficiencies. The compander is being developed for use in a concentrated solar power supercritical carbon dioxide power plant with expected turbine inlet temperatures of 705°C and utilizing dry cooling leading to compressor inlet temperature varying between 35°C and 55°C. The compander is unique as it consists of eight turbomachinery stages on four pinions all being driven by a single bull gear. The separate stages offer the opportunity to consider a variety of flow splits and cycle configurations including intercooling and multiple stages of reheat. Cycle modeling was conducted in two stages: on-design and off-design. On-design modeling was simulated with all components operating at their design point. This was used to compare the performance of different cycle configurations and design temperatures. Off-design modeling was then performed to investigate the temperature dependence of the cycle efficiency and power output and to develop a control strategy. Strategies considered and discussed include: turbine bypass, compressor recycle, inlet guide vanes, and inventory control. To determine the best operating conditions for each configuration and control strategy, a genetic algorithm was implemented to optimize the cycle performance across the range of operating temperatures being considered. The final selection of cycle configuration, design temperature and control strategy is also presented.

bennett, jeffrey↗
DOE OSTI2021

On Distributed Model-Free Reinforcement Learning Control with Stability Guarantee

Distributed learning can enable scalable and effective decision making in numerous complex cyber-physical systems such as smart transportation, robotics swarm, power systems, etc. However, the stability of the system is usually not guaranteed in most existing learning paradigms; and this limitation can hinder the wide deployment of machine learning in decision making of safety-critical systems. This paper presents a stability guaranteed distributed reinforcement learning (SGDRL) framework for interconnected linear subsystems, without knowing the subsystem models. While the learning process requires data from a peer-to-peer (p2p) communication architecture, the control implementation of each subsystem is only based on its local state. The stability of the interconnected subsystems will be ensured by a diagonally dominant eigenvalue condition, which will then be used in a model-free RL algorithm to learn the feedback control gains. The RL algorithm structure follows an off-policy iterative framework, with interleaved policy evaluation and policy update steps. We numerically validate our theoretical results by performing simulations on four interconnected sub-systems.

Mukherjee, Sayak↗
DOE OSTI2018

Fuel Efficient Speed Optimization for Real-World Highway Cruising

This paper introduces an eco-driving highway cruising algorithm based on optimal control theory that is applied to a conventionally-powered connected and automated vehicle. Thanks to connectivity to the cloud and/or to infrastructure, speed limit and slope along the future route can be known with accuracy. This can in turn be used to compute the control variable trajectory that will minimize energy consumption without significantly impacting travel time. Automated driving is necessary to the implementation of this concept, because the chosen control variables (e.g., torque and gear) impact vehicle speed. An optimal control problem is built up where quadratic models are used for the powertrain. The optimization is solved by applying Pontryagin’s minimum principle, which reduces the problem to the minimization of a cost function with parameters called co-states. The proposed algorithm assumes piecewise constant slopes and speed limits, and it solves the transition vehicle speeds for each junction of such segments. In addition, a method to extract route information from digital maps is presented, which complies with the proposed optimization algorithm. The algorithms are evaluated in simulation, using Autonomie, a simulation tool for vehicle energy consumption modeling. The optimal control trajectory (e.g., torque, gear) is first computed offline. It is then applied in an open-loop fashion in online simulation, using a forward-looking model of the vehicle in Autonomie. Simulation results show over 8% fuel saving for two selected real-world routes.

Simulation and modeling, Optimization, Vehicle net↗