SEARCH · Search NASA

Results for “cooperative control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Trust-Based Detection and Mitigation of Cyber Attacks in Distributed Cooperative Control of Islanded AC Microgrids

In this study, we address the challenge of detecting and mitigating cyber attacks in the distributed cooperative control of islanded AC microgrids, with a particular focus on detecting False Data Injection Attacks (FDIAs), a significant threat to the Smart Grid (SG). The SG integrates traditional power systems with communication networks, creating a complex system with numerous vulnerable links, making it a prime target for cyber attacks. These attacks can lead to the disclosure of private data, control network failures, and even blackouts. Unlike machine learning-based approaches that require extensive datasets and mathematical models dependent on accurate system modeling, our method is free from such dependencies. To enhance the microgrid’s resilience against these threats, we propose a resilient control algorithm by introducing a novel trustworthiness parameter into the traditional cooperative control algorithm. Our method evaluates the trustworthiness of distributed energy resources (DERs) based on their voltage measurements and exchanged information, using Kullback-Leibler (KL) divergence to dynamically adjust control actions. We validated our approach through simulations on both the IEEE-34 bus feeder system with eight DERs and a larger microgrid with twenty-two DERs. The results demonstrated a detection accuracy of around 100%, with millisecond range mitigation time, ensuring rapid system recovery. Additionally, our method improved system stability by up to almost 100% under attack scenarios, showcasing its effectiveness in promptly detecting attacks and maintaining system resilience. These findings highlight the potential of our approach to enhance the security and stability of microgrid systems in the face of cyber threats.

Computer Science↗

DOE OSTI2024

Mitigating the Effect of Wind Gusts on Local Run-of-River Hydropower Plants Using Cooperative Control

This paper focuses on the challenges and solutions associated with the integration of wind farms in a hydro- dominated power system. Due to sudden increases in wind power, the system frequency can increase, causing excessive reduction in the run-of-river (ROR) system’s power. Considering their small pondage, this can result in damage to the physical structure due to water level violations which are also penalized by stakeholders. To prevent excessive ROR power deviations, ROR governor wear and tear, and to prevent tie-line deviations, a centralized, distributed, and hybrid scheme for coordinating the response from a cluster of ROR plants is examined. Both centralized and distributed control as well as their hybrids can reduce frequency peaks. However, the inclusion of decentralized cooperative controls leads to reduced governor actions from fast- acting plants while enhancing net response from the hydro unit cluster.

13 HYDRO ENERGY↗

DOE OSTI2024

Robust cooperative control strategy for a platoon of connected and autonomous vehicles against sensor errors and control errors simultaneously in a real-world driving environment

In a real-world driving environment, a platoon of connected and autonomous vehicles (CAVs) is subject to many internal and external disturbances, resulting in uncertain vehicle dynamics. In general, the disturbances can be categorized into two types: disturbances due to vehicle sensor errors (e.g., GPS error) and disturbances due to vehicle control errors (e.g., actuator delay). In the literature, many control strategies have been proposed to improve the robustness of the CAV platoon against uncertain vehicle dynamics induced by these disturbances. However, most of these strategies only consider one type of disturbance and cannot tackle both types of disturbances simultaneously. Furthermore, they are designed to maximize the benefits of each vehicle in the platoon independently, which can deteriorate the performance of the platoon. Here, to address these problems, this study proposes a robust cooperative control (RCC) strategy to maneuver the vehicles in the platoon cooperatively to counteract the impacts of both types of disturbances. The RCC strategy is developed based on a minimax problem, where the maximization subproblem seeks to find the worst inputs for the uncertainty terms in the vehicle dynamics equation to minimize the platoon performance, while the minimization subproblem seeks to find the optimal control decisions for all subsequent vehicles to maximize the platoon performance in the worst case. To solve the minimax problem, this study proposes a globally convergent solution algorithm. It can solve the minimax problem very efficiently to enable real time deployment of the RCC strategy. Numerical application indicates that compared to the existing methods, the RCC strategy can dramatically improve the robustness of the CAV platoon against the uncertain vehicle dynamics induced by both vehicle state detection errors and vehicle control errors. Therefore, it can maneuver the CAV platoon safely and efficiently in a real-world driving environment.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

Self-Aware Local Autonomous and Semi-Cooperative Control for Cross-Layered Resilience (SLAC3R)

The objective of this work is to develop and demonstrate novel, adaptive, lightweight algorithms that enable the decision-making agents in a large cyber-physical network to act both autonomously and in collaborative harmony to enforce assured resilience across spatiotemporal layers, even under unforeseen adversarial scenarios (e.g., high- impact-low-probability events). Towards this end, the proposed solution will serve as minimally invasive add-on layers that bridge the existing (faster, reactive) local myopic controls and (slower, predictive) centralized optimization. Importantly, the proposed algorithms will enable the multi-agent network to autonomously and collaboratively enforce resilient operation under no or limited communication environment typical of severe cyber- physical adversarial events. The expected outcome of this effort is a suite of prototype, open-source, software algorithms for safety-aware local autonomous and semi-cooperative control (SLAC3R), demonstrated on networked microgrids (via RD2C/Thrust-1 OPAL-RT testbed).

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Cooperative control of a DNA origami force sensor

Abstract Biomolecular systems are dependent on a complex interplay of forces. Modern force spectroscopy techniques provide means of interrogating these forces, but they are not optimized for studies in constrained environments as they require attachment to micron-scale probes such as beads or cantilevers. Nanomechanical devices are a promising alternative, but this requires versatile designs that can be tuned to respond to a wide range of forces. We investigate the properties of a nanoscale force sensitive DNA origami device which is highly customizable in geometry, functionalization, and mechanical properties. The device, referred to as the NanoDyn, has a binary (open or closed) response to an applied force by undergoing a reversible structural transition. The transition force is tuned with minor alterations of 1 to 3 DNA oligonucleotides and spans tens of picoNewtons (pN). The DNA oligonucleotide design parameters also strongly influence the efficiency of resetting the initial state, with higher stability devices (≳10 pN) resetting more reliably during repeated force-loading cycles. Finally, we show the opening force is tunable in real time by adding a single DNA oligonucleotide. These results establish the potential of the NanoDyn as a versatile force sensor and provide fundamental insights into how design parameters modulate mechanical and dynamic properties.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Trajectory Shaper: A Solution for Disrupted Cooperative Adaptive Cruise Control

Cooperative adaptive cruise control (CACC) can effectively reduce energy consumption, alleviate traffic congestion, and enhance safety. However, communication-related constraints and uncooperative vehicle users can disrupt CACC during real-world operations, significantly undermining the putative benefits of CACC. To alleviate the negative impacts of disrupted CACC, this study develops the trajectory shaper (TS) methods as backup solutions for two scenarios: (i) communication between vehicles is infeasible, and vehicles execute adaptive cruise control (ACC) using local sensor measurements; (ii) follower vehicles reject forming a cooperative platoon and execute their local distributed controllers using the information attained via communication. When communication is infeasible, a distributed TS is devised on each vehicle to modify the sensor measurements, enabling safe and efficient ACC operations. When communication is available but uncooperative agents are involved, the lead vehicle of the platoon executes a centralized TS to modify the information shared with uncooperative agents, achieving optimal platoon-level performance. The centralized and distributed TSs are implemented based on the model predictive control algorithms to yield optimal modifications on input information. Robustness is also factored to tackle model uncertainties during TS operations to ensure safety and efficiency. Numerical experiments validate the control performance of the proposed TSs.

Zhou, Anye [ORNL] (ORCID:0000000301455579)↗

DOE OSTI2022

Evaluating an Eco-Cooperative Automated Control System

The paper evaluates an Eco-Cooperative Automated Control (Eco-CAC) system on a large-scale network considering a combination of internal combustion engine vehicles (ICEVs), hybrid electric vehicles (HEVs), and battery-only electric vehicles (BEVs) in a microscopic traffic simulation environment. We used a novel integrated control system that: (1) routes ICEVs, HEVs, and BEVs in a fuel/energy-efficient manner; (2) selects vehicle speeds based on anticipated traffic network evolution; (3) minimizes vehicle fuel/energy consumption near signalized intersections; and (4) intelligently modulates the longitudinal motion of vehicles along freeways within a cooperative platoon to minimize fuel/energy consumption. The study tested the system using the INTEGRATION software on the Los Angeles (LA), U.S., downtown network for three different demand levels: no congestion, mild congestion, and heavy congestion. The results demonstrated that the Eco-CAC system effectively reduces vehicle fuel and energy consumption, travel time, total delay, and stopped delay in heavily congested conditions. However, different vehicle compositions produced different results. In particular, the maximum energy consumption savings for BEVs (36.9%) for a current vehicle composition occurred at a 10% market penetration rate (MPR) of connected automated vehicles (CAVs) in mild congestion, while the maximum savings for a future vehicle composition (35.5%) occurred at a 50% CAV MPR in no congestion. The system reduced fuel consumption for ICEVs and HEVs by up to 5.4% and 6.3% at a 25% CAV MPR in heavy congestion for current and future vehicle compositions, respectively. However, the system increased total fuel consumption by up to 4.6% at a 50% CAV MPR in no congestion for a current vehicle composition. The study demonstrates that the effectiveness of the Eco-CAC system depends on traffic conditions, including congestion level, network configuration, CAV MPR, and vehicle composition.

Engineering↗

DOE OSTI2025

Incentivizing Cooperative Merging Control: Insights from Multi-Agent Deep Reinforcement Learning

Cooperative driving automation enables connected and automated vehicles (CAVs) to devise cooperative merging control, introducing great potentials to alleviate traffic congestion, reduce energy consumption, and enhance safety for highway on-ramp operations. Although numerous CAV cooperative merging algorithms have been developed to improve energy and traffic performance, the agreement-seeking among CAV users and their local benefits have been understudied. This can lead to rejections of cooperative merging plans and jeopardizing CAV performance, as a cooperation may entail certain CAVs to sacrifice their local benefits to achieve a system optimum. To address this issue, the study first leverages multi-agent deep reinforcement learning (MADRL) factoring both local reward and regional reward to demonstrate the discrepancies between CAV users’ local benefits and system optimum. Next, the existence of a correlated equilibrium is proved to characterize the convergence of MADRL training. This further facilitates the incorporation of incentives (computed based on reward discrepancies) to compensate for CAV users’ local benefits and facilitate system-optimal agreements in cooperative merging operations.

Zhou, Anye [ORNL] (ORCID:0000000301455579)↗

DOE OSTI2021

Blockchain Enabled Intelligence of Federated Systems (BELIEFS): An attack-tolerant trustable distributed intelligence paradigm

In this article, a Blockchain Enabled Intelligence of Federated Systems (BELIEFS) is proposed to conduct cooperative control for the multi-regional large-scale power system with a multi-agents system (MAS). By establishing a two levels blockchain, each regional AI agent can simultaneously manage intra-regional controllers and cooperate with other AI agents. Under the consensus mechanism, the agents, which respectively conducted distributed deep reinforcement learning (DDRL) algorithm in multi-regions, can have the tolerant capability of malicious attacks in their training process. The demonstration of the proposed approach is within a multi-regional large-scale interconnected power system. Under the mode of "centralized dispatching and hierarchical management", this article aims to definite a mathematical model to deal with the control problem of the power systems. With the comparison experiments, the effectiveness and efficiency of our proposed method in the training process are verified. In addition, malicious attacks are set on the main chain and shard chains to verify the attack-tolerant capability. We expect that such approach and results can suggest a new paradigm of attack-tolerant trustable distributed AI deployment.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Developing an Eco-Cooperative Automated Control System (Eco-CAC)

The goal of the project was to develop a novel Eco-Cooperative Automated Control (Eco-CAC) system that integrates vehicle dynamics (VD) control with connected and automated vehicle (CAV) applications. In particular, the team developed a novel integrated control system that (1) routes vehicles in a fuel/energy-efficient manner for internal combustion engine vehicles (ICEVs), battery-only electric vehicles (BEVs), and hybrid electric vehicles (HEVs); (2) selects vehicle speeds based on anticipated traffic network evolution; (3) minimizes vehicle fuel/energy consumption near signalized intersections; and (4) intelligently modulates the longitudinal motion of vehicles within a cooperative platoon to minimize its fuel/energy consumption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Distributed Secondary Control of Grid-Forming Inverters and AC Microgrids: Impacts of Voltage Feedback Choices

In this paper, the operational choices in distributed secondary control are examined, and their impacts on grid-forming (GFM) inverters and grid operation are investigated. In particular, the effects of feedback voltage choices, either average voltage feedback (AVF) or terminal voltage feedback (TVF), are studied with respect to reactive power sharing, voltage regulation, and grid-forming operation during black start. The secondary control used is a subgradient-based distributed cooperative control, and it provides the voltage, angle, and frequency references to the GFM inverters and their primary tracking controls. The overall control architecture employs multi-rate sampling such that the secondary control is slower than the primary control. The operational choices and their control performance are illustrated using a four-GFM-inverter microgrid in MATLAB/SIMULINK. Furthermore, the results show the effectiveness of the secondary controller, and several conclusions are drawn on the voltage feedback signals as the design choices.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

PowerNet: Multi-agent Deep Reinforcement Learning for Scalable Powergrid Control

This paper develops an efficient multi-agent deep reinforcement learning algorithm for cooperative controls in powergrids. Specifically, we consider the decentralized inverter-based secondary voltage control problem in distributed generators (DGs), which is first formulated as a cooperative multi-agent reinforcement learning (MARL) problem. We then propose a novel on-policy MARL algorithm, PowerNet, in which each agent (DG) learns a control policy based on (sub-)global reward but local states and encoded communication messages from its neighbors. Motivated by the fact that a local control from one agent has limited impact on agents distant from it, we exploit a novel spatial discount factor to reduce the effect from remote agents, to expedite the training process and improve scalability. Furthermore, a differentiable, learning-based communication protocol is employed to foster the collaborations among neighboring agents. In addition, to mitigate the effects of system uncertainty and random noise introduced during on-policy learning, we utilize an action smoothing factor to stabilize the policy execution. To facilitate training and evaluation, we develop PGSim, an efficient, high-fidelity powergrid simulation platform. Here, experimental results in two microgrid setups show that the developed PowerNet outperforms the conventional model-based control method, as well as several state-of-the-art MARL algorithms. The decentralized learning scheme and high sample efficiency also make it viable to large-scale power grids.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Enabling cooperative adaptive cruise control on strings of vehicles with heterogeneous dynamics and powertrains

Recent studies have shown that positive impact of Cooperative Adaptive Cruise Control (CACC) can only be guaranteed as market penetration rate increases. Removing the string homogeneity constraint is essential to encourage widespread adoption. In this work, a hierarchical architecture is proposed to enable CACC on vehicles with not only mixed dynamics but also different powertrain types. A low-level layer deals with the vehicle and powertrain dynamics to provide accurate and consistent reference speed tracking response. The high-level layer uses: (1) a Linear Parameter Varying feedback system to provide loop stability, robustness and enforce a variable time gap policy and (2) a feedforward system that processes Vehicle-to-Vehicle information to enhance string stability and response bandwidth, by dealing with the string heterogeneity. A gap management strategy is built on top of the CACC architecture to handle gap setting changes or cut-in/out situations, via a dynamics constrained time gap trajectory planning algorithm. We report the proposed work has been designed, developed and validated on three different real passenger vehicles on public highways and test tracks, showing the potential of the proposed algorithm to enable robust string stable CACC, despite the different dynamics and powertrains considered.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2022

Resilient Hierarchical Networked Control Systems: Secure Controls for Critical Locations and at Edge

Integration of information and communication technology (ICT) offers new opportunities in improving the management and operation of critical infrastructures such as power systems as it allows connection of different sensors and control components via a communication network, leading to the so-called networked control systems (NCS). However, the use of open and pervasive ICT such as the Internet or wireless communication technologies comes at a price of making NCS vulnerable to cyber intrusions/attacks which may cause physical damage. Here, this chapter presents control algorithms to ensure resilient and safe operation of NCS under unknown cyberattacks. Specifically, a variant of dynamic watermarking strategies is presented by embedding encoding/decoding components of chaotic signals into the NCS for secure control for critical locations where the measurement/control signals are transmitted to/from the control center via a communication network. In addition, resilient cooperative control algorithms are discussed to ensure safe operation at edge of the NCS which consists of a large number of distributed controllable devices. Several numerical examples are provided to illustrate the proposed control strategies.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2022

A Multiagent Deep Reinforcement Learning-Enabled Dual-Branch Damping Controller for Multimode Oscillation

Here, this study develops a multiagent deep reinforcement learning (MADRL)-enabled framework for the decentralized cooperative control of a novel dual-branch (DB) damping controller for both low-frequency oscillation (LFO) and ultralow-frequency oscillation (ULFO). It has two branches, each of which consists of a proportional resonance (PR) and a second-order polynomial that is designed to handle target oscillation modes. To improve the robustness of the controller to system uncertainties, MADRL is developed, where multiagents are centrally trained to obtain the coordinated adaptive control policy while being executed in a decentralized manner to provide the optimal parameter setting for each controller with only local states. Comparisons with the IEEE 10-machine 39-bus system demonstrate that the proposed method achieves better robustness to uncertainties, lower communication delay, and single-point failure, as well as damping control performances for both LFO and ULFO.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

A Human-Machine Shared Control Framework Considering Time-Varying Driver Characteristics

The uncertainties of driver's behavior seriously affect road safety and bring significant challenges to the human-machine cooperative control. Here, this paper proposes a human-machine shared control framework considering driver's time-varying characteristics to improve the co-driving cooperation performance. Firstly, the driving intention is introduced to describe the driver's involvement level through using Gauss-Bernoulli restricted Boltzmann machine method. And the index of driving ability is proposed to evaluate driver skills based on path-tracking errors. Then, a novel human-machine authority allocation strategy is designed by combining the two driving behavior characteristics and used to construct the driver-vehicle interaction system. Subsequently, a T-S fuzzy robust state-feedback shared control system is developed considering time-varying driver behaviors and vehicle states. Finally, the proposed shared steering system is validated by the driver-in-the-loop test bench. The results show that the proposed control method can reduce human-machine conflicts and has obvious superiority in improving performance of driving comfort, path tracking, and vehicle stability for the co-driving vehicles.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2026

Optimization-based approaches to control of connected and automated vehicles: Principles, complexities, applications, challenges, and outlook

Safe and optimal motion control for connected and automated vehicles (CAVs) poses a fundamental optimization challenge at the intersection of system complexity, environmental uncertainty, and stringent real-time constraints. Existing surveys address this challenge in isolation – focusing either on specific control techniques or individual uncertainty sources – without providing a unified framework that characterizes the trade-offs among computational tractability, performance verifiability, and adaptive generalization across paradigms. This review addresses that gap by presenting a cohesive analytical framework concentrated on the decision-making and trajectory optimization layers of the CAV autonomy stack. We systematically analyze three major optimization paradigms – first-principles model-based optimization, data-driven methods, and hybrid synergistic architectures – evaluating each against four core complexity axes: problem formulation, constraint handling, optimality guarantees, and robustness. Key applications including platooning, trajectory planning, collision avoidance, and cooperative control are examined to reveal recurring methodological patterns and critical operational constraints that limit real-world performance. Our synthesis identifies verifiable hybrid architectures, incentive-aligned multi-agent cooperation, and hardware-algorithm co-design as the defining research frontiers, and distills a targeted agenda for developing CAV control systems that are simultaneously safe, computationally efficient, and deployable in the full complexity of real-world traffic environments.

Muzahid, Abu Jafar Md [University of Tennessee, Kn↗

DOE OSTI2026

VECTOR Phase 1 Dataset: CAV Trajectory and Energy Consumption Records

This dataset contains benchmark experimental data from Phase 1 of the VECTOR project, focusing on the energy impact of CAV hardware components. The dataset includes vehicle trajectory data (speed and position) and corresponding energy consumption records collected from a CAV platform equipped with lidar, cameras, onboard computation units, and communication modules. The primary objective is to quantify the baseline energy consumption attributable to sensing and computing systems, independent of any advanced cooperative control strategies. During experiments, the leading vehicle followed a predetermined velocity profile, and the following CAV mirrored this trajectory using a basic car-following control to ensure consistent driving behavior. This setup enables a reliable benchmark for assessing the energy cost introduced by onboard CDA hardware (e.g., lidar and GPU-based processing). The dataset is essential for evaluating energy baselines and supports future comparative studies involving additional cooperative strategies. ![system img](system.png) ![vector img](vector.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗