SEARCH · Search NASA
Results for “adaptive controls”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Cybersecurity Enhancement in Digital Substations: Hidden Markov Model-Based Smart Cyber Switching and Threat Response
The rising incidence of cyber-attacks on critical infrastructure and power grids poses significant threats to the stability and reliability of electrical substations, with potentially devastating consequences such as extended blackouts. This paper introduces an advanced cybersecurity framework aimed at safeguarding IEC 61850-based substations through the integration of software-defined networking (SDN) and digital twin (DT) technologies. The proposed DT-based framework employs smart cyber switching (SCS) for proactive threat mitigation and concurrent intelligent electronic device (CIED) for swift system restoration, thereby maintaining continuous operational integrity and robust cybersecurity defenses. Central to this framework is the adaptive port controller (APC), which enables dynamic port management to adapt to evolving threats, and an intrusion detection system (IDS) designed to detect and neutralize malicious attacks on IEC 61850-based sampled value (SV) and generic object-oriented substation event (GOOSE) messages within the substation’s communication network. Further, novel predictive intrusion detection and response (PIDR) algorithm is implemented on a digital substation (DS) to predict the best route to be taken by the attacker. The efficacy of these comprehensive cybersecurity frameworks is validated through rigorous simulations and a hardware-in-the-loop (HIL) testbed, showcasing the system’s ability to sustain substation operations amidst cyber-attacks.
Supervisory Algorithm for Autonomous Hemodynamic Management Systems
Future military conflicts will require new solutions to manage combat casualties. The use of automated medical systems can potentially address this need by streamlining and augmenting the delivery of medical care in both emergency and combat trauma environments. However, in many situations, these systems may need to operate in conjunction with other autonomous and semi-autonomous devices. Management of complex patients may require multiple automated systems operating simultaneously and potentially competing with each other. Supervisory controllers capable of harmonizing multiple closed-loop systems are thus essential before multiple automated medical systems can be deployed in managing complex medical situations. The objective for this study was to develop a Supervisory Algorithm for Casualty Management (SACM) that manages decisions and interplay between two automated systems designed for management of hemorrhage control and resuscitation: an automatic extremity tourniquet system and an adaptive resuscitation controller. SACM monitors the required physiological inputs for both systems and synchronizes each respective system as needed. We present a series of trauma experiments carried out in a physiologically relevant benchtop circulatory system in which SACM must recognize extremity or internal hemorrhage, activate the corresponding algorithm to apply a tourniquet, and then resuscitate back to the target pressure setpoint. SACM continues monitoring after the initial stabilization so that additional medical changes can be quickly identified and addressed, essential to extending automation algorithms past initial trauma resuscitation into extended monitoring. Overall, SACM is an important step in transitioning automated medical systems into emergency and combat trauma situations. Future work will address further interplay between these systems and integrate additional medical systems.
NEXT Generation Energy Technologies for Connected and Automated On-Road Vehicles (NEXTCAR Phase I & II)
The Ohio State University’s ARPA-E NEXTCAR project was a multi-phase, multi-year research, development, and demonstration program focused on improving the energy efficiency of connected and automated vehicles (CAVs). The team developed and validated advanced vehicle motion and powertrain control algorithms that coordinate propulsion and automation systems to optimize energy use. Key technologies included Dynamic Skip Fire engine control, predictive eco-driving functions such as Eco-Approach and Departure (Eco-AND) and Eco-Adaptive Cruise Control (Eco-ACC), and powertrain-agnostic optimization frameworks for hybrid, plug-in hybrid, and battery electric vehicles. The project successfully demonstrated up to 30% energy-efficiency improvement during real-world testing at the Transportation Research Center and the American Center for Mobility. The outcomes provide a foundation for scalable, cost-effective deployment of energy-optimized CAV technologies across the automotive industry.
Safety evaluation of connected and automated vehicles in mixed traffic with conventional vehicles at intersections
Connected and Automated Vehicles (CAVs) can potentially improve the performance of the transportation system by reducing human errors. This paper investigates the safety impact of CAVs in a mixed traffic with conventional vehicles at intersections. Analyzing real-world AV crashes in California revealed that rear-end crashes at intersections are the dominant crash type. Therefore, to enhance our understanding of the future interactions between human-driven vehicles with CAVs at intersections, a simulation framework was developed to model the mixed traffic environment of Automated Vehicles (AV), cooperative AVs, and conventional human-driven vehicles. In order to model AVs driving behavior, Adaptive Cruise Control (ACC) and cooperative ACC (CACC) models are utilized. Particularly, this study explores system improvements due to automation and connectivity across varying CAV market penetration scenarios. ACC and CACC car following models are used to mimic the behavior of AVs and cooperative AVs. Real-world connected vehicle data are utilized to modify and tune the acceleration/deceleration regimes of the Wiedemann model. Next, the driving volatility concept capturing variability in vehicle speeds was utilized to calibrate the simulation to represent the safety performance of a real-world environment. Two surrogate safety measures are used to evaluate the safety performance of a representative intersection under different market penetration rate of CAVs: the number of longitudinal conflicts and driving volatility. At low levels of ACC market penetration, the safety improvements were found to be marginal, but safety improved substantially with more than 40% ACC penetration. Additional safety improvements can be achieved more quickly through the addition of cooperation and connectivity through CACC. Furthermore, ACC/CACC vehicles were found to improve mobility performance in terms of average speed and travel time at intersections.
Real-time plasma monitoring framework for advanced plasma control and ML-research in DIII-D
Real-time and adaptive plasma control is crucial for robust tokamak operation, requiring sensitivity and tolerance measurements of the plasma state. This paper presents the implementation of an integrated real-time plasma monitoring framework on the DIII-D tokamak to support advanced control approaches, including machine-learning (ML) methods. The system is built on the SHIELD framework, a high-performance modular architecture that provides a unified pipeline for integrating diverse diagnostics. The framework leverages high-bandwidth digitizers, fast numerical processing, and deterministic, low-latency interconnects to stream high-fidelity data from diagnostics such as electron cyclotron emission (ECE), beam emission spectroscopy (BES), CO interferometers, and a visible tangential divertor camera (TangTV). The system’s validity is demonstrated through direct comparisons of real-time and offline data. Furthermore, we present two key applications of the developed plasma monitoring system with ML-based plasma control strategies, including real-time divertor detachment and active Alfvén Eigenmode control. As a result, this work presents a robust and scalable approach for integrating high-frequency, multidimensional diagnostics into advanced control algorithms for future fusion devices.
Adaptive Machine Learning for Robust Diagnostics and Control of Time-Varying Particle Accelerator Components and Beams
Machine learning (ML) is growing in popularity for various particle accelerator applications including anomaly detection such as faulty beam position monitor or RF fault identification, for non-invasive diagnostics, and for creating surrogate models. ML methods such as neural networks (NN) are useful because they can learn input-output relationships in large complex systems based on large data sets. Once they are trained, methods such as NNs give instant predictions of complex phenomenon, which makes their use as surrogate models especially appealing for speeding up large parameter space searches which otherwise require computationally expensive simulations. However, quickly time varying systems are challenging for ML-based approaches because the actual system dynamics quickly drifts away from the description provided by any fixed data set, degrading the predictive power of any ML method, and limits their applicability for real time feedback control of quickly time-varying accelerator components and beams. In contrast to ML methods, adaptive model-independent feedback algorithms are by design robust to un-modeled changes and disturbances in dynamic systems, but are usually local in nature and susceptible to local extrema. In this work, we propose that the combination of adaptive feedback and machine learning, adaptive machine learning (AML), is a way to combine the global feature learning power of ML methods such as deep neural networks with the robustness of model-independent control. We present an overview of several ML and adaptive control methods, their strengths and limitations, and an overview of AML approaches.
Rapid Load Transition for Integrated Solid Oxide Fuel Cell - Gas Turbine (SOFC-GT) Energy Systems: A Demonstration of the Potential for Grid Response
Rapid load transition is an essential requirement for integrated energy systems to maintain grid resilience as more renewable resources are added to the grid. Integrated solid oxide fuel cell - gas turbine (SOFC-GT) systems can provide high efficiency and low carbon emissions over a broad range of turndown. These hybrids also have the potential to enable rapid grid response. The challenge has been to demonstrate effective control strategies to manage load transitions. In the present study, a load transition of ~50% was achieved in 10 s using a novel but simple strategy. Power demand on the SOFC and the GT were ramped down concurrently. During this transition, the SOFC anode fuel was manipulated to maintain SOFC fuel utilization while the cathode inlet air flow and temperature were also manipulated to thermally protect the SOFC. This study was conducted using the Hybrid Performance (Hyper) facility at the National Energy Technology Laboratory (NETL) in a co-simulation environment with the Idaho National Laboratory (INL)'s grid-simulation. The load ramping strategy was tested using a hardware-based cyber-physical simulation methodology. The results demonstrate a high-fidelity representation of SOFC-GT hybrid dynamics and validation of the control strategy. Thermal and electrochemical transients indicated that the SOFC was well protected during rapid load turndown without violating operability constraints. This demonstration revealed the non-linear nature of tightly coupled SOFC-GT system components, especially the non-linear response of SOFC cathode air flow and inlet temperature controls. These results highlight the needs and challenges in developing adaptive automatic controls for autonomous rapid load transitions. This work demonstrates that SOFC-GT hybrids are a viable option to provide the fast-ramping characteristics essential to accommodate high levels of variable renewable power while maintaining grid resilience, reliability, and environmental performance. The results also demonstrate the utility of co-simulation in advancing the tightly-coupled integrated energy systems needed to meet goals for zero-carbon power generation.
Sensor enabled data-driven predictive analytics for modeling and control with high penetration of DERs in distribution systems
The electric power grid is undergoing a tremendous transformation due to the increasing penetration of renewable energy resources beginning with wind and more recently with the distributed energy resources (DERs) such as solar and battery storage. DERs have dramatically changed the role of the distribution systems in the overall power grid, and they are expected to contribute a significant portion of power generation in the future. If current trends for DERs continue, system operation and control will need to change dramatically for improved grid reliability and resiliency. As renewable resources increase in penetration, new and challenging operational, planning, and design problems are expected to emerge. Some of the key challenges that arise in the planning and operation of the future grid are: 1) Quantifying the impact of high DER penetration in distribution systems on bulk grid behavior over multiple time scales. 2) Identifying whether a particular DER configuration/settings have a large impact on the overall grid behavior. These challenges can be addressed in an offline manner using detailed T&D grid models and they can also be addressed in an online manner using sensor measurements. In particular, the advancement and planned growth in sensor technology in power grid over various voltage levels provide us with a unique opportunity to tackle these challenges from a data analytic perspective without needing detailed T&D grid models. A few questions that naturally arise when addressing the challenges from DERs using sensor data are: 1) How can we use limited sensor measurements to monitor & control voltage stability and small signal stability of the bulk system? 2) How can we ensure that the developed data analytic methods are robust to data availability and quality issues? 3) How can we compute the developed analytics in a scalable manner using streaming measurements? In this project, we addressed the aforementioned challenges arising from DERs and answered the questions raised above on how to effectively use the sensor measurements to enhance the reliability and performance of the electric grid. Thus, the overarching goal of this project is to develop effective reduced/representative system models from data that make the computational complexity sufficiently manageable so as to be useful to simulate, analyze, and even control complex non-linear power systems dynamics with large penetrations of DERs. In order to achieve the objective, the project team established a four-fold technical approach 1) Formulated a combined transmission-distribution co-simulation framework for data generation and validation, 2) Derived reduced/representative models of power systems based on data-driven methods for efficient computation and appropriate representation of system behavior, 3) Developed data driven characterization of power system behavior based on transfer operator theory, machine learning and optimization for model estimation, 4) Incorporated a scalable data management and processing architecture using distributed Kafka streaming applications that coordinate input data streams to the developed data analytics. The key accomplishments of the project are: 1) Development of a scalable multi-timescale T&D co-simulation framework (both for steady state and for dynamic co-simulation) using commercial solvers (PSSE and GridLAB-D). The steady-state T&D co-simulation interface is shared with our industry partner (PJM). 2) A structured reduced order dynamic model of distribution systems that can represent partial motor stalling along with a systematic procedure to derive the model parameters. 3) A PMU based online method to monitor, localize and mitigate fault-induced delayed voltage recovery using DER reactive support and load control in distribution systems. 4) Development of linear operator based robust methodologies for dynamic state estimation, uncertainty quantification, system identification and trajectory prediction for power system dynamics. 5) An adaptive damping control for utilizing wind energy resources to provide oscillation damping and system stability. 6) Implementation of Kafka-based framework for efficient processing of streaming data using Linux-based local virtual environment.
A Vision–based Robust $\mathcal{H}$ ∞ Gain Scheduling Longitudinal and Lateral Following Controller for Autonomous Vehicles on Urban Curved Roads
Implementing advanced driver assistance systems (ADAS) in congested and intricate urban traffic scenarios poses significant challenges. To address the frequent stop–and–go motions exhibited by autonomous vehicles (AVs) navigating urban roads with changes in curvature, we propose a vision–based robust $\mathcal{H}$ ∞ adaptive cruise control system (ACC) for longitudinal control, plus a lane keeping assist system (LKAS) for lateral control. For the vision-based ACC, a weighted probability objective function for the vehicle following behavior is formulated. We incorporate $\mathcal{H}$ ∞ performance and gain scheduling techniques to mitigate the impact of uncertainty in visual sensor measurements. Furthermore, the optimal time headway is scheduled based on the velocity to ensure traffic flow efficiency and safety during the vehicle following process. For the LKAS, we introduce a road curvature estimation method that integrates lane and vehicle dynamics information to obtain the lateral and heading offsets. Next, the design criterion of the observer–based robust gain scheduling lateral motion controller is established by linear matrix inequality (LMI). Here, a series of experiments conducted within a camera–in–loop platform validate the proposed method.
Gradient-Descent-Based Learning Gain for Backstepping Controller and Disturbance Observer of Nonlinear Systems
This paper proposes a gradient-descent-based learning (GL) gain for backstepping controller and disturbance observer (DOB) of nonlinear system. The proposed method consists of the GL gain update law, controller, and DOB. The GL gain update law is proposed to adapt the control gain and DOB gain according to the direction that minimizes the cost function. The mathematical analysis reveals that the GL gain always has a positive sign and upper bound. The controller is designed via a backstepping procedure to track the desired output with GL control gain. The DOB is designed to estimate the unknown external disturbance with the GL DOB gain. Because the control and DOB gains are simultaneously tuned to achieve improved performance, the time consumption for tuning can be reduced. In addition, the peaking phenomenon can be avoided initially by a small initial value of GL gains. The stability of the closed-loop system is guaranteed using the input-to-state stability property. The performance of the proposed method was validated via simulations and experiments using a DC motor.
A Robust Data-Driven Approach for Mechanical Serial Sectioning
Mechanical serial sectioning (MSS) provides detailed microstructural information across large length scales. By repeatedly removing thin layers of material and imaging the exposed surface, a 3D representation of a specimen’s internal structure can be constructed, enabling failure analysis and feature identification that are otherwise inaccessible via conventional 2D or nondestructive evaluation techniques. Achieving consistent and accurate material removal can be challenging due to system variability, requiring an experienced operator to manually adjust parameters, prolonging data collection times and necessitating post-processing routines to standardize the data. Here, to address these challenges, this paper presents the employment of a one-step model predictive control (MPC) framework tailored to a run-to-run (R2R) controller. The R2R-MPC controller automates the parameter selection process, improving the consistency of material removal through iterative feedback for disturbance rejection and accurate tracking of the target removal rate. Using a data-driven approach, the controller robustly adapts to changing material characteristics. The effectiveness of the R2R-MPC controller is demonstrated through simulation and experimental results and compared to previous data collection procedures.
Adaptive changes in sexual behavior in the high–risk population in response to human monkeypox transmission in Canada can help control the outbreak: Insights from a two–group, two–route epidemic model
Monkeypox, a zoonotic disease, is emerging as a potential sexually transmitted infection/disease, with underlying transmission mechanisms still unclear. We devised a risk-structured, compartmental model, incorporating sexual behavior dynamics. We compared different strategies targeting the high-risk population: a scenario of control policies geared toward the use of condoms and/or sexual abstinence (robust control strategy) with risk compensation behavior change, and a scenario of control strategies with behavior change in response to the doubling rate (adaptive control strategy). Monkeypox's basic reproduction number is 1.464, 0.0066, and 1.461 in the high-risk, low-risk, and total populations, respectively, with the high-risk group being the major driver of monkeypox spread. Policies imposing condom use or sexual abstinence need to achieve a 35% minimum compliance rate to stop further transmission, while a combination of both can curb the spread with 10% compliance to abstinence and 25% to condom use. With risk compensation, the only option is to impose sexual abstinence by at least 35%. Adaptive control is more effective than robust control where the daily sexual contact number is reduced proportionally and remains constant thereafter, shortening the time to epidemic peak, lowering its size, facilitating disease attenuation, and playing a key role in controlling the current outbreak.
Adaptive Load Shedding for Grid Emergency Control via Deep Reinforcement Learning
Emergency control, typically such as under-voltage load shedding (UVLS), is broadly used to grapple with low voltage and voltage instability issues in real-world power systems under contingencies. However, existing emergency control schemes are rule-based and cannot be adaptively applied to uncertain and floating operating conditions. Here, we propose an adaptive UVLS algorithm for emergency control via deep reinforcement learning (DRL) and expert systems. We first construct dynamic components for picturing the power system operation as the environment. The transient voltage recovery criteria, which poses time-varying requirements to UVLS, is integrated into the states and reward function to advise the learning of deep neural networks. The proposed method has no tuning issue of coefficients in reward functions, and this issue was regarded as a deficiency in the existing DRL-based algorithms. Case studies illustrate that the proposed method outperforms the traditional UVLS relay in both the timeliness and efficacy for emergency control.
Towards in-situ certification of additively manufactured parts: the vital roles of physics-based and data-driven models
Certifying additively manufactured (AM) parts in-situ at the completion of a build is an enticing prospect, as it can help reduce the high costs associated with post-build testing and evaluation. However, achieving this goal presents significant challenges that may keep it aspirational for the foreseeable future. Nonetheless, incremental progress can pave the way forward. A critical aspect of in-situ certification involves continuous quality checking due to the random nature of the AM process and the difficulties in detecting defects or anomalies once layers are built over. While real-time in-situ monitoring strategies assisted by machine learning (ML) play a pivotal role in auditing part quality, they must ideally be supported by real-time (or near real-time) adaptive process control enabled by ML-assisted decision-making. By analyzing in-situ monitoring data in real-time (or near real- time) to dynamically adjust manufacturing parameters, such intervention can ensure AM parts are built to meet stringent certification standards. This can be achieved virtually by using high-fidelity performance models for the physical testing and evaluation tasks. In this short editorial, we discuss the key contributions made by data-driven and physics-based models in providing intelligence to the monitoring and process control tasks underpinning in-situ certification and in the simulation of the build’s performance under test and service conditions. While our focus lies in metal AM, the concepts discussed here are also relevant to other AM processes.
"Traffic Control via Connected and Automated Vehicles: An Open-Road Field Experiment with 100 CAVs"
The CIRCLES project aims to reduce instabilities in traffic flow, which are naturally occurring phenomena due to human driving behavior. These "phantom jams" or "stop-and-go waves,"are a significant source of wasted energy. Toward this goal, the CIRCLES project designed a control system referred to as the MegaController by the CIRCLES team, that could be deployed in real traffic. Our field experiment leveraged a heterogeneous fleet of 100 longitudinally-controlled vehicles as Lagrangian traffic actuators, each of which ran a controller with the architecture described in this paper. The MegaController is a hierarchical control architecture, which consists of two main layers. The upper layer is called Speed Planner, and is a centralized optimal control algorithm. It assigns speed targets to the vehicles, conveyed through the LTE cellular network. The lower layer is a control layer, running on each vehicle. It performs local actuation by overriding the stock adaptive cruise controller, using the stock on-board sensors. The Speed Planner ingests live data feeds provided by third parties, as well as data from our own control vehicles, and uses both to perform the speed assignment. The architecture of the speed planner allows for modular use of standard control techniques, such as optimal control, model predictive control, kernel methods and others, including Deep RL, model predictive control and explicit controllers. Depending on the vehicle architecture, all onboard sensing data can be accessed by the local controllers, or only some. Control inputs vary across different automakers, with inputs ranging from torque or acceleration requests for some cars, and electronic selection of ACC set points in others. The proposed architecture allows for the combination of all possible settings proposed above. Most configurations were tested throughout the ramp up to the MegaVandertest.
Laboratory demonstration of the prediction of wind-blown turbulence by adaptive optics at 8 kHz with use of LQG control
The low-latency adaptive optical mirror system (LLAMAS) is designed to push the limits on achievable latencies and frame rates. It has 21 subapertures across its pupil. Here, a reformulated version of the linear quadratic Gaussian (LQG) method predictive Fourier control is implemented in LLAMAS; for all modes, it takes just 30 µs to compute. In the testbed, a turbulator mixes hot and ambient air to produce wind-blown turbulence. Wind prediction clearly improves correction when compared to an integral controller. Closed-loop telemetry shows that wind-predictive LQG removes the characteristic “butterfly” and reduces temporal error power by up to a factor of three for mid-spatial frequency modes. Strehl changes seen in focal plane images are consistent with telemetry and the system error budget.