Search NASA⌕ Search

SEARCH · Search NASA

Results for “ADAPTIVE CONTROL SYSTEM”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Controlling optical-cavity locking using reinforcement learning

Abstract This study applies an effective methodology based on Reinforcement Learning to a control system. Using the Pound–Drever–Hall locking scheme, we match the wavelength of a controlled laser to the length of a Fabry-Pérot cavity such that the cavity length is an exact integer multiple of the laser wavelength. Typically, long-term drift of the cavity length and laser wavelength exceeds the dynamic range of this control if only the laser’s piezoelectric transducer is actuated, so the same error signal also controls the temperature of the laser crystal. In this work, we instead implement this feedback control grounded on Q-Learning. Our system learns in real-time, eschewing reliance on historical data, and exhibits adaptability to system variations post-training. This adaptive quality ensures continuous updates to the learning agent. This innovative approach maintains lock for eight days on average.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Wideband Impedance Passivation of MMCs for Suppressing Harmonic Oscillations

Harmonic instability and associated oscillation events have become one of the main concerns in MMC-based HVdc systems. These oscillations can appear in the range from a few hundred hertz to several kilohertz, and the root cause is identified as delay-induced negative damping of MMC impedance appearing at the system resonance frequency. Here, this paper introduces a wideband impedance reshaping method through MMC control to eliminate such negative damping for both grid-following (GFL) and grid-forming (GFM) MMCs, which makes the MMC impedance completely passive from the second harmonic frequency upward, thus preventing all harmonic oscillations. First, simplified impedance models of MMCs are derived for the harmonic stability analysis and the impedance reshaping control design. Next, a passivity-based impedance reshaping method is presented, as well as practical considerations for its implementation. In addition, to maintain the MMC's disturbance ride-through capability, an adaptive activation scheme is developed, which enables the wideband impedance reshaping control only in the presence of harmonic oscillation events. The effectiveness of the proposed method is validated by frequency domain analysis and by electromagnetic transient (EMT) simulations of two typical MMC-based power systems.

17 WIND ENERGY↗
DOE OSTI2024

Application of Controller Area Network for Power Converter Network Monitoring and Control

This presentation explores the adaptation and implementation of CAN bus technology in a network of power converters, emphasizing its potential beyond automotive applications. In this system, multiple power converters can utilize the CAN bus to transmit diverse data types, each assigned specific message and node IDs. A central controller continuously monitors the status of each converter, ensuring efficient management and coordination of power distribution. Additionally, an individual CAN node is

Montoya, Armando Yassir↗
DOE OSTI2025

Adaptive anomaly detection for identifying attacks in cyber-physical systems: A systematic literature review

Modern cyberattacks in cyber-physical systems (CPS) rapidly evolve and cannot be deterred effectively with most current methods, which focus on characterizing past threats. Adaptive anomaly detection (AAD) is among the most promising techniques to detect evolving cyberattacks, with an emphasis on fast data processing and model adaptation. AAD has been researched extensively; however, to the best of our knowledge, our work is the first systematic literature review (SLR) on current research in this field. We present a comprehensive SLR, gathering 397 relevant papers and systematically analyzing 65 of them (47 research and 18 survey papers) on AAD in CPS from 2013 to November 2023. We introduce a novel taxonomy considering attack types, CPS application, learning paradigm, data management, and algorithms. Our findings show that most studies addressed either model adaptation or data processing, but rarely both simultaneously. This indicates a research gap in fully adaptive solutions. We also categorize algorithms, datasets, and attack characteristics, and summarize strengths and weaknesses across the literature. Our review provides a structured and accessible reference for researchers and practitioners, offering insights into key trends and highlighting limitations in current approaches. Finally, we outline several future research directions, including the need for integrated real-time processing and adaptive learning, explainability, and uncertainty quantification in AAD for CPS.

Adaptation↗
DOE OSTI2026

Signal Whisperers: Enhancing Wireless Reception Using DRL-Guided Reflector Arrays

This paper presents a multi-agent reinforcement learning (MARL) approach for controlling adjustable metallic reflector arrays to enhance wireless signal reception in non-line-of-sight (NLOS) scenarios. Unlike conventional reconfigurable intelligent surfaces (RIS) that require complex channel estimation, our system employs a centralized training with decentralized execution (CTDE) paradigm where individual agents corresponding to reflector segments autonomously optimize reflector element orientation in three-dimensional space using spatial intelligence based on user location information. Through extensive ray-tracing simulations with dynamic user mobility, the proposed multi-agent beam-focusing framework demonstrates substantial performance improvements over single-agent reinforcement learning baselines, while maintaining rapid adaptation to user movement within one simulation step. Comprehensive evaluation across varying user densities and reflector configurations validates system scalability and robustness. The results demonstrate the potential of learning-based approaches for adaptive wireless propagation control.

deep reinforcement learning↗
DOE OSTI2026

Toward Unified Autonomous Scattering Experiments: A Cross-Facility Case Study at ALS and PETRA III

Autonomous experiments rely on the integration of control, data acquisition, analysis, and decision-making frameworks. While such systems have been demonstrated at individual facilities, adapting them to additional instruments remains challenging due to differences in local infrastructure. We present a modular workflow that connects existing open-source tools for data access (Tiled), workflow orchestration (Prefect), analysis and visualization (pyFAI, Plotly Dash), and Gaussian-process-based adaptive sampling (gpCAM) into a unified framework for autonomous scattering experiments. The same configuration operates across two synchrotron beamlines (ALS 7.3.3 and PETRA III P03) with only minimal facility-specific adjustments, as shown in proof-of-concept demonstrations. This validates that a consistent design emphasizing modularity and shared interfaces can ease deployment across diverse experimental environments. The resulting framework provides a flexible foundation for extending autonomous control and analysis capabilities beyond a single beamline or instrument.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Data driven drift correction for complex optical systems

To exploit the thousand-fold increase in spectral brightness of modern light sources, increasingly intricate experiments are being conducted that demand extremely precise beam trajectory. Maintaining the optimal trajectory over several hours of an experiment with the needed precision necessitates active drift control. Here, we outline time varying Bayesian optimization (TVBO) as a data driven approach for robust drift correction, and illustrate its application for a split and delay optical system composed of six crystals and twelve input dimensions. Using numerical simulations, we exhibit the application of TVBO for linear drift, non-smooth temporal drift as well as constrained TVBO for multi-objective control settings, representing real-life operating conditions. This approach can be easily adapted to other X-ray beam conditioning and guidance systems, including multi-crystal monochromators and grazing-incidence mirrors, to maintain sub-micrometer and nanoradian beam stability over the course of an experiment spanning several hours.

Bayesian optimization↗
DOE OSTI2025

Next-Generation Energy Technologies for Connected and Automated On-Road Vehicles (NEXTCAR) - Predictive Data-Driven Vehicle Dynamics and Powertrain Control: from ECU to the Cloud (Final Scientific/Technical Report)

This project developed and demonstrated a predictive, data-driven vehicle control system designed to improve energy efficiency and driving performance. The team created intelligent self-driving car technology that optimizes fuel and electricity use by proactively planning vehicle actions. By combining Level 4 autonomous driving capabilities with vehicle-to-everything (V2X) connectivity, the system enables vehicles to adjust speed and change lanes in response to traffic signals, surrounding vehicles, and road conditions, reducing unnecessary stops and delays. In testing, the system improved vehicle fuel economy by more than 30% and reduced travel time by approximately 10%, compared to a conventional adaptive cruise control baseline. These results demonstrate the technical effectiveness of using predictive, V2X-enabled strategies, such as traffic light timing and surrounding traffic awareness, to inform real-time vehicle powertrain control and driving behavior. Additionally, a supporting cloud platform was developed to provide dispatch and route recommendations as well as to log vehicle data, demonstrating the economic feasibility of this approach at the fleet level. By optimizing dispatching and routing operations, this technology enables electric fleet operators to use their vehicles more efficiently and reduce reliance on diesel backups, lowering both operating costs and energy consumption. Overall, this project’s technology advances the future of clean, energy-efficient transportation, enabling vehicles and fleets to reduce energy waste, cut costs, and lower emissions through intelligent automation and connectivity.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

NEXT Generation Energy Technologies for Connected and Automated On-Road Vehicles (NEXTCAR Phase I & II)

The Ohio State University’s ARPA-E NEXTCAR project was a multi-phase, multi-year research, development, and demonstration program focused on improving the energy efficiency of connected and automated vehicles (CAVs). The team developed and validated advanced vehicle motion and powertrain control algorithms that coordinate propulsion and automation systems to optimize energy use. Key technologies included Dynamic Skip Fire engine control, predictive eco-driving functions such as Eco-Approach and Departure (Eco-AND) and Eco-Adaptive Cruise Control (Eco-ACC), and powertrain-agnostic optimization frameworks for hybrid, plug-in hybrid, and battery electric vehicles. The project successfully demonstrated up to 30% energy-efficiency improvement during real-world testing at the Transportation Research Center and the American Center for Mobility. The outcomes provide a foundation for scalable, cost-effective deployment of energy-optimized CAV technologies across the automotive industry.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Physics-informed Deep Reinforcement Learning-based Control in Power systems

Incorporating physics information into the deep reinforcement learning (DRL) process is a promising approach for addressing the challenges faced in learning-based control design problems for physical systems. Power grid dynamics, being a physical system, adheres to specific physical laws, constraints, as well as operational and control rules. Therefore, consideration of such physics-based law improves the learning process drastically. In general, traditional grid control schemes rely on rule-based mechanisms that cannot adapt to changing operating conditions. To improve the adaptability and computation time, recent research has seen a surge of DRL-based applications in power grid control. A generic DRL-based control design imposes the system performance requirements through the design of reward functions. In some cases, some of the important physics information is injected through this reward function. However, due to the complex dynamics and large state-action space, learning an optimal DRL policy often becomes challenging. Inspired by the latest developments in general machine learning (ML) research, power system researchers have been investigating more direct ways of incorporating physics knowledge into DRL training. This chapter specifically focuses on these aspects of physics-informed DRL designs in grid control. It discusses the significance, applications, research gaps, and open problems that need to be addressed in future research.

artificial intelligence, machine learning↗
DOE OSTI2025

A molecular conveyor belt-associated protein controls the rotational direction of the bacterial type 9 secretion system

ABSTRACT Many bacteria utilize the type 9 secretion system (T9SS) for gliding motility, surface colonization, and pathogenesis. This dual-function motor supports both gliding motility and protein secretion, where rotation of the T9SS plays a central role. Fueled by the energy of the stored proton motive force and transmitted through the torque of membrane-anchored stator units, the rotary T9SS propels an adhesin-coated conveyor belt along the bacterial outer membrane like a molecular snowmobile, thereby enabling gliding motion. However, the mechanisms controlling the rotational direction and gliding motility of T9SS remain elusive. Shedding light on this mechanism, we find that in the gliding bacteriumFlavobacterium johnsoniae, deletion of the C-terminus of the conveyor belt-associated protein GldJ controls and, in fact, reverses the rotational direction of T9SS from counterclockwise (CCW) to clockwise (CW). This suggests that the interface between the conveyor belt-associated protein GldJ and the T9SS ring protein GldK plays an important role in controlling the directionality of T9SS, potentially by modulating its interaction with the stator complex GldLM, which drives motor rotation. Combined with MD simulation of the T9SS stator units GldLM, we suggest a “tri-component gearset” model where GldJ controls the rotational direction of its driver, the T9SS, thus providing adaptive sensory feedback to influence the motility of the gliding bacterium. IMPORTANCE The type 9 secretion system (T9SS) is fundamental to bacterial gliding motility, pathogenesis, and surface colonization. Our findings reveal that the C-terminal region of the conveyor belt-associated protein GldJ functions as a molecular switch which is capable of reversing the rotational direction of T9SS. Through the coordinated actions of the T9SS stator units (akin to a driving motor), the GldK ring (the gear that converts rotational energy into linear movement), and GldJ, this machinery forms a smart conveyor belt system reminiscent of flexible or cognitive mechanical conveyors. Such advanced conveyors can alter their direction to adapt to shifting demands. Here, we show that the bacterial T9SS similarly adjusts its rotational bias based on feedback from the conveyor belt-associated protein GldJ. This dual-role feedback mechanism underscores an evolved, controllable biological snowmobile, offering new avenues for studying how bacteria fine-tune motility in dynamic environments.

Microbiology↗
DOE OSTI2025

Dynamic Model Development of a Wind Power Plant Using Neural Net Method to Forecast Wind Power Output (CRADA Final Report)

This project is intended to model wind power plant based on monitored data at the wind power plant. This project will promote the university research in Renewable Energy area and trains the future highly qualified engineers. The dynamic model will be based on neural net model with the input from the two met towers (12 inputs), and the number of turbines in operation (one input). The overall input will be 13 inputs to drive the simulations. The output power at the point of interconnection will be used to tune the neural net weight coefficients. Two neural net concepts will be investigated (the back propagation neural net and the dynamic recurrent neural net with feedback).

17 WIND ENERGY↗
DOE OSTI2026

A Compact Cryogenic Environment for In Situ Neutron Diffraction Under Mechanical Loading

Understanding the deformation mechanisms of materials at cryogenic temperatures is crucial for cryogenic engineering applications. In situ neutron diffraction is a powerful technique for probing such mechanisms under cryogenic conditions. In this study, we present the development of a compact cryogenic environment (CCE) designed to facil-itate in situ neutron diffraction experiments under mechanical loading at tempera-tures as low as 77 K. The CCE features a polystyrene foam cryogenic chamber, alumi-num blocks serving as neutron-transparent cold sinks, a liquid nitrogen dosing system for cryogen delivery, a nitrogen gas flow control system for thermal management, a process controller for temperature control, and a pair of thermally isolated grip adapt-ers for mechanical testing. The CCE achieves reliable temperature control with mini-mal neutron attenuation. Utilizing this setup, we conducted three in situ neutron dif-fraction tensile tests on a 316L stainless steel at 77 , 173 , and 298 K, respectively. The results highlight the pronounced effects of cryogenic temperatures on the material's deformation mechanisms, underscoring both the significance of cryogenic deformation studies and the effectiveness of the CCE.

Yu, Dunji [ORNL] (ORCID:0000000189467851)↗
DOE OSTI2025

Deep Reinforcement Learning for Distribution System Operations: A Tutorial and Survey

Here, the rapid evolution of modern electric power distribution systems into complex networks of interconnected active devices, distributed generation (DG), and storage poses increasing difficulties for system operators. The large-scale integration of distributed energy resources (DERs) and the rapid exchange of measurement data via communication networks present major opportunities for advancing grid operations but also introduce greater uncertainty, higher data dimensionality, more complex network and device models, and challenging control and optimization problems. Deep reinforcement learning (DRL) algorithms are promising in addressing these challenges. However, they have not been effectively adapted for power systems applications, requiring extensive customization for implementation and evaluation. This has resulted in reproducibility challenges and a steep learning curve for researchers new to applying DRL algorithms to the power systems domain. To bridge these gaps, this tutorial aims to serve as a valuable resource for researchers interested in exploring learning-based algorithms to operate active power distribution networks. Specifically, this work presents a generalized process for translating sequential decision-making problems in power distribution systems into Markov decision process (MDP) formulations, illustrated through concrete grid service examples. Additionally, we introduce a simple environment design strategy to develop and evaluate example DRL algorithms for distribution system applications, complete with an included code repository to guide users through environment construction.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Occupant-Centric Demand Response for Thermostatically-Controlled Home Loads

Efficiently managing energy usage to balance supply and demand on the electric grid is crucial, especially with the widespread deployment of distributed variable renewable electricity generation. This paper introduces two duty-cycle control methods for heating systems, adjusting thermostat setpoints to limit and shift electricity demand. The control approaches employ innovative techniques, such as adaptive duty cycling, to prioritize household thermal comfort while reducing peak demand. These control methods can respond to signals from the electric grid, including demand targets and time-of-use tariffs, and were tested physically on an electric furnace and heat pump in a test home during winter conditions in 2021 and 2022. The results are given as average demand reductions and energy use impacts with respect to the average indoor-outdoor temperature difference during the control period. For heat pumps, demand limiting control reduced power by 18.5% and 23.3% for indoor-outdoor temperature differences of 30°F and 40°F. Preheating-based demand shifting achieved reductions of 34.8% and 33.2% for the same temperature differences. Electric furnace tests showed demand reductions of 33.8% and 25.3% for demand limiting, and 56.1% and 45.7% for preheating-based demand shifting. These findings highlight the potential for innovative control methods to enhance grid efficiency and reduce energy consumption.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Direct measurement of thermal Knudsen forces in rarefied gas environments

At micro- and nanoscales, momentum transfer between surfaces is influenced by various physical mechanisms, including quantum fluctuations, electromagnetic interactions, electric charges, and the dynamics of (rarefied) gases. Under non-isothermal conditions, rarefied gases give rise to thermal Knudsen forces whose magnitudes strongly depend on the gas species and surface characteristics. Knudsen forces are particularly relevant in nanotechnology, optical manipulation, and aerospace systems, where gas rarefaction occurs due to highly confined geometries, sub-micrometer length scales, and reduced particle densities. Despite their significance, predictive modeling of Knudsen forces is limited by a lack of comprehensive experimental data across diverse materials and surface morphologies. Here, in this work, we present a highly sensitive and adaptable measurement platform capable of directly quantifying Knudsen forces using a suspended, interchangeable micro-cantilever within controlled rarefied helium and nitrogen environments. The system integrates optical fiber interferometry to precisely capture out-of-plane displacements at sub-micrometer resolution, driven by Knudsen forces. From the empirical data, we derive a robust correlation linking the magnitudes of Knudsen forces to energy accommodation coefficients, offering deeper insights into the underlying gas–surface interaction mechanisms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Autonomous elemental characterization enabled by a low cost robotic platform built upon a generalized software architecture

Despite the rapidly growing applications of robots in industry, the use of robots to automate tasks in scientific laboratories is less prolific due to the lack of generalized methodologies and the high cost of hardware. This paper focuses on the automation of characterization tasks necessary for reducing cost while maintaining generalization and proposes a software architecture for building robotic systems in scientific laboratory environments. A dual-layer (Socket.IO and ROS) action server design is the basic building block, which facilitates the implementation of a web-based front end for user-friendly operation and the use of ROS Behavior Trees for convenient task planning and execution. A robotic platform for automating mineral and material sample characterization is built upon the architecture, with an open-source, low-cost three-axis computer numerical control gantry system serving as the main robot. A handheld laser induced breakdown spectroscopy (LIBS) analyzer is integrated with a 3D printed adapter, enabling (1) automated 2D chemical mapping and (2) autonomous sample measurement (with the support of an RGB-Depth camera). We demonstrate the utility of automated chemical mapping by scanning the surface of a spodumene-bearing pegmatite core sample with a 1071-point dense hyperspectral map acquired at a rate of 1520 bits per second. Furthermore, we showcase the autonomy of the platform in terms of perception, dynamic decision-making, and execution, through a case study of LIBS measurement of multiple mineral samples. The platform enables controlled and autonomous chemical quantification in the laboratory that complements field-based measurements acquired with the same handheld device, linking resource exploration and processing steps in the supply chain for lithium-based battery materials.

Cao, Xuan [Lawrence Berkeley National Laboratory (↗
DOE OSTI2025

Tree tensor network hierarchical equations of motion based on time-dependent variational principle for efficient open quantum dynamics in structured thermal environments

In this work, we introduce an efficient method, TTN-HEOM, for exactly calculating the open quantum dynamics for driven quantum systems interacting with highly structured bosonic baths by combining the tree tensor network (TTN) decomposition scheme with the bexcitonic generalization of the numerically exact hierarchical equations of motion (HEOM). The method yields a series of quantum master equations for all core tensors in the TTN that efficiently and accurately capture the open quantum dynamics for non-Markovian environments to all orders in the system–bath interaction. These master equations are constructed based on the time-dependent Dirac–Frenkel variational principle, which isolates the optimal dynamics for the core tensors given the TTN ansatz. The dynamics converges to the HEOM when increasing the rank of the core tensors, a limit in which the TTN ansatz becomes exact. We introduce TENSO, tensor equations for non-Markovian structured open systems, as a general-purpose Python code to propagate the TTN-HEOM dynamics. We implement three general propagators for the coupled master equations: two fixed-rank methods that require a constant memory footprint during the dynamics and one adaptive-rank method with a variable memory footprint controlled by the target level of computational error. We exemplify the utility of these methods by simulating a two-level system coupled to a structured bath containing one Drude–Lorentz component and eight Brownian oscillators, which is beyond what can presently be computed using the standard HEOM. Our results show that the TTN-HEOM is capable of simulating both dephasing and relaxation dynamics of driven quantum systems interacting with structured baths, even those of chemical complexity, with an affordable computational cost.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗