Search NASASearch

SEARCH · Search NASA

Results for “Autonomous Control Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Hardware-Based Demonstration of Temperature Control Functions for Reactor Systems

Establishing autonomy in reactor control systems has become essential for the expansion of nuclear technologies. Thermal regulation in particular remains crucial for maintaining stable operation and ensuring the integrity of fuel. To alleviate public skepticism of the safety of nuclear reactors, demonstrating control over this key factor is pivotal. Utilizing electric heat pads to simulate the heat released in a reactor core, thermocouples for temperature monitoring, and an Arduino micro programmable logic controller (PLC) for control, a hardware-based demonstration of a reactor heating system validates the efficacy of reactor control over this key parameter. To improve precision, a proportional-integral-derivative (PID) algorithm was implemented in the heating control loop to ensure meticulous control of reactor functions. In addition, the integration of this physical system with a digital simulator tool such as RELAP5-3D establishes a foundation for a comprehensive testing environment. This allows for a refinement of temperature control under various simulated reactor conditions, bringing another layer of reliability to the operation of the system. By facilitating a physical demonstration of reactor thermal management and control strategies, this project provides a foundation for expanded testing and educational outreach. Ultimately, this system advances the broader goal of demonstrating the safety and viability of autonomous reactor operations, contributing to public trust and future reactor deployment.

22 GENERAL STUDIES OF NUCLEAR REACTORS

Next-Generation Energy Technologies for Connected and Automated On-Road Vehicles (NEXTCAR) - Predictive Data-Driven Vehicle Dynamics and Powertrain Control: from ECU to the Cloud (Final Scientific/Technical Report)

This project developed and demonstrated a predictive, data-driven vehicle control system designed to improve energy efficiency and driving performance. The team created intelligent self-driving car technology that optimizes fuel and electricity use by proactively planning vehicle actions. By combining Level 4 autonomous driving capabilities with vehicle-to-everything (V2X) connectivity, the system enables vehicles to adjust speed and change lanes in response to traffic signals, surrounding vehicles, and road conditions, reducing unnecessary stops and delays. In testing, the system improved vehicle fuel economy by more than 30% and reduced travel time by approximately 10%, compared to a conventional adaptive cruise control baseline. These results demonstrate the technical effectiveness of using predictive, V2X-enabled strategies, such as traffic light timing and surrounding traffic awareness, to inform real-time vehicle powertrain control and driving behavior. Additionally, a supporting cloud platform was developed to provide dispatch and route recommendations as well as to log vehicle data, demonstrating the economic feasibility of this approach at the fleet level. By optimizing dispatching and routing operations, this technology enables electric fleet operators to use their vehicles more efficiently and reduce reliance on diesel backups, lowering both operating costs and energy consumption. Overall, this project’s technology advances the future of clean, energy-efficient transportation, enabling vehicles and fleets to reduce energy waste, cut costs, and lower emissions through intelligent automation and connectivity.

33 ADVANCED PROPULSION SYSTEMS

Development of a Discrepancy Checker for the Digital Twin in a Supervisory Control System for a Thermal Energy Delivery System

Defined as a virtual representation of a physical object, process, or service, and used to support real-world decision-making, a digital twin (DT) can be utilized to combine classical and novel frameworks in sensors, state predictions, and multi-input/multi-output systems, and to enable optimal autonomous operations. However, a DT’s usefulness largely depends on its ability to adequately mirror the state of its physical counterpart, and this adequacy should be reflected by the level of uncertainty in the underlying simulation models when estimating and predicting quantities of interest (QOIs). Moreover, simulation models in a DT may involve multiple fidelities of representations—ranging from physics-based models to data-driven ones—but classical uncertainty quantification (UQ) methods struggle to handle numerous uncertainty sources, nor are they designed for real-time applications. This work presents a UQ-based discrepancy checking and diagnosis tool for a DT-based supervisory control system applied to a thermal energy delivery system (TEDS) at Idaho National Laboratory. The discrepancy checker was developed using metadata from an automated DT development process, and these metadata included different combinations of physical model forms and model parameters, training data and hyperparameters for surrogate models, and design parameters for supervisory control systems. Next, correlations between the uncertainty results and the metadata were established and then applied to the DT operations. The discrepancy checker evaluates the discrepancies between model predictions from virtual and sensor measurements and backtraces them to the corresponding major sources of uncertainty. The discrepancy checker showed reasonable performance in detecting discrepancies and diagnosing sources of uncertainty in testing scenarios.

22 - GENERAL STUDIES OF NUCLEAR REACTORS

Grid Resiliency using Hydro-based Microgrids During Wildfires

The primary objective of this project is to assess the techno-economic viability of hydropower resources with supplementary investments, including microgrid controllers, storage solutions, load banks, additional generation like diesel generators, communication links, and transmission infrastructure. The aim is to enable these systems to operate autonomously (in islanded mode) and ensure grid resiliency during and after wildfire events. The project seeks to establish a comprehensive framework for setting up hydropower-based microgrids, from risk estimation to final investment decisions. These microgrids can provide critical support during emergencies and offer additional grid stability and revenue opportunities during regular operations and other system contingencies.

24 POWER TRANSMISSION AND DISTRIBUTION

AutoFocus: AI/ML-driven real-time wavefront diagnostics to autonomously align and optimize X-ray optics

We present an integrated system that combines advanced wavefront diagnostics with artificial intelligence (AI) to automate and optimize X-ray optics at synchrotron beamlines. This system couples real-time wavefront sensing with AI-driven control algorithms to achieve precise beam alignment, stabilization, and performance optimization. A key feature is the use of multi-fidelity transfer learning, which enables knowledge gained from both real-world beamline optimizations and ultra-realistic digital twin simulations to be effectively applied to in situ optimization. By leveraging multi-objective bayesian optimization, the system continuously refines its performance, reducing optimization time and minimizing the need for manual adjustments. Designed for seamless deployment, it operates with existing beamline hardware and provides an intuitive graphical interface. Initial deployments at the advanced photon source beamlines have demonstrated its ability to enhance beam stability, improve reproducibility, and significantly streamline alignment procedures. This AI-enhanced control framework represents a significant step toward fully autonomous beamline operation in next-generation synchrotron facilities.

Rebuffi, Luca [Argonne National Laboratory (ANL),

From Sim to Real: A Pipeline for Training and Deploying Traffic Smoothing Cruise Controllers

Designing and validating controllers for connected and automated vehicles to enhance traffic flow presents significant challenges, from the complexity of replicating real-world stop-and-go traffic dynamics in simulation, to the intricacies involved in transitioning from simulation to actual deployment. In this work, we present a full pipeline from data collection to controller deployment. Specifically, we collect 772 km of driving data from the I-24 in Tennessee, and use it to build a one-lane simulator, placing simulated vehicles behind real-world trajectories. Using policy-gradient methods with an asymmetric critic, we improve fuel efficiency by over 10% when simulating congested scenarios. Our comprehensive approach includes reinforcement learning for controller training, software verification, hardware validation and setup, and navigating various sim-to-real challenges. Furthermore, we analyze the controller's behavior and wave-smoothing properties, and deploy it on four Toyota Rav4’s in a real-world validation experiment on the I-24. Lastly, we release the driving dataset, the simulator and the trained controller, to enable future benchmarking and controller design.

42 ENGINEERING

New Era Towards Autonomous Additive Manufacturing: A Review of Recent Trends and Future Perspectives

Abstract The Additive Manufacturing (AM) landscape has significantly transformed in alignment with Industry 4.0 principles, primarily driven by the integration of Artificial Intelligence (AI) and Digital Twin (DT). However, current Intelligent Additive Manufacturing (IAM) systems face limitations such as fragmented AI tool usage and suboptimal human-machine interaction (HMI). This paper reviews existing IAM solutions, emphasizing control, monitoring, process autonomy, and end-to-end integration, and identifies key limitations, such as the absence of a high-level controller for global decision-making. To address these gaps, we propose a transition from IAM to Autonomous Additive Manufacturing (AAM), featuring a hierarchical framework with four integrated layers: knowledge, generative solution, operational, and cognitive. In the cognitive layer, AI agents notably enable machines to independently observe, analyze, plan, and execute operations that traditionally require human intervention. These capabilities streamline production processes and expand the possibilities for innovation, particularly in sectors like in-space manufacturing (ISM). Additionally, this paper discusses the role of AI in self-optimization and lifelong learning, positing that the future of AM will be characterized by a symbiotic relationship between human expertise and advanced autonomy, fostering a more adaptive, resilient manufacturing ecosystem.

Fan, Haolin

First-of-a-Kind Risk-Informed Digital Twin for Operational Decision Making

A digital twin (DT) is a digital model or a collection of models of a physical entity. DTs in the nuclear arena can be used from plant design through decommissioning. Decisions are typically a priori or made offline. Risk-informed decision making is identifying what can go wrong, its frequency, and the consequences of its failure. Ideally risk-informed decision making reflects the current state of the plant and provides a decision in real time. Traditionally, probabilistic risk assessments (PRAs) evaluate the failures of safety systems, the risk of core damage, and the offsite dose as the consequence. However, this DT evaluates the decisions on the control side rather than the protection side. It uses the same risk methods to probabilistically inform the decision-making process but in a different way. Rather than evaluating the risk of core damage, this DT evaluates the likelihood of avoiding a trip set point while maintaining plant safety. Performance-based assessments are identified via its probabilistic evaluation of operational alternatives based on system status. Because the purpose of the control system is to maintain system variables within prescribed operating ranges, upsets or challenges that can exceed a trip set point resulting in a plant transient and a challenge to plant mitigating systems based on actual plant conditions, are evaluated to safely maintain the plant within the operating ranges. The probabilistic portion of the model is autonomously and automatically adjusted, and the metric of interest (i.e. likelihood of avoiding a trip set point) is recalculated. The digital representation of the physical system (i.e. the DT) performs a deterministic performance–based assessment of the probabilistically identified alternatives identified to validate the probabilistic assessment. A decision-making algorithm selects the appropriate option based on the probabilistic and deterministic assessments and transmits a control signal to a component(s) to initiate a corrective action or informs an operator of its decision.

digital twin

Signal Whisperers: Enhancing Wireless Reception Using DRL-Guided Reflector Arrays

This paper presents a multi-agent reinforcement learning (MARL) approach for controlling adjustable metallic reflector arrays to enhance wireless signal reception in non-line-of-sight (NLOS) scenarios. Unlike conventional reconfigurable intelligent surfaces (RIS) that require complex channel estimation, our system employs a centralized training with decentralized execution (CTDE) paradigm where individual agents corresponding to reflector segments autonomously optimize reflector element orientation in three-dimensional space using spatial intelligence based on user location information. Through extensive ray-tracing simulations with dynamic user mobility, the proposed multi-agent beam-focusing framework demonstrates substantial performance improvements over single-agent reinforcement learning baselines, while maintaining rapid adaptation to user movement within one simulation step. Comprehensive evaluation across varying user densities and reflector configurations validates system scalability and robustness. The results demonstrate the potential of learning-based approaches for adaptive wireless propagation control.

deep reinforcement learning

Autonomous Operations for Advanced Reactors Utilizing Supervisory Control

Automation is a critical tenet of reactor plant operations as reliance on nuclear energy increases. Nuclear power plants require a large workforce which does not scale with output; that is, the cost per megawatt increases as reactor output becomes smaller. The economic viability of advanced reactors, particularly small modular reactors (SMRs) and microreactors, requires a significantly reduced onsite workforce. The logical solution is establishing a systematic process of elimination of reliance on human operators, and to the extent possible, replacing these actions with automated functions. In this paper, we propose a method for such transformation to establish a robust technical basis to enable transition to autonomy. Our method is based on finite state automata (FSA)—also known as finite state machines (FSMs). Relying on this method allows us to exploit the rich set of mathematical proofs available in the field of regular languages. FSA are one of the mathematical tools to model discrete event systems (DES). These properties are applied to produce an automated startup controller for the Massachusetts Institute of Technology Research Reactor (MITR). The startup procedure is captured in terms of discrete changes from one state to another while an independent supervisory control system directs the sequence of states and alerts a human in the event of an abnormal operation. First, the design and behavior of the MITR rod control system were modeled in Simulink. Then, the startup procedure was applied to the rod control system and the DES performed a startup by procedurally withdrawing rods to the subcritical position. The simulation also stops rod motion in response to an uncontrollable event and restarts rod motion once the event has been cleared.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN

Functional Nano-to-Microstructures by Jet Printing and Direct Ink Writing

Jet-based printing techniques and direct ink writing have emerged as complementary, convergent technologies serving as key platforms in additive manufacturing for functional nano- to microscale architectures. This review highlights how these approaches enable fine feature resolution and three-dimensional structures in advanced electronics and biointerfacing applications. The interplay of fluid mechanics, viscoelastic ink rheology, droplet–substrate interactions, and drying dynamics is examined as a critical determinant of printing fidelity. Application-focused case studies, from flexible thin-film transistors to bioprinted artificial tissues, demonstrate how precise structural control via printing translates to enhanced device performance and new functionality in electronic and biological systems. Finally, we discuss the challenges and future opportunities driving the evolution of these printing platforms toward autonomous, adaptive, and intelligent manufacturing systems.

Luo, Junchen [Sichuan Univ. of Arts and Science (C

Advancing Development of Emissions Detection (Final Report)

This document is the final report to the U.S. Department of Energy (DOE for contract DE-FE0031873) awarded to Colorado State University (CSU). CSU and partners at Harrisburg University of Science and Technology, University of Texas Arlington, and University of Texas at Austin organized several testing rounds to provide knowledge focused on advancing the detection capabilities of emissions monitoring devices. With this funding opportunity the research group began by establishing the Advancing the Development of Emission Detection (ADED) program, with the goal focused on enhancing the accuracy, reliability, and field applicability of methane detection technologies. This effort aimed to address the critical challenges of identifying and quantifying methane emissions while enabling industry stakeholders to meet regulatory compliance and environmental sustainability goals. The program engaged with industry, government, and technology stakeholders to promote adoption and consensus on testing techniques for methane detection solutions. Methane, a potent greenhouse gas, contributes significantly to global warming, and the oil and natural gas (O&G) sector is a primary source of methane emissions. Regulatory measures such as leak detection and repair (LDAR) programs have been implemented to address emissions. However, traditional LDAR approaches, reliant on handheld and component-level measurements, are resource-intensive. To address these limitations and move with evolving regulations, advanced methane technologies are emerging. These solutions include ground-based sensors, mobile systems (e.g., drones, vehicles, and aircraft), and satellite-based platforms. They offer innovative capabilities for autonomous monitoring, larger spatial coverage, and emission quantification using methods such as tracer gas techniques and inverse modeling with Gaussian plume analysis. The ADED program began with creating protocols for methane controlled release (CR) testing these continuous monitoring (CM) and survey technologies that detect and monitor methane emissions at O&G facilities. The protocols were then implemented throughout testing of CM and survey devices at CSU’s Methane Emissions Technology Evaluation Center (METEC) facility from 2021 through 2024. As apart of the protocol, solutions that tested under the ADED program installed their solutions at METEC, documented their system under test, and provided detection reports to the METEC team for analysis. The METEC team would provide the solutions with analyzed reports of their emissions and ground truth data of the releases conducted during their testing session. Under the ADED program, CMs were also tested at O&G facilities for a six week test run of challenge release (ChR) releases. The findings from the ADED program underscore the critical role of collaborative research and innovation in tackling methane emissions, offering a pathway for the oil and gas sector to achieve significant environmental and economic benefits. Results from METEC testing saw improvement of performance and accuracy across all solutions over the extent of the ADED experiments. The results also showed a variance in CM solution performance between CRs and ChRs. That variance pushed the team to further analyze the differences between CR testing environments and field conditions. With the drive from regulations and that variance in field conditions, the ADED team began designing a new CR testing protocol and additions to the METEC testing facility. The METEC team is furthering the progress made through the ADED program with awarded funding from DE-FE0032276. This funding pushes the development of METEC’s addition with new equipment, allowing for an updated facility layout. METEC still facilitates for traditional facilities, with a legacy pad, while expanding an new design based on how O&G infrastructure has Final Report - Contract Number: DE-FE0031873 been changed over the last decade. Throughout the ADED program the team has also been working with international partners to ensure staying in the trend globally. International partners have been essential in moving the new protocol forward to implement into CR testing at the METEC facility in Spring 2025.

42 ENGINEERING

Eco-driving Profile Optimization by Dynamic Programming for Battery Electric Vehicles

Although full automation has not yet been achieved, automated vehicles are a valid research area. Not only would automated vehicles provide ultimate driver convenience, but they would maximize energy efficiency by eliminating undesired human driving behaviors and optimally controlling the powertrain. From the perspective of control related to energy saving, speed profile optimization is important for improving system efficiency and satisfying passenger demands. This study employs Dynamic Programming (DP) to solve the constrained optimal problem for travel time, distance, and speed limit by exploring all possible control options. The solutions obtained by DP demonstrate consistent control patterns combining four control modes-acceleration, cruising, coasting, and braking, with cruising or coasting being selective depending on the boundary conditions. Further, this study introduces DP-based simulation results and attempts to provide comprehensive interpretations of the optimal policy by analyzing the essential factors that affect the control problem, including boundary conditions, road load, and powertrain characteristics. Based on these interpretations, the control concepts can be explained as the optimal policy selecting the best control option based on system efficiency and boundary conditions. The results of DP are compared with a human-like driver model to show that the optimal speed profiles can effectively reduce energy consumption.

Autonomous vehicles

WM26 Paper Multi-Robot Collaboration for Hazardous Environments

Hazardous nuclear and industrial facilities are rarely designed for robots. Work in these domains demand precise manipulation and robust mobility in cluttered, constrained spaces where off-the-shelf platforms struggle and “one-size-fits-all” machines become costly and complex. Idaho National Laboratory (INL) is developing an autonomous, multi-robot inspection system that coordinates task-specific platforms rather than relying on a single omni-tool robot. An electric truck serves as a power and compute hub for a custom manipulator co-developed with Florida International University (FIU), a commercial mini crawler, a pan–tilt–zoom camera, and a Nexxis Argus LiDAR mapping system. Working in concert, these robots generate spatial, radiation, and temperature maps of the pit environments at the Hanford Waste Tank Farms. These systems will capture visual records and environmental telemetry to allow for analysis post inspection. The system architecture uses Robot Operating System 2 (ROS 2) for publish/subscribe integration, NVIDIA Isaac Sim and Unity for simulation and visualization, and algorithms such as NVBlox to fuse data into unified 3D overlays. This robot-agnostic approach reduces operator burden by enabling autonomy across heterogeneous platforms and lets each robot be used where it is strongest. Having autonomous functions means operators don’t have to fully control multiple different components. The ease of use could allow for more widespread adoption of advanced robotics at waste management sites that see continued use. By coordinating simpler, purpose-built mechanisms, the approach lowers design and manufacturing complexity, reduces capital risk in contaminated settings, and improves controllability for complex inspection and manipulation tasks. We present the architecture, early results, and lessons learned from building and deploying this coordinated multi-robot system, with the goal of accelerating safe, cost-effective adoption of advanced robotics at waste-management sites.

42 - ENGINEERING

Lab-Scale Cable-Driven Parallel Robot Prototype for Automated Prefabricated Component Manipulation

This paper presents the design and evaluation of a lab-scale cable-driven parallel robot (CDPR) developed as a flexible platform for automated installation of prefabricated components onto exterior building envelopes. Traditional manual installation methods for prefabricated components, which depend on scaffolding, cranes, cherry pickers, and verbal coordination, are not only labor-intensive and error-prone but also face significant limitations in dense urban environments due to site access constraints. To address these challenges, we developed a lab-scale CDPR platform capable of autonomously transporting building envelope components from a designated pickup zone to their target installation location, minimizing the need for human intervention. This study describes the system’s mechanical design, actuation architecture, real-time feedback system, and control strategy of the CDPR, and evaluates its performance in a laboratory environment. The robot’s actuation system uses torque control for end-effector manipulation. The robot’s real-time pose feedback comes from a construction-grade total station and a wireless inertial measurement unit (IMU), which together support precise end-effector control. Experimental results demonstrate the successful integration of the hardware, sensing, state estimation, and control subsystems. Preliminary tests showed that our lab-scale prototype can position the end effector with an error of less than 3 mm, which is a level of precision not previously achieved by existing CDPRs in construction applications. The key findings are twofold: (1) torque-only control is necessary but not sufficient for minimizing final pose error, and (2) incorporating real-time pose feedback can achieve the desired placement accuracy.

Liu, Yifang [Oak Ridge National Laboratory (ORNL),

Agentic artificial intelligence for multistage physics experiments at a large-scale user facility particle accelerator

We present a language-model-driven agentic artificial intelligence (AI) system to autonomously execute multistage physics experiments on a production synchrotron light source. Implemented at the Advanced Light Source particle accelerator, the system translates natural language user prompts into structured execution plans that combine archive data retrieval, control-system channel resolution, automated script generation, controlled machine interaction, and analysis. In a representative machine physics task, we show that preparation time was reduced by 2 orders of magnitude relative to manual scripting even for a system expert, while operator-standard safety constraints were strictly upheld. Core architectural features, plan-first orchestration, bounded tool access, and dynamic capability selection, enable transparent, auditable execution with fully reproducible artifacts. These results establish a blueprint for the safe integration of agentic AI into accelerator experiments and demanding machine physics studies, as well as routine operations, with direct portability across accelerators worldwide and, more broadly, to other large-scale scientific infrastructures.

Accelerator/storage ring control systems

Griffin Capability Improvements in Support of Ex-core Deep-Penetration Problems

Advanced reactor designs, especially portable reactors that are designed to be located closer to humans and operate autonomously, require the ability to accurately compute the ex-core neutron and gamma flux solutions in terms of shielding design optimization to reduce dose rates at the vessel boundary and detector signal prediction to drive the reactor control system. The Nuclear Energy Advanced Modeling and Simulation program has prioritized improvements to the Griffin discrete ordinates (SN) solver for deep-penetration problems in fiscal year 2025. Significant advancements have been made to the Griffin methodologies for solving ex-core deep-penetration problems for steady-state, fixed-source and transient calculations. This work presents the methodology improvements as well as a comprehensive demonstration with a Transient Test Reactor model and measurements.

22 - GENERAL STUDIES OF NUCLEAR REACTORS