Search NASA⌕ Search

SEARCH · Search NASA

Results for “Automation & control systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Optimizing Traffic Signal Control to Enhance Transportation Efficiency and Maximize Pedestrian Benefits in the Road Network

Increasing urban mobility requirements demand efficient transportation system strategies for both vehicular and pedestrian movement. This study enhances the Decentralized Graph-based Multi-Agent Reinforcement Learning (DGMARL) approach, originally tailored for vehicular traffic signal timing, to incorporate pedestrian traffic dynamics. The improved algorithm considers crucial metrics such as Eco_PI, assesses vehicle fuel consumption by factoring in stops and delays, and addresses pedestrian waiting time, crucial for system efficiency while acknowledging driver waiting time impact. Utilizing Digital Twin simulation along the MLK Smart Corridor in Chattanooga, Tennessee, the algorithm's performance is compared for various pedestrian control scenarios. To evaluate the effectiveness of DGMARL, this study compared DGMARL-enabled signal management with automated pedestrian traffic detection and an actuated signal management system (real-word baseline) with pedestrian recall, which predetermingly enforces a pedestrian phase every cycle. Findings indicate substantial improvements with DGMARL, showing a 28.29% enhancement in vehicle Eco_PI, a 60.55 % reduction in pedestrian waiting time, and a 55.74% decrease in driver stop delay, on average, compared to the baseline actuated signal timing plan.

Kumarasamy, Vijayalakshmi K [The University of Ten↗

An Edge-Cloud Integrated Solution for Buildings Demand Response Using Reinforcement Learning

Buildings, as major energy consumers, can provide great untapped demand response (DR) resources for grid services. However, their participation remains low in real-life. One major impediment for popularizing DR in buildings is the lack of cost-effective automation systems that can be widely adopted. Existing optimization-based smart building control algorithms suffer from high costs on both building-specific modeling and on-demand computing resources. To tackle these issues, this paper proposes a cost-effective edge-cloud integrated solution using reinforcement learning (RL). Beside RL’s ability to solve sequential optimal decision-making problems, its adaptability to easy-to-obtain building models and the off-line learning feature are likely to reduce the controller’s implementation cost. Using a surrogate building model learned automatically from building operation data, an RL agent learns an optimal control policy on cloud infrastructure, and the policy is then distributed to edge devices for execution. Simulation results demonstrate the control efficacy and the learning efficiency in buildings of different sizes. A preliminary cost analysis on a 4-zone commercial building shows the annual cost for optimal policy training is only 2.25% of the DR incentive received. Results of this study show a possible approach with higher return on investment for buildings to participate in DR programs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Assessment of Flow-Enhanced Electrochemical Sensor Testing and Deployments for MSRs

This report serves as the deliverable for Milestone M3RS-23AN0401061 that is part of Work Package RS-23AN040106 (Flow Enhanced Sensors for MSRs – ANL). The goal of this milestone was to determine performance of the flow enhanced electrochemical sensor (FEES) and modular flow instrumentation testbed (MFIT) in safeguards relevant scenarios. Flow enhanced electrochemical sensors are a type of electroanalytical sensor that has been developed at Argonne National Laboratory to be installed directly into MSR flow conduits to make measurements of the salt composition. These sensors represent a significant improvement in capabilities compared to earlier electroanalytical sensors that instead can only be operated in quiescent conditions. Previous work has focused on testing of the FEES in flowing conditions provided by the MFIT to assess the accuracy and precision of the sensor measurements. To further improve this capability, in FY23 we undertook a campaign of safeguards relevant scenarios in molten salt containing a range of uranium chloride concentrations (0 to 3 wt%). All the testing carried out in FY23 was aided by a control system designed to automatically actuate flow conditions and collect data. This new automation system is estimated to have increased experimental throughput by a factor of four and enabled testing in a variety of complex conditions. The advancements in throughput and repeatability led to improved quantification of actinide concentrations using the in-flow sensors, with a reduction of the mean absolute relative error from 5.6% in FY22 to 3.1% in FY23. In addition to safeguards scenarios run in the MFIT, FY23 work included deployment of a FEES at a partner institution where it will be tested in a flowing salt loop. The FEES was successfully integrated into that loop and is being tested prior to loop startup. In FY23, work also continued on the smaller flow system that we have named the mini-MFIT. This smaller system is capable of rapid prototyping of new sensor designs prior to installation in the larger MFIT radiological flow system. Work was carried out to test this new system in non-radiological molten salts in a separate glovebox. This work is helping us to enhance the accuracy of our salt monitoring capabilities through the integration of multiple types of sensors. The high degree of accuracy required by 10 CFR 74 represents a significant challenge, and further design evolution and integration of the sensors into multimodal sensing frameworks will be needed to further push the measurement accuracy to the needed level.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Assessment of Commercial Building Lighting as a Frequency Regulation Resource

This paper evaluates the potential for automated lighting control as a resource for frequency regulation of the electric grid system in the context of current energy policies, economic incentives, and technological trends. The growing prevalence of renewable energy has increased the need for ancillary services to maintain grid frequency and stability. While demand side resources like heating, ventilating, and air-conditioning systems, as well as water treatment plants are already evaluated as regulation service providers, the potential application to electrical lighting systems has largely been ignored. Yet, aggregations of lighting systems that are retrofitted with intelligent controls could conceivably contribute to frequency regulation services with little impact on user comfort. To further explore the feasibility of lighting potential, this paper explores (1) how lighting control systems are limited by visual comfort perception and acceptability, (2) how such limitations impact the performance of the lighting system as an frequency regulation resource, and (3) how the market potential of lighting systems as demand side resources compares in different regional transmission organizations. Finally, the impact of developing technologies on the application of lighting systems for frequency regulation is discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

NRIC Asset Suite Engineering and Operations Data Integration Plan

The National Reactor Innovation Center (NRIC), established by the U.S. Department of Energy (DOE) in August 2019, accelerates the demonstration and deployment of advanced nuclear energy through its mission to inspire stakeholders and the public, empower innovators, and deliver successful outcomes through efficient coordination of partners and resources. NRIC is a national program led by Idaho National Laboratory (INL), enabling collaborators to harness the world-class capabilities of the U.S. National Laboratory System. Committed to demonstrating advanced reactors by the end of 2025, NRIC is designed to bridge the gap between research, development, and the marketplace to help convert some of the Nation’s most promising advanced nuclear reactors into commercial applications by 2030. To meet these needs, NRIC is developing two reactor demonstration test beds at Idaho National Laboratory (INL), the Laboratory for Operation and Testing in the United States (LOTUS) and the Demonstration and Operation of Microreactor Experiments (DOME) test bed. Each test bed involves the modification of existing facilities at INL’s Materials and Fuels Complex (MFC). Retrofitting these facilities to accommodate novel reactors, as well as subsequent but similar NRIC projects, is a non-trivial engineering task and is expected to generate a significant amount of new and revised documentation. Leveraging digital engineering practices, this documentation will be managed in a purpose-built data management tool to facilitate origination, review, and approval while coordinating with the design contractor. The subsequent upload and review of documentation to INL’s existing document control system comprises a long and unnecessarily manual task. An opportunity exists to automate this upload process and save job-hours while continuing to adhere to INL/MFC document management procedures.

99 GENERAL AND MISCELLANEOUS↗

Automated Mobility Districts - A Conceptual Definition: Preprint

An automated mobility district (AMD) provides for the movement of people and goods within a district through the use of fleets of roboticized vehicles as the primary mobility system. The concept of an AMD has precursors deployed in a few places around the world, in which the circulation within a dense urban district, such as a business and residential center or a major activity center like an airport terminal complex is accomplished using a fully automated transport system(s).

ADVANCED PROPULSION SYSTEMS↗

Beyond PID Controllers: PPO with Neuralized PID Policy for Proton Beam Intensity Control in Mu2e

We introduce a novel Proximal Policy Optimization (PPO) algorithm aimed at addressing the challenge of maintaining a uniform proton beam intensity delivery in the Muon to Electron Conversion Experiment (Mu2e) at Fermi National Accelerator Laboratory (Fermilab). Our primary objective is to regulate the spill process to ensure a consistent intensity profile, with the ultimate goal of creating an automated controller capable of providing real-time feedback and calibration of the Spill Regulation System (SRS) parameters on a millisecond timescale. We treat the Mu2e accelerator system as a Markov Decision Process suitable for Reinforcement Learning (RL), utilizing PPO to reduce bias and enhance training stability. A key innovation in our approach is the integration of a neuralized Proportional-Integral-Derivative (PID) controller into the policy function, resulting in a significant improvement in the Spill Duty Factor (SDF) by 13.6%, surpassing the performance of the current PID controller baseline by an additional 1.6%. This paper presents the preliminary offline results based on a differentiable simulator of the Mu2e accelerator. It paves the groundwork for real-time implementations and applications, representing a crucial step towards automated proton beam intensity control for the Mu2e experiment.

43 PARTICLE ACCELERATORS↗

Distributed Maneuver Planning With Connected and Automated Vehicles for Boosting Traffic Efficiency

Connected and automated vehicles (CAVs) have the potential to improve traffic throughput and achieve a more efficient utilization of the available roadway infrastructure. They also have the potential to reduce energy consumption through traffic motion harmonization, even when operating in mixed traffic with other human-driven vehicles. The key to realizing these potentials are coordinated control schemes that can be implemented in a distributed manner with the CAVs. In this paper, we propose a distributed predictive control framework that features a two-dimensional maneuver planner incorporating explicit coordination constraints between connected vehicles operating in mixed traffic at various penetration levels. Here, the framework includes a distributed implementation of a reference speed assigner that estimates local traffic speed from on-board measurements and communicated information. We present an extensive evaluation of the proposed framework in traffic micro-simulations at various CAV penetrations from traffic flow, energy use, and lane utilization points of view. Results are compared to a baseline scenario with no CAVs, as well as, a benchmark one-dimensional planner.

33 ADVANCED PROPULSION SYSTEMS↗

Concrete Thermal Energy Storage Enabling Flexible Operation without Coal Plant Cycling

The work described in this report is responsive to the Office of Fossil Energy program “Energy Storage for Fossil Power Generation.” The pilot plant built as a result of this project demonstrated the feasibility and performance of a concrete thermal energy storage (CTES) system integrated with a supercritical coal power plant. The 10 MWh electrical (>25 MWh thermal) CTES unit, developed by Storworks Power, was designed to enable flexible operation of coal plants without cycling damage. The project's key technical achievements showcase a significant advancement in energy storage technology. A modular CTES system using 42 “Bolderblocs” units was successfully designed and constructed at Alabama Power’s Plant Gaston Unit 5, with each block containing embedded stainless-steel coils in specialized, cost-effective high-temperature concrete. The system interfaced seamlessly with the plant's 3500 psig (241 barg), 1000°F (538°C) supercritical steam, demonstrating operational flexibility. Over 86 full cycles, the CTES exhibited rapid charging and discharging capabilities, effectively mimicking steam turbine feed conditions and handling varying load profiles and storage durations. Performance validation confirmed the system's ability to consistently meet design target steam conditions of 75 bar-a and ~400°C for nominal baseline discharge. The concrete material withstood repeated thermal cycling without degradation, validating earlier lab-scale tests. Integration of balance of plant components, including a condensate management system with storage tank and air-cooled condenser, minimized plant interfaces and water consumption. A robust control scheme ensured safe, automated operation across various scenarios. Key learnings from the project were invaluable: 1. Initial concrete drying and commissioning procedures were refined for future deployments, enhancing efficiency in subsequent installations. 2. System flexibility exceeded expectations, with rapid response to changing conditions. 3. Design improvements were identified including optimized insulation and piping that will enhance overall system efficiency in future deployments 4. Full cycle thermal roundtrip efficiencies exceeded 88%. While the roundtrip electrical efficiency was somewhat limited by known challenges using input steam, such constraints may be mitigated by swapping steam for hot air as thermal input. 5. A summary of key performance parameters for the pilot test and predicted performance of a full scale commercial system with specified improvements determined from the pilot are shown in Section 8. The project faced challenges, including COVID-19 delays and host plant availability constraints. However, these were overcome through adaptive planning and execution. The successful management of these obstacles demonstrated the resilience and adaptability of the project team and the robustness of the CTES technology. This successful pilot demonstrates the potential for CTES to enhance coal plant flexibility, supporting grid stability as renewable penetration increases. The validated design and operational data provide a solid foundation for scaling up to utility-scale implementations, potentially transforming how thermal plants operate in evolving energy landscapes. The system's ability to rapidly respond to changing grid conditions while maintaining high efficiency makes it a promising solution for balancing intermittent renewable energy sources. Furthermore, the project highlighted the potential for even greater efficiencies in future iterations. The use of air as an input medium could potentially eliminate the limitations observed with steam input, opening new possibilities for energy storage applications beyond coal plant integration. In conclusion, this pilot project not only achieved its primary goals but also uncovered additional benefits and potential applications of the CTES technology. It represents a significant step forward in addressing the challenges of grid stability and flexibility in an increasingly renewable-driven energy landscape.

01 COAL, LIGNITE, AND PEAT↗

A Smart Vision-Aided RICH (Robotic Interface Control and Handling) System for VULCAN

High-flux neutron beams and high-efficiency detectors enable rapid neutron diffraction measurements at the Engineering Materials Diffractometer (VULCAN) at the Spallation Neutron Source (SNS), Oak Ridge National Laboratory (ORNL). To optimize beam time utilization, efficient sample exchange, alignment, and automated measurements are essential. Recent advances in artificial intelligence (AI) have expanded the capabilities of robotic systems. Here, we report the development of a Robotic Interactive Control and Handling (RICH) system for sample handling at VULCAN, designed to support high-throughput experiments and reduce overhead time. The RICH system employs a six-axis desktop robot integrated with AI-based computer vision models capable of recognizing and localizing samples in real time from instrument and depth-resolving cameras. Vision algorithms combine these detections to align samples with designated measurement positions or place them within complex sample environments such as furnaces. This integration of machine learning-assisted vision with robotic handling demonstrates the feasibility of autonomous sample detection and preparation, offering a pathway toward fully unmanned neutron scattering experiments.

automation↗

Hardware-in-Loop Modules for Testing Automated Ventilator Controllers

Automated ventilator controllers have the potential to simplify oxygen and carbon dioxide management for trauma. In the pre-hospital or military medicine environment, trauma care can be required for prolonged periods by personnel with limited ventilator management training. As such, there is a need for closed-loop control systems that can adapt ventilator management to a complex, ever-changing medical environment. Here, we present a novel hardware-in-loop test platform for the independent troubleshooting and evaluation of oxygen and carbon dioxide automated ventilator management capabilities. The oxygen management system provides an analogue blood oxygen signal that is responsive to the fraction of inspired oxygen and the peak inspiratory pressure ventilator settings. A tested oxygenation controller successfully reached the target oxygen saturation within 5 min. The carbon dioxide removal system integrates with commercial ventilator technology and mimics carbon dioxide generation, lung compliance, and airway resistance while providing an end-tidal carbon dioxide level that is responsive to changes in the tidal volume and respiratory rate settings. A test mechanical ventilator controller was able to regulate EtCO2 regardless of the starting value within 10 min. This highlights the system’s functionality and provides proof-of-concept demonstrations for how the hardware-in-loop test platforms can be used for evaluating closed-loop controller technologies.

Berard, David (ORCID:0000000322863846)↗

Cooperative Automated Cohort Driving on Connected Infrastructure, Arterial Roadways, and Highways: Final Project Demonstration and System-of-Systems Model Correlation

This project seeks to synergize vehicle automated driving and connectivity data to improve mobility and energy efficiency of groups of mixed vehicles operating in close proximity (vehicle cohort) on various infrastructure. A custom cellular communication network links vehicles operating as a cohort with infrastructure to a centralized system-of-systems digital twin with an AI-based optimal behavior planner. The data contained in this set are from final testing and technology demonstrations to U.S. Department of Energy staff at the American Center for Mobility. The data contain single-lane, single-light scenarios; multi-lane, multi-light arterial scenarios; and limited-access highway scenarios. All test cases were derived from simulations and replicated on the test track. The project employed two and four light-duty vehicles with connectivity and drive automation for the testing. The baseline scenario without connectivity was run under the control of the system-of-systems centralized planner but operating each vehicle with an intelligent driver model controlling the velocity, lane utilization, and vehicle gap. This was to ensure the highest compatibility with the simulation in terms of dynamic behavior. The connected cohort case utilized AI optimization to perform coordinated and cooperative control for energy, as well as safe, comfortable behavior for the cohort. The dataset is appropriately named with unconnected and connected designations, with comparisons sharing the same run index number. The included PowerPoint and PDF files describe the test setup and provide an overview of results from the project. ![image](de-EE0009209_March_2023_Data_Arterial_Scenario_Results.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Challenges and opportunities of machine learning control in building operations

Machine learning control (MLC) is a highly flexible and adaptable method that enables the design, modeling, tuning, and maintenance of building controllers to be more accurate, automated, flexible, and adaptable. The research topic of MLC in building energy systems is developing rapidly, but to our knowledge, no review has been published that specifically and systematically focuses on MLC for building energy systems. Here this paper provides a systematic review of MLC in building energy systems. We review technical papers in two major categories of applications of machine learning in building control: (1) building system and component modeling for control, and (2) control process learning. We identify MLC topics that have been well-studied and those that need further research in the field of building operation control. We also identify the gaps between the present and future application of MLC and predict future trends and opportunities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Human Supervision of Autonomous Vehicle Fleet Operations and Associated Passenger Communications: Preprint

Advances in automated vehicle (AV) technology and expanded operations are rapidly emerging with Automated Mobility District (AMD) deployments in global cities. NLR's AMD research addresses critical elements of human supervision of AV fleet operations and associated passenger communications for vehicles in which no driver or safety attendant is present. Although sufficiently advanced AVs no longer have direct oversight by a driver, fleet management remains staffed with operations personnel at the operations command and control (OCC) facility. This paper examines the functionality of the OCC, drawing comparisons of how automated train control and automated people mover OCCs operate. Within an AMD, the OCC manages various vehicle types, sizes, and operational modes, including on-demand and fixed route service, to facilitate a 'network of networks' for transport within a metropolitan area. The OCC serves as oversight for multiple AV fleets assisting AVs via remote operation of vehicles, communication, and dispatching personnel to resolve problems. The OCC also coordinates system operation, geographically staging vehicles, and managing weather, police, and emergency events. Informed by traffic management center (TMC) strategies using highly integrated software and communications, OCCs facilitate seamless information flows. OCC personnel remotely assist passengers and oversee multi-party operation to ensure safety and security. Although social norms mitigate large-capacity unattended vehicle operations, social interaction in multi-party automated small vehicles has little precedent. This poses a new frontier for society and requires research to effectively understand and manage. Future research will monitor OCC implementations, passenger interfaces, and deployment scaling of initial AMD systems.

33 ADVANCED PROPULSION SYSTEMS↗

Power and Communications Hardware-in-the-Loop CPS Architecture and Platform for DER Monitoring and Control Applications: Preprint

The rapid growth of distributed energy resources (DERs) has prompted increasing interest in the monitoring and control of DERs through hybrid smart grid communications. The deployment of communications and computation has transformed the traditional physical power grid into a smart cyber-physical system (CPS). To fully understand the interdependency between physical grid and cyber netowrks, this study designed a power and communications hardware-in-the-loop (PCommHIL) CPS architecture, which enables the flexible verification of DER monitoring and control with hybrid communications architectures and Internet protocols. Design, development and case study of a PCommHIL testbed for the DER coordination are discussed in detail, and the proposed platform integrates DER devices, Advanced Metering Infrastructures (AMIs), and a suite of hybrid communications networks for distribution automation applications. Case study on DER situational awareness and Volt-Var control validates the efficacy of this proposed PCommHIL platform with hybrid communications designs. Results show that the HAN communication technologies play a critical role in hybrid designs and it is the bottleneck for DER applications. High performance communication technologies are highly recommended to be applied in the HAN for enhanced monitoring and real-time control of DERs.

AMIs↗

Emulation and detection of physical faults and cyber-attacks on building energy systems through real-time hardware-in-the-loop experiments

The increasing use of remote or mobile access, integrated wearable technologies, data exchange, and cloud-based data analytics in modern smart buildings is steering the building industry towards open communication technologies. The increased connectivity and accessibility could lead to more cyber-attacks in smart buildings. On the other hand, physical faults (e.g., HVAC -heating, ventilation, and air-conditioning faults) may have similar adverse impacts as those from the cyber-attacks on building energy systems, such as occupant discomfort, energy wastage, and equipment downtime. However, current physical behavior-based anomaly detection methods fail to differentiate between cyber-attacks and physical faults in building energy systems. Moreover, the challenge in collecting real-world threat data with ground truth has led researchers to rely on numerical models with user-defined assumptions, which may not accurately reflect real-world conditions due to the lack of in-situ experimental datasets. To address these challenges and gaps, this paper presents a flexible hardware-in-the-loop (HIL) testbed for generating cyber-attack and physical fault datasets and demonstrating threat detection algorithms in a real building automation system (BAS) environment. This testbed combines hardware (i.e., real BAS with local HVAC controllers and a physical network) with software (i.e., high-fidelity models to represent behaviors of building envelope and HVAC energy systems), enabling emulations of realistic threats. Five HIL experiments, including one baseline without any threats, two with physical faults, and two with cyber-attacks, were conducted to generate datasets containing detailed network traffic and system states. A joint classification framework, incorporating a network analyzer and a physical HVAC fault detector, was proposed to automatically detect cyber-physical abnormalities on BAS at both the network and the physical HVAC levels. The network analyzer comprises a conditional random fields (CRF) based command validator and a statistics-based detection strategy. The fault detector employs a weather and schedule-based pattern matching and feature-based principal component analysis (WPM-FPCA) method. Evaluation of the classification using four metrics from the multi-class confusion matrix revealed an average accuracy of 90.2%, recall of 89.7%, precision of 88.5% and F1-score of 89.2%. Finally, these results demonstrate that the proposed joint classification framework can effectively differentiate between specific types of cyber-attacks (e.g., device reinitialization attack, network Denial-of-Service attack) and physical faults (e.g., air handling unit operational fault, cooling coil valve stuck) in real time for improved building energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Leading in Los Angeles: Demonstrating scalable emerging energy efficient technologies for integrated façade, lighting, and plug loads INTER System FLEXLAB Test Report

This report is a part of the California Energy Commission (Energy Commission) EPIC study Leading in Los Angeles: Demonstrating scalable emerging energy efficient technologies for integrated façade, lighting, and HVAC. The set of technologies are called the Integrated Technologies for Energy-efficient Retrofits (INTER) and are comprised of automated shading products and LED lighting systems with networked luminaire-level sensors and controls. In addition, the project will include control modifications and assessments of HVAC savings. This document includes the test plan and test results for the FLEXLAB® testing of the shading and lighting INTER system and related energy use impact. The test plan describes the test objectives and features, test cases, schedule, and measurements. The test results cover system performance in the lab; including lighting and HVAC energy, visual comfort, and thermal comfort.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

ARCADE (Advanced Reactor Cyber Analysis and Development Environment)

SAND2025-11780O ARCADE (Advanced Reactor Cyber Analysis and Development Environment) software performs cybersecurity experiments on Defensive Cyber Security Architectures (DCSA) for Distributed Control Systems (DCSs). The application is integrated into a cohesive environment that performs cyber risk analyses and reduces costs. ARCADE can investigate the entire cyber-attack surface of a DCS from the physics of control, down to the firmware of individual components with automated efficiency. ARCADE has five major functional components: the Data Broker system, the virtualization environment, the cyber-attack simulator, the cyber-physical analysis system, and the physics simulator. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Valme, Romuald↗