SEARCH · Search NASA
Results for “Autonomous Operation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Dragon: Deep Reinforcement Learning for Autonomous Grid Operation and Attack Detection
Explore the source record for details and available documents.
Draft Methodology for Cybersecurity Analysis for Adoption of Wireless Technology in Nuclear Power Plants
The report is delivered as DOE-NE Cybersecurity Program Milestone M2CT-22IN1104014-Industry cybersecurity guidance adoption status. The milestone is specifically to document the process and the status of the efforts towards developing guidance in support of industry’s adoption of wireless communication technologies. To transform the operation of nuclear power plants, including domestic light-water reactors, advanced reactors, microreactors, and fission battery, for grid and non-grid applications, secure and resilient wireless capabilities are required. In addition, to realize new operational concepts such as autonomous operation and remote monitoring, advanced sensor, and instrumentation, wireless technology is essential. However, industry implementation is low, and there is no technical basis for how to understand and address potential risks for wireless communications for critical plant functions. A methodology with a technical basis for implementing secure wireless communication is crucial. This wireless adoption methodology is intended to assist a licensee in identifying an appropriate technological approach for securing wireless communications in nuclear power plant. However, this methodology does not provide guidance for addressing wireless design criteria or for addressing all the cybersecurity commitments in licensees’ cybersecurity plans (CSPs) including addressing security impact analysis that a licensee must perform before an update to a Critical Digital Asset (CDA). This methodology guides a licensee through a process of evaluating a proposed wireless implementation and drafting a plant change notification for an example use case. The example is a generic/nonproprietary version of the first test case of the methodology, which, if successfully implemented, is part of the consideration for protecting other functions’ use of wireless in a cybersecure manner.
Machine Learning for Autonomous Drones Operations
Presentation to the Machine Learning & Artificial Intelligence Symposium on October 16, 2020
Human Factors Considerations for Anticipated Uses of Autonomy in Advanced Reactor Technologies
The objective of this report is examine anticipated advanced reactor designs that incorporate high levels of autonomy in operation of advanced reactor systems or facilities, and to begin identifying the human factors engineering (HFE) considerations relevant to those designs. The insights gained will help identify areas where U.S. Nuclear Regulatory Commission (NRC) may need to develop or update review guidance to adequately address HFE considerations essential for safe operation. The adequacy of existing guidance, along with recommendations for updates or new guidance, may be addressed in future reports. We use the term “landscape analysis” to describe the review, analysis, and characterization of publicly available information on the anticipated future state of the industry regarding particular technologies or operational concepts. This landscape analysis considers the potential range of advanced reactor automation concepts that may be used for monitoring and controlling nuclear systems and facilities, including the potential for highly automated, near autonomous, or fully autonomous operation of advanced nuclear reactors.
Operation and Security Considerations for Heat Pipe Cooled Microreactors
Microreactors and small modular reactors (SMRs) are anticipated to be key elements in the United States' carbon-free energy portfolio, serving as reliable power sources for remote communities, disaster relief zones, extraterrestrial deployments, and backup power needs. Microreactors employ technologies that are substantially more advanced and recent compared to conventional reactors. Furthermore, they are of a drastically smaller scale and are designed to be operated in a diverse set of locations, offering operational flexibility and mobility. In addition, the autonomous or semi-autonomous operation of microreactors with minimal or no on-site staff is anticipated. These factors give rise to specific challenges with regards to their safety and security. The present work investigates considerations related to heat pipe operation, reactor transport, and cyber/cyberphysical security to ensure the indirect and direct consequences of nefarious actors’ actions are understood and can be mitigated by design or through physical security measures. In addition, future directions are proposed for consideration by both HPMR designers and for regulators.
Dynamic Microgrids in Resilient Distribution Systems With Reconfigurable Cyber-Physical Networks
Modern distribution systems energized by inverter-interfaced distributed generators (DGs) operate as coupled cyber-physical networks (C/P-networks), where the controllable components in the physical network (P-network) are coordinated through the cyber network (C-network). The concept of dynamic microgrids (MGs) operation has been adopted to enable distribution system autonomous operation with varying electric boundaries. To further enhance system operation resiliency and flexibility, dynamic MGs operation with reconfigurable C/P-networks is discussed in this work. An evaluation framework is proposed to assess the operational feasibility of distribution feeders with multiple inverter-based dynamic MGs and come out with possible restoration solutions in the context of cross-layer C/P-network reconfiguration. Furthermore, distributed controllers are developed for components with different operating characteristics to realize seamless system topology variations and provide coordinated secondary regulation in various operation modes. Furthermore, the proposed evaluation framework along with the developed distributed controller has been validated using a Hardware-in-the-Loop (HIL) real-time CPS testbed.
Characterization of Embedded Sensors in Stainless Steel Test Articles and Design/Planning for MAGNET Testing
The nuclear industry is pursuing microreactors that can be factory assembled and deployed to remote regions for reliable power generation. One class of microreactors uses a monolithic metal core block coupled to heat pipes for heat rejection, which results in significant thermal stresses in the monolithic structures. This work describes the initial characterization and test plan for evaluating stainless steel test articles fabricated with embedded sensors for measuring heat pipe performance limits, as well as spatially distributed temperatures and strains during electrically heated thermal testing. The electrically heated testing will be performed in the non-nuclear Microreactor Agile Non-Nuclear Testbed and Single Primary Heat Extraction and Removal Emulator facilities located at Idaho National Laboratory. The goals of these tests are to (1) accurately monitor temperature and strain distributions that result from differential thermal expansion in the test articles and (2) quantify heat rejection limits of heat pipes as a function of operating temperature and working fluid during steady-state and transient operations. More generally, the ability to monitor component and system health during microreactor operation is attractive for providing a high sensor density to inform a limited number of microreactor operators to ultimately reduce operation and maintenance costs and move toward semi-autonomous operation. This report discusses the characterization of embedded thermocouples and fiber optic sensors in relevant test articles, including cylindrical pipes and hexagonal monolithic test articles for heat pipe-based reactors. The sensors were embedded by placing them in machined channels and then building up additional material by using ultrasonic additive manufacturing (UAM). UAM is a solid-state welding process that uses downward pressure and a lateral scrubbing motion to bond thin metal foils to a base material layer by layer. The ultrasonic welding process relies on the plastic deformation of the metal—as opposed to typical melting and solidification—to break oxide scales and bond the metal layers. The characterization of these embedded sensors included evaluating fiber optic signal attenuation, observing residual strain in the fibers, investigating microstructural and mechanical aspects, and demonstrating the sensors under various thermal loads and acoustic vibrations. Post-embedding characterization showed a fine grain structure (<1 μm) near the interfaces of the bonded foils as a result of severe deformation from the welding process. A large increase in hardness was observed at the foil interfaces and the fiber/matrix interface compared with the bulk matrix. Even when compared with the SS304 interfaces, the higher hardness observed around the embedded fiber suggests a higher degree of deformation due to the soft metal coating around the silica fiber core. The distributed fiber-optic temperature sensors and embedded thermocouples reliably measured temperature distributions during steady-state and transient thermal testing. The embedded fiber-optic sensors reliably measured strain during both transient and steady-state testing and properly identified resonant frequencies during acoustic testing.
Artificial Intelligence/Machine Learning Technologies for Advanced Reactors (Workshop Summary Report)
A workshop on artificial intelligence and machine learning (AI/ML) for advanced reactors (AR) was held October 5-6, 2021. The workshop was to be attended in-person at ANL but COVID restrictions forced the workshop to go virtual. The objectives of the workshop were to identify the most promising AI/ML opportunities for improving advanced reactor design, optimizing plant performance, and enhancing economic competitiveness and to develop an understanding of the scientific, engineering and licensing challenges facing their application. The workshop planning committee included GAIN, EPRI and NEI and members of three national laboratories (ANL, INL, and ORNL). The workshop was attended by more than 200 individuals representing academic and scientific institutions and the nuclear power industry. The definition put forth for an AI/ML system was one that perceives its environment and takes actions that maximize its chance of achieving its goals. In this report AI/ML refers to next generation algorithms that include deep learning, statistical analysis and data analytics and associated scientific computing and their potential application to the design, licensing, operation and maintenance of ARs. These methods typically incorporate models built from process data and may also include data generated by simulations that represent the behavior of a system. The workshop was organized in response to the growing interest in application of AI/ML for improving the economic competitiveness of nuclear energy. Increasingly more resources are being allocated to investigating the benefits of AI/ML methods. The DOE created the Artificial Intelligence & Technology Office to promote their development. And within the Office of Nuclear Energy, resources have been allocated to explore and understand the potential benefits of AI/ML. Additionally, the national laboratories are strategically positioned with DOE computing facilities such as Summit, Perlmutter, Aurora and Frontier that support large-scale simulations, hybrid HPC models with AI surrogates, and the exploration of new types of generative models emerging from multi-model data streams and sources. The workshop was organized with members of the AR community to understand the effort and to identify the level of interest and progress in this emerging technology. The workshop discussions focused on identifying opportunities for AI/ML across diverse areas of the nuclear industry and identifying current scientific and engineering challenges for advanced reactors that might be addressed through transformational uses of AI/ML. Discussion panels focused on four high-interest technical domains for advanced reactors: design, maintenance and operations, energy storage, and materials. The results of those discussions are summarized in this report. This includes opportunities that were identified for exploiting AI techniques and methods to improve the efficacy and efficiency of reactor analysis and to improve the operation and optimization of advanced reactors. Advanced reactor developers expressed an interest in learning more about AI/ML methods and their application. This included understanding whether ML methods can provide an advantage over existing nonlinear data regression methods for collapsing high-fidelity simulation results into faster running models. A consensus emerged that AR advances planned for the next decade will benefit from the use of AI/ML tools. The need exists to understand and model complex systems across length scales and modalities. AI/ML is a tool for discovery that can yield a set of engineering principles for use by nuclear engineers, licensing bodies, and operators to solve problems in plant design, safety analyses, autonomous operation, and predictive maintenance. While AI/ML represents a new set of tools, an awareness by the nuclear community of the full potential is still in the early stages so there is a need to increase awareness. It appears that the wide-spread adoption of AI/ML tools for ARs would be facilitated by future educational workshops that describe foundational methods and capabilities and describe successful applications.
A Simple and Accurate Energy-Detector-Based Transient Waveform Detection for Smart Grids: Real-World Field Data Performance
Integration of distributed energy sources, advanced meshed operation, sensors, automation, and communication networks all contribute to autonomous operations and decision-making processes utilized in the grid. Therefore, smart grid systems require sophisticated supporting structures. Furthermore, rapid detection and identification of disturbances and transients are a necessary first step towards situationally aware smart grid systems. This way, high-level monitoring is achieved and the entire system kept operational. Even though smart grid systems are unavoidably sophisticated, low-complexity algorithms need to be developed for real-time sensing on the edge and online applications to alert stakeholders in the event of an anomaly. In this study, the simplest form of anomaly detection mechanism in the absence of any a priori knowledge, namely, the energy detector (also known as radiometer in the field of wireless communications and signal processing), is investigated as a triggering mechanism, which may include automated alerts and notifications for grid anomalies. In contrast to the mainstream literature, it does not rely on transform domain tools; therefore, utmost design and implementation simplicity are attained. Performance results of the proposed energy detector algorithm are validated by real power system data obtained from the DOE/EPRI National Database of power system events and the Grid Signature Library.
Techno-economic assessment of distributed wellhead RO water treatment for nitrate removal and salinity reduction: A field study in small disadvantaged communities
Techno-economic analysis of distributed wellhead water treatment and desalination (DWTD) systems was carried out based on a three-year field study in three small, disadvantaged communities (DACs) to evaluate the reliability and affordability of upgrading their impaired well water. The local water supplies of the three study DACs, located in Salinas Valley, California, were contaminated with nitrate at levels (~ 12–87 mg/L NO$^{-}_{3}$ - N) ) above the California maximum contaminant level (MCL) of 10 mg/L NO$^{-}_{3}$ - N , and had elevated water salinity (~600–1,600 mg/L total dissolved solids(TDS)) above its secondary MCL (SMCL) of 500 mg/L TDS. Well water nitrate removal and salinity reduction were accomplished via reverse osmosis (RO) based DWTD systems that operated autonomously, supported by remote monitoring and supervisory cyberinfrastructure. Reliable DWTD operation provided treated water quality, with respect to nitrate and salinity, in the range of 0.5–6.3 mg/L NO$^{-}_{3}$ - N and 57–161 mg/L TDS, respectively, which were well below the respective MCL and SMCL. The levelized cost of water treatment was in the range of ~$$2/m 3 - $$2.9/m 3 which aligns with typical residential water costs in California and in the study region, and monthly residential water costs (39 dollars-74 dollars/residential unit/month) were also within the range in California. The study showcased the DWTD approach as a viable and potentially scalable solution for upgrading impaired local potable water supply of communities lacking centralized water delivery infrastructure. However, streamlined permitting processes and standardized regulatory frameworks are critical to promoting wider adoption and maximizing the socio-economic benefits of the DWT approach. Moreover, DACs are likely to require government subsidies in order to cover the CapEx of DWTD systems in addition to upgrade of site infrastructure.
ToPolyAgent: AI agents for coarse-grained bead-spring topological polymer simulations
We introduce ToPolyAgent, a multi-agent AI framework for performing coarse-grained molecular dynamics (MD) simulations of topological polymers through natural language instructions. By integrating large language models (LLMs) with domain-specific computational tools, ToPolyAgent supports both interactive and autonomous simulation workflows across diverse polymer architectures, including linear, ring, brush, and star polymers, as well as dendrimers. The system consists of four LLM-powered agents: a Config Agent for generating initial polymer–solvent configurations, a Simulation Agent for executing LAMMPS-based MD simulations and conformational analyses, a Report Agent for compiling markdown reports, and a Workflow Agent for streamlined autonomous operations. Interactive mode incorporates user feedback loops for iterative refinements, while autonomous mode enables end-to-end task execution from detailed prompts. We demonstrate ToPolyAgent's versatility through case studies involving diverse polymer architectures under varying solvent conditions, thermostats, and simulation lengths. Furthermore, we highlight its potential as a research assistant by directing it to investigate the effect of interaction parameters on the linear polymer conformation, and the influence of grafting density on the persistence length of the brush polymer. By coupling natural language interfaces with rigorous simulation tools, ToPolyAgent lowers barriers to complex computational workflows and advances AI-driven materials discovery in polymer science. It lays the foundation for autonomous and extensible multi-agent scientific research ecosystems.
Enabling a Physical Twin for Control Methods Evaluation
Advanced nuclear reactors play an important role in the energy future of the United States and the rest of the world. They are designed and operated based on a different model than that of the current operating fleet, thus enabling deployment in remote locations and allowing for safe semi-autonomous or autonomous operations. Such characteristics require the development of a new reactor control paradigm. A significant factor in the development of control technologies and methods is integration of the various technologies and methods with each other and with hardware (both reactor system hardware and control hardware). A recent workshop on control of advanced reactors identified the lack of a flexible, expandable software/hardware infrastructure to enable such integration as a key gap. A previous phase of the current effort involved developing and demonstrating the Control and Optimization Modular Modeling Application for Nuclear Deployment (COMMAND) platform, which is capable of integrating autonomous-control-enabling technologies and methods, without the constraints imposed by existing software solutions. This platform will enable advanced reactor developers to deploy and test any developed technologies and methods by employing a common framework, and to couple them with their own models and hardware. The present phase of this effort entails using the Microreactor Automated Control System (MACS) platform, which was developed by the U.S. Department of Energy (DOE) Microreactor Program, to serve as a control method testbed. MACS can be used by advanced reactor developers to integrate their control related research activities with any reactor system. For the present effort, MACS was customized to mirror Idaho National Laboratory (INL)’s Microreactor Applications Research Validation and Evaluation (MARVEL) microreactor, and COMMAND was leveraged to enable MACS to emulate the physics of MARVEL, thus positioning MACS as a physical twin of MARVEL.
Integrating Control Methods and Digital Twins for Advanced Nuclear Reactors
Advanced nuclear reactors offer new capabilities such as the ability to adapt to variable energy demand, operate autonomously with remote supervision, be deployable in rural locations, be compact in size, afford lower power ratings, and rely on novel techniques for increased operational safety. However, realizing these capabilities requires intelligent control systems that can track changing power demands and make autonomous decisions based on these demands. The unique aspects of advanced reactors (e.g., strict regulatory requirements, harsh operating environments, high consequences, highly coupled dynamics, evolving knowledge, and limited operating histories) directly impact the design and deployment of control systems for these reactors. The present work identifies and evaluates these aspects so as to develop a set of control system requirements to guide future research and development. To meet these requirements, a layered control system approach is proposed that integrates digital twins with different control paradigms. This work aims to demonstrate how different methods interface with enabling solutions, and to identify any gaps that need to be researched.
Automating Component-Level Stress Measurements for Inverter Reliability Estimation
In the near future, grid operators are expected to regularly use advanced distributed energy resource (DER) functions, defined in IEEE 1547-2018, to perform a range of grid-support operations. Many of these functions adjust the active and reactive power of the device through commanded or autonomous operating modes which induce new stresses on the power electronics components. In this work, an experimental and theoretical framework is introduced which couples laboratory-measured component stress with advanced inverter functionality and derives a reduction in useful lifetime based on an applicable reliability model. Multiple DER devices were instrumented to calculate the additional component stress under multiple reactive power setpoints to estimate associated DER lifetime reductions. A clear increase in switch loss was demonstrated as a function of irradiance level and power factor. This is replicated in the system-level efficiency measurements, although magnitudes were different—suggesting other loss mechanisms exist. Using an approximate Arrhenius thermal model for the switches, the experimental data indicate a lifetime reduction of 1.5% when operating the inverter at 0.85 PF—compared to unity PF—assuming the DER failure mechanism thermally driven within the H-bridge. If other failure mechanisms are discovered for a set of power electronics devices, this testing and calculation framework can easily be tailored to those failure mechanisms.
A comparative study on deep learning models for condition monitoring of advanced reactor piping systems
Advanced nuclear reactors offer innovative applications due to their portability, reliability, resiliency, and high capacity factors. To operate them on a wider scale, reducing maintenance life-cycle costs while ensuring their integrity is essential. Autonomous operations in advanced nuclear reactors using augmented Digital Twin (DT) technology can serve as a cost-effective solution by increasing awareness about the system’s health. A key component of nuclear DT frameworks is the condition monitoring of safety systems, such as piping-equipment systems, which involves acquiring and monitoring the plant’s sensor data. Here, this research proposes a condition monitoring methodology utilizing deep learning algorithms, such as multilayer perceptions (MLP) and convolutional neural networks (CNNs), to detect degradation and its severity in nuclear piping-equipment systems. Sensor signals are processed to obtain the power spectral density and the Short-Time Fourier transform, and feature extraction methodologies are proposed to develop degradation-sensitive data repositories. The performance of MLP, one-dimensional (1D) CNN, and 2D CNN within the proposed condition monitoring framework is compared using a finite element model of a 3D piping system subjected to seismic loads as the application case study. Various approaches, such as dropout, k-Fold validation, regularization, and early stopping of training the network, are investigated to avoid overfitting the models to the input sensor data. The predictive capability and computational capacity of the deep learning algorithms are also compared to detect degradation in the Z-pipe system of the Experimental Breeder Reactor II (EBRII). The Z-pipe system is subjected to harmonic excitations that represent normal operating loads, such as pump-induced vibrations. The findings of the study indicate that the proposed artificial intelligence (AI)-driven condition monitoring framework demonstrates superior prediction accuracies with a 2D CNN, whereas the MLP exhibits higher computational efficiency.
SPARTAN and IMPROVE Comparison Experiment (SPICE) Interim Campaign Report
SPICE (the SPARTAN and IMPROVE Comparison Experiment) aims to obtain and quantify comparisons between aerosol PM 2.5 mass concentration measurements from the University of Oklahoma (OU) Surface Particulate Matter Network (SPARTAN) station and the U.S. Environmental Protection Agency (EPA) Interagency Monitoring of Protected Visual Environments (IMPROVE) station hosted by the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) User Facility at ARM’s Southern Great Plains (SGP) observatory in Oklahoma. Aerosols—both natural and anthropogenic—affect human populations in multiple ways. Much of ARM’s research focuses on how aerosols influence weather and climate through their optical and radiative effects, as well as their impacts on clouds and precipitation. However, aerosols also pose direct risks to humans and other organisms through inhalation, with the severity of health impacts depending on particle size, chemical composition, and duration of exposure. The IMPROVE network was established by the U.S. EPA to monitor air quality, including visible clarity as well as total and chemically speciated aerosol mass concentrations. The ARM SGP site hosts the IMPROVE SOGP station. Separately, the SPARTAN network operates a globally distributed set of stations similar to IMPROVE but with an emphasis on remote deployment and semi-autonomous operation for use beyond the borders of the United States (IMPROVE only operates within the U.S.). The University of Oklahoma operates a SPARTAN station. To establish confidence in the OU SPARTAN instrumentation and measurement protocol relative to the EPA-certified IMPROVE station, the OU SPARTAN station is currently deployed at SGP in close proximity to the IMPROVE SOGP station. The SPICE campaign was envisioned as a contiguous calendar-year effort for 2025 to capture seasonal variation in mass loading as well as composition. However, independent of the SPICE campaign, the SPARTAN network adopted a new filter construction part-way through the year, interrupting our contiguous data set. Thus, to obtain a contiguous data set with a uniform consistent configuration, SPICE desires an extension through 2026.
Employing MACS/ViBRANT as a Surrogate MARVEL Reactor for Startup Reactivity Tuning and Supervisory Control Processes
Advanced nuclear reactors are a key part of the future of nuclear energy both in the United States and globally. They offer unique benefits for various energy-demanding applications, including use in remote locations, compact size, modular manufacturing, remote monitoring, low and/or variable power rating operation, and reliance on novel technologies to enhance operational safety. To achieve economic feasibility, advanced reactors must significantly reduce their workforces in comparison with the current fleet. Achieving this reduction will occur through reducing staff workloads using technology to achieve autonomous or semi-autonomous operations, demonstrated by comprehensive testing and validation activities. These operations will require both software and hardware platforms during the design and testing phases. While simulations are useful during the design phase, their performance can significantly deviate during actual deployment on hardware. This report presents the outcomes of a collaborative technical initiative between the U.S. Department of Energy (DOE) Microreactor Program (MRP) and Advanced Sensors and Instrumentation (ASI) Program. The collaboration utilized the Microreactor Automated Control System (MACS) hardware platform to bridge the gap between theoretical reactor design and actual startup and control operations. Two key use cases were investigated: facilitating the startup testing period and demonstrating supervisory control. The first use case details the key Microreactor Applications Research Validation and Evaluation (MARVEL) reactor startup physics testing activities conducted using the MACS platform. These activities included drum worth measurements, shutdown margin assessment, temperature feedback analysis, and scram time evaluation, as well as unique testing that would apply to the MARVEL reactor to demonstrate the testing methodologies in a low-risk environment. The MACS platform, serving as a surrogate representation of the MARVEL reactor, proved instrumental in performing these tests. The exercise revealed aspects that led to optimized processes, refined hardware design, and enhanced base software capabilities. By maturing methods and technologies in this manner, the initiative promises to reduce wasted time in the actual on-site reactor deployment effort, thereby saving significant time and resources. The second use case focuses on the development and implementation of supervisory control methods aimed at managing core tilt, which can result from asymmetrical operations or manufacturing imperfections in fuel rods or reactivity control devices. A key objective was to assess and compare the use of artificial intelligence (AI) for supervisory control. The effort aimed to define the role of supervisory control to enhance performance without risking control instability. This effort explored three distinct approaches: rules-based (RB) methods, optimization techniques, and reinforcement learning (RL) algorithms. Each approach was evaluated for its ease of implementation, its usability, and its effectiveness in responding to asymmetries in neutron flux. Comparative analysis of these approaches provided valuable insights into their applicability and effectiveness, offering a robust framework for advanced reactor operations. Together, these two use cases highlight the potential of hardware test beds to help streamline the design, operation, and control of advanced nuclear reactors. This collaborative effort underscores the importance of continued innovation and experimentation in achieving the next generation of safe, reliable, and economically viable nuclear energy solutions.