Machine Learning and Autonomous Decision Making for National Security: Designing Decision Rules using Multiobjective Optimization
Explore the source record for details and available documents.
Smith, Mark A.↗
SEARCH · Search NASA
Results for “autonomous decision making”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Problem-fluent models for complex decision-making in autonomous materials research
Not Available
Baek, Soojung↗
Improving Self-Driving Labs: Quantifying System-Level Experiment Repeatability and Broadening Instrument-Level Compatibility
Modular Autonomous Research System (MARS) is a self-driving laboratory (SDL) which performs wet-lab science with peptide-lanthanide combinations in an automated and, ultimately, an autonomous manner to aid in soil analysis for domestic lithium mining. Autonomous experimentation involves automated experimentation, experiment planning, and active learning. MARS consists of a 6-axis robotic arm (UR5e) on a linear rail, pipette robots (Opentrons 2), and microplate readers. These components transport, operate on, and collect data with chemical solutions in standard labware. For effective autonomy, MARS must perform system-level labware operations repeatably, plan experiments autonomously, and be portable between research-domains. Repeatability is evaluated by labware placement precision, such that future operations can properly locate labware, as well as the elapsed time, so that low variance mean estimates of experiment duration can inform high-level researcher decision making. Autonomous experiment planning is the next step to decouple experimentation from human management; however, there is a conflict between the ideal system-level experiment goals and the constraints imposed by instruments’ limitations. Sub-domain portability is a long-term goal to extend MARS’ research beyond the chemistry of peptide-lanthanide binding to other sub-domains without having to invest significant overhead to system retrofitting. To address these goals, we manually trained the robotic arm labware placement and modelled statistical failurerate and uncertainty Additionally, we benchmarked the duration and variance of each experiment sub-operation as a heuristic for research decision making. Next, we use a parameterized geometric program (PGP) approach to design experiments that optimize system-level objectives and satisfy instrument-level constraints. Lastly, we proposed a Python framework to maximize MARS’ extensibility to other scientific sub-domains through a JSON-based experiment specification.
36 MATERIALS SCIENCE↗
Exploring Benchmarks for Self-Driving Labs using Color Matching
Self Driving Labs (SDLs) that combine automation of experimental procedures with autonomous decision making are gaining popularity as a means of increasing the throughput of scientific workflows. The task of identifying quantities of supplied colored pigments that match a target color, the color matching problem, provides a simple and flexible SDL test case, as it requires experiment proposal, sample creation, and sample analysis, three common components in autonomous discovery applications. We present a robotic solution to the color matching problem that allows for fully autonomous execution of a color matching protocol. Our solution leverages the WEI science factory platform to enable portability across different robotic hardware, the use of alternative optimization methods for continuous refinement, and automated publication of results for experiment tracking and post-hoc analysis.
Artificial intelligence↗
Integration of Control Methods and Digital Twins for Advanced Nuclear Reactors
Advanced nuclear reactors offer a new set of features to energy generation, due to their ability to adapt to variable energy demand, operate autonomously, be deployed in rural locations and monitored remotely, afford compact size and lower power ratings, and rely on novel technologies to achieve safer operations. Thus, a requirement for the success of these reactors is the use of intelligent forms of control to track changing power demands, make autonomous decisions, and reduce the need for human involvement. Regulatory requirements pertaining to control of nuclear reactors could be met via historical means of control; however, these are not expected to enable the level of highly autonomous operations desired in advanced nuclear reactors. Historical control methods rely on both logical and high-performance (HP) control. These two types of control are usually used separately, with a human element being introduced whenever decisions are cascaded from one science to another. AI/ML control, on the other hand, can replace the human element in the current U.S. fleet of nuclear power plants (NPPs) by acting as a supervisory optimizer that understands the plant internal/external variables in order to make control decisions, and can easily handle non-linear and multi-input/multi out (MIMO) decisions—another requirement for advanced nuclear reactors that could be difficult to handle via logical and HP control. Because of the harsh operating environments produced in advanced reactors, resulting in the frequent failure of sensors and other types of equipment, and considering the lack of operating history for advanced nuclear reactors, control of advanced nuclear reactors would necessitate relying on a model that can track and adapt to the actual process (i.e., a digital twin). This digital twin can make approximations when knowledge and data are unavailable and would evolve as more knowledge is gained. The reactor control must also be risk-informed to account for the high-consequence nature of advanced reactors. This report introduces a high-level (i.e., not method- or process-specific) integration of the three different control and digital twinning methods able to meet the requirements for advanced nuclear reactors. These methods could be applied during both the operational and design stages of these reactors. The aim is to demonstrate how each method interfaces with and highlights enabling solutions necessitated by the unique features of advanced nuclear reactors.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Blockchain for Fault-Tolerant Grid Operations Version 2.0
This report explores the potential of distributed ledger technology (DLT) as a transformative tool to enhance fault-tolerant operations in electrical distribution systems. Leveraging DLT's core attributes, including an immutable decentralized ledger, distributed consensus mechanisms, and state replication capabilities, this study focuses on three critical use cases. A central aspect of this research centers on the utilization of a consensus-driven ledger, providing actors within the system, such as distributed resources, with access to a reliable data repository. This empowers these actors to collaborate effectively and make informed decisions, all securely recorded on the blockchain. The first use case concentrates on data configuration, utilizing mathematical criteria---particularly, the chi-squared test for gross error detection---to identify trustworthy sensors for advanced decision-making. Building upon this foundation of trust, the second use case, topology identification, accurately determines circuit breaker states, unveiling the distribution network's topology. Ultimately, the third use case leverages this trust to execute switching actions, reconfiguring feeders and restoring power to disconnected customers after fault events. The concept of trust serves as a cornerstone in this approach, marking a departure from traditional fault location, isolation, and service restoration (FLISR) methods. Additionally, the blockchain-based architecture introduces decentralization, empowering disconnected areas to make autonomous decisions, even when communication with a central control center is disrupted. The primary contributions of this report are twofold: (1) a novel approach for evaluating distribution system voltage areas while preserving data ownership and (2) the implementation of interactions between distribution network areas using the actor model. Unlike the previous sequential approach for evaluating the area connection voltages, which required a radial network topology, this study's area model reduction enables a more versatile approach. The area model reduction addresses issues of prolonged data waiting times and multiple points of failure within the previous approach. Notably, the presented evaluation for the reduced network model area connection reveals a significant increase in the differences in voltage magnitudes. Simulation and evaluation of area agents across four distinct cases elucidate the area-level interaction behavior during a fault event. Simulations demonstrate that the proposed distributed FLISR (DFLISR) approach can successfully restore service to an affected area. Varying message delays and message loss probabilities in each simulation case underscore their impacts on restoration times, ranging from 3 min and 32 s to 6 min and 19 s. In contrast, power is not restored in an area in one of our simulation cases.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Communication breakdown: Energy efficiency recommendations to address the disconnect between building operators and occupants
As technology advances, progressive building performance goals are met with ease and occupant behavior plays an increasingly significant role in preventing building operators from achieving those goals. However, removing occupants from participating in building control and operation is counterintuitive to the purpose of building operation. Occupant-centric control (OCC) has been suggested as a means of incorporating the occupant while simultaneously reducing the negative impact their behavior can have on building performance. As a result, operators are now tasked with incorporating OCC into their daily operation. The relationship between building occupants and operators is a critical component to OCC, and balancing occupant comfort and building performance. In this paper, we present findings from an international qualitative study of building operators with a focus on the operator and occupant relationship. This paper identifies the role operators play in OCC, how these relationships develop, and how these relationships impact building operation through two key research questions: What factors influence the quality of relationships between occupants and operators? How can the relationships between operators and occupants be improved? Subsequently, these questions revealed this relationship becomes strained when building performance is prioritized over comfort, occupants are ignored or uneducated, and feedback is negative or sparse. In short: there is a disconnection between operators and occupants. Here we propose several solutions including modifying job requirements to prioritize occupant comfort, educating occupants to make autonomous decisions that are not detrimental to operation, and creating effective communication channels for instances where operator intervention is required.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Behavior Engine - Umbra Package
The Umbra Behavior Engine allows simulated Umbra characters to autonomously make decisions to accomplish goals set for them in a specific scenario. These goals are based on commands given to characters and reactions to stimuli in the simulated environment of the characters. When the character responds to the command issued to him, instead of running a single behavior, he runs a suite of behaviors where only one is active at a time. Other behaviors in the suite include reaction behaviors that can be triggered due to detected objects and activity in the characters' environment. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-3175 O
Hart, BrianE.↗
Integrating Control Methods and Digital Twins for Advanced Nuclear Reactors
Advanced nuclear reactors offer new capabilities such as the ability to adapt to variable energy demand, operate autonomously with remote supervision, be deployable in rural locations, be compact in size, afford lower power ratings, and rely on novel techniques for increased operational safety. However, realizing these capabilities requires intelligent control systems that can track changing power demands and make autonomous decisions based on these demands. The unique aspects of advanced reactors (e.g., strict regulatory requirements, harsh operating environments, high consequences, highly coupled dynamics, evolving knowledge, and limited operating histories) directly impact the design and deployment of control systems for these reactors. The present work identifies and evaluates these aspects so as to develop a set of control system requirements to guide future research and development. To meet these requirements, a layered control system approach is proposed that integrates digital twins with different control paradigms. This work aims to demonstrate how different methods interface with enabling solutions, and to identify any gaps that need to be researched.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Self-driving thin film laboratory: autonomous epitaxial atomic-layer synthesis via real-time computer vision analysis of electron diffraction
Emerging materials science platforms with the ability to make autonomous decisions on the fly are fundamentally changing the outlook and protocols for materials optimization and discovery. Because AI-driven self-navigating schemes can effectively reduce the total number of iterations needed to arrive at the "answer" (i.e. the best stochiometric composition for a desired physical property, optimum materials processing parameters, etc.) by significant margins, they have the potential to revolutionize materials and chemical manufacturing processes at large in research laboratory settings as well as in industrial plants. Here, we demonstrate a successful implementation of real-time closed-loop autonomous navigation of a multi-dimensional materials synthesis parameter space for fabricating phase-pure epitaxial films of a metastable phase of a functional oxide in a combinatorial pulsed laser deposition chamber. Sequential epitaxial growth iterations in search of the optimized recipe to stabilize the desired crystal phase were performed using frame-by-frame quantitative computer vision analysis of reflection high-energy electron diffraction (RHEED) images of the unit-cell level film being deposited. The autonomous scheme regularly resulted in > 30-fold reduction in the number of required experiments compared to a comprehensive mapping of the parameter space. The real-time workflow developed here can be readily extended to a variety of thin film synthesis platforms opening the door for self-driving atomic-level materials design as well as autonomous optimization of semiconductor manufacturing.
36 MATERIALS SCIENCE↗
Autonomous materials discovery driven by Gaussian process regression with inhomogeneous measurement noise and anisotropic kernels
Abstract A majority of experimental disciplines face the challenge of exploring large and high-dimensional parameter spaces in search of new scientific discoveries. Materials science is no exception; the wide variety of synthesis, processing, and environmental conditions that influence material properties gives rise to particularly vast parameter spaces. Recent advances have led to an increase in the efficiency of materials discovery by increasingly automating the exploration processes. Methods for autonomous experimentation have become more sophisticated recently, allowing for multi-dimensional parameter spaces to be explored efficiently and with minimal human intervention, thereby liberating the scientists to focus on interpretations and big-picture decisions. Gaussian process regression (GPR) techniques have emerged as the method of choice for steering many classes of experiments. We have recently demonstrated the positive impact of GPR-driven decision-making algorithms on autonomously-steered experiments at a synchrotron beamline. However, due to the complexity of the experiments, GPR often cannot be used in its most basic form, but rather has to be tuned to account for the special requirements of the experiments. Two requirements seem to be of particular importance, namely inhomogeneous measurement noise (input-dependent or non-i.i.d.) and anisotropic kernel functions, which are the two concepts that we tackle in this paper. Our synthetic and experimental tests demonstrate the importance of both concepts for experiments in materials science and the benefits that result from including them in the autonomous decision-making process.
36 MATERIALS SCIENCE↗
DISTRI: Distributed Multi-Facility HPC Simulator (DISTRI) v2.1
DISTRI is an advanced network simulator designed for multi-facility computational infrastructures with agentic behavior. It simulates HPC facilities where computational resources act as autonomous agents, making intelligent decisions about job scheduling, load balancing, and resource allocation. The simulator focuses on developing and testing decentralized algorithms that promote resilience and efficiency in multi-facility environments. Key Features: - Agentic Resource Behavior: Processors and DTNs act as autonomous agents with decision-making capabilities - Pheromone-Based Load Balancing: Decentralized load balancing inspired by ant colony optimization - Dual Topology Support: Mesh (normal operations) and Dumbell (network testing) topologies - Comprehensive TCP Simulation: Realistic TCP implementations with multiple congestion control algorithms - Failure Resilience Testing: Processor failure simulation with automatic job reassignment - Extensive Visualization: Detailed performance analysis and metrics collection - Research-Ready: Designed for algorithm development and benchmarking
Bez, Jean Luca [Lawrence Berkeley National Laborat↗
Autonomous fabrication of tailored defect structures in 2D materials using machine learning-enabled scanning transmission electron microscopy
Materials with tailored quantum properties can be engineered from atomic-scale assembly techniques, but existing methods often lack the agility and accuracy to precisely and intelligently control the manufacturing process. Here, we demonstrate a fully autonomous approach for fabricating atomic-level defects using electron beams in scanning transmission electron microscopy (STEM) that combines advanced machine learning and automated beam control. As a proof of concept, we achieved controlled fabrication of MoS-nanowire (MoS-NW) edge structures by iterative and targeted exposure of MoS 2 monolayer to a focused electron beam to selectively eject sulfur atoms, utilizing high-angle annular dark-field (HAADF) imaging for feedback-controlled monitoring of structural evolution of defects. A machine learning framework combining a random forest model and a convolutional neural network (CNN) was developed to decode the HAADF image and accurately identify atomic positions and species. This atomic-level information was then integrated into an autonomous decision-making platform, which applied predefined fabrication strategies to instruct beam control about atomic sites to be ejected. The selected sites were subsequently exposed to a localized electron beam using an FPGA-controlled scan routine with precise control over beam positioning and duration. While the MoS-NW edge structures produced exhibit promising mechanical and electronic properties, the proposed methods to build the autonomous fabrication framework is material-agnostic and can be extended to other 2D materials for the creation of diverse defect structures and heterostructures beyond Mo S2 .
Engineering↗
A Robotics Enabled Eddy Current Testing System for Autonomous Inspection of Heat Exchanger Tubes
The objective of the project is to develop a robotics enabled eddy current testing system (REECTS) in automatic probe deployment, inspection, and data acquisition and analysis. The main functions of the REECTS are to: 1) identify geometry and locations of heat exchange tubes with assistance of an imaging recognition system; 2) precisely control the position and motion speed of ECT probes by an adaptive control system; 3) facilitate data analysis and real-time decision making for autonomous inspection assisted by machine learning algorithms.
20 FOSSIL-FUELED POWER PLANTS↗
Recognition Method of Vehicle Cluster Situation Based on Set Pair Logic considering Driver’s Cognition
The recognition of vehicle cluster situations is one of the critical technologies of advanced driving, such as intelligent driving and automated driving. The accurate recognition of vehicle cluster situations is helpful for behavior decision‐making safe and efficient. In order to accurately and objectively identify the vehicle cluster situation, a vehicle cluster situation model is proposed based on the interval number of set pair logic. The proposed model can express the traffic environment’s knowledge considering each vehicle’s characteristics, grouping relationships, and traffic flow characteristics in the target vehicle’s interest region. A recognition method of vehicle cluster situation is designed to infer the traffic environment and driving conditions based on the connection number of set pair logic. In the proposed model, the uncertainty of the driver’s cognition is fully considered. In the recognition method, the relative uncertainty and relative certainty of driver’s cognition, traffic information, and vehicle cluster situation are fully considered. The verification results show that the proposed recognition method of vehicle cluster situations can realize accurate and objective recognition. The proposed anthropomorphic recognition method could provide a basis for vehicle autonomous behavior decision‐making.
Liu, Shijie↗
Prognostic model and failure mechanisms of steam generators in Sodium-Cooled fast reactors
This paper presents a prognostic model for sodium-cooled fast reactor (SFR) steam generators (SGs). Here, the purpose of the model is to estimate the remaining useful life of SFR SGs and thus to support the decision-making of autonomous control. SFR SGs are of great interest for plant integrity due to their harsh operation environment. They operate at higher temperatures and higher coolant-to-steam pressure differences than those of current light water reactors (LWR). The severity of the SFR SG failure consequences, which include water-sodium contact, is another reason. Understanding its failure mechanisms is important for the development of its prognostic model. Based on our literature review and physics-based analysis, we concluded that creep would be a dominant degradation mode of SFR SGs due to SFR’s high-temperature and high-pressure environment. Thus, creep is the focus of the prognostic model. Various other failure modes were also investigated in this study. The mechanical fatigue due to flow-induced vibration is usually observed in early developmental phases and would not be an important issue during normal operation. The thermal fatigue due to thermal stripping is occasionally observed in other components in SFRs but does not affect SG integrity. Pure water stress corrosive crack, fretting, and so on are commonly observed in LWR SGs but are significantly less important in SFR SGs because of the high temperatures, high pressure differences, and chemical properties of liquid sodium. Based on these investigations, a prognostic model focusing on creep failures was developed. It estimates the failure probability profile by sampling the Larson-Miller parameter (LMP) and temperature and associated uncertainties through Monte Carlo methods. Two case studies were presented. The first one demonstrated the model’s capability to calculate the failure probability for a new specimen within a given time. If the tube is working under temperatures of 500C ± 3 and pressures of 15.2 MPa, which leads to LMP of 20,100 ± 50, the failure probabilities within 50, 70, and 90 years are approximately 0.1 %, 3.2 %, and 17.5 %. The second demonstrated how adjusting the workload can help to protect the integrity of the component. For an old tube reaching 99 % of its lifespan, continuing to run at temperatures of 500C ± 3 and LMP of 20,100 ± 50 leads to a failure probability of about 29.0 % within a year. If the temperature is reduced by 5C, the failure probability can be reduced to 2.5 %, and, if the pressure is also reduced such that the LMP is increased by 100, the failure probability can further be reduced to 0.12 %.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Forecasting of in situ electron energy loss spectroscopy
Abstract Forecasting models are a central part of many control systems, where high-consequence decisions must be made on long latency control variables. These models are particularly relevant for emerging artificial intelligence (AI)-guided instrumentation, in which prescriptive knowledge is needed to guide autonomous decision-making. Here we describe the implementation of a long short-term memory model (LSTM) for forecasting in situ electron energy loss spectroscopy (EELS) data, one of the richest analytical probes of materials and chemical systems. We describe key considerations for data collection, preprocessing, training, validation, and benchmarking, showing how this approach can yield powerful predictive insight into order-disorder phase transitions. Finally, we comment on how such a model may integrate with emerging AI-guided instrumentation for powerful high-speed experimentation.
36 MATERIALS SCIENCE↗
Control Design and EMT Simulation Toward the Restoration of Faulted Wind-Dominant Grids
Present power engineers have been challenged to employ electromagnetic transient (EMT) simulations to study the restoration of wind-dominant grids. This paper addresses this hurdle by developing strategies to: (i) reliably control the dc-link voltage of grid-forming wind turbines with dc-coupled batteries, (ii) tune controllers to stably interconnect wind power plants into a grid under recovery, and (iii) autonomously make restoration decisions if transmission faults occur during restoration. These contributions are assessed via EMT simulations of wind-dominant versions of the WSCC 9-bus grid and a 22-bus power system. Furthermore, this paper is significant to address recommendations by the North American Electric Reliability Corporation.
17 WIND ENERGY↗