Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Integrated emergency control board including design extended conditions for Krsko NPP - 297

In the aim of implementing post-Fukushima safety measures, Krsko Nuclear Power Plant is developing a Safety Upgrade Program. Krsko NPP is upgrading the remote shutdown capabilities and implementing ways to prevent and mitigate the consequences of potential Severe Accidents. This modification enhances remote shutdown capabilities of the plant to prevent potential severe accidents and improve the ways to mitigate their consequences. Within the set of plant design modifications, addressed the design, construction, and commissioning, of a new Emergency Control Room (EMCB. Tecnatom is the responsible of the design modification of the plant together with Idom, that participates with Tecnatom in the project as a joint venture, who provides a new set of field instrumentation, including its design and the corresponding wiring. EMCB integrates Human- System Interface throughout centralizing capabilities to safety shutdown and cooldown the plant as well as to control the new Design Extension Systems. The process relies on a Human Factors Engineering (HFE) analysis applying a specific methodology based on NUREG-0711 . Tecnatom has developed a specific HFE Program Management Plan to proceed with the analysis in a documented, traceable and reliable way. HFE activities ends with an Integrated System Validation in the actual full scope simulator involving MCR crews. This paper describes different phases of the project, the integrated schedule between HFE and I and C activities, benefits of upgrading main and emergency control rooms beyond design bases and addresses Tecnatom lessons learned obtained during the project execution. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2016

TH-AB-BRB-05: Using a Research Real-Time Control Interface to Go Beyond Dynamic MLC Tracking

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Fast Adaptive Neural Control of Resonant Extraction at Fermilab

We present progress on the development of a machine learning (ML) regulation system for third-order resonant extraction of the beam delivered to the Mu2e experiment at Fermilab. We consider classical and ML-based controllers optimized on semi-analytic simulations and provide performance comparisons for several models. Additionally, we discuss the efficiency of each model in training, which has implications for future work on adaptive control. We also discuss progress on developing optimized implementations of ML models for edge-based inference.

Whitbeck, A. [Fermilab] (ORCID:0000000342245164)↗
DOE OSTI2025

Fast Adaptive Neural Control of Resonant Extraction at Fermilab

We present progress on the development of a machine learning (ML) regulation system for third-order resonant extraction of the beam delivered to the Mu2e experiment at Fermilab. We consider classical and ML-based controllers optimized on semi-analytic simulations and provide perfor- mance comparisons for several models. Additionally, we discuss the efficiency of each model in training, which has implications for future work on adaptive control. We also discuss progress on developing optimized implementations of ML models for edge-based inference.

Whitbeck, A. [Fermilab]↗
DOE OSTI2022

Autonomous System Subversion Tactics: Prototypes and Recommended Countermeasures

One of the fielding requirements for Advanced and Small Modular Reactors (AR/SMR) is the ability to support remote and autonomous operations. Autonomous Control Systems (ACS) are found on platforms such as Autonomous Space Vehicles, Cruise Missiles, and advanced driver-assistance systems. Each of these ACS implementations depends upon a set of decision support subsystems responsible for supporting Autonomous Mission Managers (names vary based upon field and author preferences). These Autonomous Mission Managers receive inputs from system sensors (e.g., LIDAR collection from an automobile travelling down a street; transients from a nuclear reactor), and perform a set of classifications (e.g., Red Traffic Light; Small Pedestrian at 10m; Load Rejection; Single Coolant Pump Trip), and then use these classifications in combination with recommendation algorithms to achieve platform goals (e.g., Stop the Vehicle at the Traffic Light, Avoid the Small Pedestrian; Trip the Reactor to prevent a Safety Event). The design, implementation, and fielding of an ACS capability will alter the cyber-attack surface such that existing risk management plans will need to be updated to include how to protect and defend against data-science and decision-support-system attack classes. These attack classes would include protection of the design and training environments where algorithm selection and testing and training data would be obvious attack vectors. These attack classes would also require an informed set of detection and response procedures to identify anomalous behaviors and document best practices for anomaly assessment and vulnerability mitigation and remediation. Last year we published a Cyber Threat Assessment Methodology for Autonomous and Remote Operations for AR/SMRs along with a companion publication on Cyber Attack and Defense Use Cases. The focus of the methodology was on describing and enumerating ACS processes, components, and functions such that security engineers could: evaluate subversion options against the target; identify threat actor attributes and capabilities derived from each subversion option; and identify security controls and response countermeasures. The Use Cases document offered detailed methodology examples including an assessment of a Military Base SMR, an Autonomous System Decision Loop, and implementation of AR/SMR Machine Learning algorithms. Our proposal at the end of last year was to focus on implementation of subversion prototypes related to the last Use Case area: AR/SMR Machine Learning (ML) Algorithms. We included six attack scenarios in our Use Cases paper: a Poisoning Attack against ML functions implemented using an FPGA; a Trojaning Attack against ML classifiers exploiting the excitability of Nuclear Engineers; a Backdooring Attack against ML Training environments to ensure persistence of an attack vector; a False Positive Evasion Attack against multi-factor Access Control Systems using clever inputs; an Inference Attack against ML models by an Insider with access to the Operational environment; and an Adversarial Reprogramming Attack against a Material Access Control Video Surveillance System. At the beginning of this year these six attack scenarios were provided to our research teams at Georgia Tech and Idaho State University and each team successfully implemented a subversion attack against a ML implementation to include transient misclassifications. While this is a notable outcome from this type of research, this paper offers the reader insight into not only how to structure and execute these types of attacks, but into the thought process behind how the researcher investigated the problem space, performed initial algorithm implementation, and the trial-and-error behind arriving at the successful subversion prototypes. We include in this paper a set of associated Scenarios on how these subversion prototypes could be implemented and an initial set of guidance for AR/SMR architects, Nuclear Regulators, and Cyber Defenders to implement awareness and defense capabilities into their current operational portfolios.

42 ENGINEERING↗
DOE OSTI2024

Novel Approach to PV Inverter Modeling and Simulation Leveraging Experiments, Learning Based Modeling and Co-Simulation: Preprint

Photovoltaic inverter (PV) inverter manufacturers use custom, proprietary control approaches and topologies in their inverter design. Due to this proprietary nature, it is not possible to share EMT domain models for system studies. This research work presents a novel approach in experimental design, high fidelity data collection, use of learning-based modeling, and co-simulation to enhance the PV inverter modeling. We used a 20 kW off-the-shelf grid following PV inverter and subjected the inverter to controlled tests including voltage and frequency step changes, as well as solar irradiance variations. The recorded high frequency data was used in learning-based model training. This learning-based model was imported into an Electromagnetic Transient (EMT) simulation tool using co-simulation techniques to complete the modeling effort and integrate the model into an EMT simulation tool. The three key components in this research work are the design of experimental setup, use of learning-based approach for model development and use of co-simulation to complete the approach. The proposed approach will allow users to develop a model in a really short period of time and achieve reasonable inverter models.

artificial intelligence↗
DOE OSTI2024

Metric Learning to Accelerate Convergence of Operator Splitting Methods

Recent developments in machine learning have led to promising advances in accelerating the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial intelligence and optimal control has led to a variety of proposed strategies for learning to produce fast solutions to optimization problems. For example, recent works have shown that it is possible to accelerate the convergence of optimization algorithms by learning to select their parameters, such as gradient descent stepsizes. This work proposes a new approach, in which the underlying metric spaces of proximal operator splitting algorithms are learned to maximize convergence rate. While prior works in optimization theory have derived optimal metrics in simple cases, no such result exists for many practical problem forms including general Quadratic Programming (QP). This paper shows how differentiable optimization can enable the end-to-end learning of proximal metrics, enhancing the convergence of proximal algorithms for QP problems beyond what is possible based on known theory. Additionally, the results illustrate a strong connection between the learned proximal metrics and active constraints at the optima, leading to an interpretation in which the predicted proximal metrics can be viewed as a form of active set prediction.

King, Ethan [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2022

Prediction of DIII-D Pedestal Structure from Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. An experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (ne) and electron temperature (Te) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (Ip), toroidal magnetic field (Bφ), neutral beam heating power (PNBI) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Digital twins and deep learning segmentation of defects in monolayer MX 2 phases

Developing methods to understand and control defect formation in nanomaterials offers a promising route for materials discovery. Monolayer MX 2 phases represent a particularly compelling case for defect engineering of nanomaterials due to the large variability in their physical properties as different defects are introduced into their structure. However, effective identification and quantification of defects remain a challenge even as high-throughput scanning transmission electron microscopy methods improve. This study highlights the benefits of employing first principles calculations to produce digital twins for training deep learning segmentation models for defect identification in monolayer MX 2 phases. Around 600 defect structures were obtained using density functional theory calculations, with each monolayer MX 2 structure being subjected to multislice simulations for the purpose of generating the digital twins. Several deep learning segmentation architectures were trained on this dataset, and their performances evaluated under a variety of conditions such as recognizing defects in the presence of unidentified impurities, beam damage, grain boundaries, and with reduced image quality from low electron doses. Further, this digital twin approach allows benchmarking different deep learning architectures on a theory dataset, which enables the study of defect classification under a broad array of finely controlled conditions. It thus opens the door to resolving the underpinning physical reasons for model shortcomings and potentially chart paths forward for automated discovery of materials defect phases in experiments.

36 MATERIALS SCIENCE↗
DOE OSTI2016

MO-DE-BRA-01: Flipped Physics Courses Within a Radiologic Technologist Program: Video Production and Long Term Outcomes

Purpose: To determine if the flipped class format has an effect on examination results for a radiologic technologist (RT) program and discuss benefits from creating video resources. Methods: From 2001–2015, students had taken both a radiological physics and quality control (QC) class as a part of their didactic training. In 2005/2006, the creation of videos of didactic lectures and QC test demonstrations allowed for a flip where content was studied at home while exercises and reviews were done in-class. Final examinations were retrospectively reviewed from this timeframe. 12 multiple choice physics questions (MCP) and 5 short answer QC questions (SAQC) were common to pre and post flip exams. The RT program’s ARRT exam scores were also obtained and compared to national averages. Results: In total, 36 lecture videos and 65 quality control videos were created for the flipped content. Data was ∼2.4GB and distributed to students via USB or CD media. For MCP questions, scores improved by 7.9% with the flipped format and significance (Student’s t-test, p<0.05) was found for 3 of the 12 questions. SAQC questions showed improvement by 14.6% and significance was found for 2 of the 5 questions. Student enrollment increased from ∼14 (2001–2004) to ∼23 students (2005–15). Content was continuously added post-flip due to the efficiency of delivery. The QC class in 2003 covered 45 test setups in-class while 65 were covered with video segments in 2014. Flipped materials are currently being repurposed. In 2015, this video content was restructured into an ARRT exam review guide and in 2016, the content was reorganized for fluoroscopy training for physicians. Conclusion: We believe that flipped classes can improve efficiency of content delivery and improve student performance even with an increase in class size. This format allows for flexibility in learning as well as re-use in multiple applications.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2025

SECURED: Simulator-Enhanced Control and Understanding of Reactor systems for cyber-Event Defense

The study discusses a learning approach for analyzing cyber-events in reactor systems using integrated hardware and personal computer simulator models. Key points include the rise in cyber-attacks and their sophistication in industrial control systems (ICS), the necessity for awareness, understanding, resource allocation, and preparation to combat these threats, and the digital transformation of old and new nuclear plants, increasing their exposure to cyber threats. It highlights the cyber vulnerabilities of advanced reactor systems, which rely on digital instrumentation and control for operations and safety functions, making them susceptible to cyber-attacks. The approach involves demonstrating reactor system plant ICS cyber-attacks under various operational conditions utilizing tools like simulator models and hardware-based kits. A strategic solution approach tailored to critical infrastructure is emphasized, along with community engagement for public and government support, adopting effective learning approaches, and the preparation for anticipated future challenges. The presentation concludes with a call to action to address challenges, leverage opportunities, and advance through lesson learning in cybersecurity for nuclear energy systems.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Improving and testing machine learning methods for benchmarking soil carbon dynamics representation of land surface models

Representation of soil organic carbon (SOC) dynamics in Earth system models (ESMs) is a key source of uncertainty in predicting carbon climate feedbacks. The magnitude of this uncertainty can be reduced by accurate representation of environmental controllers of SOC stocks in ESMs. In this study, we used data of environmental factors, field SOC observations, ESM projections and machine learning approaches to identify dominant environmental controllers of SOC stocks and derive functional relationships between environmental factors and SOC stocks. Our derived functional relationships predicted SOC stocks with similar accuracy as the machine learning approach. We used the derived relationships to benchmark the coupled model intercomparison project phase six ESM representation of SOC stocks. We found divergent environmental control representation in ESMs in comparison to field observations. Representation of SOC in ESMs can be improved by including additional environmental factors and representing their functional relationships with SOC consistent with observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Are We Adapting to Floods? Evidence from Global Flooding Fatalities

There has been a growing interest in understanding whether and how people adapt to extreme weather events in a changing climate. This article presents one of the first empirical analyses of adaptation to flooding on a global scale. Using a sample of 97 countries between 1985 and 2010, we investigate the extent and pattern of flood adaptation by estimating the effects of a country's climatological risk, recent flood experiences, and socioeconomic characteristics on its flood-related fatalities. Our results provide mixed evidence on adaptation: countries facing greater long-term climatological flooding risks do not necessarily adapt better and suffer fewer fatalities; however, after controlling for the cross-country heterogeneity, we find that more recent flooding shocks have a significant and negative effect on fatalities from subsequent floods. These findings may suggest the short-term learning dynamics of adaptation and potential inefficacy of earlier flood control measures, particularly those that promote increased exposure in floodplains. Our findings provide important implications for climate adaptation policy making and climate modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

ARM-IRL: Adaptive Resilience Metric Quantification Using Inverse Reinforcement Learning

The resilience of safety-critical systems is gaining importance due to the rise in cyber and physical threats, especially within critical infrastructure. Traditional static resilience metrics may not capture dynamic system states, leading to inaccurate assessments and ineffective responses to cyber threats. This work aims to develop a data-driven, adaptive method for resilience metric learning. We propose a data-driven approach using inverse reinforcement learning (IRL) to learn a single, adaptive resilience metric. The method infers a reward function from expert control actions. Unlike previous approaches using static weights or fuzzy logic, this work applies adversarial inverse reinforcement learning (AIRL), training a generator and discriminator in parallel to learn the reward structure and derive an optimal policy. The proposed approach is evaluated on multiple scenarios: optimal communication network rerouting, power distribution network reconfiguration, and cyber–physical restoration of critical loads using the IEEE 123-bus system. The adaptive, learned resilience metric enables faster critical load restoration in comparison to conventional RL approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reinforcement Learning for Small Autonomous Ground Vehicle

Microcontroller: • ESP-WROOM 32 control board • Wi-Fi 802.11 b/g/n Actuators: • 2 Futaba S3003 Servos • Commanded angles of 0 to 180 • Effectors • Piano wire “legs” and “feet” • Current, Voltage, Power Sensor: • Adafruit INA260 • Range Finder (1D LiDAR) Sensor: • SparkFun VL53L1X • Power Supply: • Battery powered, Adafruit UN3480 Li Ion Polymer 1200 mAh • Adafruit JST 2 PH power breakout board • Body: • Additively manufactured frame

Wells, William Willie↗
DOE OSTI2025

Modernizing Accelerator Responsiveness and Controls in Operations

Accelerators increasingly use artificial intelligence (AI) and machine learning (ML) software and workflows for a variety of tasks, from optimization to fault detection and recovery. Efficient and sustainable application of these technologies necessitates specialized and facility-specific infrastructure commitments. Accelerator facilities also introduce unique radiation and security hazards, placing additional demands on operational infrastructure. These needs further escalate the prioritization of effective collaboration models and associated funding mechanisms and legal frameworks.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

Fast and accurate reduced-order modeling of a MOOSE-based additive manufacturing model with operator learning

One predominant challenge in additive manufacturing (AM) is to achieve specific material properties by manipulating manufacturing process parameters during the runtime. Such manipulation tends to increase the computational load imposed on existing simulation tools employed in AM. The goal of the present work is to construct a fast and accurate reduced-order model (ROM) for an AM model developed within the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework, ultimately reducing the time/cost of AM control and optimization processes. Our adoption of the operator learning (OL) approach enabled us to learn a family of differential equations produced by altering process variables in the laser’s Gaussian point heat source. More specifically, we used the Fourier neural operator (FNO) and deep operator network (DeepONet) to develop ROMs for time-dependent responses. Furthermore, we benchmarked the performance of these OL methods against a conventional deep neural network (DNN)-based ROM. Ultimately, we found that OL methods offer comparable performance and, in terms of accuracy and generalizability, even outperform DNN at predicting scalar model responses. The DNN-based ROM afforded the fastest training time. Furthermore, all the ROMs were faster than the original MOOSE model yet still provided accurate predictions. FNO had a smaller mean prediction error than DeepONet, with a larger variance for time-dependent responses. Unlike DNN, both FNO and DeepONet were able to simulate time series data without the need for dimensionality reduction techniques. Finally, the present work can help facilitate the AM optimization process by enabling faster execution of simulation tools while still preserving evaluation accuracy.

36 MATERIALS SCIENCE↗