Search NASA⌕ Search

SEARCH · Search NASA

Results for “Operator learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Predicting cutoff L-shells of solar protons using the GPPSn particle dataset

Solar energetic protons (SEPs) arriving at the Earth trigger severe radiation storms in the near-Earth space, directly impacting space missions operating at various altitudes. Therefore, monitoring SEP events and predicting the penetration depths of solar protons are critical for aerospace sectors. Building on previous efforts, here we demonstrate the feasibility of using proton measurements from the Global Prompt Proton Sensor network (GPPSn), enabled by Los Alamos National Laboratory developed combined X-ray dosimeters aboard GPS satellites, to characterize and predict the penetration of solar protons into the geomagnetic field. The inclined medium-Earth-orbits (MEOs) of the global GPS constellation offer a unique advantage of allowing simultaneous measurements of penetrating solar protons inside both open- and closed-field line regions. Therefore, the L-profiles of ∼10s–100 MeV solar protons and their associated cutoff L-shells can be determined from the GPPSn dataset, using predefined threshold proton flux values rather than traditional flux ratios. After examining a list of SEP event intervals across solar cycles 23, 24 and 25—including the 2024 Mother’s Day superstorm, we showcase how the latest GPPSn proton dataset (release v1.10), reprocessed and calibrated, can not only be used to monitor solar proton distributions inside the dynamic geomagnetic field for individual events, but also to derive a new empirical model linking cutoff L-shells with several key space weather parameters. This newly developed SEPCL-MEO model demonstrates high predictive performance; for example, predictions for > 30 MeV solar protons yield a correlation coefficient of 0.85 and performance efficiency of 0.67 when validated against GPPSn observations. Results from this pilot study underscores the scientific and operational value of the GPPSn dataset, and this dataset—when paired with machine-learning techniques—can play a critical role in observing and predicting the effects of future incoming SEP events, including extreme ones.

58 GEOSCIENCES↗
DOE OSTI2026

Analysis of Power Electronic Solutions for Wide-Range Wave Energy Input

Wave energy is a largely untapped energy source with the potential to provide 290 TWh per year to the continental United States. As a new technology, wave energy converters are less efficient and reliable compared to established energy sources, leaving the vast energy of the sea largely unutilized. Wave energy is uniquely inconsistent, with large fluctuations. Paired with harsh operating environments and difficulty in repair, the power electronics designed to harvest wave energy need to be reliable, cost-effective, and able to work in a wide operating band. The literature on existing power electronics in wave energy converters and lessons learned across other industries provide a framework of topologies to simulate. WEC-Sim, an open-source hydrodynamic platform in MATLAB Simulink developed by the National Laboratory of the Rockies, was used to simulate a wide range of power electronics under a variety of wave conditions. This paper provides a comprehensive investigation into existing wave energy power electronics converters, state-of-the-art topologies that can be applied to wave energy, and novel solutions to wave conversion.

16 TIDAL AND WAVE POWER↗
DOE OSTI2022

1.2.4.404 - Data-Driven Approach for Hydropower Plant Controller Prototyping Using Remote Hardware in the Loop (DR-HIL)

Real-time prototyping of hydropower plant controls is important for reducing the cost and the risk of field deployment. This project will 1) collect design and operational data from actual hydro plants and 2) use a physics-informed machine learning approach for real-time emulation of hydropower plants, including hydro turbine and hydrodynamics. The data-driven models will be interfaced with digital real-time simulation at NREL’s Flatirons campus for hardware-in-the-loop (HIL) testing of the governor hardware device or controller-HIL (CHIL). The proposed approach will also establish the connectivity based remote CHIL testing capability using real-time data streams from an actual hydro plant. This integrated hydro-plant emulation with CHIL will be used to prototype hydro-governor controls and eventually provide an opportunity to test hydropower integrated with various technologies (e.g. conventional and renewable generation, energy conversion, etc.) as HIL.

controls prototyping↗
DOE OSTI2013

Graphite Waste Tank Cleanup and Decontamination under the Marcoule UP1 D and D Program - 13166

The UP1 plant in Marcoule reprocessed nearly 20,000 tons of used natural uranium gas cooled reactor fuel coming from the first generation of civil nuclear reactors in France. During more than 40 years, the decladding operations produced thousands of tons of processed waste, mainly magnesium and graphite fragments. In the absence of a French repository for the graphite waste, the graphite sludge content of the storage pits had to be retrieved and transferred into a newer and safer pit. After an extensive R and D program, the equipment and process necessary for retrieval operations were designed, built and tested. The innovative process is mainly based on the use of two pumps (one to capture and the other one to transfer the sludge) working one after the other and a robotic arm mounted on a telescopic mast. A dedicated process was also set up for the removal of the biggest fragments. The retrieval of the most irradiating fragments was a challenge. Today, the first pit is totally empty and its stainless steel walls have been decontaminated using gels. In the second pit, the sludge retrieval and transfer operations have been almost completed. Most of the non-pumpable graphite fragments has been removed and transferred to a new storage pit. After more than 6 years of operations in sludge retrieval, a lot of experience was acquired from which important 'lessons learned' could be shared. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2017

Integrity Assessment of Hanford 242-A Evaporator Facility E-A-1 Re-boiler Vessel via Fluorescein Liquid Tracer Test Methods - 17357

The 242-A Evaporator Facility is critical to the United States Department of Energy's (DOE) Hanford Site clean-up mission due to limited space within the existing Double-Shell Tanks (DSTs) used to store nuclear and chemical waste until future processing. The 242-A Evaporator Facility is currently the sole waste volume reduction process used at Hanford, and the E-A-1 Re-boiler is essential to the Evaporator process. Due to the potential for cross-contamination between the Re-boiler tubes through which waste passes and the tube sheets of uncontaminated steam, an assessment of the Re-boiler vessel's integrity is required for continuing operations of the facility. In order to meet these requirements, an independent integrity assessment was designed to use fluorescein liquid tracer (LT) to verify the leak-tightness of the Re-boiler vessel in accordance with Washington River Protection Solutions, LLC (WRPS) tightness test standards, as well as, the ASME Boiler and Pressure Vessel (B and PV) Code, Section III, Division 1, NB-6300. LT test methodologies were evaluated and determined to be appropriate for a vessel with restricted access, such as the E-A-1 Re-boiler, as it provided the needed sensitivity, reliability, and cost; as well as, exceeded the leak-tightness specifications required by both WRPS and ASME B and PV Code standards. The integrity test requires water laced with fluorescein be circulated through the waste processing loop of the 242-A Evaporator and samples of steam condensate be collected and analyzed for traces of fluorescein to determine leak-tightness. Liquid condensate sampling was conducted prior to and during testing and the samples were analyzed for fluorescein tracer to determine the amount of fluorescein that flowed out of the tubes of the Re-boiler into the steam side of the vessel. Given the established criteria for 'leak-tight,' test results determined that the Re-boiler passed the integrity assessment. After further scrutiny of the 2014 test and data results, it was determined that although the Re-boiler was 'leak-tight,' as established by the test criteria, there was concern of future leakage. The DOE and the DOE Office of River Protection (ORP) requested that WRPS repeat the integrity assessment in two and a half years to determine if the potential leak was growing, which could threaten continuing operations of the 242-A Evaporator. The 2017 test has been redesigned using lessons learned from the 2014 test and was modified to account for ergonomic and safety considerations, ease of repeatability, and accuracy of results. The liquid tracer methodology and test plan developed for the Re-boiler will continue to be implemented in 5 year increments to monitor current and future integrity. The method may also prove useful for other aging components across the Hanford Site, where appropriate. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

Panel Session 62: Progress on Deep Repository Programs Around the World

This panel session focused on the progress of deep repository programs, worldwide. While efforts on a deep geological repository for SNF/UNF and HLW in the USA were terminated in 2010, several other repository programs continue to make considerable progress and deserve to be recognized. Panelists were invited from national, multi-national, and international repository programs and organizations to report upon the status and future as well as the perceived reasons underlying the success and the failure of components of their respective repository program. This panel provided a forum for interested parties to present, exchange, and take advantage of, as appropriate, repository progress, challenges, concepts/designs and other lessons learned around the world, including site characterization, site selection, research and development, licensing, construction, operation, and public acceptance and participation. Presentations proposed include: 1 - Cigeo (French Deep Geological Repository Project) update 2018 (Daniel Delort, Andra (France)); 2 - Progress on Deep Geological Repository Programs Around the World (Bruce McKirdy, Radioactive Waste Management (United Kingdom)); 3 - Geological disposal facility in Belgium (Didier Leonard, ONDRAF/NIRAS (Belgium))

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Panel Session 89: Progress on Deep Repository Around the World

This panel focused on the progress of deep repository programs, worldwide. While efforts on a deep geological repository for SNF/UNF and HLW in the USA were terminated in 2010, several other repository programs continue to make considerable progress 10 and deserve to be recognized. Panelists from national, multi-national, and international repository programs and organizations reported on the status and future plans as well as the perceived reasons underlying the success and the failure of components of their respective repository program. This session provided a forum for interested parties to present, exchange, and take advantage of, as appropriate, repository progress, challenges, concepts/designs and other lessons learned around the world, including site characterization, site selection, research and development, licensing, construction, operation, and public acceptance and participation. Panelists with presentations: Switzerland's Geological Repository Program for Radioactive Waste (Tim Vietor); Update on NWMO's Progress in Implementing Canada's Plan (Sarah Hirschorn); Cigeo Project Progress and Next Milestones (Corinne Bauer)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Ensuring Safe, Effective, and Reliable Use of Artificial Intelligence-Based Applications for Nuclear Electricity Generation through a Systems Approach

There is a significant potential to reduce operating and maintenance cost at nuclear power plants using artificial intelligence (AI) and machine learning (ML). For instance, AI/ML has the potential to significant improve work management processes, condition reporting, and plant surveillance activities. However, the nuclear industry has been slow in adopting AI/ML due to several multifaceted barriers discussed in this paper. This work presents such multidisciplinary approach intended to 1) accelerate industry adoption of AI/ML-based applications at nuclear power plants and 2) ensure their safe, reliable, and effective use. This approach is discussed further in this work and will be used to address overarching challenges associated with AI deployment at scale to provide industry guidance that support accelerated adoption of AI/ML technologies throughout the industry.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Luna

SAND2021-15051 O Luna is an experimental cognitive architecture that seeks to enable continuous learning in an embodied agent. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Dellana, Ryan↗
DOE OSTI2025

Efficient and assured reinforcement learning-based building HVAC control with heterogeneous expert-guided training

Abstract Building heating, ventilation, and air conditioning (HVAC) systems account for nearly half of building energy consumption and $$20\%$$ of total energy consumption in the US. Their operation is also crucial for ensuring the physical and mental health of building occupants. Compared with traditional model-based HVAC control methods, the recent model-free deep reinforcement learning (DRL) based methods have shown good performance while do not require the development of detailed and costly physical models. However, these model-free DRL approaches often suffer from long training time to reach a good performance, which is a major obstacle for their practical deployment. In this work, we present a systematic approach to accelerate online reinforcement learning for HVAC control by taking full advantage of the knowledge from domain experts in various forms . Specifically, the algorithm stages include learning expert functions from existing abstract physical models and from historical data via offline reinforcement learning, integrating the expert functions with rule-based guidelines, conducting training guided by the integrated expert function and performing policy initialization from distilled expert function. Moreover, to ensure that the learned DRL-based HVAC controller can effectively keep room temperature within the comfortable range for occupants, we design a runtime shielding framework to reduce the temperature violation rate and incorporate the learned controller into it. Experimental results demonstrate up to 8.8 X speedup in DRL training from our approach over previous methods, with low temperature violation rate.

Xu, Shichao↗
DOE OSTI2024

Anomaly Detection and Mitigation for Dynamic Frequency Regulation in Hydropower-Battery Systems: Preprint

Hydropower operators and energy storage providers are increasingly interested in participating in frequency regulation services, driven by the incentives offered by independent system operators, such as the Pennsylvania-New Jersey-Maryland Interconnection (PJM), in a competitive electricity market. This transition, however, unfolds against the backdrop of a modernizing and rapidly digitizing power grid, exposing the integrated legacy infrastructure and vulnerable communication networks to a multitude of cybersecurity threats. These evolving threats not only endanger grid operations but also have the potential to trigger cascading disruptions across the broader grid network and influence regulation markets. This work presents an approach for developing an anomaly detection and mitigation system to address cybersecurity challenges during the participation of a hydropower-integrated battery energy storage system (BESS) in a frequency regulation market. The applied anomaly detector utilizes machine learning algorithms to provide detailed classification of cyber-physical events and provide a comprehensive situation awareness to grid operators. Later, the applied mitigation system triggers predefined corrective actions to minimize the impact of data integrity attacks on the regulation market and system stability. We evaluated the proposed approach on a fully active BESS topology using the slow regulation signal (Reg A) coming from the PJM market. Our simulation results reveal that the proposed approach performs well in detecting data integrity attacks within the allocated time frame and also minimizes the system's instability and economic loss during the participation of hydropower and BESS in the regulation market.

battery energy storage system↗
DOE OSTI2024

An Autonomous Critical Data Extrapolator for the AGN-201m

Nuclear nonproliferation serves as a key goal, being undertaken by the International Atomic Energy Agency (IAEA). To recognize proliferation there are two pathways that states, who intend to use nuclear material for malicious purposes can take, diversion can misuse. Diversion is when fissile nuclear material is declared to the IAEA for non-weapon purposes, but then covertly removed. If the source of nuclear material, that is not declared and not fissionable, is placed inside the reactor core to create fissile material used to create weapons then the state is using the second pathway of proliferation, misuse. With the emerging development in areas of simulation and machine learning the creation of virtual models of reactor systems, digital twins, serve as a potential method to identify proliferation through detecting anomalous behavior in the reactor. A digital twin for a physical nuclear reactor has never been developed, as digital twins serve as an emerging technology. To investigate the process for development and use of a digital twin for a nuclear reactor Idaho State University’s AGN-201m serves as the nuclear reactor used for development of this digital twin. A data acquisition system has been installed to the reactor system allowing for the transfer of collected data from a reactor operation to Idaho National Laboratory’s Deeplynx data warehouse. When utilizing data to train reactor physics and machine learning models, a significant challenge encountered is the initial state of the data. Nuclear proliferation will have the capacity to be detected when the reactor immediately starts up, nor will it occur after the reactor shuts down. Generally, it will be detected when the reactor is operating at some desired power over a sufficient period for that specific reactor design. For the AGN-201m this will be when the reactor is critical (generally 1 mW or above) for a timespan that is within or less than the range of a regular business day. Datasets sent to Deeplynx have had to be manually cut to when the reactor is critical based on plots of power levels. This method is inefficient and laborious, especially when using multiple datasets at once to train a model. To provide a more streamlined approach an automated critical data extrapolator is developed, with capabilities of recognizing when the reactor operation first reaches criticality, and when the reactor undergoes a SCRAM and is shutdown.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Learning model combining convolutional deep neural network with a self-attention mechanism for AC optimal power flow

Alternating current optimal power flow (OPF) analysis is critical for efficient and reliable operation of power systems. For large systems or repetitive computations, the traditional methods such as the direct and gradient methods, or non-traditional methods, such as the genetic algorithm and simulating annealing, are time-consuming and unsuitable for real-time computing. The work in this paper proposes a novel framework to obtain the optimal solution of power flow in real-time using a combination of convolutional neural networks and a self-attention mechanism. All parameters of the power networks are rearranged in an image-like shape of a multi-channel image where each channel is a two-dimensional matrix. The proposed approach is adaptive with every input size of power systems as well as frequent variations of network topologies without intervention to the framework core. The encompassment of all power system contexts in which all parameters of internal elements, generation costs, and topology information are included, contributes to the higher accuracy of inference compared to other current machine-learning-based OPF-solving methods. Besides, the proposed framework established on ubiquitous platforms is effortlessly integrated into current infrastructures of power systems, and the great efficiency along with the computation speed may serve as a critical point for practical implications, such as enabling faster decision-making during real-time operations, predicting system contingencies, and remedial actions based on an offline pre-trained model. Furthermore, this supervised learning process is applied to the dataset of four case studies of meshed power systems: the IEEE 5-bus system (IEEE-5), the IEEE 30-bus system (IEEE-30), the IEEE 39-bus system (IEEE-39), and the IEEE 57-bus system (IEEE-57) to prove the efficacy of the proposed method.

42 ENGINEERING↗
DOE OSTI2024

Fermilab s Transition to Token Authentication

Fermilab is the first High Energy Physics institution to transition from X.509 user certificates to authentication tokens in production systems. All of the experiments that Fermilab hosts are now using JSON Web Token (JWT) access tokens in their grid jobs. Many software components have been either updated or created for this transition, and most of the software is available to others as open source. The tokens are defined using the WLCG Common JWT Profile. Token attributes for all the tokens are stored in the Fermilab FERRY system which generates the configuration for the CILogon token issuer. High security-value refresh tokens are stored in Hashicorp Vault configured by htvault-config, and JWT access tokens are requested by the htgettoken client through its integration with HTCondor. The Fermilab job submission system jobsub was redesigned to be a lightweight wrapper around HTCondor. For automated job submissions a managed tokens service was created to reduce duplication of effort and knowledge of how to securely keep tokens active. The existing Fermilab file transfer tool ifdh was updated to work seamlessly with tokens, as well as the Fermilab POMS (Production Operations Management System) which is used to manage automatic job submission and the RCDS (Rapid Code Distribution System) which is used to distribute analysis code via the CernVM FileSystem. The dCache storage system was reconfigured to accept tokens for authentication in place of X.509 proxy certificates. As some services and sites have not yet implemented token support, proxy certificates are still sent with jobs for backwards compatibility but some experiments are beginning to transition to stop using them. There have been some glitches and learning curve issues but in general the system has been performing well and is being improved as operational problems are addressed.

Dykstra, David↗
DOE OSTI2024

Low latency optical-based mode tracking with machine learning deployed on FPGAs on a tokamak

Active feedback control in magnetic confinement fusion devices is desirable to mitigate plasma instabilities and enable robust operation. Optical high-speed cameras provide a powerful, non-invasive diagnostic and can be suitable for these applications. Here, in this study, we process high-speed camera data, at rates exceeding 100 kfps, on in situ field-programmable gate array (FPGA) hardware to track magnetohydrodynamic (MHD) mode evolution and generate control signals in real time. Our system utilizes a convolutional neural network (CNN) model, which predicts the n = 1 MHD mode amplitude and phase using camera images with better accuracy than other tested non-deep-learning-based methods. By implementing this model directly within the standard FPGA readout hardware of the high-speed camera diagnostic, our mode tracking system achieves a total trigger-to-output latency of 17.6 μs and a throughput of up to 120 kfps. This study at the High Beta Tokamak-Extended Pulse (HBT-EP) experiment demonstrates an FPGA-based high-speed camera data acquisition and processing system, enabling application in real-time machine-learning-based tokamak diagnostic and control as well as potential applications in other scientific domains.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

Predicting and Preventing Failures [Slides]

Unpredicted bearings failures can be costly and dangerous. Current methods of detecting bearing faults rely on trained specialists with expensive detection equipment. Specialists must react daily, as the sheer number of bearings and the machines they operate are critical and any downtime will result in loss of productivity and endanger personal. My method utilizes machine learning algorithms coupled with relatively inexpensive accelerometers to remotely monitor data for specialists for fault detection, and estimate the diameter of the fault that has been caused by the bearing. The algorithm offers high accuracy detection using solely accelerometer data that can be obtained remotely, reducing the strain on analysists and ensuring that equipment is always running at an optimal and safe level. The algorithms operate in two layers, one layer detects the type of fault, and the second estimates the diameter of wear to determine the severity of the fault. The detection layer operates in the frequency space using a high accuracy Support Vector Machine algorithm and is trained on different types and sizes of machines to ensure generalization. The second layer uses a modified k-means clustering algorithm and vector calculus to estimate the bearing wear.

42 ENGINEERING↗
DOE OSTI2023

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement

Distribution system resilience enhancement is an important topic to ensure customers have access to power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecast. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗