Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2013

Cleanup and Dismantling of Highly Contaminated Ventilation Systems Using Robotic Tools - 13162

The UP1 plant reprocessed nearly 20,000 tons of used natural uranium gas cooled reactor fuel coming from the first generation of civil nuclear reactors in France. Following operating incidents in the eighties, the ventilation system of the continuous dissolution line facility was shut down and replaced. Two types of remote controlled tool carriers were developed to perform the decontamination and dismantling operations of the highly contaminated ventilation duct network. The first one, a dedicated small robot, was designed from scratch to retrieve a thick powder deposit within a duct. The robot, managed and confined by two dedicated glove boxes, was equipped for intervention inside the ventilation duct and used for carrying various cleanup and inspection tools. The second type, consisting of robotic tools developed on the base of an industrial platform, was used for the clean-up and dismantling of the ventilation duct system. Depending on the type of work to be performed, on the shape constraints of the rooms and any equipment to be dismantled, different kinds of robotic tools were developed and installed on a Brokk 40 carrier. After more than ten years of ventilation duct D and D operations at the UP1 plant, a lot of experience was acquired about remote operations. The three main important lessons learned in terms of remote controlled operation are: characterizing the initial conditions as much as reasonably possible, performing non-radioactive full scale testing and making it as simple and modular as possible. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Multivariate prognosis of battery advanced state of health via transformers

De-risking energy storage investments necessary to meet CO 2 reduction targets requires a deep understanding of the connections between battery health, design, and use. The historical definition of the battery state of health (SOH) as the percentage of current versus initial capacity is inadequate for this purpose, motivating an expanded SOH consisting of an interrelated set of descriptors including capacity, energy, ionic and electronic impedances, open-circuit voltages, and microstructure metrics. In this work, we introduce deep transformer networks for the simultaneous prognosis of 28 battery SOH descriptors using two cycling datasets representing six lithium-ion cathode chemistries, multiple electrolyte/anode compositions, and different charge-discharge scenarios. The accuracy of these predictions for battery life (with an unprecedented mean absolute error of 19 cycles in predicting end of life for a lithium-iron-phosphate fast-charging dataset) illustrates the promise of deep learning toward providing enhanced understanding and control of battery health.

25 ENERGY STORAGE↗
DOE OSTI2024

Quantifying Streambed Grain Size, Uncertainty, and Hydrobiogeochemical Parameters Using Machine Learning Model YOLO

Abstract Streambed grain sizes control river hydro‐biogeochemical (HBGC) processes and functions. However, measuring their quantities, distributions, and uncertainties is challenging due to the diversity and heterogeneity of natural streams. This work presents a photo‐driven, artificial intelligence (AI)‐enabled, and theory‐based workflow for extracting the quantities, distributions, and uncertainties of streambed grain sizes from photos. Specifically, we first trained You Only Look Once, an object detection AI, using 11,977 grain labels from 36 photos collected from nine different stream environments. We demonstrated its accuracy with a coefficient of determination of 0.98, a Nash–Sutcliffe efficiency of 0.98, and a mean absolute relative error of 6.65% in predicting the median grain size of 20 ground‐truth photos representing nine typical stream environments. The AI is then used to extract the grain size distributions and determine their characteristic grain sizes, including the 10th, 50th, 60th, and 84th percentiles, for 1,999 photos taken at 66 sites within a watershed in the Northwest US. The results indicate that the 10th, median, 60th, and 84th percentiles of the grain sizes follow log‐normal distributions, with most likely values of 2.49, 6.62, 7.68, and 10.78 cm, respectively. The average uncertainties associated with these values are 9.70%, 7.33%, 9.27%, and 11.11%, respectively. These data allow for the computation of the quantities, distributions, and uncertainties of streambed HBGC parameters, including Manning's coefficient, Darcy‐Weisbach friction factor, top layer interstitial velocity magnitude, and nitrate uptake velocity. Additionally, major sources of uncertainty in grain sizes and their impact on HBGC parameters are examined.

58 GEOSCIENCES↗
DOE OSTI2021

Attention Enabled Multi-Agent DRL for Decentralized Volt-VAR Control of Active Distribution System Using PV Inverters and SVCs

This paper proposes attention enabled multi-agent deep reinforcement learning (MADRL) framework for active distribution network decentralized Volt-VAR control. Using the unsupervised clustering, the whole distribution system can be decomposed into several sub-networks according to the voltage and reactive power sensitivity relationships. Then, the distributed control problem of each sub-network is modeled as Markov games and solved by the improved MADRL algorithm, where each sub-network is modeled as an adaptive agent. An attention mechanism is developed to help each agent focus on specific information that is mostly related to the reward. All agents are centrally trained offline to learn the optimal coordinated Volt-VAR control strategy and executed in a decentralized manner to make online decisions with only local information. Compared with other distributed control approaches, the proposed method can effectively deal with uncertainties, achieve fast decision makings, and significantly reduce the communication requirements. Comparison results with model-based and other data-driven methods on IEEE 33-bus and 123-bus systems demonstrate the benefits of the proposed approach.

distribution network↗
DOE OSTI2013

An Evaluation of Machine Learning Methods to Detect Malicious SCADA Communications

Critical infrastructure Supervisory Control and Data Acquisition (SCADA) systems were designed to operate on closed, proprietary networks where a malicious insider posed the greatest threat potential. The centralization of control and the movement towards open systems and standards has improved the efficiency of industrial control, but has also exposed legacy SCADA systems to security threats that they were not designed to mitigate. This work explores the viability of machine learning methods in detecting the new threat scenarios of command and data injection. Similar to network intrusion detection systems in the cyber security domain, the command and control communications in a critical infrastructure setting are monitored, and vetted against examples of benign and malicious command traffic, in order to identify potential attack events. Multiple learning methods are evaluated using a dataset of Remote Terminal Unit communications, which included both normal operations and instances of command and data injection attack scenarios.

critical infrastructure protection↗
DOE OSTI2024

Machine Learning for Real-time Fusion Plasma Behavior Prediction and Manipulation

This project set out with an ambitious goal: to develop and apply machine learning-based methods of discovering new controllers and operating regimes for achieving better performing plasmas in tokamaks. As summarized in the dozens of papers below, the project was a huge success. It developed several machine learning components and integrated them into a single ML system that was added to the DIII-D PCS. That functionality was demonstrated over a series of experiments on DIII-D. A summary of these results is given here with the details in the published papers below.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

DOE Final Report Machine Learning for Real-time Fusion Plasma Behavior Prediction and Manipulation

This project set out with an ambitious goal: to develop and apply machine learning-based methods of discovering new controllers and operating regimes for achieving better performing plasmas in tokamaks. As summarized in the dozens of papers below, the project was a huge success. It developed several machine learning components and integrated them into a single ML system that was added to the DIII-D PCS. That functionality was demonstrated over a series of experiments on DIII-D. A brief summary of these results is given here with the details in the published papers below.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

SAFE-OCC: A novelty detection framework for Convolutional Neural Network sensors and its application in process control

Herein we present a novelty detection framework for Convolutional Neural Network (CNN) sensors that we call Sensor-Activated Feature Extraction One-Class Classification (SAFE-OCC). We show that this framework enables the safe use of computer vision sensors in process control architectures. Emergent control applications use CNN models to map visual data to a state signal that can be interpreted by the controller. Incorporating such sensors introduces a significant system operation vulnerability because CNN sensors can exhibit high prediction errors when exposed to novel (abnormal) visual data. Unfortunately, identifying such novelties in real-time is nontrivial. To address this issue, the SAFE-OCC framework leverages the convolutional blocks of the CNN to create an effective feature space to conduct novelty detection using a desired one-class classification technique. This approach engenders a feature space that directly corresponds to that used by the CNN sensor and avoids the need to derive an independent latent space. We demonstrate the effectiveness of SAFE-OCC via simulated control environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Hardware-accelerated inference for real-time gravitational-wave astronomy

The field of transient astronomy has seen a revolution with the first gravitational-wave detections and the arrival of multi-messenger observations they enabled. Transformed by the first detection of binary black hole and binary neutron star mergers, computational demands in gravitational-wave astronomy are expected to grow by at least a factor of two over the next five years as the global network of kilometer-scale interferometers are brought to design sensitivity. With the increase in detector sensitivity, real-time delivery of gravitational-wave alerts will become increasingly important as an enabler of multi-messenger followup. In this work, we report a novel implementation and deployment of deep learning inference for real-time gravitational-wave data denoising and astrophysical source identification. This is accomplished using a generic Inference-as-a-Service model that is capable of adapting to the future needs of gravitational-wave data analysis. Overall, our implementation allows seamless incorporation of hardware accelerators and also enables the use of commercial or private (dedicated) as-a-service computing. Based on our results, we propose a paradigm shift in low-latency and offline computing in gravitational-wave astronomy. Such a shift can address key challenges in peak-usage, scalability and reliability, and provide a data analysis platform particularly optimized for deep learning applications. The achieved sub-millisecond scale latency will also be relevant for any machine learning-based real-time control systems that may be invoked in the operation of near-future and next generation ground-based laser interferometers, as well as the front-end collection, distribution and processing of data from such instruments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Machine Learning-Assisted Stability Boundary Determination of Multiport Autonomous Reconfigurable Solar Power Plants

The multiport autonomous reconfigurable solar (MARS) power plant is a promising solution to integrate renewable resources and energy storage systems into the alternating current (ac) power grid and an high-voltage direct current (HVdc) link. In the MARS system, various input power sources are connected to the individual submodules (SMs) through direct current (dc)–dc converters. However, the presence of external power sources can result in unbalanced capacitor voltages of SMs, thereby violating stability constraints under multiple/diverse operating conditions. This article aims to address the gap by accurately determining the stability boundary of the MARS system. As such, a novel machine learning (ML)-assisted energy balancing control (EBC) criterion is proposed. Further, in conjunction with a refined EBC, this approach ensures balanced capacitor voltages across various types of SMs, significantly enhancing the overall system efficiency. The proposed EBC criterion effectively controls EBC activation and deactivation, achieving remarkable accuracy. Both power systems computer aided design (PSCAD)/electromagnetic transients including direct current (EMTDC) simulations and control hardware-in-the-loop (cHIL) tests are conducted to validate the feasibility and efficiency of the proposed method. By combining the EBC and ML-assisted EBC criterion, efficient energy management is achieved for systems featuring multiple input power sources, such as MARS. This approach enables the system to fully exploit its potential across an expanded operational range while upholding high-efficiency standards.

14 SOLAR ENERGY↗
DOE OSTI2022

HE Production Update at JLab - Introducing an Enhanced Nitrogen Purge for Clean String Assembly

A major limitation to cryomodule performance is field emission caused by particulates within the superconducting cavities. To reduce contamination of the inner surfaces during assembly in a cleanroom, the whole string can be connected to a purge system, which maintains a constant overpressure of dry, clean nitrogen gas. Following successes of similar systems at XFEL and Fermilab, Jefferson Lab followed this example for the production of LCLS-II HE cryomodules. Implementing this system required new procedures, infrastructure, and hardware, as well as significant testing of the system before production began. This paper will summarize the implemented controls and procedures, including lessons learned from Fermilab, as well as the results of mock-up tests. Based on the latter, the system was used to assemble the first article string in April 2022, and was also used during a rework required due to issues with cold FPC ceramics two months later. The benefits of using a purge system with regards to procedure, time savings, and added flexibility for potential rework have already proven to provide a significant improvement for the production of LCLS-II-HE cryomodules at Jefferson Lab.

Owen, P. D.↗
DOE OSTI2020

First Ever Polymer Flood Field Pilot To Enhance The Recovery Of Heavy Oils On Alaska’s North Slope - Pushing Ahead One Year Later

In June 2018 the team embarked on an ambitious project to address the slow development pace of Alaska’s 20+ billion barrels heavy oil resource via the first ever polymer flood pilot. Following the successful commencement of the pilot in August 2018, the field demonstration, supporting laboratory experiments and numerical simulation have steadily progressed. A significant amount of valuable data and lessons learned have been collected, and are reported in this paper. The ongoing pilot and the research activities is making headway toward the primary objective of validating the use of polymer flooding for extracting heavy oil in Alaska’s challenging environment. The pilot is conducted in two pre-existing pairs of horizontal injectors and producers in an isolated fault block of the Schrader Bluff heavy oil reservoir at the Milne Point Field. A customized polymer blending and pumping unit injects HPAM polymer at a concentration of 1,750 ppm to achieve a target viscosity of 45 cP. Supporting coreflood laboratory experiments have focused on quantification of polymer retention in the rock, and effect of injection water salinity, polymer, and their combinations on oil recovery. The injection and production response of the pilot flood pattern is utilized to develop a history matched reservoir simulation model for forecasting oil recovery beyond the pilot. Finally, specially designed laboratory experiments address anticipated operating concerns regarding post-polymer breakthrough such as oil-water separation efficiency and polymer induced fouling of heater tubes. Polymer has been injected continuously since startup except for two short equipment modification shutdowns, and more recently a prolonged disruption due to polymer hydration issues at the J-pad field site. Cumulatively, over 600,000 lbs. of polymer has been injected, corresponding to ~7%PV. The two producers show significant decrease in the water cut, gradually increasing oil rate, and no polymer breakthrough. Two main observations from the coreflood are a significant uncertainty in polymer retention values, and positive oil recovery response to low salinity water (2,600 mg/liter TDS). The heterogeneity in the flood pattern presents some challenges in obtaining a robust history matched simulation model. Experimental results on produced fluids treatment indicate the formation of a dense polymer deposit, at certain conditions, on heating tubes that can negatively impact the heat transfer efficiency. The scientific knowledge, including the lessons learned during unanticipated shutdowns, quality control, logistics and field data that is being acquired from this effort has referential value for other planned EOR projects. Finally, by all indications, the polymer field pilot is steadily progressing toward achieving the ultimate goal of unlocking the massive heavy oil resources on Alaska North Slope (ANS).

Dandekar, Abhijit↗
DOE OSTI2018

Advanced Instrumentation for Transient Reactor Testing

Transient testing involves placing fuel or material into the core of specialized materials test reactors that are capable of simulating a range of design basis accidents, including reactivity insertion accidents, that require the reactor produce short bursts of intense highpower neutron flux and gamma radiation. Testing fuel behavior in a prototypic neutron environment under high-power, accident-simulation conditions is a key step in licensing nuclear fuels for use in existing and future nuclear power plants. Transient testing of nuclear fuels is needed to develop and prove the safety basis for advanced reactors and fuels. In addition, modern fuel development and design increasingly relies on modeling and simulation efforts that must be informed and validated using specially designed material performance separate effects studies. These studies will require experimental facilities that are able to support variable scale, highly instrumented tests providing data that have appropriate spatial and temporal resolution. Finally, there are efforts now underway to develop advanced light water reactor (LWR) fuels with enhanced performance and accident tolerance. These advanced reactor designs will also require new fuel types. These new fuels need to be tested in a controlled environment in order to learn how they respond to accident conditions. For these applications, transient reactor testing is needed to help design fuels with improved performance. In order to maximize the value of transient testing, there is a need for in-situ transient realtime imaging technology (e.g., the neutron detection and imaging system like the hodoscope) to see fuel motion during rapid transient excursions with a higher degree of spatial and temporal resolution and accuracy. There also exists a need for new small, compact local sensors and instrumentation that are capable of collecting data during transients (e.g., local displacements, temperatures, thermal conductivity, neutron flux, etc.).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Operation, Manufacturing, and Supply Chain of Lithium-ion Batteries for Electric Vehicles

The US Department of Energy (DOE) has a rich history of funding key innovations in batteries through multiple programs, including the Energy Efficiency and Renewable Energy programs sponsored by the Vehicle Technologies Office and Advanced Manufacturing Office. These DOE-sponsored innovations have been critical in lowering the cost of lithium-ion batteries to less than $160/kWh and increasing their energy density to more than 250 Wh/kg, enhancing the nation’s electrification system and achieving higher degrees of decarbonization. These investments continue to be crucial for positioning the United States as the hub for the most cumulative battery R&D programs worldwide. However, major breakthroughs in battery manufacturing are still needed to enable an electrified future evolving to predominantly incorporate rechargeable lithium-ion batteries. This will require a strong battery manufacturing base that will not only enable cutting-edge advancements in materials and manufacturing sciences but will also allow the United States to become a world leader in this fast-growing area. This review aims at supporting DOE’s Advanced Technology Vehicle Manufacturing Loan Program to give technology background and information that can be used to develop the basis for loan topics and evaluate battery applications. Such a program can represent a significant stride toward reinforcing the US position in advanced manufacturing by introducing artificial intelligence, machine learning, and sensing and smart controls to facilitate, expedite, and lead the battery industry by 2030.

25 ENERGY STORAGE↗
DOE OSTI2021

BOOSTR: A Dataset for Accelerator Control Systems

The Booster Operation Optimization Sequential Time-series for Regression (BOOSTR) dataset was created to provide a cycle-by-cycle time series of readings and settings from instruments and controllable devices of the Booster, Fermilab’s Rapid-Cycling Synchrotron (RCS) operating at 15 Hz. BOOSTR provides a time series from 55 device readings and settings that pertain most directly to the high-precision regulation of the Booster’s gradient magnet power supply (GMPS). To our knowledge, this is one of the first well-documented datasets of accelerator device parameters made publicly available. We are releasing it in the hopes that it can be used to demonstrate aspects of artificial intelligence for advanced control systems, such as reinforcement learning and autonomous anomaly detection.

Kafkes, Diana (ORCID:000000021716463X)↗
DOE OSTI2023

A Data-Driven Framework for Direct Local Tensile Property Prediction of Laser Powder Bed Fusion Parts

This article proposes a generalizable, data-driven framework for qualifying laser powder bed fusion additively manufactured parts using part-specific in situ data, including powder bed imaging, machine health sensors, and laser scan paths. To achieve part qualification without relying solely on statistical processes or feedstock control, a sequence of machine learning models was trained on 6299 tensile specimens to locally predict the tensile properties of stainless-steel parts based on fused multi-modal in situ sensor data and a priori information. A cyberphysical infrastructure enabled the robust spatial tracking of individual specimens, and computer vision techniques registered the ground truth tensile measurements to the in situ data. The co-registered 230 GB dataset used in this work has been publicly released and is available as a set of HDF5 files. The extensive training data requirements and wide range of size scales were addressed by combining deep learning, machine learning, and feature engineering algorithms in a relay. The trained models demonstrated a 61% error reduction in ultimate tensile strength predictions relative to estimates made without any in situ information. Lessons learned and potential improvements to the sensors and mechanical testing procedure are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Transforming Energy through Computational Science: Computing for Clean Energy

This fact sheet discusses the opportunity space for NREL's computational science capabilities to address national clean energy objectives. Achieving a carbon-free power sector by 2035 as a step towards a decarbonized U.S. energy economy in 2050 will require major advances in power generation, autonomous energy systems, transportation, and buildings/communities. Development of integrated modeling approaches for complex energy systems will be essential for deployment. Success requires developments in optimization and control theory, complemented by machine learning (ML) and artificial intelligence (AI), all of which in turn need targeted investments in breadth and scale of computing. This document defines an opportunity space where: embracing computing can link established research and development (R&D) to a decarbonization agenda; pursuing emerging approaches can accelerate the pace of technology advancement across the portfolio; and leading by example could reduce the carbon footprint of computing worldwide.

advanced computing↗
DOE OSTI2021

BOOSTR: A Dataset for Accelerator Control Systems

The Booster Operation Optimization Sequential Time-series for Regression (BOOSTR) dataset was created to provide a cycle-by-cycle time series of readings and settings from instruments and controllable devices of the Booster, Fermilab's Rapid-Cycling Synchrotron (RCS) operating at 15~Hz. BOOSTR provides a time series from 55 device readings and settings that pertain most directly to the high-precision regulation of the Booster's gradient magnet power supply (GMPS). To our knowledge, this is one of the first well-documented datasets of accelerator device parameters made publicly available. We are releasing it in the hopes that it can be used to demonstrate aspects of artificial intelligence for advanced control systems, such as reinforcement learning and autonomous anomaly detection.

43 PARTICLE ACCELERATORS↗