Search NASA⌕ Search

SEARCH · Search NASA

Results for “Operator learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

A Cooperative Multi-Agent Deep Reinforcement Learning Framework for Real-Time Residential Load Scheduling

Internet-of-Things (IoT) enabled monitoring and control capabilities are enabling increasing numbers of household users with controllable loads to actively participate in smart grid energy management. Realizing an efficient real-time energy management system that takes advantage of these developments requires novel techniques for managing the increased complexity of the control action space in resolving multiple challenges such as the uncertainty in energy prices and renewable energy output along with the need to satisy physical grid constraints such as transformer capacity. Addressing these challenges, we develop a multi-household energy management framework for residential units connected to the same transformer and containing DERs such as PV, ESS and controllable loads. The goal of our framework is to schedule controllable household appliances and ESS such that the cost of procuring electricity from the utility over a horizon is minimized while physical grid constraints are satisfied at each scheduling step. Traditional energy management frameworks either perform global optimization to satisfy grid constraints but suffer from high computational complexity (for example Integer Program, Mixed Integer Programming frameworks and centralized reinforcement learning) or perform decentralized real-time energy management without satisfying global grid constraints (for example multi-agent reinforcement learning with no cooperation). In contrast, we propose a cooperative multiagent reinforcement learning (MARL) framework that i) operates in real-time, and ii) performs explicit collaboration to satisfy global grid constraints. The novelty in our framework is two fold. Firstly, our framework trains multiple independent learners (IL) for each household in parallel using historical data and performs real-time inferencing of control actions using the most recent system state. Secondly, our framework contains a low complexity knapsack based cooperation agent which combines the outputs of ILs to minimize cost while satisfying grid constraints. Simulation results show that our cooperative MARL approach achieves significant cost improvement over centralized reinforcement learning and day-ahead planning baselines. Moreover, our approach strictly satisfies physical constraints with no apriori knowledge of system dynamics while the baseline approaches have occasional violations. We also measure the training and inference time by ranging the number of households from 1 to 25. Results show that our cooperative MARL approach scales best among various approaches.

14 SOLAR ENERGY↗
DOE OSTI2024

Taking learning to another level

As a technical project manager at Los Alamos National Laboratory, Scott Boise works on programs and projects that make a big impact. Although he spends most of his days in a quiet office, he also makes a big impact on his team. He's well-known for his character and integrity because of the way he develops leadership skills on the team, promotes respect for others and lives a commitment to learning. Scott joined the Lab in June 2021, the period of the COVID-19 pandemic when most new employees began their careers without ever having stepped foot on-site. That experience has continued to serve as a reminder to him that new employees face numerous challenges no matter how and when they start. He's made it his aim to do what he can to lift some of that load. Coming to the Lab from a career in the biomedical industry, Scott arrived with years of project management experience but without a deep understanding of nuclear operations. His dedication to continuous learning has helped him pursue experiential opportunities and ask the proper questions to understand his role.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2019

CO 2 Leakage During EOR Operations – Analog Studies to Geologic Storage of CO 2

This study focuses on CO 2 EOR operations and CO 2 geologic storage in saline-bearing formations; both individually and in relation to each other. This study is the third of three that evaluate analog industries of CO 2 storage (first focuses on underground natural gas storage and second on deep well waste disposal using U.S. EPA UIC Class I wells). Several pieces of information can be found throughout the study including overview of CO 2 EOR history and side-by-side comparisons of major synergistic features between CO 2 EOR and CO 2 storage in saline-bearing formations. Best practices and lessons learned from CO 2 EOR operations can provide perspective from which future CO 2 storage R&D pursuits and field projects can benefit. A summary document providing a high-level overview and key takeaways of this study is available on NETL’s website under the Collection Name: NETL’s Analog Studies to Geologic Storage of CO 2 .

58 GEOSCIENCES↗
DOE OSTI2020

Machine Learning-Based PV Reserve Determination Strategy for Frequency Control on the WECC System

Frequency control from photovoltaic (PV) power plants has great potential to address the frequency response challenge of the power system with high penetrations of renewable generation. Using model-based approaches to determine the optimal PV headroom reserve, however, requires significant online computation and is intractable for an interconnection level system. This paper proposes a machine learning based strategy, that is suitable for real-time operation, to determine the optimal PV reserve for frequency control. The proposed machine learning algorithm is trained and tested on 1,987 offline simulations of a 60% renewable penetration Western Electricity Coordinating Council (WECC) system. Furthermore, the proposed reserve determination strategy is applied on a realistic 1-day operation profile of the WECC system and demonstrates a savings of more than 40% PV headroom compared to a conservative approach. It is evident that the proposed strategy can efficiently and effectively determine the optimal PV frequency control reserve for realistic interconnection systems.

frequency control↗
DOE OSTI2023

Lessons from commissioning and operations of the ICARUS cryogenic system at Fermilab

Results and lessons from three years of commissioning and operations of the cryogenic and purificationsystems of the ICARUS neutrino detector installed at the Fermilab are described. The detector uses liquid argon stored in two separate containers of about 275 m 3 each. The liquid argon must be kept in very stable thermal conditions, and the contamination of electronegative impurities must be consistently kept at small fractions of parts per billion. Since its fill in early 2020, the detector has been commissioned and then operated in neutrino beams at Fermilab for the search of sterile neutrinos and measurements of neutrino-argon cross sections. The results of operating the cryogenic and purification systems and lessons learned, including challenges in reaching the design electron lifetime in argon bath, operating and servicing liquid nitrogen and argon circulation pumps, argon condensers and purifiers, are described. Plans for future operations and list of recommendations are presented.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

A Multi-Objective Bayesian Optimized Human Assessed Multi-Target Generated Spectral Recommender System for Rapid Pareto Discoveries of Material Properties

Optimization for different tasks like material characterization, synthesis, and functional properties for desired applications over multi-dimensional control parameter and function spaces need a rapid strategic search through active learning. However, in all cases prior to optimization, the target material properties are assumed known and fixed, which mostly deviates from real-world scenarios in material synthesis. This can be critical for running expensive experiments on new materials, when the experimental results are fuzzy for any scientific outcomes due to improper target setting, ultimately wasting time and cost. The failure rate and cost are even higher over exploring on multi-target space, where we want to learn the pareto among multiple properties, to jointly optimize during material synthesis for desired applications. To address the challenge, here we introduce the human-operator attempt flexibility in the active learning based automated experiment framework, with generating multiple human assessed targets through a voting-based recommender system during real-time microscope measurements over the large material image space, sequentially learn/update multiple desired targets through a weighting system, and adaptively search in multiple material properties functional space for non-dominated pareto discoveries to maximize the custom structural similarity based acquisition function. We term this a multi-objective Bayesian optimized human assessed multi-target generated spectral recommender systems (MOBO-HAM-SRS). The approach has been demonstrated to peizoresponse force spectroscopy of a ferroelectric thin film, exploring with different kernels and acquisition functions. This work shows an advancement towards human-AI collaborated automated experiments, steering optimization trajectories through human overpowering AI at the early stage when uncertainty is high and AI overpowering human at the later stage with rapid exploration towards optimal goal, following human-assessed multiple targets properties.

Biswas, Arpan↗
DOE OSTI2025

Enhancing Autonomous Control of Microreactors Using Multi-Agent Reinforcement Learning

In order for microreactors to be economically competitive, operation costs will need to be minimized through some degree of autonomous control. Previous work has demonstrated the effectiveness of reinforcement learning (RL) for load-following control in a drum-controlled microreactor. This study extends that work by exploring the potential of RL to independently control each of the reactor’s drums. We compare a single-agent RL approach with a multi-agent RL (MARL) framework, testing them for generalization across different load-following power profiles and control timescales, and for robustness in cases of randomly disabled control drums. Since the point kinetics simulation environment used in this study cannot resolve spatial effects, we assume that in the absence of spatially localized disturbances, optimal drum movements should be symmetrical. We demonstrate that single-agent RL is able to achieve accurate performance only when symmetric actions are ignored; otherwise, it fails to train a useful controller. Meanwhile, the MARL framework performs symmetric actions by design and trains a robust, accurate agent, as evidenced by mean absolute errors in power matching of 0.41% for the training power profile, 0.68% for a profile with half the drums disabled, and 0.21% for a profile on a realistic load-following time horizon.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

A New Approach to Monitoring Solvent Extraction Processes for the Nuclear Industry

As part of an initiative to steward research, development, and innovation into the nuclear fuel cycle, Idaho National Laboratory is building the Beartooth testbed. Beartooth will include a cascade of centrifugal contactors, glove box lines, solidification, and dissolution equipment to aid in the progression of novel separation techniques and provide hands-on opportunities to early-career separation scientists. Beartooth will incorporate novel monitoring techniques using sensors and machine learning algorithms to inform a process operator of separation conditions. This research is examining monitoring technologies not typically used in nuclear separation processes such as acoustic microphones, accelerometers, infrared cameras, red-green-blue color sensors, among others. These sensors are being examined for their functionality within a separation process and their ability to detect applicable signals. Machine learning methods are being developed to determine their utility in detecting faults and alerting operators of expected and unexpected events. These methods have the potential to impact Safeguards by Design efforts and real-time decision making. This overview will detail preliminary results from acoustic, vibration, and color sensors.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Machine Learning for Scalable and Optimal Load Shedding Under Power System Contingency

Prompt and effective corrective actions in response to unexpected contingencies are crucial for improving power system resilience and preventing cascading blackouts. The optimal load shedding (OLS) accounting for network limits has the potential to address the diverse system-wide impacts of contingency scenarios as compared to traditional local schemes. However, due to the fast cascading propagation of initial contingencies, real-time OLS solutions are challenging to attain in large systems with high computation and communication needs. In this paper, we propose a decentralized design that leverages offline training of a neural network (NN) model for individual load centers to autonomously construct the OLS solutions from locally available measurements. Our learning-for-OLS approach can greatly reduce the computation and communication needs during online emergency responses, thus preventing the cascading propagation of contingencies for enhanced power grid resilience. Numerical studies on both the IEEE 118-bus system and a synthetic Texas 2000-bus system have demonstrated the efficiency and effectiveness of our scalable OLS learning design for timely power system emergency operations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2016

WE-DE-207A-00: Advances in Image-Guided Neurointerventions-Clinical Pull and Technology Push

1. Parallels in the evolution of x-ray angiographic systems and devices used for minimally invasive endovascular therapy Charles Strother - DSA, invented by Dr. Charles Mistretta at UW-Madison, was the technology which enabled the development of minimally invasive endovascular procedures. As DSA became widely available and the potential benefits for accessing the cerebral vasculature from an endovascular approach began to be apparent, industry began efforts to develop tools for use in these procedures. Along with development of catheters, embolic materials, pushable coils and the GDC coils there was simultaneous development and improvement of 2D DSA image quality and the introduction of 3D DSA. Together, these advances resulted in an enormous expansion in the scope and numbers of minimally invasive endovascular procedures. The introduction of flat detectors for c-arm angiographic systems in 2002 provided the possibility of the angiographic suite becoming not just a location for vascular imaging where physiological assessments might also be performed. Over the last decade algorithmic and hardware advances have been sufficient to now realize this potential in clinical practice. The selection of patients for endovascular treatments is enhanced by this dual capability. Along with these advances has been a steady reduction in the radiation exposure required so that today, vascular and soft tissue images may be obtained with equal or in many cases less radiation exposure than is the case for comparable images obtained with multi-detector CT. Learning Objectives: To understand the full capabilities of today’s angiographic suite To understand how c-arm cone beam CT soft tissue imaging can be used for assessments of devices, blood flow and perfusion. Advances in real-time x-ray neuro-endovascular image guidance Stephen Rudin - Reacting to the demands on real-time image guidance for ever finer neurovascular interventions, great improvements in imaging chains are being pursued. For the highest spatial and temporal resolution, x-ray guidance with fluoroscopy and angiography although dominant are still being vastly improved. New detectors such as the Micro-Angiographic Fluoroscope (MAF) and x-ray source designs that enable higher outputs while maintaining small focal spots will be highlighted along with new methods for minimizing the radiation dose to patients. Additionally, new platforms for training and device testing that include patient-specific 3D printed vascular phantoms and new metrics such as generalized relative object detectability for objectively inter-comparing systems will be discussed. This will improve the opportunity for better evaluation of these technological advances which should contribute to the safety and efficacy of image guided minimally invasive neuro-endovascular procedures. Learning Objectives: To understand the operation of new x-ray imaging chain components such as detectors and sources To be informed about the latest testing methods, with 3D printed vascular phantoms, and new evaluation metrics for advanced imaging in x-ray image guided neurovascular interventions Advances in cone beam CT anatomical and functional imaging in angio-suite to enable one-stop-shop stroke imaging workflow Guang-Hong Chen - The introduction of flat-panel detector based cone-beam CT in clinical angiographic imaging systems enabled treating physicians to obtain three-dimensional anatomic roadmaps for bony structure, soft brain tissue, and vasculatures for treatment planning and efficacy checking after the procedures. However, much improvement is needed to reduce image artifacts, reduce radiation dose, and add potential functional imaging capability to provide four-dimensional dynamic information of vasculature and brain perfusion. In this presentation, some of the new techniques developed to address radiation dose issues, image artifact reduction and brain perfusion using C-arm cone-beam CT imaging system will be introduced for the audience. Learning Objectives: To understand the clinical need of one-stop-shop stroke imaging workflow To understand to technical challenges in cone beam CT perfusion To understand the potential technical solutions to enable one-stop-shop imaging workflow Recent advances in devices used in neuro--interventions Mattew Gounis - Over the past two decades, there has been explosive development of medical devices that have revolutionized the endovascular treatment of cerebrovascular diseases. There is now Level 1, Class A evidence that intra-arterial, mechanical thrombectomy in acute ischemic stroke is superior to medical management; and similarly that minimally invasive, endovascular repair of ruptured brain aneurysms is superior to surgical treatment. Stent-retrievers are now standard of care for emergent large vessel occlusions causing a stroke, with a number of patients need to treat for good clinical outcomes as low as 4. Recent technologies such as flow diverters and disrupters, intracranial self-expanding stents, flexible large bore catheters that can reach vessels beyond the circle of Willis, stent-retrievers, and super-compliant balloons are the result of successful miniaturization of design features and novel manufacturing technologies capable of building these devices. This is a rapidly evolving field, and the device technology enabling such advancements will be reviewed. Importantly, image-guidance technology has not kept pace in neurointervention and the ability to adequately characterize these devices in vivo remains a significant opportunity. Learning Objectives: A survey of devices used in neurointerventions, their materials and essential design characteristics Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; G. Chen, Funding received from NIH; funding received from DOD; funding received from GE Healthcare; funding received from Siemens AX.; M. Gounis, consultant for Codman Neurovascular and Stryker Neurovascular; Holds stock in InNeuroCo Inc, research grants: NIH, Medtronic Neurovascular, Microvention/Terumo, Cerevasc LLC, Gentuity, Codman Neurovascular, Philips Healthcare, Stryker Neurovascular, Tay Sachs Foundation, and InNeuroCo Inc.; S. Rudin, Supported in part by NIH Grant R01EB002873 and the Toshiba Medical System Corp.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

WE-DE-207A-01: Parallels in the Evolution of X-Ray Angiographic Systems and Devices Used for Minimally Invasive Endovascular Therapy

1. Parallels in the evolution of x-ray angiographic systems and devices used for minimally invasive endovascular therapy Charles Strother - DSA, invented by Dr. Charles Mistretta at UW-Madison, was the technology which enabled the development of minimally invasive endovascular procedures. As DSA became widely available and the potential benefits for accessing the cerebral vasculature from an endovascular approach began to be apparent, industry began efforts to develop tools for use in these procedures. Along with development of catheters, embolic materials, pushable coils and the GDC coils there was simultaneous development and improvement of 2D DSA image quality and the introduction of 3D DSA. Together, these advances resulted in an enormous expansion in the scope and numbers of minimally invasive endovascular procedures. The introduction of flat detectors for c-arm angiographic systems in 2002 provided the possibility of the angiographic suite becoming not just a location for vascular imaging where physiological assessments might also be performed. Over the last decade algorithmic and hardware advances have been sufficient to now realize this potential in clinical practice. The selection of patients for endovascular treatments is enhanced by this dual capability. Along with these advances has been a steady reduction in the radiation exposure required so that today, vascular and soft tissue images may be obtained with equal or in many cases less radiation exposure than is the case for comparable images obtained with multi-detector CT. Learning Objectives: To understand the full capabilities of today’s angiographic suite To understand how c-arm cone beam CT soft tissue imaging can be used for assessments of devices, blood flow and perfusion. Advances in real-time x-ray neuro-endovascular image guidance Stephen Rudin - Reacting to the demands on real-time image guidance for ever finer neurovascular interventions, great improvements in imaging chains are being pursued. For the highest spatial and temporal resolution, x-ray guidance with fluoroscopy and angiography although dominant are still being vastly improved. New detectors such as the Micro-Angiographic Fluoroscope (MAF) and x-ray source designs that enable higher outputs while maintaining small focal spots will be highlighted along with new methods for minimizing the radiation dose to patients. Additionally, new platforms for training and device testing that include patient-specific 3D printed vascular phantoms and new metrics such as generalized relative object detectability for objectively inter-comparing systems will be discussed. This will improve the opportunity for better evaluation of these technological advances which should contribute to the safety and efficacy of image guided minimally invasive neuro-endovascular procedures. Learning Objectives: To understand the operation of new x-ray imaging chain components such as detectors and sources To be informed about the latest testing methods, with 3D printed vascular phantoms, and new evaluation metrics for advanced imaging in x-ray image guided neurovascular interventions Advances in cone beam CT anatomical and functional imaging in angio-suite to enable one-stop-shop stroke imaging workflow Guang-Hong Chen - The introduction of flat-panel detector based cone-beam CT in clinical angiographic imaging systems enabled treating physicians to obtain three-dimensional anatomic roadmaps for bony structure, soft brain tissue, and vasculatures for treatment planning and efficacy checking after the procedures. However, much improvement is needed to reduce image artifacts, reduce radiation dose, and add potential functional imaging capability to provide four-dimensional dynamic information of vasculature and brain perfusion. In this presentation, some of the new techniques developed to address radiation dose issues, image artifact reduction and brain perfusion using C-arm cone-beam CT imaging system will be introduced for the audience. Learning Objectives: To understand the clinical need of one-stop-shop stroke imaging workflow To understand to technical challenges in cone beam CT perfusion To understand the potential technical solutions to enable one-stop-shop imaging workflow Recent advances in devices used in neuro--interventions Mattew Gounis - Over the past two decades, there has been explosive development of medical devices that have revolutionized the endovascular treatment of cerebrovascular diseases. There is now Level 1, Class A evidence that intra-arterial, mechanical thrombectomy in acute ischemic stroke is superior to medical management; and similarly that minimally invasive, endovascular repair of ruptured brain aneurysms is superior to surgical treatment. Stent-retrievers are now standard of care for emergent large vessel occlusions causing a stroke, with a number of patients need to treat for good clinical outcomes as low as 4. Recent technologies such as flow diverters and disrupters, intracranial self-expanding stents, flexible large bore catheters that can reach vessels beyond the circle of Willis, stent-retrievers, and super-compliant balloons are the result of successful miniaturization of design features and novel manufacturing technologies capable of building these devices. This is a rapidly evolving field, and the device technology enabling such advancements will be reviewed. Importantly, image-guidance technology has not kept pace in neurointervention and the ability to adequately characterize these devices in vivo remains a significant opportunity. Learning Objectives: A survey of devices used in neurointerventions, their materials and essential design characteristics Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; G. Chen, Funding received from NIH; funding received from DOD; funding received from GE Healthcare; funding received from Siemens AX.; M. Gounis, consultant for Codman Neurovascular and Stryker Neurovascular; Holds stock in InNeuroCo Inc, research grants: NIH, Medtronic Neurovascular, Microvention/Terumo, Cerevasc LLC, Gentuity, Codman Neurovascular, Philips Healthcare, Stryker Neurovascular, Tay Sachs Foundation, and InNeuroCo Inc.; S. Rudin, Supported in part by NIH Grant R01EB002873 and the Toshiba Medical System Corp.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

WE-DE-207A-02: Advances in Cone Beam CT Anatomical and Functional Imaging in Angio-Suite to Enable One-Stop-Shop Stroke Imaging Workflow

1. Parallels in the evolution of x-ray angiographic systems and devices used for minimally invasive endovascular therapy Charles Strother - DSA, invented by Dr. Charles Mistretta at UW-Madison, was the technology which enabled the development of minimally invasive endovascular procedures. As DSA became widely available and the potential benefits for accessing the cerebral vasculature from an endovascular approach began to be apparent, industry began efforts to develop tools for use in these procedures. Along with development of catheters, embolic materials, pushable coils and the GDC coils there was simultaneous development and improvement of 2D DSA image quality and the introduction of 3D DSA. Together, these advances resulted in an enormous expansion in the scope and numbers of minimally invasive endovascular procedures. The introduction of flat detectors for c-arm angiographic systems in 2002 provided the possibility of the angiographic suite becoming not just a location for vascular imaging where physiological assessments might also be performed. Over the last decade algorithmic and hardware advances have been sufficient to now realize this potential in clinical practice. The selection of patients for endovascular treatments is enhanced by this dual capability. Along with these advances has been a steady reduction in the radiation exposure required so that today, vascular and soft tissue images may be obtained with equal or in many cases less radiation exposure than is the case for comparable images obtained with multi-detector CT. Learning Objectives: To understand the full capabilities of today’s angiographic suite To understand how c-arm cone beam CT soft tissue imaging can be used for assessments of devices, blood flow and perfusion. Advances in real-time x-ray neuro-endovascular image guidance Stephen Rudin - Reacting to the demands on real-time image guidance for ever finer neurovascular interventions, great improvements in imaging chains are being pursued. For the highest spatial and temporal resolution, x-ray guidance with fluoroscopy and angiography although dominant are still being vastly improved. New detectors such as the Micro-Angiographic Fluoroscope (MAF) and x-ray source designs that enable higher outputs while maintaining small focal spots will be highlighted along with new methods for minimizing the radiation dose to patients. Additionally, new platforms for training and device testing that include patient-specific 3D printed vascular phantoms and new metrics such as generalized relative object detectability for objectively inter-comparing systems will be discussed. This will improve the opportunity for better evaluation of these technological advances which should contribute to the safety and efficacy of image guided minimally invasive neuro-endovascular procedures. Learning Objectives: To understand the operation of new x-ray imaging chain components such as detectors and sources To be informed about the latest testing methods, with 3D printed vascular phantoms, and new evaluation metrics for advanced imaging in x-ray image guided neurovascular interventions Advances in cone beam CT anatomical and functional imaging in angio-suite to enable one-stop-shop stroke imaging workflow Guang-Hong Chen - The introduction of flat-panel detector based cone-beam CT in clinical angiographic imaging systems enabled treating physicians to obtain three-dimensional anatomic roadmaps for bony structure, soft brain tissue, and vasculatures for treatment planning and efficacy checking after the procedures. However, much improvement is needed to reduce image artifacts, reduce radiation dose, and add potential functional imaging capability to provide four-dimensional dynamic information of vasculature and brain perfusion. In this presentation, some of the new techniques developed to address radiation dose issues, image artifact reduction and brain perfusion using C-arm cone-beam CT imaging system will be introduced for the audience. Learning Objectives: To understand the clinical need of one-stop-shop stroke imaging workflow To understand to technical challenges in cone beam CT perfusion To understand the potential technical solutions to enable one-stop-shop imaging workflow Recent advances in devices used in neuro--interventions Mattew Gounis - Over the past two decades, there has been explosive development of medical devices that have revolutionized the endovascular treatment of cerebrovascular diseases. There is now Level 1, Class A evidence that intra-arterial, mechanical thrombectomy in acute ischemic stroke is superior to medical management; and similarly that minimally invasive, endovascular repair of ruptured brain aneurysms is superior to surgical treatment. Stent-retrievers are now standard of care for emergent large vessel occlusions causing a stroke, with a number of patients need to treat for good clinical outcomes as low as 4. Recent technologies such as flow diverters and disrupters, intracranial self-expanding stents, flexible large bore catheters that can reach vessels beyond the circle of Willis, stent-retrievers, and super-compliant balloons are the result of successful miniaturization of design features and novel manufacturing technologies capable of building these devices. This is a rapidly evolving field, and the device technology enabling such advancements will be reviewed. Importantly, image-guidance technology has not kept pace in neurointervention and the ability to adequately characterize these devices in vivo remains a significant opportunity. Learning Objectives: A survey of devices used in neurointerventions, their materials and essential design characteristics Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; G. Chen, Funding received from NIH; funding received from DOD; funding received from GE Healthcare; funding received from Siemens AX.; M. Gounis, consultant for Codman Neurovascular and Stryker Neurovascular; Holds stock in InNeuroCo Inc, research grants: NIH, Medtronic Neurovascular, Microvention/Terumo, Cerevasc LLC, Gentuity, Codman Neurovascular, Philips Healthcare, Stryker Neurovascular, Tay Sachs Foundation, and InNeuroCo Inc.; S. Rudin, Supported in part by NIH Grant R01EB002873 and the Toshiba Medical System Corp.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

WE-DE-207A-03: Recent Advances in Devices Used in Neuro--Interventions

1. Parallels in the evolution of x-ray angiographic systems and devices used for minimally invasive endovascular therapy Charles Strother - DSA, invented by Dr. Charles Mistretta at UW-Madison, was the technology which enabled the development of minimally invasive endovascular procedures. As DSA became widely available and the potential benefits for accessing the cerebral vasculature from an endovascular approach began to be apparent, industry began efforts to develop tools for use in these procedures. Along with development of catheters, embolic materials, pushable coils and the GDC coils there was simultaneous development and improvement of 2D DSA image quality and the introduction of 3D DSA. Together, these advances resulted in an enormous expansion in the scope and numbers of minimally invasive endovascular procedures. The introduction of flat detectors for c-arm angiographic systems in 2002 provided the possibility of the angiographic suite becoming not just a location for vascular imaging where physiological assessments might also be performed. Over the last decade algorithmic and hardware advances have been sufficient to now realize this potential in clinical practice. The selection of patients for endovascular treatments is enhanced by this dual capability. Along with these advances has been a steady reduction in the radiation exposure required so that today, vascular and soft tissue images may be obtained with equal or in many cases less radiation exposure than is the case for comparable images obtained with multi-detector CT. Learning Objectives: To understand the full capabilities of today’s angiographic suite To understand how c-arm cone beam CT soft tissue imaging can be used for assessments of devices, blood flow and perfusion. Advances in real-time x-ray neuro-endovascular image guidance Stephen Rudin - Reacting to the demands on real-time image guidance for ever finer neurovascular interventions, great improvements in imaging chains are being pursued. For the highest spatial and temporal resolution, x-ray guidance with fluoroscopy and angiography although dominant are still being vastly improved. New detectors such as the Micro-Angiographic Fluoroscope (MAF) and x-ray source designs that enable higher outputs while maintaining small focal spots will be highlighted along with new methods for minimizing the radiation dose to patients. Additionally, new platforms for training and device testing that include patient-specific 3D printed vascular phantoms and new metrics such as generalized relative object detectability for objectively inter-comparing systems will be discussed. This will improve the opportunity for better evaluation of these technological advances which should contribute to the safety and efficacy of image guided minimally invasive neuro-endovascular procedures. Learning Objectives: To understand the operation of new x-ray imaging chain components such as detectors and sources To be informed about the latest testing methods, with 3D printed vascular phantoms, and new evaluation metrics for advanced imaging in x-ray image guided neurovascular interventions Advances in cone beam CT anatomical and functional imaging in angio-suite to enable one-stop-shop stroke imaging workflow Guang-Hong Chen - The introduction of flat-panel detector based cone-beam CT in clinical angiographic imaging systems enabled treating physicians to obtain three-dimensional anatomic roadmaps for bony structure, soft brain tissue, and vasculatures for treatment planning and efficacy checking after the procedures. However, much improvement is needed to reduce image artifacts, reduce radiation dose, and add potential functional imaging capability to provide four-dimensional dynamic information of vasculature and brain perfusion. In this presentation, some of the new techniques developed to address radiation dose issues, image artifact reduction and brain perfusion using C-arm cone-beam CT imaging system will be introduced for the audience. Learning Objectives: To understand the clinical need of one-stop-shop stroke imaging workflow To understand to technical challenges in cone beam CT perfusion To understand the potential technical solutions to enable one-stop-shop imaging workflow Recent advances in devices used in neuro--interventions Mattew Gounis - Over the past two decades, there has been explosive development of medical devices that have revolutionized the endovascular treatment of cerebrovascular diseases. There is now Level 1, Class A evidence that intra-arterial, mechanical thrombectomy in acute ischemic stroke is superior to medical management; and similarly that minimally invasive, endovascular repair of ruptured brain aneurysms is superior to surgical treatment. Stent-retrievers are now standard of care for emergent large vessel occlusions causing a stroke, with a number of patients need to treat for good clinical outcomes as low as 4. Recent technologies such as flow diverters and disrupters, intracranial self-expanding stents, flexible large bore catheters that can reach vessels beyond the circle of Willis, stent-retrievers, and super-compliant balloons are the result of successful miniaturization of design features and novel manufacturing technologies capable of building these devices. This is a rapidly evolving field, and the device technology enabling such advancements will be reviewed. Importantly, image-guidance technology has not kept pace in neurointervention and the ability to adequately characterize these devices in vivo remains a significant opportunity. Learning Objectives: A survey of devices used in neurointerventions, their materials and essential design characteristics Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; G. Chen, Funding received from NIH; funding received from DOD; funding received from GE Healthcare; funding received from Siemens AX.; M. Gounis, consultant for Codman Neurovascular and Stryker Neurovascular; Holds stock in InNeuroCo Inc, research grants: NIH, Medtronic Neurovascular, Microvention/Terumo, Cerevasc LLC, Gentuity, Codman Neurovascular, Philips Healthcare, Stryker Neurovascular, Tay Sachs Foundation, and InNeuroCo Inc.; S. Rudin, Supported in part by NIH Grant R01EB002873 and the Toshiba Medical System Corp.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

WE-DE-207A-04: Advances in Radiological Neuro-Endovascular Interventional Imaging

1. Parallels in the evolution of x-ray angiographic systems and devices used for minimally invasive endovascular therapy Charles Strother - DSA, invented by Dr. Charles Mistretta at UW-Madison, was the technology which enabled the development of minimally invasive endovascular procedures. As DSA became widely available and the potential benefits for accessing the cerebral vasculature from an endovascular approach began to be apparent, industry began efforts to develop tools for use in these procedures. Along with development of catheters, embolic materials, pushable coils and the GDC coils there was simultaneous development and improvement of 2D DSA image quality and the introduction of 3D DSA. Together, these advances resulted in an enormous expansion in the scope and numbers of minimally invasive endovascular procedures. The introduction of flat detectors for c-arm angiographic systems in 2002 provided the possibility of the angiographic suite becoming not just a location for vascular imaging where physiological assessments might also be performed. Over the last decade algorithmic and hardware advances have been sufficient to now realize this potential in clinical practice. The selection of patients for endovascular treatments is enhanced by this dual capability. Along with these advances has been a steady reduction in the radiation exposure required so that today, vascular and soft tissue images may be obtained with equal or in many cases less radiation exposure than is the case for comparable images obtained with multi-detector CT. Learning Objectives: To understand the full capabilities of today’s angiographic suite To understand how c-arm cone beam CT soft tissue imaging can be used for assessments of devices, blood flow and perfusion. Advances in real-time x-ray neuro-endovascular image guidance Stephen Rudin - Reacting to the demands on real-time image guidance for ever finer neurovascular interventions, great improvements in imaging chains are being pursued. For the highest spatial and temporal resolution, x-ray guidance with fluoroscopy and angiography although dominant are still being vastly improved. New detectors such as the Micro-Angiographic Fluoroscope (MAF) and x-ray source designs that enable higher outputs while maintaining small focal spots will be highlighted along with new methods for minimizing the radiation dose to patients. Additionally, new platforms for training and device testing that include patient-specific 3D printed vascular phantoms and new metrics such as generalized relative object detectability for objectively inter-comparing systems will be discussed. This will improve the opportunity for better evaluation of these technological advances which should contribute to the safety and efficacy of image guided minimally invasive neuro-endovascular procedures. Learning Objectives: To understand the operation of new x-ray imaging chain components such as detectors and sources To be informed about the latest testing methods, with 3D printed vascular phantoms, and new evaluation metrics for advanced imaging in x-ray image guided neurovascular interventions Advances in cone beam CT anatomical and functional imaging in angio-suite to enable one-stop-shop stroke imaging workflow Guang-Hong Chen - The introduction of flat-panel detector based cone-beam CT in clinical angiographic imaging systems enabled treating physicians to obtain three-dimensional anatomic roadmaps for bony structure, soft brain tissue, and vasculatures for treatment planning and efficacy checking after the procedures. However, much improvement is needed to reduce image artifacts, reduce radiation dose, and add potential functional imaging capability to provide four-dimensional dynamic information of vasculature and brain perfusion. In this presentation, some of the new techniques developed to address radiation dose issues, image artifact reduction and brain perfusion using C-arm cone-beam CT imaging system will be introduced for the audience. Learning Objectives: To understand the clinical need of one-stop-shop stroke imaging workflow To understand to technical challenges in cone beam CT perfusion To understand the potential technical solutions to enable one-stop-shop imaging workflow Recent advances in devices used in neuro--interventions Mattew Gounis - Over the past two decades, there has been explosive development of medical devices that have revolutionized the endovascular treatment of cerebrovascular diseases. There is now Level 1, Class A evidence that intra-arterial, mechanical thrombectomy in acute ischemic stroke is superior to medical management; and similarly that minimally invasive, endovascular repair of ruptured brain aneurysms is superior to surgical treatment. Stent-retrievers are now standard of care for emergent large vessel occlusions causing a stroke, with a number of patients need to treat for good clinical outcomes as low as 4. Recent technologies such as flow diverters and disrupters, intracranial self-expanding stents, flexible large bore catheters that can reach vessels beyond the circle of Willis, stent-retrievers, and super-compliant balloons are the result of successful miniaturization of design features and novel manufacturing technologies capable of building these devices. This is a rapidly evolving field, and the device technology enabling such advancements will be reviewed. Importantly, image-guidance technology has not kept pace in neurointervention and the ability to adequately characterize these devices in vivo remains a significant opportunity. Learning Objectives: A survey of devices used in neurointerventions, their materials and essential design characteristics Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; G. Chen, Funding received from NIH; funding received from DOD; funding received from GE Healthcare; funding received from Siemens AX.; M. Gounis, consultant for Codman Neurovascular and Stryker Neurovascular; Holds stock in InNeuroCo Inc, research grants: NIH, Medtronic Neurovascular, Microvention/Terumo, Cerevasc LLC, Gentuity, Codman Neurovascular, Philips Healthcare, Stryker Neurovascular, Tay Sachs Foundation, and InNeuroCo Inc.; S. Rudin, Supported in part by NIH Grant R01EB002873 and the Toshiba Medical System Corp.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Concrete Thermal Energy Storage Enabling Flexible Operation without Coal Plant Cycling

The work described in this report is responsive to the Office of Fossil Energy program “Energy Storage for Fossil Power Generation.” The pilot plant built as a result of this project demonstrated the feasibility and performance of a concrete thermal energy storage (CTES) system integrated with a supercritical coal power plant. The 10 MWh electrical (>25 MWh thermal) CTES unit, developed by Storworks Power, was designed to enable flexible operation of coal plants without cycling damage. The project's key technical achievements showcase a significant advancement in energy storage technology. A modular CTES system using 42 “Bolderblocs” units was successfully designed and constructed at Alabama Power’s Plant Gaston Unit 5, with each block containing embedded stainless-steel coils in specialized, cost-effective high-temperature concrete. The system interfaced seamlessly with the plant's 3500 psig (241 barg), 1000°F (538°C) supercritical steam, demonstrating operational flexibility. Over 86 full cycles, the CTES exhibited rapid charging and discharging capabilities, effectively mimicking steam turbine feed conditions and handling varying load profiles and storage durations. Performance validation confirmed the system's ability to consistently meet design target steam conditions of 75 bar-a and ~400°C for nominal baseline discharge. The concrete material withstood repeated thermal cycling without degradation, validating earlier lab-scale tests. Integration of balance of plant components, including a condensate management system with storage tank and air-cooled condenser, minimized plant interfaces and water consumption. A robust control scheme ensured safe, automated operation across various scenarios. Key learnings from the project were invaluable: 1. Initial concrete drying and commissioning procedures were refined for future deployments, enhancing efficiency in subsequent installations. 2. System flexibility exceeded expectations, with rapid response to changing conditions. 3. Design improvements were identified including optimized insulation and piping that will enhance overall system efficiency in future deployments 4. Full cycle thermal roundtrip efficiencies exceeded 88%. While the roundtrip electrical efficiency was somewhat limited by known challenges using input steam, such constraints may be mitigated by swapping steam for hot air as thermal input. 5. A summary of key performance parameters for the pilot test and predicted performance of a full scale commercial system with specified improvements determined from the pilot are shown in Section 8. The project faced challenges, including COVID-19 delays and host plant availability constraints. However, these were overcome through adaptive planning and execution. The successful management of these obstacles demonstrated the resilience and adaptability of the project team and the robustness of the CTES technology. This successful pilot demonstrates the potential for CTES to enhance coal plant flexibility, supporting grid stability as renewable penetration increases. The validated design and operational data provide a solid foundation for scaling up to utility-scale implementations, potentially transforming how thermal plants operate in evolving energy landscapes. The system's ability to rapidly respond to changing grid conditions while maintaining high efficiency makes it a promising solution for balancing intermittent renewable energy sources. Furthermore, the project highlighted the potential for even greater efficiencies in future iterations. The use of air as an input medium could potentially eliminate the limitations observed with steam input, opening new possibilities for energy storage applications beyond coal plant integration. In conclusion, this pilot project not only achieved its primary goals but also uncovered additional benefits and potential applications of the CTES technology. It represents a significant step forward in addressing the challenges of grid stability and flexibility in an increasingly renewable-driven energy landscape.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2025

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

Physics Informed Reinforcement Learning for Power Grid Control using Augmented Random Search

Wide adoption of deep reinforcement learning need to overcome several challenges in energy system domain, including scalability, learning from limited samples, and high-dimensional continuous state and action spaces. In this paper, we integrated physics-based information from the normal generator operation state formula in the reinforcement learning agent's neural network loss function, and applied an augmented random search agent to optimize the generator control under dynamic contingency. Simulation results demonstrated the reliability performance improvements in training speed, reward convergence, sampling efficiency, scalability, and transferability.

physics informed ML, Physics Informed Neural Netwo↗