Search NASA⌕ Search

SEARCH · Search NASA

Results for “Operator learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Taking learning to another level

As a technical project manager at Los Alamos National Laboratory, Scott Boise works on programs and projects that make a big impact. Although he spends most of his days in a quiet office, he also makes a big impact on his team. He's well-known for his character and integrity because of the way he develops leadership skills on the team, promotes respect for others and lives a commitment to learning. Scott joined the Lab in June 2021, the period of the COVID-19 pandemic when most new employees began their careers without ever having stepped foot on-site. That experience has continued to serve as a reminder to him that new employees face numerous challenges no matter how and when they start. He's made it his aim to do what he can to lift some of that load. Coming to the Lab from a career in the biomedical industry, Scott arrived with years of project management experience but without a deep understanding of nuclear operations. His dedication to continuous learning has helped him pursue experiential opportunities and ask the proper questions to understand his role.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2019

CO 2 Leakage During EOR Operations – Analog Studies to Geologic Storage of CO 2

This study focuses on CO 2 EOR operations and CO 2 geologic storage in saline-bearing formations; both individually and in relation to each other. This study is the third of three that evaluate analog industries of CO 2 storage (first focuses on underground natural gas storage and second on deep well waste disposal using U.S. EPA UIC Class I wells). Several pieces of information can be found throughout the study including overview of CO 2 EOR history and side-by-side comparisons of major synergistic features between CO 2 EOR and CO 2 storage in saline-bearing formations. Best practices and lessons learned from CO 2 EOR operations can provide perspective from which future CO 2 storage R&D pursuits and field projects can benefit. A summary document providing a high-level overview and key takeaways of this study is available on NETL’s website under the Collection Name: NETL’s Analog Studies to Geologic Storage of CO 2 .

58 GEOSCIENCES↗
NASA NTRSDate not supplied

Reinforcement Learning for Spacecraft Navigation & Environment Characterization in the Planar-Restricted Two-Body Problem

As science, exploration, and commercial space missions become increasingly complex, so does the need for efficient, autonomous, and integrated spacecraft navigation and operations techniques. Key operational functions, including data collection and transmission, environment characterization, systems constraints, human factors, and navigation, often are intertwined and conflicted. Deep Reinforcement Learning (DRL) offers a framework for addressing integrated spacecraft navigation and planning in an uncertain dynamical environment. The goal of this study is to evaluate the utility of DRL for integrated spacecraft navigation and planning. This is achieved by developing a simple environmental characterization training environment in the Planar-Restricted 2-Body Problem (PR2BP), establishing benchmarks and heuristic baselines, and designing a previously unstudied Markov Decision Process (MDP) formulation. This MDP formulation enables the spacecraft DRL agents to appropriately balance navigation and actuation capabilities. The resulting DRL-derived policy exceeds a random or untrained policy and meets or exceeds the level of performance of a heuristic without actuation. In the process, valuable intuition is gained about the problem with insight into how DRL methods could scale to increasingly more realistic scenarios, including net-work design and training architectures, efficient state space representations, and methods for encouraging exploration in a parametric action space, among others.

navigation↗
DOE OSTI2020

Machine Learning-Based PV Reserve Determination Strategy for Frequency Control on the WECC System

Frequency control from photovoltaic (PV) power plants has great potential to address the frequency response challenge of the power system with high penetrations of renewable generation. Using model-based approaches to determine the optimal PV headroom reserve, however, requires significant online computation and is intractable for an interconnection level system. This paper proposes a machine learning based strategy, that is suitable for real-time operation, to determine the optimal PV reserve for frequency control. The proposed machine learning algorithm is trained and tested on 1,987 offline simulations of a 60% renewable penetration Western Electricity Coordinating Council (WECC) system. Furthermore, the proposed reserve determination strategy is applied on a realistic 1-day operation profile of the WECC system and demonstrates a savings of more than 40% PV headroom compared to a conservative approach. It is evident that the proposed strategy can efficiently and effectively determine the optimal PV frequency control reserve for realistic interconnection systems.

frequency control↗
DOE OSTI2023

Lessons from commissioning and operations of the ICARUS cryogenic system at Fermilab

Results and lessons from three years of commissioning and operations of the cryogenic and purificationsystems of the ICARUS neutrino detector installed at the Fermilab are described. The detector uses liquid argon stored in two separate containers of about 275 m 3 each. The liquid argon must be kept in very stable thermal conditions, and the contamination of electronegative impurities must be consistently kept at small fractions of parts per billion. Since its fill in early 2020, the detector has been commissioned and then operated in neutrino beams at Fermilab for the search of sterile neutrinos and measurements of neutrino-argon cross sections. The results of operating the cryogenic and purification systems and lessons learned, including challenges in reaching the design electron lifetime in argon bath, operating and servicing liquid nitrogen and argon circulation pumps, argon condensers and purifiers, are described. Plans for future operations and list of recommendations are presented.

43 PARTICLE ACCELERATORS↗
NASA NTRS2011

Constellation Program Lessons Learned: Detailed Lessons Learned - Volume 2

These lessons learned are part of a suite of hardware, software, test results, designs, knowledge base, and documentation that comprises the legacy of the Constellation Program. The context, summary information, and lessons learned are presented in a factual format, as known and described at the time. While our opinions might be discernable in the context, we have avoided all but factually sustainable statements. Statements should not be viewed as being either positive or negative; their value lies in what we did and what we learned that is worthy of passing on. The lessons include both "dos" and "don ts." In many cases, one person s "do" can be viewed as another person s "don t"; therefore, we have attempted to capture both perspectives when applicable and useful. While Volume I summarizes the views of those who managed the program, this Volume II encompasses the views at the working level, describing how the program challenges manifested in day-to-day activities. Here we see themes that were perhaps hinted at, but not completely addressed, in Volume I: unintended consequences of policies that worked well at higher levels but lacked proper implementation at the working level; long-term effects of the "generation gap" in human space flight development, the need to demonstrate early successes at the expense of thorough planning, and the consequences of problems and challenges not yet addressed because other problems and challenges were more immediate or manifest. Not all lessons learned have the benefit of being operationally vetted, since the program was cancelled shortly after Preliminary Design Review. We avoid making statements about operational consequences (with the exception of testing and test flights that did occur), but we do attempt to provide insight into how operational thinking influenced design and testing. The lessons have been formatted with a description, along with supporting information, a succinct statement of the lesson learned, and recommendations for future programs and projects that may be placed in similar circumstances.

Jennifer Rhatigan↗
NASA NTRS1993

Reconfigurable fuzzy cell

This invention relates to a reconfigurable fuzzy cell comprising a digital control programmable gain operation amplifier, an analog-to-digital converter, an electrically erasable PROM, and 8-bit counter and comparator, and supporting logic configured to achieve in real-time fuzzy systems high throughput, grade-of-membership or membership-value conversion of multi-input sensor data. The invention provides a flexible multiplexing-capable configuration, implemented entirely in hardware, for effectuating S-, Z-, and PI-membership functions or combinations thereof, based upon fuzzy logic level-set theory. A membership value table storing 'knowledge data' for each of S-, Z-, and PI-functions is contained within a nonvolatile memory for storing bits of membership and parametric information in a plurality of address spaces. Based upon parametric and control signals, analog sensor data is digitized and converted into grade-of-membership data. In situ learn and recognition modes of operation are also provided.

Salazar, George A.↗
DOE OSTI2023

A Multi-Objective Bayesian Optimized Human Assessed Multi-Target Generated Spectral Recommender System for Rapid Pareto Discoveries of Material Properties

Optimization for different tasks like material characterization, synthesis, and functional properties for desired applications over multi-dimensional control parameter and function spaces need a rapid strategic search through active learning. However, in all cases prior to optimization, the target material properties are assumed known and fixed, which mostly deviates from real-world scenarios in material synthesis. This can be critical for running expensive experiments on new materials, when the experimental results are fuzzy for any scientific outcomes due to improper target setting, ultimately wasting time and cost. The failure rate and cost are even higher over exploring on multi-target space, where we want to learn the pareto among multiple properties, to jointly optimize during material synthesis for desired applications. To address the challenge, here we introduce the human-operator attempt flexibility in the active learning based automated experiment framework, with generating multiple human assessed targets through a voting-based recommender system during real-time microscope measurements over the large material image space, sequentially learn/update multiple desired targets through a weighting system, and adaptively search in multiple material properties functional space for non-dominated pareto discoveries to maximize the custom structural similarity based acquisition function. We term this a multi-objective Bayesian optimized human assessed multi-target generated spectral recommender systems (MOBO-HAM-SRS). The approach has been demonstrated to peizoresponse force spectroscopy of a ferroelectric thin film, exploring with different kernels and acquisition functions. This work shows an advancement towards human-AI collaborated automated experiments, steering optimization trajectories through human overpowering AI at the early stage when uncertainty is high and AI overpowering human at the later stage with rapid exploration towards optimal goal, following human-assessed multiple targets properties.

Biswas, Arpan↗
DOE OSTI2025

Enhancing Autonomous Control of Microreactors Using Multi-Agent Reinforcement Learning

In order for microreactors to be economically competitive, operation costs will need to be minimized through some degree of autonomous control. Previous work has demonstrated the effectiveness of reinforcement learning (RL) for load-following control in a drum-controlled microreactor. This study extends that work by exploring the potential of RL to independently control each of the reactor’s drums. We compare a single-agent RL approach with a multi-agent RL (MARL) framework, testing them for generalization across different load-following power profiles and control timescales, and for robustness in cases of randomly disabled control drums. Since the point kinetics simulation environment used in this study cannot resolve spatial effects, we assume that in the absence of spatially localized disturbances, optimal drum movements should be symmetrical. We demonstrate that single-agent RL is able to achieve accurate performance only when symmetric actions are ignored; otherwise, it fails to train a useful controller. Meanwhile, the MARL framework performs symmetric actions by design and trains a robust, accurate agent, as evidenced by mean absolute errors in power matching of 0.41% for the training power profile, 0.68% for a profile with half the drums disabled, and 0.21% for a profile on a realistic load-following time horizon.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

A New Approach to Monitoring Solvent Extraction Processes for the Nuclear Industry

As part of an initiative to steward research, development, and innovation into the nuclear fuel cycle, Idaho National Laboratory is building the Beartooth testbed. Beartooth will include a cascade of centrifugal contactors, glove box lines, solidification, and dissolution equipment to aid in the progression of novel separation techniques and provide hands-on opportunities to early-career separation scientists. Beartooth will incorporate novel monitoring techniques using sensors and machine learning algorithms to inform a process operator of separation conditions. This research is examining monitoring technologies not typically used in nuclear separation processes such as acoustic microphones, accelerometers, infrared cameras, red-green-blue color sensors, among others. These sensors are being examined for their functionality within a separation process and their ability to detect applicable signals. Machine learning methods are being developed to determine their utility in detecting faults and alerting operators of expected and unexpected events. These methods have the potential to impact Safeguards by Design efforts and real-time decision making. This overview will detail preliminary results from acoustic, vibration, and color sensors.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Machine Learning for Scalable and Optimal Load Shedding Under Power System Contingency

Prompt and effective corrective actions in response to unexpected contingencies are crucial for improving power system resilience and preventing cascading blackouts. The optimal load shedding (OLS) accounting for network limits has the potential to address the diverse system-wide impacts of contingency scenarios as compared to traditional local schemes. However, due to the fast cascading propagation of initial contingencies, real-time OLS solutions are challenging to attain in large systems with high computation and communication needs. In this paper, we propose a decentralized design that leverages offline training of a neural network (NN) model for individual load centers to autonomously construct the OLS solutions from locally available measurements. Our learning-for-OLS approach can greatly reduce the computation and communication needs during online emergency responses, thus preventing the cascading propagation of contingencies for enhanced power grid resilience. Numerical studies on both the IEEE 118-bus system and a synthetic Texas 2000-bus system have demonstrated the efficiency and effectiveness of our scalable OLS learning design for timely power system emergency operations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2019

NASA KSC Intern Final Report - Virtual Reality in STEM Engagement

For this internship, I was a part of the multi-center NextGen STEM (Science, Technology, Engineering, and Mathematics) pilot. Specifically, I worked with the Developing Commercial Crew Program (CCP) Capabilities team that focuses on human spaceflight to the space station with NASA’s commercial partners. Composed of NASA employees and contractors (who are connected to KSC, JSC, and LaRC), they work to ensure that students will experience traditional classroom content and be immersed in emerging technologies in order to explore Commercial Crew missions and launch facilities. This group is in the process of creating educational products and resources to inspire the next generation to pursue STEM and to allow educators to have access to unique and enticing STEM activities. These products include: age-appropriate classroom lessons (including activity sheets and challenges) for kindergarten through twelfth grade; a CCP app and corresponding guide; learning experiences for students as well as educators; and virtual field trips and tours using NASA-created Virtual Reality (VR) videos and a custom VR app. My particular assignment was managing the VR equipment, developing an understanding of how to maximize the use of the equipment, creating documents that explain and convey the operations and procedures concerning the equipment (including lessons learned from equipment use), and training others to utilize the equipment effectively and correctly for conference events and group demonstrations. Over the course of this internship, I helped my team outline and learn essential procedures of operation for the VR equipment, solved technology problems that arose (due to the nature of creating unique products), and encouraged audiences at KSC and various conferences to consider using the CCP VR videos in their classrooms as an opportunity to engage and challenge the next generation to pursue STEM careers.

STEM↗
NASA NTRSDate not supplied

Quantum-Compatible Variational Segmentation for Image-to-Image Wildfire Detection Using Satellite Data

Wildfire occurrences have been increasing for the past decade, leaving devastating traces across the world. In the recent efforts, remote sensing and airborne missions have been utilized to better understand and manage wildfires. This has resulted in an exponential increase in volume of remote sensing data, which has pushed the need for intelligent automation of data extraction for wildfire studies. Machine learning offers accurate automation in detecting such natural anomalies and enable decision-makers to take actions in a timely manner. Recent advances in machine learning algorithms, namely probabilistic generative methods, allow researchers and decisionmakers to step beyond detection and study “what-if” scenarios for wildfire occurrences. Additionally, they offer better imitations to the stochastic behavior of nature, and wildfire events. However, optimizing the performance of these probabilistic generative models is a computationally expensive process, specially using digital computers. On the other hand, quantum computers have recently shown a promise to reduce computationally costly training of such models and provide performance improvements. There is a body of research investigating the potential for improved machine learning methods in which key operations are performed on a quantum computer. In this study, we propose a probabilistic image-toimage segmentation approach combining a very well-known segmentation method, U-NET, with a Conditional Variational Auto-Encoder (CVAE) to not only detect wildfires but also describe the stochasticity of the phenomenon and be capable of running “what-if” scenarios. Our proposed model is compatible with training on quantum computers, which results in a quantum-assisted image-to-image segmentation approach and can be used to benchmark the potential benefit of quantum computing over the classical one.

quantum↗
DOE OSTI2024

Concrete Thermal Energy Storage Enabling Flexible Operation without Coal Plant Cycling

The work described in this report is responsive to the Office of Fossil Energy program “Energy Storage for Fossil Power Generation.” The pilot plant built as a result of this project demonstrated the feasibility and performance of a concrete thermal energy storage (CTES) system integrated with a supercritical coal power plant. The 10 MWh electrical (>25 MWh thermal) CTES unit, developed by Storworks Power, was designed to enable flexible operation of coal plants without cycling damage. The project's key technical achievements showcase a significant advancement in energy storage technology. A modular CTES system using 42 “Bolderblocs” units was successfully designed and constructed at Alabama Power’s Plant Gaston Unit 5, with each block containing embedded stainless-steel coils in specialized, cost-effective high-temperature concrete. The system interfaced seamlessly with the plant's 3500 psig (241 barg), 1000°F (538°C) supercritical steam, demonstrating operational flexibility. Over 86 full cycles, the CTES exhibited rapid charging and discharging capabilities, effectively mimicking steam turbine feed conditions and handling varying load profiles and storage durations. Performance validation confirmed the system's ability to consistently meet design target steam conditions of 75 bar-a and ~400°C for nominal baseline discharge. The concrete material withstood repeated thermal cycling without degradation, validating earlier lab-scale tests. Integration of balance of plant components, including a condensate management system with storage tank and air-cooled condenser, minimized plant interfaces and water consumption. A robust control scheme ensured safe, automated operation across various scenarios. Key learnings from the project were invaluable: 1. Initial concrete drying and commissioning procedures were refined for future deployments, enhancing efficiency in subsequent installations. 2. System flexibility exceeded expectations, with rapid response to changing conditions. 3. Design improvements were identified including optimized insulation and piping that will enhance overall system efficiency in future deployments 4. Full cycle thermal roundtrip efficiencies exceeded 88%. While the roundtrip electrical efficiency was somewhat limited by known challenges using input steam, such constraints may be mitigated by swapping steam for hot air as thermal input. 5. A summary of key performance parameters for the pilot test and predicted performance of a full scale commercial system with specified improvements determined from the pilot are shown in Section 8. The project faced challenges, including COVID-19 delays and host plant availability constraints. However, these were overcome through adaptive planning and execution. The successful management of these obstacles demonstrated the resilience and adaptability of the project team and the robustness of the CTES technology. This successful pilot demonstrates the potential for CTES to enhance coal plant flexibility, supporting grid stability as renewable penetration increases. The validated design and operational data provide a solid foundation for scaling up to utility-scale implementations, potentially transforming how thermal plants operate in evolving energy landscapes. The system's ability to rapidly respond to changing grid conditions while maintaining high efficiency makes it a promising solution for balancing intermittent renewable energy sources. Furthermore, the project highlighted the potential for even greater efficiencies in future iterations. The use of air as an input medium could potentially eliminate the limitations observed with steam input, opening new possibilities for energy storage applications beyond coal plant integration. In conclusion, this pilot project not only achieved its primary goals but also uncovered additional benefits and potential applications of the CTES technology. It represents a significant step forward in addressing the challenges of grid stability and flexibility in an increasingly renewable-driven energy landscape.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2025

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗