Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

The Final Count Down: A Review of Three Decades of Flight Controller Training Methods for Space Shuttle Mission Operations

Operations of human spaceflight systems is extremely complex, therefore the training and certification of operations personnel is a critical piece of ensuring mission success. Mission Control Center (MCC-H), at the Lyndon B. Johnson Space Center, in Houston, Texas manages mission operations for the Space Shuttle Program, including the training and certification of the astronauts and flight control teams. As the space shuttle program ends in 2011, a review of how training for STS-1 was conducted compared to STS-134 will show multiple changes in training of shuttle flight controller over a thirty year period. This paper will additionally give an overview of a flight control team s makeup and responsibilities during a flight, and details on how those teams have been trained certified over the life span of the space shuttle. The training methods for developing flight controllers have evolved significantly over the last thirty years, while the core goals and competencies have remained the same. In addition, the facilities and tools used in the control center have evolved. These changes have been driven by many factors including lessons learned, technology, shuttle accidents, shifts in risk posture, and generational differences. A primary method used for training Space Shuttle flight control teams is by running mission simulations of the orbit, ascent, and entry phases, to truly "train like you fly." The reader will learn what it is like to perform a simulation as a shuttle flight controller. Finally, the paper will reflect on the lessons learned in training for the shuttle program, and how those could be applied to future human spaceflight endeavors.

Dittemore, Gary D.↗
DOE OSTI2015

TU-B-304-01: The Aftermath of TG-142

Although published in 2009, the AAPM TG-142 report on accelerator quality assurance still proves a challenge for full clinical implementation. The choice of methodologies to satisfy TG-142 requirements is critical to a successful application. Understanding the philosophy of TG-142 can help in creating an institution-specific QA practice that is both efficient and effective. The concept of maintaining commissioned beam profiles is still found confusing. The physicist must also consider technologies not covered by TG-142 (i.e. arc therapy techniques). On the horizon is TG-198 report on implementing TG-142. Although the community still lacks a final TG-100 report, performing a failure-mode -and-effects analysis and statistical process control analysis to determine the institution-specific clinical impact of each TG-142 test may be useful for identifying trends for pro-active surveillance. Learning Objectives: To better understand the confusing and controversial aspects of TG-142. To understand what is still missing from TG-142 and how to account for these tests in clinical practice To describe which QA tests in TG-142 yield the largest potential clinical result if not discovered.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

TU-B-304-02: Quantitative FMEA of TG-142

Although published in 2009, the AAPM TG-142 report on accelerator quality assurance still proves a challenge for full clinical implementation. The choice of methodologies to satisfy TG-142 requirements is critical to a successful application. Understanding the philosophy of TG-142 can help in creating an institution-specific QA practice that is both efficient and effective. The concept of maintaining commissioned beam profiles is still found confusing. The physicist must also consider technologies not covered by TG-142 (i.e. arc therapy techniques). On the horizon is TG-198 report on implementing TG-142. Although the community still lacks a final TG-100 report, performing a failure-mode -and-effects analysis and statistical process control analysis to determine the institution-specific clinical impact of each TG-142 test may be useful for identifying trends for pro-active surveillance. Learning Objectives: To better understand the confusing and controversial aspects of TG-142. To understand what is still missing from TG-142 and how to account for these tests in clinical practice To describe which QA tests in TG-142 yield the largest potential clinical result if not discovered.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

TU-B-304-00: The Aftermath of TG-142

Although published in 2009, the AAPM TG-142 report on accelerator quality assurance still proves a challenge for full clinical implementation. The choice of methodologies to satisfy TG-142 requirements is critical to a successful application. Understanding the philosophy of TG-142 can help in creating an institution-specific QA practice that is both efficient and effective. The concept of maintaining commissioned beam profiles is still found confusing. The physicist must also consider technologies not covered by TG-142 (i.e. arc therapy techniques). On the horizon is TG-198 report on implementing TG-142. Although the community still lacks a final TG-100 report, performing a failure-mode -and-effects analysis and statistical process control analysis to determine the institution-specific clinical impact of each TG-142 test may be useful for identifying trends for pro-active surveillance. Learning Objectives: To better understand the confusing and controversial aspects of TG-142. To understand what is still missing from TG-142 and how to account for these tests in clinical practice To describe which QA tests in TG-142 yield the largest potential clinical result if not discovered.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Exploring far-from-equilibrium ultrafast polarization control in ferroelectric oxides with excited-state neural network quantum molecular dynamics

Ferroelectric materials exhibit a rich range of complex polar topologies, but their study under far-from-equilibrium optical excitation has been largely unexplored because of the difficulty in modeling the multiple spatiotemporal scales involved quantum-mechanically. To study optical excitation at spatiotemporal scales where these topologies emerge, we have performed multiscale excited-state neural network quantum molecular dynamics simulations that integrate quantum-mechanical description of electronic excitation and billion-atom machine learning molecular dynamics to describe ultrafast polarization control in an archetypal ferroelectric oxide, lead titanate. Far-from-equilibrium quantum simulations reveal a marked photo-induced change in the electronic energy landscape and resulting cross-over from ferroelectric to octahedral tilting topological dynamics within picoseconds. The coupling and frustration of these dynamics, in turn, create topological defects in the form of polar strings. The demonstrated nexus of multiscale quantum simulation and machine learning will boost not only the emerging field of ferroelectric topotronics but also broader optoelectronic applications.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Online Learning of Effective Turbine Wind Speed in Wind Farms

To develop better wind farm controllers that can meet more complex objectives, methods of modeling the wind turbine wakes at low computational expense are needed. Gaussian process (GP) regression offers a computationally inexpensive framework for learning complex functions from noisy measurements with very few datapoints. In this work, an online learning approach is presented to learn the rotor-averaged wind velocity at downstream wind turbines with GPs, using the available datastream of wind field measurements and wind turbine control set-points. This framework can readily be integrated into model-based controls methods because the model a) is updated online at low computational expense, b) assumes a mathematically favorable Gaussian form, and c) explicitly quantifies the stochastic nature of the wake field so that the trade-off between exploration and exploitation, and the uncertainty in the prediction, can be utilized. We show that a GP-learned model can match true values with errors within 0.5% on average, with as few as 5 training data points.

Gaussian process↗
NASA NTRS1992

Neural joint control for Space Shuttle Remote Manipulator System

Neural networks are being used to control a robot arm in a telerobotic operation. The concept uses neural networks for both joint and inverse kinematics in a robotic control application. An upper level neural network is trained to learn inverse kinematic mappings. The output, a trajectory, is then fed to the Decentralized Adaptive Joint Controllers. This neural network implementation has shown that the controlled arm recovers from unexpected payload changes while following the reference trajectory. The neural network-based decentralized joint controller is faster, more robust and efficient than conventional approaches. Implementations of this architecture are discussed that would relax assumptions about dynamics, obstacles, and heavy loads. This system is being developed to use with the Space Shuttle Remote Manipulator System.

Atkins, Mark A.↗
DOE OSTI2025

Performance Evaluation of Intelligent Solar Control Software Through Hardware-in-the-Loop (CRADA Final Report)

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been developed by Latimer Controls, Inc. to estimate the headroom of large PV plants for grid operation and control; however, these technologies lack comprehensive validation under real-world application scenarios. Latimer Controls, Inc. received two voucher awards for research at a national laboratory from the Department of Energy American Made Solar Prize Round 6. The National Renewable Energy Laboratory (NREL) was selected to collaborate with Latimer staff to conduct a performance evaluation of Latimer PV control software. The NREL team will develop a hardware-in-the-loop (HIL) testbed to perform testing and validation of the Latimer PV control technology in a de-risked yet realistic testbed environment. Latimer and NREL worked together to analyze the test data, draw conclusions from the results, and disseminate the resulting scientific findings. In this CRADA work, we propose to test and validate the real-world application of the Latimer Control solution in an HIL environment. We evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. In particular, a data-driven potential high limit (PHL) estimation is developed for large solar plants to accurately estimate their headroom so that they have fast and short-time regulation and control capability to participate in grid services and respond to grid signals in real time (e.g., AGC). This PHL estimation algorithm is embedded in a hardware power plant controller (PPC) and tested with an IEEE-39 bus system model developed in RTDS. To account for the varying cloud conditions and diverse inverter dispatches, we developed a 135-MW PV plant with detailed modeling of 27 individual PV modules and inverters using RTDS. The real-world communications used in such big plants, such as ModBus TCP/IP for inverter level and DNP3 for plant level, were developed to emulate the real-world applications in big PV plants. The ML-based PHL estimation method is tested under nine separate weather scenarios against the ‘reference-control’ solution, hereafter referred to as the baseline solution. The baseline method reserves a subset of inverters (reference group) to operate at their PHL at all times and dispatches only the remaining inverters (control group) at curtailed levels to fulfill the flexibility need. Despite being successfully piloted by NREL in California in 2017 and Chile in 2020, there exist two gaps in the state of the art to fully unlock the flexibility of PV plants: a. There is a trade-off between the PHL estimation accuracy and the flexibility range. b. There lacks granularity in the PHL estimation to capture the variation across inverters. The Latimer solution seeks to address these gaps by applying machine learning methods to improve PHL estimation accuracy while accounting for variability at every inverter. Performance metrics were taken from the 2023 Georgia Power CARES utility-scale RFP. The results demonstrate that the ML-based approach outperforms the traditional baseline method in PHL estimation accuracy for 7 of 9 scenarios. The average PHL error across the nine scenarios was 7.40% for the ML-based method, 2.06% less than the 9.46% PHL error average across scenarios that was exhibited by the baseline method. Additionally, the PHL error was below 5% for at least 95% of the testing interval for 3 of 9 tested intervals with the ML approach, whereas it did not achieve this metric for any of the baseline tests. Overall, simulation results indicate the superior performance of an ML-based approach compared to the conventional baseline reference-control approach, showcasing its potential to support grid stability and operational efficiency. This laboratory HIL testing using real PPC, representative power system simulation models in real-time with detailed PV plant and inverter models, and real-world communication protocols gives us confidence that this machine learning based PHL estimation algorithm works well in the hardware PPC and therefore de-risks future field commissioning. The end goal of this project is to advance grid technology to address the grid operation challenges brought by solar plant’s variability and uncertainties in power generation.

14 SOLAR ENERGY↗
NASA NTRS2014

Vision Based Autonomous Robotic Control for Advanced Inspection and Repair

The advanced inspection system is an autonomous control and analysis system that improves the inspection and remediation operations for ground and surface systems. It uses optical imaging technology with intelligent computer vision algorithms to analyze physical features of the real-world environment to make decisions and learn from experience. The advanced inspection system plans to control a robotic manipulator arm, an unmanned ground vehicle and cameras remotely, automatically and autonomously. There are many computer vision, image processing and machine learning techniques available as open source for using vision as a sensory feedback in decision-making and autonomous robotic movement. My responsibilities for the advanced inspection system are to create a software architecture that integrates and provides a framework for all the different subsystem components; identify open-source algorithms and techniques; and integrate robot hardware.

sensory feedback↗
DOE OSTI2022

Energy Efficient Material Processing through Automated Process Monitoring and Controls

Smart manufacturing is bound to play a crucial role in reducing global energy consumption while accelerating economic development. This phenomenon is evident in advanced sensing technology developments, data analytics and machine learning/AI, automated controls, cloud computing, etc. The immediate opportunity for smart manufacturing is to improve the energy efficiency of manufacturing operations through innovations in processes and controls. The manufacturing industry still consumes about 30% of total global energy production, which is significant. This program focused on the recommendation of heterogeneous sensors to monitor the Chemical Vapor Infiltration (CVI) process parameters, states, and key performance indices and utilize cloud computing to sort and analyze the real-time data. Learning through data analytics helps guide the control parameters affecting energy usage. The target process in the program is the CVI process at the Honeywell South Bend facility, which is one of the most energy-intensive manufacturing industries.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRSDate not supplied

Predicting Airport Runway Configurations for Decision-Support Using Supervised Learning

One of the most challenging tasks for air traffic controllers is runway configuration management (RCM). It deals with the optimal selection of runways to operate on (for arrivals and departures) based on current and forecast of traffic, surface wind speed, wind direction, other environmental variables, noise constraints, and several other airport-specific factors. In this paper, a methodology using supervised learning is developed to build a predictive model for RCM decision-support from large volumes of historical data. Data from two full years (2018 and 2019) related to current and forecast weather, demand/capacity, etc. is collected, analyzed, and fused together. A variety of supervised learning algorithms are tested for predicting runway configuration and hyperparameter tuning is carried out to select the best performing model. The validation process involves two airports of low (Charlotte Douglas International Airport, CLT) and high (Denver International Airport, DEN) complexity of configuration decision-making. The results show significant promise for the two airports with test accuracy of 93% (CLT) and 73% (DEN). The methodology is scalable and generalizable to other airports across the U.S. National Airspace System.

air traffic management↗
NASA NTRSDate not supplied

Predicting Airport Runway Configuration for Decision-Support Using Supervised Learning

One of the most challenging tasks for air traffic controllers is runway configuration management (RCM). It deals with the optimal selection of runways to operate on (for arrivals and departures) based on current and forecast of traffic, surface wind speed, wind direction, other environmental variables, noise constraints, and several other airport-specific factors. In this paper, a methodology using supervised learning is developed to build a predictive model for RCM decision-support from large volumes of historical data. Data from two full years (2018 and 2019) related to current and forecast weather, demand/capacity, etc. is collected, analyzed, and fused together. A variety of supervised learning algorithms are tested for predicting runway configuration and hyperparameter tuning is carried out to select the best performing model. The validation process involves two airports of low (Charlotte Douglas International Airport, CLT) and high (Denver International Airport, DEN) complexity of configuration decision-making. The results show significant promise for the two airports with test accuracy of 93% (CLT) and 73% (DEN). The methodology is scalable and generalizable to other airports across the U.S. National Airspace System.

air traffic management↗
NASA NTRS1997

Collaborating Fuzzy Reinforcement Learning Agents

Earlier, we introduced GARIC-Q, a new method for doing incremental Dynamic Programming using a society of intelligent agents which are controlled at the top level by Fuzzy Relearning and at the local level, each agent learns and operates based on ANTARCTIC, a technique for fuzzy reinforcement learning. In this paper, we show that it is possible for these agents to compete in order to affect the selected control policy but at the same time, they can collaborate while investigating the state space. In this model, the evaluator or the critic learns by observing all the agents behaviors but the control policy changes only based on the behavior of the winning agent also known as the super agent.

Berenji, Hamid R.↗
NASA NTRS2023

SERFE PLSS Component Lessons Learned from ISS

NASA has been developing a new spacesuit, called the Exploration Extravehicular Mobility Unit (xEMU) for over a decade. This spacesuit is under development to support missions to the International Space Station (ISS) and also to the Moon. Improvements in the life and robustness of the Portable Life Support System (PLSS) has been a major objective of these efforts. The Suit Water Membrane Evaporator (SWME) was chosen as the technology to provide cooling to the xEMU and has undergone several iterations of development over this period. An ISS flight experiment centered around the SWME and other thermal control loop (TCL) technologies was developed and tested in an ISS EXpedite PRocessing of Experiments to the Space Station (EXPRESS) rack from November of 2020 to August of 2022. In addition to the SWME, the SWME EXPRESS Rack Flight Experiment (SERFE) contains several technologies from the xEMU project and demonstrated their performance in micro-gravity and over an extended duration. These included two dissimilar water pumps, custom check valves, custom bypass relieve valves, a custom thermal control valve, development pressure and temperature sensors, and the thermal loop controller. This paper presents PLSS component lessons learned after return of the SERFE flight unit in August of 2022. The SERFE team took the flight unit apart and handed hardware components over to hardware owners to see how parts of the TCL managed after almost 2 years on the ISS and 25 simulated EVAs (Exploration Extravehicular Activity) on orbit. The team performed inspection, testing, and analysis and provided lessons learned on PLSS components for NASA’s prototype spacesuit. This analysis included how well SWME maintained its heat rejection capability, as well as looked at the robustness of the other TCL hardware.

SERFE↗
NASA NTRS2023

SERFE PLSS Component Lessons Learned from ISS

NASA has been developing a new spacesuit, called the Exploration Extravehicular Mobility Unit (xEMU) for over a decade. This spacesuit is under development to support missions to the International Space Station (ISS) and also to the Moon. Improvements in the life and robustness of the Portable Life Support System (PLSS) has been a major objective of these efforts. The Suit Water Membrane Evaporator (SWME) was chosen as the technology to provide cooling to the xEMU and has undergone several iterations of development over this period. An ISS flight experiment centered around the SWME and other thermal control loop (TCL) technologies was developed and tested in an ISS EXpedite PRocessing of Experiments to the Space Station (EXPRESS) rack from November of 2020 to August of 2022. In addition to the SWME, the SWME EXPRESS Rack Flight Experiment (SERFE) contains several technologies from the xEMU project and demonstrated their performance in micro-gravity and over an extended duration. These included two dissimilar water pumps, custom check valves, custom bypass relieve valves, a custom thermal control valve, development pressure and temperature sensors, and the thermal loop controller. This paper presents PLSS component lessons learned after return of the SERFE flight unit in August of 2022. The SERFE team took the flight unit apart and handed hardware components over to hardware owners to see how parts of the TCL managed after almost 2 years on the ISS and 25 simulated EVAs (Exploration Extravehicular Activity) on orbit. The team performed inspection, testing, and analysis and provided lessons learned on PLSS components for NASA’s prototype spacesuit. This analysis included how well SWME maintained its heat rejection capability, as well as looked at the robustness of the other TCL hardware.

SERFE↗
DOE OSTI2020

State-of-the-art on research and applications of machine learning in the building life cycle

Fueled by big data, powerful and affordable computing resources, and advanced algorithms, machine learning has been explored and applied to buildings research for the past decades and has demonstrated its potential to enhance building performance. This study systematically surveyed how machine learning has been applied at different stages of building life cycle. By conducting a literature search on the Web of Knowledge platform, we found 9579 papers in this field and selected 153 papers for an in-depth review. The number of published papers is increasing year by year, with a focus on building design, operation, and control. However, no study was found using machine learning in building commissioning. There are successful pilot studies on fault detection and diagnosis of HVAC equipment and systems, load prediction, energy baseline estimate, load shape clustering, occupancy prediction, and learning occupant behaviors and energy use patterns. None of the existing studies were adopted broadly by the building industry, due to common challenges including (1) lack of large scale labeled data to train and validate the model, (2) lack of model transferability, which limits a model trained with one data-rich building to be used in another building with limited data, (3) lack of strong justification of costs and benefits of deploying machine learning, and (4) the performance might not be reliable and robust for the stated goals, as the method might work for some buildings but could not be generalized to others. Finally, findings from the study can inform future machine learning research to improve occupant comfort, energy efficiency, demand flexibility, and resilience of buildings, as well as to inspire young researchers in the field to explore multidisciplinary approaches that integrate building science, computing science, data science, and social science.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2017

Integrated Systems Health Management for Sustainable Habitats (Using Sustainability Base as a Testbed)

Habitation systems provide a safe place for astronauts to live and work in space and on planetary surfaces. They enable crews to live and work safely in deep space, and include integrated life support systems, radiation protection, fire safety, and systems to reduce logistics and the need for resupply missions. Innovative health management technologies are needed in order to increase the safety and mission-effectiveness for future space habitats on other planets, asteroids, or lunar surfaces. For example, off-nominal or failure conditions occurring in safety-critical life support systems may need to be addressed quickly by the habitat crew without extensive technical support from Earth due to communication delays. If the crew in the habitat must manage, plan and operate much of the mission themselves, operations support must be migrated from Earth to the habitat. Enabling monitoring, tracking, and management capabilities on-board the habitat and related EVA platforms for a small crew to use will require significant automation and decision support software.Traditional caution and warning systems are typically triggered by out-of-bounds sensor values, but can be enhanced by including machine learning and data mining techniques. These methods aim to reveal latent, unknown conditions while still retaining and improving the ability to provide highly accurate alerts for known issues. A few of these techniques will briefly described, along with performance targets for known faults and failures. Specific system health management capabilities required for habitat system elements (environmental control and life support systems, etc.) may include relevant subsystems such as water recycling systems, photovoltaic systems, electrical power systems, and environmental monitoring systems. Sustainability Base, the agency's flagship LEED-platinum certified green building acts as a living laboratory for testing advanced information and sustainable technologies that provides an opportunity to test novel machine learning and controls capabilities. In this talk, key features of Sustainability Base that make it relevant to deep space habitat technology and its use of these kinds of subsystems previously listed will be presented. The fact that all such systems require less power to support human occupancy can be used as a focal point to serve as a testbed for deep space habitats that will need to operate within finite energy budgets.

Systems Health Management↗
DOE OSTI2022

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗