Search NASA⌕ Search

SEARCH · Search NASA

Results for “Operator learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Independent malware detection architecture

A system and method (referred to as the system) detect malware by training a rule-based model, a functional based model, and a deep learning-based model from a memory snapshot of a malware free operating state of a monitored device. The system extracts a feature set from a second memory snapshot captured from an operating state of the monitored device and processes the feature set by the rule-based model, the functional-based model, and the deep learning-based model. The system identifies identifying instances of malware on the monitored device without processing data identifying an operating system of the monitored device, data associated with a prior identification of the malware, data identifying a source of the malware, data identifying a location of the malware on the monitored device, or any operating system specific data contained within the monitored device.

Smith, Jared M.↗

Airport Runway Configuration Management with Offline Model-free Reinforcement Learning

Runway configuration management (RCM) deals with the optimal selection of runways to operate on (for arrivals and departures) based on traffic, surface wind speed, wind direction and other environmental variables. RCM is one of the most challenging tasks in air traffic management, as it relies on operational and environmental variables (e.g., weather forecast) that are highly uncertain and complex to model. In this paper, an innovative and automated approach is deployed using offline model-free reinforcement learning to provide decision-support for RCM. The proposed technology processes historical data about variables of interest, decisions made regarding RCM, and their subsequent outcome, to identify a policy that would encourage good decisions and avoid the poor ones. The policy search is guided by an appropriately chosen weighted utility function (e.g., based on minimizing delays and go-arounds). Finally, the performance of the proposed tool is validated using Charlotte Douglas International Airport as the case study, which shows that the proposed method is superior to other conventional rule-based approaches.

Milad Memarzadeh↗

Airport Runway Configuration Management with Offline Model-free Reinforcement Learning

Runway configuration management (RCM) deals with the optimal selection of runways to operate on (for arrivals and departures) based on traffic, surface wind speed, wind direction and other environmental variables. RCM is one of the most challenging tasks in air traffic management, as it relies on operational and environmental variables (e.g., weather forecast) that are highly uncertain and complex to model. In this paper, an innovative and automated approach is deployed using offline model-free reinforcement learning to provide decision-support for RCM. The proposed technology processes historical data about variables of interest, decisions made regarding RCM, and their subsequent outcome, to identify a policy that would encourage good decisions and avoid the poor ones. The policy search is guided by an appropriately chosen weighted utility function (e.g., based on minimizing delays and go-arounds). Finally, the performance of the proposed tool is validated using Charlotte Douglas International Airport as the case study, which shows that the proposed method is superior to other conventional rule-based approaches.

Milad Memarzadeh↗

Two-Stage Deep Reinforcement Learning for Distribution System Voltage Regulation and Peak Load Management: Preprint

The growing integration of distributed solar photovoltaic (PV) in distribution systems could result in adverse effects during grid operation. This paper develops a soft actor critic-based deep reinforcement learning (SAC-DRL) solution to simultaneously control PV inverters and battery energy storage systems for voltage regulation and peak load demand shaving. The novel two-stage framework, featured with two different control agents, is applied for daytime and nighttime operation to enhance the control performance. Comparison results with other control methods on a real feeder in Western Colorado demonstrate that the proposed method can provide advanced voltage regulation with modest active power curtailment for peak demand reduction.

deep reinforcement learning↗

A review of machine learning in building load prediction

The surge of machine learning in recent years has been empowering engineer modeling in various fields. The decreasing hardware cost, increasing data accessibility, and advances of building automation system (BAS) allow the collection and storage of a significant amount of building operation data. The two facts provide great opportunities of applying machine learning to building energy systems modeling and analysis. There are a great number of research papers on this topic but there lacks a comprehensive and general review to summarize the current development, limitations, gaps and future trend. In this review paper series, machine learning techniques in building energy system modeling and analysis are reviewed under the organization and logic of the machine learning definition by Tom M. Mitchell: a computer program is said to learn from experience E with respect to some class of tasks T and performance measure P if its performance at tasks in T, as measured by P, improves with experience E. This paper is the first part of the review paper series, which focuses on building load prediction. First, the applications of building load prediction model (task T) are reviewed. Then, the modeling algorithms improving machine learning performance and accuracy (performance P) are reviewed. At the same time, the literature on the data perspective for modeling (experience E), including data engineering from sensors level to data level, pre-processing, feature extraction and selection, is reviewed. Finally, what is well-studied and what is lacking but with great potential are concluded; the gaps between present and future utilization of machine learning techniques are identified; the future trend and development are also predicted. The target readers of this paper are not only researchers from the building side who can get exposed to cutting edge machine learning tools, but also those from machine learning side who can understand the potential and challenge to apply machine learning in buildings.

Liang, Zhang↗

Finding accurate frontiers: A knowledge-intensive approach to relational learning

An approach to analytic learning is described that searches for accurate entailments of a Horn Clause domain theory. A hill-climbing search, guided by an information based evaluation function, is performed by applying a set of operators that derive frontiers from domain theories. The analytic learning system is one component of a multi-strategy relational learning system. We compare the accuracy of concepts learned with this analytic strategy to concepts learned with an analytic strategy that operationalizes the domain theory.

Pazzani, Michael↗

Lessons Learned In Developing Multiple Distributed Planning Systems for the International Space Station

The planning processes for the International Space Station (ISS) Program are quite complex. Detailed mission planning for ISS on-orbit operations is a distributed function. Pieces of the on-orbit plan are developed by multiple planning organizations, located around the world, based on their respective expertise and responsibilities. The "pieces" are then integrated to yield the final detailed plan that will be executed onboard the ISS. Previous space programs have not distributed the planning and scheduling functions to this extent. Major ISS planning organizations are currently located in the United States (at both the NASA Johnson Space Center (JSC) and NASA Marshall Space Flight Center (MSFC)), in Russia, in Europe, and in Japan. Software systems have been developed by each of these planning organizations to support their assigned planning and scheduling functions. Although there is some cooperative development and sharing of key software components, each planning system has been tailored to meet the unique requirements and operational environment of the facility in which it operates. However, all the systems must operate in a coordinated fashion in order to effectively and efficiently produce a single integrated plan of ISS operations, in accordance with the established planning processes. This paper addresses lessons learned during the development of these multiple distributed planning systems, from the perspective of the developer of one of the software systems. The lessons focus on the coordination required to allow the multiple systems to operate together, rather than on the problems associated with the development of any particular system. Included in the paper is a discussion of typical problems faced during the development and coordination process, such as incompatible development schedules, difficulties in defining system interfaces, technical coordination and funding for shared tools, continually evolving planning concepts/requirements, programmatic and budget issues, and external influences. Techniques that mitigated some of these problems will also be addressed, along with recommendations for any future programs involving the development of multiple planning and scheduling systems. Many of these lessons learned are not unique to the area of planning and scheduling systems, so may be applied to other distributed ground systems that must operate in concert to successfully support space mission operations.

Maxwell, Theresa G.↗

Lessons Learned in Developing Multiple Distributed Planning Systems for the International Space Station

The planning processes for the International Space Station (ISS) Program are quite complex. Detailed mission planning for ISS on-orbit operations is a distributed function. Pieces of the on-orbit plan are developed by multiple planning organizations, located around the world, based on their respective expertise and responsibilities. The pieces are then integrated to yield the final detailed plan that will be executed onboard the ISS. Previous space programs have not distributed the planning and scheduling functions to this extent. Major ISS planning organizations are currently located in the United States (at both the NASA Johnson Space Center (JSC) and NASA Marshall Space Flight Center (MSFC)), in Russia, in Europe, and in Japan. Software systems have been developed by each of these planning organizations to support their assigned planning and scheduling functions. Although there is some cooperative development and sharing of key software components, each planning system has been tailored to meet the unique requirements and operational environment of the facility in which it operates. However, all the systems must operate in a coordinated fashion in order to effectively and efficiently produce a single integrated plan of ISS operations, in accordance with the established planning processes. This paper addresses lessons learned during the development of these multiple distributed planning systems, from the perspective of the developer of one of the software systems. The lessons focus on the coordination required to allow the multiple systems to operate together, rather than on the problems associated with the development of any particular system. Included in the paper is a discussion of typical problems faced during the development and coordination process, such as incompatible development schedules, difficulties in defining system interfaces, technical coordination and funding for shared tools, continually evolving planning concepts/requirements, programmatic and budget issues, and external influences. Techniques that mitigated some of these problems will also be addressed, along with recommendations for any future programs involving the development of multiple planning and scheduling systems. Many of these lessons learned are not unique to the area of planning and scheduling systems, so may be applied to other distributed ground systems that must operate in concert to successfully support space mission operations.

Maxwell, Theresa G.↗

Deep Learning-Based Adaptive Remedial Action Scheme with Security Margin for Renewable-Dominated Power Grids

The Remedial Action Scheme (RAS) is designed to take corrective actions after detecting predetermined conditions to maintain system transient stability in large interconnected power grids. However, since RAS is usually designed based on a few selected typical operating conditions, it is not optimal in operating conditions that are not considered in the offline design, especially under frequently and dramatically varying operating conditions due to the increasing integration of intermittent renewables. The deep learning-based RAS is proposed to enhance the adaptivity of RAS to varying operating conditions. During the training, a customized loss function is developed to penalize the negative loss and suggest corrective actions with a security margin to avoid triggering under-frequency and over-frequency relays. Simulation results of the reduced United States Western Interconnection system model demonstrate that the proposed deep learning–based RAS can provide optimal corrective actions for unseen operating conditions while maintaining a sufficient security margin.

24 POWER TRANSMISSION AND DISTRIBUTION↗

An adaptive learning control system for aircraft

A learning control system is developed which blends the gain scheduling and adaptive control into a single learning system that has the advantages of both. An important feature of the developed learning control system is its capability to adjust the gain schedule in a prescribed manner to account for changing aircraft operating characteristics. Furthermore, if tests performed by the criteria of the learning system preclude any possible change in the gain schedule, then the overall system becomes an ordinary gain scheduling system. Examples are discussed.

Mekel, R.↗

The X-15 airplane - Lessons learned

The X-15 rocket research airplane flew to an altitude of 354,000 ft and reached Mach 6.70. In almost 200 flights, this airplane was used to gather aerodynamic-heating, structural loads, stability and control, and atmospheric-reentry data. This paper describes the origins, design, and operation of the X-15 airplane. In addition, lessons learned from the X-15 airplane that are applicable to designing and testing the National Aero-Space Plane are discussed.

Aeroplane↗

Simulating the Composite Propellant Manufacturing Process

There is a strategic interest in understanding how the propellant manufacturing process contributes to military capabilities outside the United States. The paper will discuss how system dynamics (SD) has been applied to rapidly assess the capabilities and vulnerabilities of a specific composite propellant production complex. These facilities produce a commonly used solid propellant with military applications. The authors will explain how an SD model can be configured to match a specific production facility followed by a series of scenarios designed to analyze operational vulnerabilities. By using the simulation model to rapidly analyze operational risks, the analyst gains a better understanding of production complexities. There are several benefits of developing SD models to simulate chemical production. SD is an effective tool for characterizing complex problems, especially the production process where the cascading effect of outages quickly taxes common understanding. By programming expert knowledge into an SD application, these tools are transformed into a knowledge management resource that facilitates rapid learning without requiring years of experience in production operations. It also permits the analyst to rapidly respond to crisis situations and other time-sensitive missions. Most importantly, the quantitative understanding gained from applying the SD model lends itself to strategic analysis and planning.

Williamson, Suzanne↗

Laser Line Scan Characterization of Cavitation-Induced Erosion to SNS Mercury Target Vessels

The mercury-facing surfaces of the Spallation Neutron Source target vessel are damaged during operation by a phenomenon called cavitation-induced erosion. To date, erosion damage has caused leaks to develop in two target modules, which necessitated interruptions in operation to replace the target module. Samples are routinely removed from the beam entrance region of SNS targets after removal from service and analyzed to learn about the damage processes occurring in the targets during operation. A laser line scan system was used to produce point-cloud models of the target samples, which were used to calculate various erosion metrics and characterize the erosion damage to each sample. The scans revealed the maximum depth of erosion and the location where the maximum erosion occurred for each sample. The results quantified and illustrated the difference in erosion patterns between different target designs. Data from the scans also showed the maximum depth of erosion was greatly reduced at all locations examined in the SNS targets operated with gas injection. The data produced by these scans will be used to compare erosion damage to future targets in order to quantify the erosion in targets with different design features and operational histories.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

European Union's Action Plan for Power Sector Decarbonisation

A collaborative report from the Clean Energy Ministerial (CEM) on Lessons Learned for Rapid Decarbonization of Power Sectors was delivered to energy ministers and presented at CEM13 in the United States in September 2022. In light of these lessons learned and discussed at CEM13, several countries signaled intent to develop Action Plans for power sector decarbonization that will be presented at CEM14 in India. These action plans complement - but are differentiated from - other international power sector initiatives such as the Breakthrough Agenda - whose broad purpose is to raise collective ambition - and the Global Power System Transformation (G-PST) Consortium - whose goals are to convene power system operators to accelerate research innovations and foster peer learning. These action plans, supported by the 21st Century Power Partnership (21CPP) and other CEM workstreams via direct technical assistance and capacity building, are instead intended to focus on implementation actions given each country's existing power sector goals and activities and are an opportunity for countries to display leadership in power sector decarbonization. These action plans are voluntary, developed by each country individually, and can be viewed as a living document that is subject to change.

decarbonization↗

Chile's Action Plan for Power Sector Decarbonization

A collaborative report from the Clean Energy Ministerial (CEM) on Lessons Learned for Rapid Decarbonization of Power Sectors was delivered to energy ministers and presented at CEM13 in the United States in September 2022. In light of these lessons learned and discussed at CEM13, several countries signaled intent to develop Action Plans for power sector decarbonization that will be presented at CEM14 in India. These action plans complement but are differentiated from - other international power sector initiatives such as the Breakthrough Agenda whose broad purpose is to raise collective ambition and the Global Power System Transformation (G-PST) Consortium whose goals are to convene power system operators to accelerate research innovations and foster peer learning. These action plans, supported by the 21st Century Power Partnership (21CPP) and other CEM workstreams via direct technical assistance and capacity building, are instead intended to focus on implementation actions given each country's existing power sector goals and activities and are an opportunity for countries to display leadership in power sector decarbonization. These action plans are voluntary, developed by each country individually, and can be viewed as a living document that is subject to change.

Chile↗

Australia's Action Plan for Power Sector Decarbonisation

A collaborative report from the Clean Energy Ministerial (CEM) on Lessons Learned for Rapid Decarbonization of Power Sectors was delivered to energy ministers and presented at CEM13 in the United States in September 2022. In light of these lessons learned and discussed at CEM13, several countries signaled intent to develop Action Plans for power sector decarbonization that will be presented at CEM14 in India. These action plans complement but are differentiated from other international power sector initiatives such as the Breakthrough Agenda whose broad purpose is to raise collective ambition and the Global Power System Transformation (G-PST) Consortium whose goals are to convene power system operators to accelerate research innovations and foster peer learning. These action plans, supported by the 21st Century Power Partnership (21CPP) and other CEM workstreams via direct technical assistance and capacity building, are instead intended to focus on implementation actions given each country's existing power sector goals and activities and are an opportunity for countries to display leadership in power sector decarbonization. These action plans are voluntary, developed by each country individually, and can be viewed as a living document that is subject to change.

Australia↗

India's Action Plan for Power Sector Decarbonisation

A collaborative report from the Clean Energy Ministerial (CEM) on Lessons Learned for Rapid Decarbonization of Power Sectors was delivered to energy ministers and presented at CEM13 in the United States in September 2022. In light of these lessons learned and discussed at CEM13, several countries signaled intent to develop Action Plans for power sector decarbonization that will be presented at CEM14 in India. These action plans complement but are differentiated from other international power sector initiatives such as the Breakthrough Agenda whose broad purpose is to raise collective ambition and the Global Power System Transformation (G-PST) Consortium whose goals are to convene power system operators to accelerate research innovations and foster peer learning. These action plans, supported by the 21st Century Power Partnership (21CPP) and other CEM workstreams via direct technical assistance and capacity building, are instead intended to focus on implementation actions given each country's existing power sector goals and activities and are an opportunity for countries to display leadership in power sector decarbonization. These action plans are voluntary, developed by each country individually, and can be viewed as a living document that is subject to change.

decarbonization↗