SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

All sources NASA NTRS DOE OSTI

NASA NTRS2010

Overview of NASA's Thermal Control Technology Development Project

NASA?s Constellation Program included the Orion, Altair, and Lunar Surface Systems project offices. The first two elements, Orion and Altair, were planned to be manned space vehicles while the third element was much broader and included several sub-elements including Rovers and a Lunar Habitat. The planned missions involving these systems and vehicles included several risks and design challenges. Due to the unique thermal operating environment, many of these risks and challenges were associated with the vehicles? thermal control system. NASA?s Exploration Technology Development Program (ETDP) consisted of several technology development projects. The project chartered with mitigating the aforementioned thermal risks and design challenges was the Thermal Control System Development for Exploration Project. These risks and design challenges were being addressed through a rigorous technology development process that was planned to culminate with an integrated thermal control system test. Although these Constellation elements have been cancelled or significantly changed, the thermal technology development process is being continued within a new program entitled Enabling Technology Development and Demonstration (ETDD). The current paper summarizes the development efforts being performed by the technology development project. The development efforts involve heat acquisition and heat rejection hardware including radiators, heat exchangers, and evaporators. The project has also been developing advanced phase change material heat sinks and performing a material compatibility assessment for a promising thermal control system working fluid. The to-date progress and lessons-learned from these development efforts will be discussed throughout the paper.

Stephan, Ryan A.↗

NASA NTRS2011

Overview of NASA's Thermal Control System Development for Exploration Project

The now-cancelled Constellation Program included the Orion, Altair, and Lunar Surface Systems project offices. The first two elements, Orion and Altair, were planned to be manned space vehicles while the third element was much more diverse and included several sub-elements. Among other things, these sub-elements were Rovers and a Lunar Habitat. The planned missions involving these systems and vehicles included several risks and design challenges. Due to the unique thermal operating environment, many of these risks and challenges were associated with the vehicles thermal control system. NASA s Exploration Technology Development Program (ETDP) consisted of various technology development projects. The project chartered with mitigating the aforementioned thermal risks and design challenges was the Thermal Control System Development for Exploration Project. These risks and design challenges were being addressed through a rigorous technology development process that was planned to culminate with an integrated thermal control system test. Although the technologies being developed were originally aimed towards mitigating specific Constellation risks, the technology development process is being continued within a new program. This continued effort is justified by the fact that many of the technologies are generically applicable to future spacecraft thermal control systems. The current paper summarizes the development efforts being performed by the technology development project. The development efforts involve heat acquisition and heat rejection hardware including radiators, heat exchangers, and evaporators. The project has also been developing advanced phase change material heat sinks and performing a material compatibility assessment for a promising thermal control system working fluid. The to-date progress and lessons-learned from these development efforts will be discussed throughout the paper.

Stephan, Ryan A.↗

NASA NTRS2011

Lunar Reconnaissance Orbiter (LRO) Thermal On-Orbit Performance

The Lunar Reconnaissance Orbiter (LRO) was launched on June 18, 2009. The nominal mission ended on September 15, 2010 and LRO is now on a four-year extended mission. The LRO performances in hot and cold cases are compared to pre-launch analysis predicts, and operational lessons learned are discussed. One instrument has required tighter-than-anticipated thermal control, and two others have frequently requested unanticipated calibration maneuvers that had to be evaluated for their thermal performance. A series of off nadir thermal analyses of the entire orbiter were performed prior to launch, and these predictions are compared to actual maneuvers, with a discussion of the process by which maneuvers can be rapidly evaluated for thermal concerns. On December 21st, 2010, LRO experienced its first severe Lunar Eclipse. Operationally, this required the Spacecraft to pre-heat its main avionics panel in order to minimize control heater power during the period when the Earth blocks the sun from the moon. The operational design and in-flight performance are summarized.

Baker, Charles↗

NASA NTRS2010

Development of Constellation's Launch Control System

The paper focuses on the National Aeronautics and Space Administration (NASA) Constellation Program's Launch Control System (LCS) development effort at Kennedy Space Center (KSC). It provides a brief history of some preceding efforts to provide launch control and ground processing systems for other NASA programs, and some lessons learned from those experiences. It then provides high level descriptions of the LCS mission, objectives, organization, architecture, and progress. It discusses some of our development tenets, including our use of standards based design and use of off-the-shelf products whenever possible, incremental development cycles, and highly reliable, available, and supportable enterprise class system servers. It concludes with some new lessons learned and our plans for the future.

Lougheed, Kirk D.↗

NASA NTRS2018

Adaptive Problem Solving and Mitigation

This presentation examines how problem solving was done on the NEEMO 22 Mission and whether human autonomy teaming would be able to assist in the type of troubleshooting that was conducted by Mission Control.

human autonomy↗

DOE OSTI2019

Distributed Reinforcement Learning with ADMM-RL

NREL researcher Peter Graf discusses distributed reinforcement learning with ADMM-RL as part of the Innovative Optimization and Control Methods for Highly Distributed Autonomous Systems workshop. NREL hosted the workshop to exchange ideas on state-of-the-art control and optimization strategies as well as get feedback on work being done at NREL.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Sensor Error Estimation for Reactor Coolant System with Generalization Error Equations

We consider a simplified version of the sensor error estimation problem in pressure sensors in the primary coolant system of a nuclear power plant under the condition that a majority of sensors are error-free. We present a sensor fusion method to estimate sensor errors in the primary coolant system of a power reactor by using measurements collected by multiple sensors. The underlying relationship between the measured and estimated parameters is inferred using measurements collected under controlled no-error conditions of the plant. We propose a machine learning approach to train fusers that provide an estimate of the sensor measurement by using measurements from other sensors, and the difference between the actual sensor measurement and its estimate provides the sensor estimate. We present generalization error equations for these methods that characterize the performance of their sensor error estimates on future measurements using the distribution-free machine learning formulation.

Rao, Nageswara S.↗

DOE OSTI2021

Data-driven estimation of energy consumption for electric bus under real-world driving conditions

Reliable and accurate estimation of an electric bus’s instantaneous energy consumption is critical in evaluating energy impacts of planning and control of electric bus operations. In this study, we developed machine learning-based long short-term memory (LSTM) and artificial neural network (ANN) models to estimate 1 Hz energy consumption of electric buses based on continuous monitoring data of electric buses in Chattanooga, Tennessee, in 2019 and 2020. We propose a data-partitioning algorithm to separate energy charging and discharging modes before applying data-driven estimation models. Here, a K-fold cross-validation-based model selection process was conducted to identify the optimal model structure and input variables in terms of prediction accuracy. The estimation results show the predicted mean absolute percentage error rates of LSTM and ANN models were 3% and 5%, respectively. We compared the proposed models with existing models in the literature based on the same testing data to demonstrate the predictability of our models.

Artificial neural network↗

DOE OSTI2020

Topological Regularization via Persistence-Sensitive Optimization

Optimization, a key tool in machine learning and statistics, relies on regularization to reduce overfitting. Traditional regularization methods control a norm of the solution to ensure its smoothness. Recently, topological methods have emerged as a way to provide a more precise and expressive control over the solution, relying on persistent homology to quantify and reduce its roughness. All such existing techniques back-propagate gradients through the persistence diagram, which is a summary of the topological features of a function. Their downside is that they provide information only at the critical points of the function. We propose a method that instead builds on persistence-sensitive simplification and translates the required changes to the persistence diagram into changes on large subsets of the domain, including both critical and regular points. This approach enables a faster and more precise topological regularization, the benefits of which we illustrate with experimental evidence.

Nigmetov, Arnur↗

DOE OSTI2020

Machine learning for natural resource assessment: An application to the blind geothermal systems of Nevada

A study is underway to apply machine learning methods to evaluate natural resource potential. In particular, we are considering the search for blind geothermal systems in Nevada. Beginning with the data and experience from the previous Nevada play fairway analysis project, we are building models in TensorFlow/Keras and gaining experience toward predicting the geothermal resource potential as a probability map. During the first year of this project we have encountered several issues particular to using geological and geophysical data sets with these tools. Through an illustrative example we develop a promising workflow for future use as more data become available and are analyzed.

15 GEOTHERMAL ENERGY↗

DOE OSTI2024

SUBTASK 1.6 – BASIN ELECTRIC CARBON STORAGE RESEARCH PROJECT: NOVEL MONITORING TECHNIQUES

The Energy & Environmental Research Center (EERC) conducted baseline activities associated with an applied research project at Basin Electric Power Cooperative’s (Basin’s) carbon capture and storage (CCS) site in Beulah, North Dakota, to establish novel carbon storage-monitoring techniques as commercial methods under Cooperative Agreement No. DE-FE0024233, Subtask 1.6. The following report summarizes the baseline activities performed and briefly describes the subsequent (operational monitoring) activities that have been proposed to the U.S. Department of Energy (DOE) as part of the overall project to develop and demonstrate novel monitoring techniques at North America’s largest permitted CCS operation. Dakota Gasification Company (DGC), a wholly owned subsidiary of Basin, owns and operates the Great Plains Synfuels Plant (GPSP) approximately 5 miles northwest of the town of Beulah, North Dakota (Figure 1). In 2023, DGC received approval from the North Dakota Industrial Commission (NDIC) to develop a storage facility on-site for injecting a stream of carbon dioxide (CO2) captured from GPSP. DGC will transport the captured CO2 stream with approximately 6.8 miles of transmission lines that extend north of GPSP and inject >1 million tonnes (MMt) of CO2 annually (>1 MMt/yr) over a 12-year period with up to six underground injection control (UIC) Class VI-compliant injection wells completed in the Broom Creek Formation, a predominantly sandstone reservoir and saline aquifer underlying GPSP. The Broom Creek Formation lies approximately 5900 feet (ft) below ground surface (bgs) at GPSP. The commercial scale (i.e., >1 MMt/yr) of DGC’s permitted carbon storage project is ideal for developing and testing the novel monitoring techniques included within Subtask 1.6. The goals of this project are to demonstrate 1) the cost-effectiveness of novel monitoring technologies included as part of this research, 2) technology capability for tracking the CO2 plume and/or associated pressure response in the subsurface and monitoring out-of-zone migration, and 3) compliance with UIC Class VI program requirements. The research activities proposed for the overall project include 1) design of an automated, integrated, modular (AIM) monitoring station; 2) time-lapse electromagnetic (EM) field surveys; 3) drone-based surveillance studies; 4) time-lapse monitoring with seismic methods; 5) advanced wellbore-monitoring methods; 6) deployment of an AIM monitoring network; 7) EM monitoring of CO2 with real-time data processing; 8) continued seasonal drone-based surveillance studies; 9) seismic monitoring with passive and active surveys; and 10) wellbore monitoring with nuclear magnetic resonance (NMR) for near-surface characterization. Completion of Activities 1.0–5.0 (baseline activities) are described in this report. Upon authorization of funding by DOE, the EERC will initiate Activities 6.0– 10.0 (operational monitoring activities). Current state-of-the-art (SOA) carbon storage-monitoring techniques require countless labor hours dedicated to the acquisition of data. Once data are gathered, these SOA techniques often rely on commercial facilities to process raw data from the field. However, it is anticipated that next-generation monitoring techniques, such as those being demonstrated, will lower acquisition footprints, be less operationally intensive, and improve data acquisition efficiencies. These new techniques are more conducive to the application of machine learning, artificial intelligence, and automation, thus providing a pathway for integration into active control systems, informing site operability, and improving the integration of data for future CCS projects across the United States. Additionally, reclaimed and active mining lands are present within the project site, creating a unique opportunity to demonstrate the effectiveness of remote sensing and surface-based geophysics monitoring techniques at similar project sites that may include disturbed, unconsolidated, or actively excavated near-surface environments. The efforts included in the overall project will produce necessary designs, learnings, and data acquired during the baseline and operational monitoring periods that are necessary for time-lapse demonstration and validation of the described monitoring techniques. In addition, it is anticipated that the monitoring technologies included in this study will be compliant with UIC Class VI requirements to enable the potential for implementation at other CCS sites across the United States.

42 ENGINEERING↗

NASA NTRS2012

Refined Synthesis and Characterization of Controlled Diameter, Narrow Size Distribution Microparticles for Aerospace Research Applications

Flow visualization using polystyrene microspheres (PSL)s has enabled researchers to learn a tremendous amount of information via particle based diagnostic techniques. To better accommodate wind tunnel researchers needs, PSL synthesis via dispersion polymerization has been carried out at NASA Langley Research Center since the late 1980s. When utilizing seed material for flow visualization, size and size distribution are of paramount importance. Therefore, the work described here focused on further refinement of PSL synthesis and characterization. Through controlled variation of synthetic conditions (chemical concentrations, solution stirring speed, temperature, etc.) a robust, controllable procedure was developed. The relationship between particle size and salt concentration, MgSO4, was identified enabling the determination of PSL diameters a priori. Suggestions of future topics related to PSL synthesis, stability, and size variation are also described.

Tiemsin, Pacita I.↗

DOE OSTI2015

Decentralized control of units in smart grids for the support of renewable energy supply

Due to the significant environmental impact of power production from fossil fuels and nuclear fission, future energy systems will increasingly rely on distributed and renewable energy sources (RES). The electrical feed-in from photovoltaic (PV) systems and wind energy converters (WEC) varies greatly both over short and long time periods (from minutes to seasons), and (not only) by this effect the supply of electrical power from RES and the demand for electrical power are not per se matching. In addition, with a growing share of generation capacity especially in distribution grids, the top-down paradigm of electricity distribution is gradually replaced by a bottom-up power supply. This altogether leads to new problems regarding the safe and reliable operation of power grids. In order to address these challenges, the notion of Smart Grids has been introduced. The inherent flexibilities, i.e. the set of feasible power schedules, of distributed power units have to be controlled in order to support demand–supply matching as well as stable grid operation. Controllable power units are e.g. combined heat and power plants, power storage systems such as batteries, and flexible power consumers such as heat pumps. By controlling the flexibilities of these units we are particularly able to optimize the local utilization of RES feed-in in a given power grid by integrating both supply and demand management measures with special respect to the electrical infrastructure. In this context, decentralized systems, autonomous agents and the concept of self-organizing systems will become key elements of the ICT based control of power units. In this contribution, we first show how a decentralized load management system for battery charging/discharging of electrical vehicles (EVs) can increase the locally used share of supply from PV systems in a low voltage grid. For a reliable demand side management of large sets of appliances, dynamic clustering of these appliances into uniformly controlled appliance sets is necessary. We introduce a method for self-organized clustering for this purpose and show how control of such clusters can affect load peaks in distribution grids. Subsequently, we give a short overview on how we are going to expand the idea of self-organized clusters of units into creating a virtual control center for dynamic virtual power plants (DVPP) offering products at a power market. For an efficient organization of DVPPs, the flexibilities of units have to be represented in a compact and easy to use manner. We give an introduction how the problem of representing a set of possibly 10{sup 100} feasible schedules can be solved by a machine-learning approach. In summary, this article provides an overall impression how we use agent based control techniques and methods of self-organization to support the further integration of distributed and renewable energy sources into power grids and energy markets. - Highlights: • Distributed load management for electrical vehicles supports local supply from PV. • Appliances can self-organize into so called virtual appliances for load control. • Dynamic VPPs can be controlled by extensively decentralized control centers. • Flexibilities of units can efficiently be represented by support-vector descriptions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

Operating a commercial building HVAC load as a virtual battery through airflow control

Virtual battery (VB) is an innovative method to model flexibility of building loads and effectively coordinate them with other resources at a system level. Unlike a real battery with a dedicated power conversion system for charging control, methods are required for operating building loads to deviate from the baseline to respond to grid signals. This paper presents a VB control for a commercial heating, ventilation, and air conditioning (HVAC) system to follow the desired power consumption in real-time by adjusting zonal airflow rates. The proposed method consists of two parts. At the system level, a mixed feedforward and feedback control is used to estimate the desired total airflow rate. At the zone level, two priority-based algorithms are then proposed to distribute the total airflow rate to individual zones. In particular, a zonal airflow limit estimation method is proposed using machine-learning techniques, in contrast to physics-based thermal models in existing studies, to more accurately capture zonal thermal dynamics and improve temperature control performance. An office building on the Pacific Northwest National Laboratory campus is implemented in EnergyPlus, and used to illustrate and validate the proposed control.

Wang, Jiyu↗

NASA NTRS2017

Implementation of a Space Communications Cognitive Engine

Although communications-based cognitive engines have been proposed, very few have been implemented in a full system, especially in a space communications system. In this paper, we detail the implementation of a multi-objective reinforcement-learning algorithm and deep artificial neural networks for the use as a radio-resource-allocation controller. The modular software architecture presented encourages re-use and easy modification for trying different algorithms. Various trade studies involved with the system implementation and integration are discussed. These include the choice of software libraries that provide platform flexibility and promote reusability, choices regarding the deployment of this cognitive engine within a system architecture using the DVB-S2 standard and commercial hardware, and constraints placed on the cognitive engine caused by real-world radio constraints. The implemented radio-resource allocation-management controller was then integrated with the larger spaceground system developed by NASA Glenn Research Center (GRC).

reinforcement learning↗

NASA NTRS2017

Implementation of a Space Communications Cognitive Engine

reinforcement learning↗

DOE OSTI2022

Dynamic machine learning-based optimization algorithm to improve boiler efficiency

With decreasing computational costs, improvement in algorithms, and the aggregation of large industrial and commercial datasets, machine learning is becoming a ubiquitous tool for process and business innovations. Machine learning is still lacking applications in the field of dynamic optimization for real-time control. This work presents a novel framework for performing constrained dynamic optimization using a recurrent neural network model combined with a metaheuristic optimizer. The framework is designed to augment an existing control system and is purely data-driven, like most industrial Model Predictive Control applications. Several recurrent neural network models are compared as well as several metaheuristic optimizers. Hyperparameters and optimizer parameters are tuned with parameter sweeps, and the resulting values are reported. Further, the best parameters for each optimizer and model combination are demonstrated in closed-loop control of a dynamic simulation, and several recommendations are made for generalizing this framework to other systems. Up to 0.953% improvement is realized over the non-optimized case for a simulated coal-fired boiler. While this is not a large improvement in percentage, the total economic impact is $991,000 per year, and this study builds a foundation for future machine learning with dynamic optimization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2026

Machine learning-enhanced hybrid modeling approach for better identification of a building thermal network model and improved prediction

The gray-box modeling approach, which uses a semi-physical thermal network model, has been widely used in building prediction applications, such as model predictive control (MPC). However, unmeasured disturbances, such as occupants, lighting, and in/exfiltration loads, make it challenging to apply this approach to practical buildings. In this word, we propose a hybrid modeling approach that integrates the gray-box model with a model for unmeasured disturbance. After reviewing several system identification approaches, we systematically designed the unmeasured disturbance model with a model selection process based on statistical tests to make it robust. We generated data based on the building model calibrated by real operational data and then trained the hybrid model for two different weather conditions. The hybrid model approach demonstrates an RMSE reduction of approximately 0.2–0.9 °C and 0.3–2 °C on 1-day ahead temperature prediction compared to the Conventional approach for mild (Berkeley, CA) and cold (Chicago, IL) climates, respectively. In addition, this approach was applied to experimental data obtained from the laboratory building to be used for the MPC application, showing superior prediction performances.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗