Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Fusing TensorFlow with building energy simulation for intelligent energy management in smart cities

Buildings account for 35% of the global final energy demand. Efficiency improvements and advanced control strategies have a significant impact in the reduction of energy costs and CO2 emissions. Building energy simulation is widely used to help planners, contractors, and building owners analyse diverse options regarding the planning and management of energy consumption in buildings. Furthermore, recent advances in data processing and computing have led to the development of sophisticated machine learning algorithms that can learn from large datasets, e.g., sensor data from buildings, and use them to develop building-specific adaptive and automatic energy controllers. Control algorithms, such as deep reinforcement learning can tune themselves, are model-free, and economical to implement. In this paper, we introduce an integrated simulation environment that combines CitySim, a fast building energy simulator, and TensorFlow, a platform for efficient implementation of advanced machine learning algorithms. The integration is achieved via Keras - an API for TensorFlow - and a set of text and csv files for data transfer between the applications. This new environment will allow researchers to investigate novel learning control algorithms, and demonstrate their robustness and potential for diverse applications in the built environment. We present two case studies for energy savings and demand response, respectively.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Optimal Control of Differentially Private EV Charging: A Scalable Learning Approach Under Uncertainty

Internet of Things (IoT)-enabled electric vehicles (IoEVs) enable intelligent charging coordination that accounts for grid congestion. However, increased data exchange raises privacy concerns, as charging patterns can reveal sensitive driver behavior to grid operators. Here, we propose a differentially private (DP) EV charging framework that enables coordinated control while protecting driver data with theoretical privacy guarantees. Nevertheless, integrating DP inevitably introduces uncertainty into the control strategy for EVs, which can lead to infeasible solutions. To tackle this challenge, we develop a feasible and scalable control algorithm based on constrained reinforcement learning (CRL) and convex hulls. While our framework is designed to handle the uncertainty introduced by DP, it is general and also applicable to other sources of uncertainty in EV charging, such as the stochastic nature of driver behavior and renewable variability. This ensures feasible and privacy-preserving coordination of EV charging at scale. Our method constructs convex hulls within the action space to guarantee feasibility under stochastic constraints and incorporates constraint reduction techniques to improve scalability. Case studies based on IEEE benchmark systems demonstrate that the proposed approach effectively balances feasibility under uncertainty, scalability, and privacy in large-scale EV charging control.

Engineering - Power transmission and distribution↗
NASA NTRS1990

Neuromorphic learning of continuous-valued mappings from noise-corrupted data. Application to real-time adaptive control

The ability of feed-forward neural network architectures to learn continuous valued mappings in the presence of noise was demonstrated in relation to parameter identification and real-time adaptive control applications. An error function was introduced to help optimize parameter values such as number of training iterations, observation time, sampling rate, and scaling of the control signal. The learning performance depended essentially on the degree of embodiment of the control law in the training data set and on the degree of uniformity of the probability distribution function of the data that are presented to the net during sequence. When a control law was corrupted by noise, the fluctuations of the training data biased the probability distribution function of the training data sequence. Only if the noise contamination is minimized and the degree of embodiment of the control law is maximized, can a neural net develop a good representation of the mapping and be used as a neurocontroller. A multilayer net was trained with back-error-propagation to control a cart-pole system for linear and nonlinear control laws in the presence of data processing noise and measurement noise. The neurocontroller exhibited noise-filtering properties and was found to operate more smoothly than the teacher in the presence of measurement noise.

Troudet, Terry↗
DOE OSTI2021

Design of nematic liquid crystals to control microscale dynamics

The dynamics of small particles, both living such as swimming bacteria and inanimate, such as colloidal spheres, has fascinated scientists for centuries. If one could learn how to control and streamline their chaotic motion, that would open technological opportunities in the transformation of stored or environmental energy into systematic motion, with applications in micro-robotics, transport of matter, guided morphogenesis. This review presents an approach to command microscale dynamics by replacing an isotropic medium with a liquid crystal. Orientational order and associated properties, such as elasticity, surface anchoring, and bulk anisotropy, enable new dynamic effects, ranging from the appearance and propagation of particle-like solitary waves to self-locomotion of an active droplet. By using photoalignment, the liquid crystal can be patterned into predesigned structures. In the presence of the electric field, these patterns enable the transport of solid and fluid particles through nonlinear electrokinetics rooted in anisotropy of conductivity and permittivity. Director patterns command the dynamics of swimming bacteria, guiding their trajectories, polarity of swimming, and distribution in space. This guidance is of a higher level of complexity than a simple following of the director by rod-like microorganisms. Namely, the director gradients mediate hydrodynamic interactions of bacteria to produce an active force and collective polar modes of swimming. The patterned director could also be engraved in a liquid crystal elastomer. When an elastomer coating is activated by heat or light, these patterns produce a deterministic surface topography. The director gradients define an activation force that shapes the elastomer in a manner similar to the active stresses triggering flows in active nematics. Finally, the patterned elastomer substrates could be used to define the orientation of cells in living tissues. The liquid-crystal guidance holds a major promise in achieving the goal of commanding microscale active flows.

36 MATERIALS SCIENCE↗
NASA NTRS2015

DSCOVR Contamination Lessons Learned

The Triana observatory was built at NASA GSFC in the late 1990's, then placed into storage. After approximately ten years it was removed from storage and repurposed as the Deep Space Climate Observatory (DSCOVR). This presentation outlines the contamination control program lessons learned during the integration, test and launch of DSCOVR.

DSCOVR↗
NASA NTRS1993

Evolving fuzzy rules in a learning classifier system

The fuzzy classifier system (FCS) combines the ideas of fuzzy logic controllers (FLC's) and learning classifier systems (LCS's). It brings together the expressive powers of fuzzy logic as it has been applied in fuzzy controllers to express relations between continuous variables, and the ability of LCS's to evolve co-adapted sets of rules. The goal of the FCS is to develop a rule-based system capable of learning in a reinforcement regime, and that can potentially be used for process control.

Valenzuela-Rendon, Manuel↗
DOE OSTI2023

Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

Here, this paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.

Frequency control↗
DOE OSTI2022

Safety-Related Instrumentation and Control Pilot Upgrade: Initial Scoping Phase Implementation and Lessons Learned

In May 2016, the U.S. Nuclear Regulatory Commission (NRC) staff provided a digital instrumentation and control (I&C) regulatory infrastructure integrated action plan to the NRC for approval. One of the objectives of that plan was to establish a clear regulatory structure with reduced regulatory uncertainty to enable the expanded safe use of digital I&C in commercial nuclear reactors while continuing to ensure safety and security. To achieve this end, the NRC, with collaboration from industry, developed a streamlined License Amendment Request Alternate Review (AR) process for safety-related (SR) digital I&C upgrades. In spite of this effort, the industry has remained reluctant to perform such I&C upgrades because of perceived regulatory and financial risks associated with being the first or an early adopter of the AR process for SR I&C upgrades. The U.S. Department of Energy Light Water Reactor Sustainability Program at the Idaho National Laboratory performed Initial Scoping Phase research to help break this impasse by supporting a SR I&C Pilot Upgrade, working with MPR Associates, ScottMadden Inc., and Exelon Generation. Exelon’s Limerick Generating Station (LGS) was selected as the target for this research. This paper summarizes the Initial Scoping Phase engineering and operations, licensing, and project management activities necessary to bound the scope, schedule, and estimated cost of the project sufficiently to enable utility management authorization of Conceptual Design Phase activities. These efforts and associated products are intended to provide a template to support larger industry efforts to perform similar upgrades as a foundation stone for a digital transformation that will improve plant safety, reliability, and operational performance while lowering plant total cost of ownership. As a result of the combined effort of Exelon Generation and research participants, Conceptual Design Phase activities for the subject upgrade at LGS were approved by Exelon. Further, the U.S. Department of Energy also awarded a $50 million cost share award to Exelon in order to pave the way for SR I&C modernization and associated control room upgrades across the U.S. nuclear fleet. Additional research reports are planned for the Conceptual Design Phase, Detailed Design Phase, and the Implementation Phase of the LGS project to document the process followed and promulgate lessons learned to industry.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1993

Architecture for Adaptive Intelligent Systems

We identify a class of niches to be occupied by 'adaptive intelligent systems (AISs)'. In contrast with niches occupied by typical AI agents, AIS niches present situations that vary dynamically along several key dimensions: different combinations of required tasks, different configurations of available resources, contextual conditions ranging from benign to stressful, and different performance criteria. We present a small class hierarchy of AIS niches that exhibit these dimensions of variability and describe a particular AIS niche, ICU (intensive care unit) patient monitoring, which we use for illustration throughout the paper. We have designed and implemented an agent architecture that supports all of different kinds of adaptation by exploiting a single underlying theoretical concept: An agent dynamically constructs explicit control plans to guide its choices among situation-triggered behaviors. We illustrate the architecture and its support for adaptation with examples from Guardian, an experimental agent for ICU monitoring.

ACTIVE CONTROL↗
NASA NTRS2010

Foot Pedals for Spacecraft Manual Control

Fifty years ago, NASA decided that the cockpit controls in spacecraft should be like the ones in airplanes. But controls based on the stick and rudder may not be best way to manually control a vehicle in space. A different method is based on submersible vehicles controlled with foot pedals. A new pilot can learn the sub's control scheme in minutes and drive it hands-free. We are building a pair of foot pedals for spacecraft control, and will test them in a spacecraft flight simulator.

Love, Stanley G.↗
DOE OSTI2021

Model-Free Voltage Control of Active Distribution System with PVs Using Surrogate Model-Based Deep Reinforcement Learning

Accurate knowledge of the distribution system topology and parameters is required to achieve good voltage control performance, but this is difficult to obtain in practice. This paper proposes a physical-model-free voltage control method based on a surrogate-model-enabled deep reinforcement learning approach. Specifically, a surrogate model is trained in a supervised manner using the recorded limited number of historical data to learn the relationship between the power injections and voltage fluctuations of each node. Then, the deep reinforcement learning algorithm is applied to learn an optimal control strategy from the experiences obtained by continuous interactions with the surrogate model. The proposed method can achieve physical-model-free control of unbalanced distribution network and inform real-time decisions to deal with fast voltage fluctuations caused by the rapid variation of PV generation. Simulation results on an unbalance IEEE 123-bus system show that the proposed method can achieve similar performance as that of perfect physical-model-based approaches while being advantageous over other traditional methods.

active distribution network↗
DOE OSTI2020

Uranium Mill Tailings Radiation Control Act Title II DOE Due Diligence and Lessons Learned from a Previous Site Transfer - 20352

Title II of the Uranium Mill Tailings Radiation Control Act (UMTRCA) established that a government agency will provide perpetual care for closed uranium and thorium ore-processing sites that were operating under an NRC source material license in 1978 or were licensed thereafter. Commercial owners (licensees) operating under an NRC or agreement state specific license when UMTRCA was passed are responsible for conducting reclamation of any byproduct material remaining from uranium-ore processing operations in accordance with an NRC or agreement state approved reclamation plan. Reclamation includes both surface and groundwater remedies. Upon completion of reclamation and approval by NRC, the site is required to be transferred to either the host state or the DOE for long-term surveillance and maintenance. Since UMTRCA's enactment, six Title II sites have been transferred to DOE; an additional 24 Title II sites are anticipated to be transferred before 2050. DoE's role mandated under UMTRCA Title II as the long-term care custodian is to perform 'monitoring, maintenance, and emergency measures necessary to protect the public health and safety.' UMTRCA requires that the licensee pay a long-term surveillance charge 'sufficient to cover the annual costs of site surveillance.' However, at some sites such as the Bluewater, New Mexico, Disposal Site, this mandate has required additional effort and expense by DOE, beyond the originally anticipated and intended scope within UMTRCA, but within the authority of DOE under UMTRCA. In 1997, the Bluewater site became the second UMTRCA Title II site to be transferred to DOE. The site was the location of a uranium mill operated from 1953 until 1982. The specific licensee began site reclamation in 1991, and by 1995 all tailings and contaminated materials were encapsulated in two tailings disposal cells and other disposal areas. In addition to surface contamination, milling activities impacted groundwater in the two upper aquifers. In 1989, the specific licensee attempted active groundwater remediation; however, no significant reduction in contaminant concentrations was observed. As a result, the specific licensee applied to NRC for alternate concentration limits (ACLs) in 1990, which were approved in 1996 as being protective, after additional corrective actions were performed. Since transfer of the Bluewater site to DOE, unforeseen challenges have occurred, requiring additional actions. The first challenge is the occurrence of surface depressions located on the northern section of the main tailings disposal cell. The depressions were first observed during DoE's initial inspection in 1998; however, evidence of these can be observed on satellite images taken prior to transfer. Since being first observed, the depressions have continued to grow both in depth and areal extent. Due to the design of the main tailings disposal cell, the depressions impede storm water from being effectively shed off the 101- hectare (250-acre) top slope of the main tailings disposal cell. Instead, storm water accumulates in the depressions, forming a large ephemeral pond that has stored up to 16.3 x 10{sup 6} liters (4.3 million gallons) of stormwater. The ponding poses a potential risk to the integrity of the main tailings disposal cell in the case of a large storm event, with the potential to cause the pond to overtop and erode the cover material and underlying waste. DOE has taken a number of short-term actions to monitor, measure, and reduce the ponding and is currently working with the US Army Corps of Engineers to design and construct a repair. Additional challenges are associated with groundwater at the Bluewater site. Nine wells were present on the 1335-hectare (3300-acre) site upon transfer. Groundwater compliance was called into question after the State of New Mexico reduced its uranium groundwater standard from 5.0 to 0.03 milligrams per liter in 2004, and when an ACL for uranium was exceeded in a site monitoring well in 2010. Acquiring historical groundwater data and subsequent evaluations as well as additional DOE groundwater monitoring led to installing 10 new monitoring wells and performing additional site hydrogeology recharacterization. DOE continues to evaluate groundwater conditions at the site and works with the NRC to determine regulatory requirements and a path forward. As a result of lessons learned at the Bluewater site and other Title II sites, improved processes have been implemented at a programmatic level to increase due diligence before site transfer and prevent similar issues from occurring at other UMTRCA Title II sites under long-term management. DoE's due diligence process is documented in the Process for Transition of UMTRCA Title II Disposal Sites to DOE for Long-Term Surveillance and Maintenance and is designed to ensure that DOE has no technical or compliance concerns with regulatory decisions that might compromise protectiveness following site transfer to DOE. Implementation of the due diligence process has increased DoE's role prior to site transfer and has been effective in identifying potential issues. Actions by NRC and specific licensees, in response to enhanced due diligence efforts by DOE, are expected to minimize, if not totally prevent, the need for unanticipated actions by DOE pertaining to the surface and groundwater remedies after site transfer. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2018

Verification and Validation Challenges for Adaptive Flight Control of Complex Autonomous Systems

Autonomy of aerospace systems requires the ability for flight control systems to be able to adapt to complex uncertain dynamic environment. In spite of the five decades of research in adaptive control, the fact still remains that currently no adaptive control system has ever been deployed on any safety-critical or human-rated production systems such as passenger transport aircraft. The problem lies in the difficulty with the certification of adaptive control systems since existing certification methods cannot readily be used for nonlinear adaptive control systems. Research to address the notion of metrics for adaptive control began to appear in the recent years. These metrics, if accepted, could pave a path towards certification that would potentially lead to the adoption of adaptive control as a future control technology for safety-critical and human-rated production systems. Development of certifiable adaptive control systems represents a major challenge to overcome. Adaptive control systems with learning algorithms will never become part of the future unless it can be proven that they are highly safe and reliable. Rigorous methods for adaptive control software verification and validation must therefore be developed to ensure that adaptive control system software failures will not occur, to verify that the adaptive control system functions as required, to eliminate unintended functionality, and to demonstrate that certification requirements imposed by regulatory bodies such as the Federal Aviation Administration (FAA) can be satisfied. This presentation will discuss some of the technical issues with adaptive flight control and related V&V challenges.

Nguyen, Nhan T.↗
DOE OSTI2026

Steady Spills, Stronger Signals: Machine Learning for Slow Spill Analysis

Particle accelerator experiments rely on stable, consistent proton beams to maximize scientific discovery. This presentation introduces beam spills, duty factor, and beam stability using a meteor shower analogy before exploring how feedback control and machine learning, including recurrent neural networks (RNNs), can analyze spill data, identify patterns, and predict beam behavior. Together, these approaches support beam optimization and improve our understanding of accelerator performance for experiments such as Mu2e.

Prescott, Matthew J. [Fermilab]↗
NASA NTRS2003

Intelligent Launch and Range Operations Virtual Test Bed (ILRO-VTB)

Intelligent Launch and Range Operations Virtual Test Bed (ILRO-VTB) is a real-time web-based command and control, communication, and intelligent simulation environment of ground-vehicle, launch and range operation activities. ILRO-VTB consists of a variety of simulation models combined with commercial and indigenous software developments (NASA Ames). It creates a hybrid software/hardware environment suitable for testing various integrated control system components of launch and range. The dynamic interactions of the integrated simulated control systems are not well understood. Insight into such systems can only be achieved through simulation/emulation. For that reason, NASA has established a VTB where we can learn the actual control and dynamics of designs for future space programs, including testing and performance evaluation. The current implementation of the VTB simulates the operations of a sub-orbital vehicle of mission, control, ground-vehicle engineering, launch and range operations. The present development of the test bed simulates the operations of Space Shuttle Vehicle (SSV) at NASA Kennedy Space Center. The test bed supports a wide variety of shuttle missions with ancillary modeling capabilities like weather forecasting, lightning tracker, toxic gas dispersion model, debris dispersion model, telemetry, trajectory modeling, ground operations, payload models and etc. To achieve the simulations, all models are linked using Common Object Request Broker Architecture (CORBA). The test bed provides opportunities for government, universities, researchers and industries to do a real time of shuttle launch in cyber space.

Bardina, Jorge↗
DOE OSTI2016

Regulation of plant cells, cell walls and development by mechanical signals

The overall goal of the revised scope of work for the final year of funding was to characterize cell wall biosynthesis in developing cotyledons and in the shoot apical meristem of Arabidopsis thaliana, as a way of learning about developmental control of cell wall biosynthesis in plants, and interactions between cell wall biosynthesis and the microtubule cytoskeleton. The proposed work had two parts – to look at the effect of mutation in the SPIRAL2 gene on microtubule organization and reorganization, and to thoroughly characterize the glycosyltransferase genes expressed in shoot apical meristems by RNA-seq experiments, by in situ hybridization of the RNAs expressed in the meristem, and by antibody staining of the products of the glycosyltransferases in meristems. Both parts were completed; the spiral2 mutant was found to speed microtubule reorientation after ablation of adjacent cells, supporting our hypothesis that reorganization correlates with microtubule severing, the rate of which is increased by the mutation. The glycosyltransferase characterization was completed and published as Yang et al. (2016). Among the new things learned was that primary cell wall biosynthesis is strongly controlled both by cell type, and by stage of cell cycle, implying not only that different, even adjacent, cells can have different sugar linkages in their (nonshared) walls, but also that a surprisingly large proportion of glycosyltransferases is regulated in the cell cycle, and therefore that the cell cycle regulates wall maturation to a degree previously unrecognized.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Improve Learning from Crowds via Generative Augmentation

Crowdsourcing provides an efficient label collection schema for supervised machine learning. However, to control annotation cost, each instance in the crowdsourced data is typically annotated by a small number of annotators. This creates a sparsity issue and limits the quality of machine learning models trained on such data. In this paper, we study how to handle sparsity in crowdsourced data using data augmentation. Specifically, we propose to directly learn a classifier by augmenting the raw sparse annotations. We implement two principles of high-quality augmentation using Generative Adversarial Networks: 1) the generated annotations should follow the distribution of authentic ones, which is measured by a discriminator; 2) the generated annotations should have high mutual information with the ground-truth labels, which is measured by an auxiliary network. Extensive experiments and comparisons against an array of state-of-the-art learning from crowds methods on three real-world datasets proved the effectiveness of our data augmentation framework. It shows the potential of our algorithm for low-budget crowdsourcing in general.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗