Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Why Games Work and the Science of Learning

In 2010, the Navy formally added the Damage Control Trainer (DCT) to the recruit training program at Great Lakes, Illinois. Despite the incredibly dense training schedule at the Navy's boot camp, the instructors were willing to set aside two hours of time for recruits to play a game. Why? Because it worked. Even with just one hour of play, research showed that recruits gained a 50-80% improvement in performance that transferred to Battle Stations 21 (B821), the Navy's capstone training event. This paper explores why games makes these kinds of results possible. It argues that the things that are known to improve learning are almost exactly the same reasons why games work: the time-honored laws of learning. It concludes that the traditional gulf between instructional design and game design is really an issue of perspective, rather than fundamentals.

Murphy, Curtiss↗
DOE OSTI2025

Neural network approaches for parameterized optimal control

Here, we consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2002

Flight Evaluation of the Army/NASA Variable Stability Fly-by-Wire Rotorcraft Aircrew Systems Concept Airborne Laboratory (RASCAL) JUH-60A

NASA Ames Research Center and the U.S. Army Aeroflight dynamics Directorate (AFDD) have performed initial flight evaluations of the Research Flight Control System (RFCS) integrated into the Army/NASA Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) JUH-GOA. The highly modified JUH-GOA Black Hawk helicopter is a full authority, high bandwidth, variable stability, in-flight simulator designed to support development of advanced flight control, sensor, and integrated display and control technologies in a fail safe environment. Preparation for flight test required an extensive hazard analysis and ground testing to ensure proper system operation. A hardware in the loop development facility was utilized to evaluate control law stability following software changes, assess servo hardover upset conditions during manual and monitor disengagements and provide pilot familiarization of test techniques and software changes prior to flight. First engagement of the RFCS was conducted on 31 Aug 2001. RFCS transfer system operation, envelope expansion and a limited rate monitor evaluation have been completed with low bandwidth and model following control laws. The presentation will discuss the following - System overview including aircraft modifications and integrated development facilities used with the RASCAL facility. - Preliminary hazard identification and mitigation prior to flight test. - Ground testing used to qualify the RFCS transfer system and verify fault monitor operation. - Flight test results of low-bandwidth and model following control law evaluations including maneuver agility, control limitations, fault monitor reliability, and recovery from manual and monitor disengagement. - Lessons learned including test techniques using a passive three-axis sidearm controller, the value of the development facility in reducing risk and crew coordination issues related to the operation of a full authority, variable stability platform. - Future research and modifications planned for the RASCAL aircraft.

Dave Arterburn↗
DOE OSTI2024

Levelized cost of charging of extreme fast charging with stationary LMO/LTO batteries

Extreme DC fast charging for electric vehicles (EVs) could be competitive with the internal combustion engine refueling experience and enable longer-distance travel, which could help with EV adoption and decarbonization, but these systems have high capital costs and extremely variable high-power demands. Behind-the-meter systems (BTMS) could support extreme-fast-charging (XFC) stations to increase nationwide adoption of EVs. Here, this study examines the optimal break-even levelized cost of charging (LCOC) across 96 BTMS scenarios to enable low-wait XFC stations providing 200 miles of charge in 10 min. This research simulates LCOC via synthetic XFC-capable EV loads, machine-learned battery life models from testing data, and nonlinear optimal controls, co-minimizing complex utility costs and battery replacements. An aggregate optimal BTMS design treating each EV load as equal likely gives an optimal LCOC per utility rate, the average of which is $\$$0.59/kWh. In addition, the sensitivity of optimal and off-optimal design factors, the long-life LMO/LTO chemistry, and optimized controls are analyzed. The battery control model, based on battery stressors to compare chemistries, optimizes LMO/LTO resting state of charge and cycle depth without compromising cost reduction, which enables greater flexibility in operation. The LCOC savings due to replacement reduction are small, up to $\$$0.035/kWh (6%), with an average of $\$$0.02/kWh (3.5%). Compared with gasoline stations, the aggregate XFC station design achieves comparable speed, experience of service, and cost at $\$$3.81/gal gasoline, showing that EVs can replace gasoline vehicles even for longer-distance travel.

25 ENERGY STORAGE↗
NASA NTRS1993

Link monitor and control operator assistant: A prototype demonstrating semiautomated monitor and control

This article describes the approach, results, and lessons learned from an applied research project demonstrating how artificial intelligence (AI) technology can be used to improve Deep Space Network operations. Configuring antenna and associated equipment necessary to support a communications link is a time-consuming process. The time spent configuring the equipment is essentially overhead and results in reduced time for actual mission support operations. The NASA Office of Space Communications (Code O) and the NASA Office of Advanced Concepts and Technology (Code C) jointly funded an applied research project to investigate technologies which can be used to reduce configuration time. This resulted in the development and application of AI-based automated operations technology in a prototype system, the Link Monitor and Control Operator Assistant (LMC OA). The LMC OA was tested over the course of three months in a parallel experimental mode on very long baseline interferometry (VLBI) operations at the Goldstone Deep Space Communications Center. The tests demonstrated a 44 percent reduction in pre-calibration time for a VLBI pass on the 70-m antenna. Currently, this technology is being developed further under Research and Technology Operating Plan (RTOP)-72 to demonstrate the applicability of the technology to operations in the entire Deep Space Network.

Lee, L. F.↗
NASA NTRS1997

Direct Adaptive Aircraft Control Using Dynamic Cell Structure Neural Networks

A Dynamic Cell Structure (DCS) Neural Network was developed which learns topology representing networks (TRNS) of F-15 aircraft aerodynamic stability and control derivatives. The network is integrated into a direct adaptive tracking controller. The combination produces a robust adaptive architecture capable of handling multiple accident and off- nominal flight scenarios. This paper describes the DCS network and modifications to the parameter estimation procedure. The work represents one step towards an integrated real-time reconfiguration control architecture for rapid prototyping of new aircraft designs. Performance was evaluated using three off-line benchmarks and on-line nonlinear Virtual Reality simulation. Flight control was evaluated under scenarios including differential stabilator lock, soft sensor failure, control and stability derivative variations, and air turbulence.

Jorgensen, Charles C.↗
DOE OSTI2022

Application of Advanced Metering Infrastructure Data to Advanced Utility System Operations: Cooperative Research and Development, CRADA Number CRD-17-00712 (Final Report)

The primary objective of the proposed project is to evaluate the capabilities of Advanced Metering Infrastructure (AMI) based controls for grid operations. This includes monitoring and control at the secondary transformer level using existing AMI infrastructure. In addition, some of the challenges of using a model-less control will also be identified. The lessons learned will be disseminated to other utilities around the country through peer-reviewed publications with the consent of SDG&E. The scope of the work includes using data from SDG&E's existing AMI infrastructure and working with third party vendors selected by SDG&E. The grid edge monitoring systems and controls provided by the selected vendors will perform grid operations using AMI data. The National Renewable Energy Laboratory (NREL) will perform a software and controller-based evaluation of the grid edge controller, intelligent devices and sensors, at the Energy System Integration Facility (ESIF) laboratory.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Search for top squarks in final states with many light-flavor jets and 0, 1, or 2 charged leptons in proton-proton collisions at $\sqrt{s}=13$ TeV

Several new physics models including versions of supersymmetry (SUSY) characterized by R-parity violation (RPV) or with additional hidden sectors predict the production of events with top quarks, low missing transverse momentum, and many additional quarks or gluons. The results of a search for top squarks decaying to two top quarks and six additional light-flavor quarks or gluons are reported. The search employs a novel machine learning method for background estimation from control samples in data using decorrelated discriminators. The search is performed using events with 0, 1, or 2 electrons or muons in conjunction with at least six jets. No requirement is placed on the magnitude of the missing transverse momentum. The result is based on a sample of proton-proton collisions at $\sqrt{s}=13$ TeV corresponding to 138 fb −1 of integrated luminosity collected with the CMS detector at the LHC in 2016–2018. With no statistically significant excess of events observed beyond the expected contributions from the standard model, the data are used to determine upper limits on the top squark pair production cross section in the frameworks of RPV and stealth SUSY. Models with top squark masses less than 700 (930) GeV are excluded at 95% confidence level for RPV (stealth) SUSY scenarios.

Hadron-Hadron Scattering↗
DOE OSTI2025

Adaptive anomaly detection for identifying attacks in cyber-physical systems: A systematic literature review

Modern cyberattacks in cyber-physical systems (CPS) rapidly evolve and cannot be deterred effectively with most current methods, which focus on characterizing past threats. Adaptive anomaly detection (AAD) is among the most promising techniques to detect evolving cyberattacks, with an emphasis on fast data processing and model adaptation. AAD has been researched extensively; however, to the best of our knowledge, our work is the first systematic literature review (SLR) on current research in this field. We present a comprehensive SLR, gathering 397 relevant papers and systematically analyzing 65 of them (47 research and 18 survey papers) on AAD in CPS from 2013 to November 2023. We introduce a novel taxonomy considering attack types, CPS application, learning paradigm, data management, and algorithms. Our findings show that most studies addressed either model adaptation or data processing, but rarely both simultaneously. This indicates a research gap in fully adaptive solutions. We also categorize algorithms, datasets, and attack characteristics, and summarize strengths and weaknesses across the literature. Our review provides a structured and accessible reference for researchers and practitioners, offering insights into key trends and highlighting limitations in current approaches. Finally, we outline several future research directions, including the need for integrated real-time processing and adaptive learning, explainability, and uncertainty quantification in AAD for CPS.

Adaptation↗
DOE OSTI2021

Industrial control system device classification using network traffic features and neural network embeddings

Characterization of modern cyber–physical Industrial Control System (ICS) devices is critical to the evaluation of their security posture and an understanding of the underlying industrial processes with which they interact. In this work, we address two related ICS device identification tasks: (1) separating ICS from non-ICS devices and (2) identifying specific ICS device types. We propose two distinct methods (one based on the existing IP2Vec method, and a novel traffic-features-based method) for achieving the first task. For transferability of the first task between two datasets, the traffic-features-based method performs significantly better (75% overall accuracy) compared to IP2Vec (22.5% overall accuracy). We further propose a novel method called DNP2Vec to address the second task. DNP2Vec is evaluated on two different datasets and achieves perfect multi-class classification accuracy (100%) for both datasets.

42 ENGINEERING↗
DOE OSTI2021

Machine learning-enabled prediction of chemical durability of A 2 B 2 O 7 pyrochlore and fluorite

Pyrochlore-structure type and its derivative in a general formula A 2 B 2 O 7 (A = rare earth elements and actinides; B = Ti, Sn, Zr, Hf, Pb, Si, etc.) display excellent structural flexibility and rich crystal chemistry as promising nuclear waste form materials capable of immobilizing actinides and fission products. It is essential to understand these materials’ chemical durability and element release of radionuclides in order to evaluate their performance in near-field environment. However, it is a formidable grand technological challenge to experimentally perform durability testing across hundreds of thousands of possibilities resulting from their extreme compositional complexities due to cation substitutions at both A and B-sites. In this work, we demonstrate a machine learning approach to determine the key materials parameters and structural characteristics governing the leaching behaviors from a small set of selected compositions as model systems, enabling a science-based prediction of their chemical durability that can be extended to a wide range of chemical compositions. The combination of four key structural characteristics and materials parameters, including ionic radius size difference , ionic potential difference , electronegativity difference , and lattice parameter , creates features an optimized prediction of the chemical durability. Two machine learning models, linear regression and Kernel ridge regression models, are trained on the randomly-split training dataset derived from the experimentally-determined elemental release rates, and subsequently tested on the testing dataset. The predicted leaching rates from both machine learning models show an excellent agreement with the experimental data, demonstrating the feasibility of rapidly evaluating the material properties of new compositions. These results highlight the immense potential of synergizing informatics through machine learning-based models and well-controlled experiments of selected model systems to accelerate materials design and discovery with optimized compositions and performance of promising materials for effective nuclear waste management.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Disruption event characterization and forecasting in tokamaks

Disruption prediction and avoidance is a critical need for next-step tokamaks, such as ITER. Disruption Event Characterization and Forecasting (DECAF) research fully automates analysis of tokamak data to determine chains of events that lead to disruptions and to forecast their evolution allowing sufficient time for mitigation or complete avoidance of the disruption. Disruption event chains related to local rotating or global magnetohydrodynamic (MHD) modes and vertical instability are examined with warnings issued for many off-normal physics events, including density limits, plasma dynamics, confinement transitions, and profile variations. Along with Greenwald density limit evaluation, a local radiative island power balance theory is evaluated and compared to the observation of island growth. Automated decomposition and analysis of rotating tearing modes produce physical event chains leading to disruptions. A total MHD state warning model comprised of 15 separate criteria produces a disruption forecast about 180 ms before a standard locked mode detector warning. Single DECAF event analyses have begun on KSTAR, MAST, and NSTX/-U databases with thousands of shot seconds of device operation using from 0.5 to 1 × 10 6 tested sample times per device. An initial multi-device database comparison illustrates a highly important result that plasma disruptivity does not need to increase as βN increases. Global MHD instabilities, such as resistive wall modes (RWMs), can give the briefest time period of warning before disruption compared to other physics events. In an NSTX database with unstable RWMs, the mode onset, loss of boundary and current control, and disruption event warnings are found in all cases and vertical displacement events are found in 91% of cases. An initial time-dependent reduced physics model of kinetic RWM stabilization created to forecast the disruption chain predicts instability 84% of the time for experimentally unstable cases with a relatively low false positive rate. Instances of the disruption event chain analysis illustrate dynamics including H–L back transitions for rotating MHD and global RWM triggering events. Furthermore, disruption warnings are issued with sufficient time before the disruption (on transport timescales) to potentially allow active profile control for disruption avoidance, active mode control, or mitigation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Autonomous sputter synthesis of thin film nitrides with composition controlled by Bayesian optimization of optical plasma emission

Autonomous experimentation has emerged as an efficient approach to accelerate the pace of material discovery. Although instruments for autonomous synthesis have become popular in molecular and polymer science, solution processing of hybrid materials, and nanoparticles, examples of autonomous tools for physical vapor deposition are scarce yet important for the semiconductor industry. Here, we report the design and implementation of an autonomous workflow for sputter deposition of thin films with controlled composition, leveraging a highly automated sputtering reactor custom-controlled by Python, optical emission spectroscopy (OES), and a Bayesian optimization algorithm. We modeled film composition, measured by x-ray fluorescence, as a linear function of plasma emission lines monitored during co-sputtering from elemental Zn and Ti targets in an N 2 and Ar atmosphere. A Bayesian control algorithm, informed by OES, navigates the space of sputtering power to fabricate films with user-defined compositions by minimizing the absolute error between desired and measured optical emission signals. We validated our approach by autonomously fabricating Zn x Ti 1-x N y films that deviate from the targeted cation composition by a relative ±3.5%, even for 15 nm thin films, demonstrating that the proposed approach can reliably synthesize thin films with a specific composition and minimal human interference. Moreover, the proposed method can be extended to more difficult synthesis experiments where plasma intensity lines depend non-linearly on pressure, or the elemental sticking coefficients strongly depend on the substrate temperature.

36 MATERIALS SCIENCE↗
DOE OSTI2022

A New Shape Optimization Approach for Lightweighting Electric Machines Inspired by Additive Manufacturing

Minimizing the mass in electric machines while maintaining superior performance is a new requirement for the advancement of drivetrains used in wind energy and electric mobility. Topology optimization (TO) for lightweighting electric machines using traditional approaches typically explores a restricted design space allowed by standard parametrizable geometry and manufacturing, while advanced methods, such as cell-based density approaches, suffer from a lack of robust manufacturability constraints during the optimization process. To overcome these drawbacks, we explore a grid-independent, boundary optimization where the outer shape of the magnet is parameterized using Bezier curves. We conduct a design of experiments (DOE) to study the effect of different magnet shapes on machine performance by varying the control points on the Bezier curves. A machine-learning-based surrogate model is constructed using the data from the DOE to quantify the relationship between the control points, air-gap torque, and mass. The control points are then optimized to maximize the torque density. The approach is used for minimizing electrical steel mass in the International Energy Agency (IEA) 15-MW radial flux direct-drive wind turbine generator. The new approach to shape optimization resulted in smooth and concise shapes that can be easily additively manufactured with up to a 20-ton reduction in electrical steel mass.

additive manufacturing↗
DOE OSTI2021

Local Power-Voltage Sensitivity and Thevenin Impedance Estimation from Phasor Measurements

This paper describes how to use voltage phasor measurements to produce a sensitivity matrix that describes how real and reactive power injections at a node on a distribution network affect the local voltage magnitude and angle. Rather than estimating the sensitivity directly, the voltage phasor measurements and power commands/measurements are used to estimate the unbalanced, three-phase Thevenin impedance. The Thevenin impedance estimation is conducted using recursive least squares on temporal difference measurements. The Thevenin impedance and voltage phasor measurement are then used to build the local power-voltage sensitivity matrix with the closed form expression for the Jacobian of the power flow manifold. Hardware-in-the-loop simulations with phasor measurement units providing real phasor measurements are used to evaluate the recursive temporal difference Thevenin impedance estimation and Thevenin-based power-voltage sensitivity methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Deep Reinforcement Learning From Demonstrations to Assist Service Restoration in Islanded Microgrids

Microgrids can be operated in island mode during utility grid outages to support service restoration and improve system resilience. To schedule and dispatch distributed energy resources (DERs) in an islanded microgrid, conventional model-based methods rely on accurate distribution network models and lack generalization and adaptability. Data-driven methods are promising for DER coordination but face practical challenges such as potential hazards to microgrids during online training and insufficient online training opportunities due to low outage rates. This paper presents a novel two-stage learning framework that builds on the deep deterministic policy gradient from demonstrations to identify an optimal restoration strategy. At the pre-training stage, imitation learning is applied to equip the control agent with expert experiences to guarantee acceptable initial performance. At the online training stage, action clipping, reward shaping, and expert demonstrations are leveraged to ensure safe exploration while accelerating the training process. In conclusion, the proposed method is illustrated using the IEEE 123-node system and compared with a representative model-based method and the standard deep deterministic policy gradient method to prove solution accuracy and demonstrate increased computational efficiency.

Du, Yan↗
DOE OSTI2022

Installation and imaging of thousands of minirhizotrons to phenotype root systems of field-grown plants

Roots are vital to plant performance because they acquire resources from the soil and provide anchorage. However, it remains difficult to assess root system size and distribution because roots are inaccessible in the soil. Existing methods to phenotype entire root systems range from slow, often destructive, methods applied to relatively small numbers of plants in the field to rapid methods that can be applied to large numbers of plants in controlled environment conditions. Much has been learned recently by extensive sampling of the root crown portion of field-grown plants. But, information on large-scale genetic and environmental variation in the size and distribution of root systems in the field remains a key knowledge gap. Minirhizotrons are the only established, non-destructive technology that can address this need in a standard field trial. Prior experiments have used only modest numbers of minirhizotrons, which has limited testing to small numbers of genotypes or environmental conditions. This study addressed the need for methods to install and collect images from thousands of minirhizotrons and thereby help break the phenotyping bottleneck in the field. Over three growing seasons, methods were developed and refined to install and collect images from up to 3038 minirhizotrons per experiment. Modifications were made to four tractors and hydraulic soil corers mounted to them. High quality installation was achieved at an average rate of up to 84.4 minirhizotron tubes per tractor per day. A set of four commercially available minirhizotron camera systems were each transported by wheelbarrow to allow collection of images of mature maize root systems at an average rate of up to 65.3 tubes per day per camera. This resulted in over 300,000 images being collected in as little as 11 days for a single experiment. The scale of minirhizotron installation was increased by two orders of magnitude by simultaneously using four tractor-mounted, hydraulic soil corers with modifications to ensure high quality, rapid operation. Image collection can be achieved at the corresponding scale using commercially available minirhizotron camera systems. Along with recent advances in image analysis, these advances will allow use of minirhizotrons at unprecedented scale to address key knowledge gaps regarding genetic and environmental effects on root system size and distribution in the field.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

AI for Science: Report on the Department of Energy (DOE) Town Halls on Artificial Intelligence (AI) for Science

The report documents the DOE Town Halls held during 2019 at Argonne National Laboratory, Oak Ridge National Laboratory, Lawrence Berkeley National Laboratory, and in Washington, DC. From July to October 2019, the Argonne, Oak Ridge, and Berkeley National Laboratories hosted a series of four town hall meetings attended by more than 1,000 U.S. scientists and engineers. The goal of the town hall series was to examine scientific opportunities in the areas of artificial intelligence (AI), Big Data, and high-performance computing (HPC) in the next decade, and to capture the big ideas, grand challenges, and next steps to realizing these opportunities. In this report and in the Department of Energy (DOE) laboratory community, we use the term “AI for Science” to broadly represent the next generation of methods and scientific opportunities in computing, including the development and application of AI methods (e.g., machine learning, deep learning, statistical methods, data analytics, automated control, and related areas) to build models from data and to use these models alone or in conjunction with simulation and scalable computing to advance scientific research. The AI for Science town hall discussions focused on capturing the transformational uses of AI that employ HPC and/or data analysis, leveraging data sets from HPC simulations or instruments and user facilities, and addressing scientific challenges unique to DOE user facilities and the agency’s wide-ranging fundamental and applied science enterprise.

36 MATERIALS SCIENCE↗