SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Prediction of DIII-D Pedestal Structure From Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. Here, an experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (n e ) and electron temperature (T e ) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (I p ), toroidal magnetic field (B Φ ), neutral beam heating power (P NBI ) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

Adaptive Circuit Learning for Quantum Metrology

Quantum sensing is an important application of emerging quantum technologies. We explore whether a hybrid system of quantum sensors and quantum circuits can surpass the classical limit of sensing. In particular, we use optimization techniques to search for encoder and decoder circuits that scalably improve sensitivity under given application and noise characteristics. Furthermore, our approach uses a variational algorithm that can learn a quantum sensing circuit based on platform-specific control capacity, noise, and signal distribution. The quantum circuit is composed of an encoder which prepares the optimal sensing state and a decoder which gives an output distribution containing information of the signal. We optimize the full circuit to maximize the Signal-to-Noise Ratio (SNR). Furthermore, this learning algorithm can be run on real hardware scalably by using the "parameter-shift" rule which enables gradient evaluation on noisy quantum circuits, avoiding the exponential cost of quantum system simulation. We demonstrate up to 13.12x SNR improvement over existing fixed protocol (GHZ), and 3.19x Classical Fisher Information (CFI) improvement over the classical limit on 15 qubits using IBM quantum computer. More notably, our algorithm overcomes the decreasing performance of existing entanglement-based protocols with increased system sizes.

42 ENGINEERING↗

DOE OSTI2023

Tyramine and its Amtyr1 receptor modulate attention in honey bees (Apis mellifera)

Animals must learn to ignore stimuli that are irrelevant to survival and attend to ones that enhance survival. When a stimulus regularly fails to be associated with an important consequence, subsequent excitatory learning about that stimulus can be delayed, which is a form of nonassociative conditioning called ‘latent inhibition’. Honey bees show latent inhibition toward an odor they have experienced without association with food reinforcement. Moreover, individual honey bees from the same colony differ in the degree to which they show latent inhibition, and these individual differences have a genetic basis. To investigate the mechanisms that underly individual differences in latent inhibition, we selected two honey bee lines for high and low latent inhibition, respectively. We crossed those lines and mapped a Quantitative Trait Locus for latent inhibition to a region of the genome that contains the tyramine receptor gene Amtyr1 [We use Amtyr1 to denote the gene and AmTYR1 the receptor throughout the text.]. We then show that disruption of Amtyr1 signaling either pharmacologically or through RNAi qualitatively changes the expression of latent inhibition but has little or slight effects on appetitive conditioning, and these results suggest that AmTYR1 modulates inhibitory processing in the CNS. Electrophysiological recordings from the brain during pharmacological blockade are consistent with a model that AmTYR1 indirectly regulates at inhibitory synapses in the CNS. Our results therefore identify a distinct Amtyr1 -based modulatory pathway for this type of nonassociative learning, and we propose a model for how Amtyr1 acts as a gain control to modulate hebbian plasticity at defined synapses in the CNS. We have shown elsewhere how this modulation also underlies potentially adaptive intracolonial learning differences among individuals that benefit colony survival. Finally, our neural model suggests a mechanism for the broad pleiotropy this gene has on several different behaviors.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Enabling scientific machine learning in MOOSE using Libtorch

A neural-network-based machine learning interface has been developed for the Multiphysics Object-Oriented Simulation Environment (MOOSE). The interface relies on Libtorch, the C++ front-end of PyTorch, and enables an online interaction between modern machine learning algorithms and all the existing simulation, modeling, and analysis processes available in MOOSE. New capabilities in MOOSE include the native generation and training of artificial neural networks together with options to load pretrained neural networks in TorchScript format. Furthermore, the MOOSE stochastic tools module (MOOSE-STM) has been enhanced with neural network-based surrogate and reduced-order model generation options for efficient stochastic analyses. Lastly, a reinforcement learning capability has been added to MOOSE-STM for the interactive control and optimization of complex multiphysics problems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Error field detection and correction studies towards ITER operation

In magnetic fusion devices, error field (EF) sources, spurious magnetic field perturbations, need to be identified and corrected for safe and stable (disruption-free) tokamak operation. Within Work Package Tokamak Exploitation RT04, a series of studies have been carried out to test the portability of the novel non-disruptive method, designed and tested in DIII-D (Paz-Soldan et al 2022 Nucl. Fusion62 126007), and to perform an assessment of model-based EF control strategies towards their applicability in ITER. In this paper, the lessons learned, the physical mechanism behind the magnetic island healing, which relies on enhanced viscous torque that acts against the static electro-magnetic torque, and the main control achievements are reported, together with the first design of the asynchronous EF correction current/density controller for ITER.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

Safety-Related Instrumentation & Control Pilot Upgrade Initiation Phase Implementation Report

This research report (1) describes the process followed and products developed during the SR I&C Pilot Project Initial Scoping Phase, and (2) captures lessons learned. Exelon Generation and LWRS collaborated to develop a Digital Transformation Strategy as part of a larger Advanced Concept of Operations. The proposed SR I&C Pilot Upgrade provides a foundation stone for this Digital Transformation that will improve plant safety, reliability, and operational performance while lowering plant Total Cost of Ownership (TCO). Initial Scoping Phase activities for this Pilot Project have been performed in accordance with industry processes that have been adapted to better support digital upgrades. These processes include IP-ENG-001, Standard Design Process (SDP) [Reference 2], NISP-EN-04, Standard Digital Engineering Process (SDEP) [Reference 3], and Electric Power Research Institute (EPRI) Report 3002011816, Digital Engineering Guide (DEG). Completing Initial Scoping Phase Engineering and Operations, Licensing, and Project Management Activities was necessary to sufficiently bound the scope, schedule, and estimated cost of the Project to enable utility management to authorize moving into the Conceptual Design Phase. A significant finding of the Business Case Analysis (BCA) methodology developed and applied as part of this effort was that the growth rate of material costs for sustaining the operation of obsolete SR I&C equipment is accelerating. This directly contributed to the Project Economic Analysis created to justify continuing the Project. Project Initial Scoping Phase lessons learned have also been captured to assist the larger industry in understanding the Digital Transformation Strategy and SR I&C Pilot Project Initial Scoping Phase efforts. This is in keeping with the public/private partnership that has been established between the Department of Energy (DOE) and Exelon for this effort with engagement from the NRC. By addressing first-of-a-kind (FOAK) risks and capturing lessons learned, the SR I&C Pilot Upgrade Project addresses technical, regulatory, and business risks to enable subsequent implementers of similar upgrades.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Decentralized Microgrid Protection Through Relative Fault Direction Classification: Preprint

Protection in inverter-based resources (IBRs) dominated microgrids generally face significant challenges due to the low fault current and inconsistent fault behaviors from IBRs. Recently, machine learning-based approaches have attracted considerable attention to address these challenges. This paper introduces a novel decentralized protection strategy for microgrids. The proposed method decomposes the protection challenge into several distributed learning tasks, enabling individual relays to autonomously determine the direction of faults using a binary classification framework based on support vector machine (SVM) algorithms. Following the distributed fault direction estimation, classifier outcomes are shared among neighboring relays, facilitating a local decision-making process to ascertain the presence of faults within the neighborhood. Finally, a tripping signal is generated based on the classifier results of each relay to operate the circuit breaker. To test and validate this approach, a 100% renewable microgrid model is simulated in MATLAB/Simulink. In the numerical analysis, the application of SVM classifiers in our approach yields impressive results: an average relay classification accuracy of 98%, and a 96% accuracy in circuit breaker control. These findings highlight the potential of machine-learning-based approaches in enhancing the efficiency and reliability of microgrid protection systems.

decentralized algorithm↗

DOE OSTI2023

Train, Inform, Borrow, or Combine? Approaches to Process–Guided Deep Learning for Groundwater–Influenced Stream Temperature Prediction

Although groundwater discharge is a critical stream temperature control process, it is not explicitly represented in many stream temperature models, an omission that may reduce predictive accuracy, hinder management of aquatic habitat, and decrease user confidence. We assessed the performance of a previously-described process-guided deep learning model of stream temperature in the Delaware River Basin (USA). We found lower accuracy (root mean square error [RMSE] of 1.71 versus 1.35°C) and stronger seasonal bias (absolute mean monthly bias of 1.06 vs. 0.68°C) for reaches primarily influenced by deep groundwater as compared to atmospheric conditions. We then tested four approaches for improving groundwater process representation: (a) a custom loss function leveraging the unique patterns of air and water temperature coupling characteristic of different temperature drivers, (b) inclusion of additional groundwater-relevant catchment attributes, (c) incorporation of additional process model outputs, and (d) a composite model. The custom loss function and the additional attributes significantly improved the predictive accuracy in groundwater-dominated reaches (RMSE of 1.37 and 1.26°C) and reduced the seasonal bias (absolute mean monthly bias of 0.44 and 0.48°C), but neither approach could identify holdout groundwater reaches. Variable importance analysis indicates the custom loss function nudges the model to use the existing inputs more efficiently, whereas with the added features the model relies on a broader suite of inputs. This analysis is a substantial step toward more accurately representing groundwater discharge processes in stream temperature models and will improve predictive accuracy and inform habitat management.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1987

Shuttle orbit flight control design lessons - Direction for Space Station

The Space Shuttle orbit flight control system, which operates during all exo-atmospheric flight phases, has successfully met operational requirements. Many design integration and operational issues that required resolution during development and testing provide an experience base that will benefit the development of future space systems, particularly the Space Station. To this end, the applicable Shuttle and Space Station hardware/software is reviewed with some perspective provided on how current design groundrules were derived and how issues that affected the Shuttle orbit control system design are a pathway for the Space Station. Some of the most significant lessons learned from the Shuttle are summarized, with a discussion of the effect of performance and design of hardware, including the data processing system on software structures and usage procedures. Crew interface issues and important results from man-in-the-loop tests are summarized. Problems resulting from trying to meet difficult orbital operational objectives, including some sophisticated payload operations are characterized. Several proposed Shuttle flight control design improvements, developed in response to some of the lessons learned so far, are identified. Potential application of the Shuttle design lessons and new control technologies to the Space Station are discussed.

Cox, Kenneth J.↗

NASA NTRS1992

Clustering of tethered satellite system simulation data by an adaptive neuro-fuzzy algorithm

Recent developments in neuro-fuzzy systems indicate that the concepts of adaptive pattern recognition, when used to identify appropriate control actions corresponding to clusters of patterns representing system states in dynamic nonlinear control systems, may result in innovative designs. A modular, unsupervised neural network architecture, in which fuzzy learning rules have been embedded is used for on-line identification of similar states. The architecture and control rules involved in Adaptive Fuzzy Leader Clustering (AFLC) allow this system to be incorporated in control systems for identification of system states corresponding to specific control actions. We have used this algorithm to cluster the simulation data of Tethered Satellite System (TSS) to estimate the range of delta voltages necessary to maintain the desired length rate of the tether. The AFLC algorithm is capable of on-line estimation of the appropriate control voltages from the corresponding length error and length rate error without a priori knowledge of their membership functions and familarity with the behavior of the Tethered Satellite System.

Mitra, Sunanda↗

DOE OSTI2015

Learn-as-you-go acceleration of cosmological parameter estimates

Cosmological analyses can be accelerated by approximating slow calculations using a training set, which is either precomputed or generated dynamically. However, this approach is only safe if the approximations are well understood and controlled. This paper surveys issues associated with the use of machine-learning based emulation strategies for accelerating cosmological parameter estimation. We describe a learn-as-you-go algorithm that is implemented in the Cosmo++ code and (1) trains the emulator while simultaneously estimating posterior probabilities; (2) identifies unreliable estimates, computing the exact numerical likelihoods if necessary; and (3) progressively learns and updates the error model as the calculation progresses. We explicitly describe and model the emulation error and show how this can be propagated into the posterior probabilities. We apply these techniques to the Planck likelihood and the calculation of ΛCDM posterior probabilities. The computation is significantly accelerated without a pre-defined training set and uncertainties in the posterior probabilities are subdominant to statistical fluctuations. We have obtained a speedup factor of 6.5 for Metropolis-Hastings and 3.5 for nested sampling. Finally, we discuss the general requirements for a credible error model and show how to update them on-the-fly.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2014

Spacecraft Hybrid Control At NASA: A Look Back, Current Initiatives, and Some Future Considerations

There is a heightened interest within NASA for the design, development, and flight implementation of mixed actuator hybrid attitude control systems for science spacecraft that have less than three functional reaction wheel actuators. This interest is driven by a number of recent reaction wheels failures on aging, but still scientifically productive, NASA spacecraft. This paper describes the highlights of the first NASA Cross-Center Hybrid Control Workshop that was held in Greenbelt, Maryland in April of 2013 under the sponsorship of the NASA Engineering and Safety Center (NESC). A brief historical summary of NASA's past experiences with spacecraft mixed actuator hybrid attitude control approaches, some of which were implemented on-orbit, will be provided. This paper will also convey some of the lessons learned and best practices captured at that workshop. Some relevant recent and current hybrid control activities will be described with an emphasis on work in support of a repurposed Kepler spacecraft. Specific technical areas for future considerations regarding spacecraft hybrid control will also be identified.

attitude control↗

DOE OSTI2024

Controlling radioisotope proportions when randomly sampling from Dirichlet distributions in PyRIID

As machine learning models for radioisotope quantification become more powerful, likewise the need for high-quality synthetic training data grows as well. For problem spaces that involve estimating the relative isotopic proportions of various sources in gamma spectra it is necessary to generate training data that accurately represents the variance of proportions encountered. In this report, we aim to provide guidance on how to target a desired variance of proportions which are randomly when using the PyRIID Seed Mixer, which samples from a Dirichlet distribution. We provide a method for properly parameterizing the Dirichlet distribution in order to maintain a constant variance across an arbitrary number of dimensions, where each dimension represents a distinct source template being mixed. We demonstrate that our method successfully parameterizes the Dirichlet distribution to target a specific variance of proportions, provided that several conditions are met. This allows us to follow a principled technique for controlling how random mixture proportions are generated which are then used downstream in the synthesis process to produce the final, noisy gamma spectra.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

Deep Learning with Reflection High-Energy Electron Diffraction Images to Predict Cation Ratio in Sr 2 x Ti 2(1– x ) O 3 Thin Films

Machine learning (ML) with in-situ diagnostics offers a transformative approach to accelerate, understand, and control thin film synthesis by uncovering relationships between synthesis conditions and material properties. In this study, we demonstrate the application of deep learning to predict the stoichiometry of Sr 2x Ti 2(1–x) O 3 thin films using reflection high-energy electron diffraction images acquired during pulsed laser deposition. A gated convolutional neural network trained for regression of the Sr atomic fraction achieved accurate predictions with a small dataset of 31 samples. Explainable AI techniques revealed a previously unknown correlation between diffraction streak features and cation stoichiometry in Sr 2x Ti 2(1–x) O 3 thin films. Here, our results demonstrate how ML can be used to transform a ubiquitous in-situ diagnostic tool, that is usually limited to qualitative assessments, into a quantitative surrogate measurement of continuously valued thin film properties. Such methods are critically needed to enable real-time control, autonomous workflows, and accelerate traditional synthesis approaches.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2015

Enabling Automated Dynamic Demand Response: From Theory to Practice

Demand response (DR) is a technique used in smart grids to shape customer load during peak hours. Automated DR offers utilities a fine grained control and a high degree of confidence in the outcome. However the impact on the customer's comfort means this technique is more suited for industrial and commercial settings than for residential homes. In this paper we propose a system for achieving automated controlled DR in a heterogeneous environment. We present some of the main issues arising in building such a system, including privacy, customer satisfiability, reliability, and fast decision turnaround, with emphasis on the solutions we proposed. Based on the lessons we learned from empirical results we describe an integrated automated system for controlled DR on the USC microgrid. Results show that while on a per building per event basis the accuracy of our prediction and customer selection techniques varies, it performs well on average when considering several events and buildings.

Frincu, Marc↗

DOE OSTI2020

Safety-Related Instrumentation and Control Pilot Upgrade (Initial Scoping Phase Implementation Report)

This research report (1) describes the process followed and products developed during the SR I&C Pilot Project Initial Scoping Phase, and (2) captures lessons learned. Exelon Generation and LWRS collaborated to develop a Digital Transformation Strategy as part of a larger Advanced Concept of Operations. The proposed SR I&C Pilot Upgrade provides a foundation stone for this Digital Transformation that will improve plant safety, reliability, and operational performance while lowering plant Total Cost of Ownership (TCO). Initial Scoping Phase activities for this Pilot Project have been performed in accordance with industry processes that have been adapted to better support digital upgrades. These processes include IP-ENG-001, Standard Design Process (SDP), NISP-EN-04, Standard Digital Engineering Process (SDEP), and Electric Power Research Institute (EPRI) Report 3002011816, Digital Engineering Guide (DEG). Completing Initial Scoping Phase Engineering and Operations, Licensing, and Project Management Activities was necessary to sufficiently bound the scope, schedule, and estimated cost of the Project to enable utility management to authorize moving into the Conceptual Design Phase. A significant finding of the Business Case Analysis (BCA) methodology developed and applied as part of this effort was that the growth rate of material costs for sustaining the operation of obsolete SR I&C equipment is accelerating. This directly contributed to the Project Economic Analysis created to justify continuing the Project. Project Initial Scoping Phase lessons learned have also been captured to assist the larger industry in understanding the Digital Transformation Strategy and SR I&C Pilot Project Initial Scoping Phase efforts. This is in keeping with the public/private partnership that has been established between the Department of Energy (DOE) and Exelon for this effort with engagement from the NRC. By addressing first-of-a-kind (FOAK) risks and capturing lessons learned, the SR I&C Pilot Upgrade Project addresses technical, regulatory, and business risks to enable subsequent implementers of similar upgrade.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Heterogeneous Mixtures of Dictionary Functions to Approximate Subspace Invariance in Koopman Operators: Why Deep Koopman Operators Work

Abstract Koopman operators model nonlinear dynamics as a linear dynamic system acting on a nonlinear function as the state. This nonstandard state is often called a Koopman observable and is usually approximated numerically by a superposition of functions drawn from a dictionary . In a widely used algorithm, extended dynamic mode decomposition (EDMD), the dictionary functions are drawn from a fixed class of functions. Deep learning combined with EDMD has been used to learn novel dictionary functions in an algorithm called deep dynamic mode decomposition (deepDMD). The learned representation both (1) accurately models and (2) scales well with the dimension of the original nonlinear system. In this paper, we analyze the learned dictionaries from deepDMD and explore the theoretical basis for their strong performance. We explore State-Inclusive Logistic Lifting (SILL) dictionary functions to approximate Koopman observables. Error analysis of these dictionary functions show they satisfy a property of subspace approximation, which we define as uniform finite approximate closure. Typically, a Koopman dictionary’s nonlinear functions are homogeneous. In this paper, we discover that structured mixing of heterogeneous dictionary functions drawn from different classes of nonlinear functions achieve the same accuracy and dimensional scaling as the deep-learning-based deepDMD algorithm Yeung et al. ( In: 2019 American Control Conference (ACC), 2019). We specifically show this by building a heterogeneous dictionary comprised of SILL functions and conjunctive radial basis functions (RBFs). This mixed dictionary achieves similar accuracy and dimensional scaling to deepDMD with an order of magnitude reduction in parameters, while maintaining geometric interpretability. These results strengthen the viability of dictionary-based Koopman models to solving high-dimensional nonlinear learning problems.

Johnson, Charles A.↗

NASA NTRS2005

Atmospheric/Space Environment Support Lessons Learned Regarding Aerospace Vehicle Design and Operations

In modern government and aerospace industry institutions the necessity of controlling current year costs often leads to high mobility in the technical workforce, "one-deep" technical capabilities, and minimal mentoring for young engineers. Thus, formal recording, use, and teaching of lessons learned are especially important in the maintenance and improvement of current knowledge and development of new technologies, regardless of the discipline area. Within the NASA Technical Standards Program Website http://standards.nasa.gov there is a menu item entitled "Lessons Learned/Best Practices". It contains links to a large number of engineering and technical disciplines related data sets that contain a wealth of lessons learned information based on past experiences. This paper has provided a small sample of lessons learned relative to the atmospheric and space environment. There are many more whose subsequent applications have improved our knowledge of the atmosphere and space environment, and the application of this knowledge to the engineering and operations for a variety of aerospace programs.

Vaughan, William W.↗