Search NASA⌕ Search

SEARCH · Search NASA

Results for “Learning control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

Lessons Learned During the Refurbishment and Testing of an Observatory After Long-Term Storage

Thermal Fluids Analysis Workshop (TFAWS) 2015, Silver Spring, MD NCTS 21070-15. This paper addresses the lessons learned during the refurbishment and testing of the thermal control system for a spacecraft which was placed into long-term storage. The DSCOVR (Deep Space Climate Observatory) Observatory (formerly known as Triana) was originally scheduled to launch on the Space Shuttle in 2002. With the Triana spacecraft nearly complete, the mission was canceled and the satellite was abruptly put into storage in 2001. In 2008 the observatory was removed from storage to begin refurbishment and testing. Problems arose associated with hardware that was not currently manufactured, coatings degradation, and a significant lack of documentation. Also addressed is the conversion of the thermal and geometric math models for use with updated thermal analysis software tools.

Thermal Control System↗

Addressing Human Error in International Space Station Flight Control Teams: Advances in Ground Training for Science Operators

In flight control, as with any human in the loop system, operator error is an inevitable reality. On the International Space Station (ISS) where crew time and physical resources are precious and often irreplaceable, operator errors can result in significant, irreversible consequences. Flight controllers at the Payload Operations Integration Center (POIC) located at NASA's Marshall Space Flight Center (MSFC) in Huntsville, Alabama know this reality well. At the POIC, operator errors can be caused by a variety of factors, from poor hardware or software design to environmental factors such as time pressure or fatigue. The most difficult errors to address, however, are those which result from ineffective teamwork. To address these teamwork errors, trainers at the POIC have drawn best practices from high reliability industries as well as from our sister ISS control center at the Johnson Space Center (JSC) in Houston, Texas, to develop and implement a new training program focused specifically on teamwork skills. This training program, called Team Skills Training, is inspired by modern and historical training programs developed by NASA and is specifically tailored to the needs of the payload operations flight control team at the POIC. The program consists of training for both certified and trainee flight controllers, and covers team skills topics such as situational awareness, leadership, and communication skills. To maximize effectiveness, the program uses novel instructional techniques which extend beyond the classroom to encourage students to apply what they have learned to their day to day work. Minimizing operator errors in flight control is an endeavor which requires constant vigilance and continuous improvement. At the POIC, Team Skills Training is an important step in this journey.

Harris, Samantha S.↗

Commissioning the James Webb Space Telescope Observatory

The James Webb Space Telescope (JWST) is going through final integration and testing and is planned to launch in 2021. The last remaining optical challenge for JWST is to fully align the observatory in flight to meet the optical requirements but this effort involves many system considerations to do this safely and efficiently and the entire effort will take several months. This talk will cover what it takes to deploy and optically commission the telescope including the many interactions and constraints of deployment, thermal, optical, attitude control and contamination properties of the observatory. The talk will cover the final optical requirements that the telescope will need to meet and will provide the roadmap of timelines, cooldown profiles, Wavefront Sensing and Control steps, system constraint considerations, and implementation of lessons learned from the ground test campaign that will result in meeting those optical requirements. The talk will also cover the organizational structure and processes in place to assure this process will be successful and efficient.

Commissioning JWST OBS↗

A Deep Learning Modeling Framework to Capture Mixing Patterns in Reactive-Transport Systems

Prediction and control of chemical mixing are vital for many scientific areas such as subsurface reactive transport, climate modeling, combustion, epidemiology, and pharmacology. Due to the complex nature of mixing in heterogeneous and anisotropic media, the mathematical models related to this phenomenon are not analytically tractable. Numerical simulations often provide a viable route to predict chemical mixing accurately. However, contemporary modeling approaches for mixing cannot utilize available spatial-temporal data to improve the accuracy of the future prediction and can be compute-intensive, especially when the spatial domain is large and for long-term temporal predictions. To address this knowledge gap, in this work we will present in this paper a deep learning (DL) modeling framework applied to predict the progress of chemical mixing under fast bimolecular reactions. This framework uses convolutional neural networks (CNN) for capturing spatial patterns and long short-term memory (LSTM) networks for forecasting temporal variations in mixing. By careful design of the framework—placement of non-negative constraint on the weights of the CNN and the selection of activation function, the framework ensures non-negativity of the chemical species at all spatial points and for all times. Our DL-based framework is fast, accurate, and requires minimal data for training. The time needed to obtain a forecast using the model is a fraction (≈ O(-6)) of the time needed to obtain the result using a high-fidelity simulation. To achieve an error of 10% (measured using the infinity norm) for capturing local-scale mixing features such as interfacial mixing, only 24% to 32% of the sequence data for model training is required. To achieve the same level of accuracy for capturing global-scale mixing features, the sequence data required for model training is 64% to 70% of the total spatial-temporal data. Hence, the proposed approach—a fast and accurate way to forecast long-time spatial-temporal mixing patterns in heterogeneous and anisotropic media—will be a valuable tool for modeling reactive-transport in a wide range of applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

MARVEL Instrumentation, Control, and Software Considerations

This paper details the various I&C considerations and design decisions made throughout the MARVEL (Micro-reactor Applications Research Validation and Evaluation) project, including sensor and actuator selection, safety-related functionality, digital control hardware and software, and testing methodologies. Key challenges such as managing radiation, temperature, and space constraints are discussed, along with the trade-offs between using standard equipment and custom solutions. The successful integration of off-the-shelf components, the emphasis on minimizing safety-related instrumentation, and the lessons learned from prototyping and testing are highlighted. The authors aim to provide insights that can benefit future micro-reactor designs and emphasize the importance of real-world testing in advancing reactor technology.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Leveraging Multitime Hamilton–Jacobi PDEs for Certain Scientific Machine Learning Problems

Hamilton-Jacobi partial differential equations (HJ PDEs) have deep connections with a wide range of fields, including optimal control, differential games, and imaging sciences. By considering the time variable to be a higher dimensional quantity, HJ PDEs can be extended to the multi-time case. In this paper, we establish a novel theoretical connection between specific optimization problems arising in machine learning and the multi-time Hopf formula, which corresponds to a representation of the solution to certain multi-time HJ PDEs. Through this connection, we increase the interpretability of the training process of certain machine learning applications by showing that when we solve these learning problems, we also solve a multi-time HJ PDE and, by extension, its corresponding optimal control problem. As a first exploration of this connection, we develop the relation between the regularized linear regression problem and the Linear Quadratic Regulator (LQR). We then leverage our theoretical connection to adapt standard LQR solvers (namely, those based on the Riccati ordinary differential equations) to design new training approaches for machine learning. Lastly, we provide some numerical examples that demonstrate the versatility and possible computational advantages of our Riccati-based approach in the context of continual learning, post-training calibration, transfer learning, and sparse dynamics identification.

97 MATHEMATICS AND COMPUTING↗

Hybrid machine learning/physics-based approach for predicting oxide glass-forming ability

Predicting the liquid compositions that will vitrify at experimentally accessible quench rates remains one of the grand challenges in the field of condensed matter physics. This glass-forming ability can be quantified as the critical quench rate needed to suppress crystallization. Knowledge of this critical quench rate also informs which glass composition could be used for new applications. There have been several physical and empirical models presented in the literature to predict the critical quench rate/glass forming ability. These models range from those theoretically derived to those quantified only through experimental characterization. In this work, we instead propose a new method to calculate the critical quench rate using the recently developed toy landscape model combined with machine learning. The toy landscape model accesses the underlying physics that control the vitrification behavior by directly simulating the liquid thermodynamics and kinetics. In conclusion, the results are discussed in terms of industrial impact, physical insights, and how the glass science community can develop improved predictions of glass-forming ability.

Crystallization↗

Kimberlina 1.2 Velocity Models and Seismic Data

Kimberlina 1.2 Velocity model and synthetic seismic data, produced in collaboration of teams at the National Energy Technology Laboratory, Los Alamos National Laboratory, and Lawrence Livermore National Laboratory through the National Risk Assessment Partnership. Data is associated with the following publication: Zheng Zhou, Youzuo Lin, Zhongping Zhang, Yue Wu, Zan Wang, Robert Dilmore, and George Guthrie, "A Data-Driven CO2 Leakage Detection Using Seismic Data and Spatial-Temporal Densely Connected Convolutional Neural Networks," International Journal of Greenhouse Gas Control, Vol 90, 2019. The Kimberlina 1.2 Velocity models were produced by Zan Wang, Robert Dilmore, William Harbert, and Lianjie Huang at NETL. The following citations are directly related to the creation of the velocity models: Wang, Z. Harbert, W., Dilmore, R., Huang, L. Modeling of time-lapse seismic monitoring using CO2 leakage simulations for a model CO2 storage site with realistic geology: Application in assessment of early leak-detection capabilities. International Journal of Greenhouse Gas Control. V. 76, September 2018, Pages 39-52. https://doi.org/10.1016/j.ijggc.2018.06.011 Wang, Z., Dilmore, R., Harbert, W. Inferring CO2 saturation from synthetic surface seismic and downhole monitoring data using machine learning for leakage detection at CO2 sequestration sites. International Journal of Greenhouse Gas Control, V. 100, September 2020. https://doi.org/10.1016/j.ijggc.2020.103115 The velocity models were built based on the Kimberlina 1.2 aquifer impact data which is associated with the following publications: Buscheck, T.A., Mansoor, K., Yang, X., Wainwright, H., and Carroll, S. (2019). Downhole pressure and chemical monitoring for CO2 and brine leak detection in aquifers above a CO2 storage reservoir. International Journal of Greenhouse Gas Control. 91. 102812. 10.1016/j.ijggc.2019.102812. Xianjin Yang, Thomas A. Buscheck, Kayyum Mansoor, Zan Wang, Kai Gao, Lianjie Huang, Delphine Appriou, Susan A. Carroll, Assessment of geophysical monitoring methods for detection of brine and CO2 leakage in drinking water aquifers, International Journal of Greenhouse Gas Control, Volume 90, 2019, 102803, ISSN 1750-5836, https://doi.org/10.1016/j.ijggc.2019.102803 The synthetic seismic data was produced by Youzuo Lin and team at LANL, and are associated with the following citations: Jordan, P. D., and J. L. Wagoner. Characterizing Construction of Existing Wells to a CO2 Storage Target: The Kimberlina Site, California. Zheng Zhou, Youzuo Lin, Zhongping Zhang, Yue Wu, Zan Wang, Robert Dilmore, and George Guthrie, "A Data-Driven CO2 Leakage Detection Using Seismic Data and Spatial-Temporal Densely Connected Convolutional Neural Networks," International Journal of Greenhouse Gas Control, Vol 90, 2019.

CO2 Leakage↗

Ibis Networks/WattIQ (IN2 Final Report)

Ibis Networks is a full-stack cleantech company that provides plug-level energy monitoring and control to solve energy and asset management problems for the enterprise. During DATES – DATES, an NREL research team worked with the Ibis team to validate their product, the InteliSocket. The Ibis InteliSocket is a pass-through plug-load energy monitor and controller that is designed to reduce energy wasted by common 120 V plug-in devices in commercial office buildings, such as computer peripherals, conference room AV equipment, and break-room appliances. The system can shut off supply power to these end uses via remote control, manual switches, pre-set schedules, or automated control algorithms. The scope of this IN2 project was the development and refinement of “smart” learning behavior algorithms (LBAs), which could help installation processes and dramatically expand the sockets’ capabilities and energy-saving potential by suggesting suitable control schedules that are based on monitored use patterns. While Ibis has the analytical and software expertise for algorithm development, the lack of test data, both in a controlled laboratory setting and in real-life deployment scenarios, represented a key barrier toward commercialization of the product. Assistance through the IN2 program provided an opportunity to conduct the needed “trial and error” algorithm development. The project included baseline field-data collection, laboratory testing, and field validation components, all of which were conducted at the NREL campus between April 2017 and July 2019.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Machine Learning-Based Method to Estimate Transformer Primary-Side Voltages with Limited Customer-Side AMI Measurements

Distribution control applications such as volt/var optimization, network reconfiguration, and distribution automation require accurate knowledge of the distribution system state. The lack of sufficient sensors on the primary side of distribution networks often limits the accuracy of the control decisions by these applications. The deployment of advanced metering infrastructure (AMI) provides utilities an opportunity to translate the AMI data on the secondary onto the primary so that it can be used as pseudo-measurements to augment the limited existing measurements on the primary. This paper develops a machine learning based approach for estimating service transformer primary-side voltages by using limited secondary-side AMI measurement. The machine learning model is developed by using random forest algorithm. The estimated primary-side voltages can be used by utilities as pseudo-measurements for distribution control applications. The detailed secondary model topology, which is an essential input data for many existing algorithms, is not required for the proposed method. The performance of the proposed method is validated by using AMI measurements from the field and an actual distribution feeder model of San Diego Gas & Electric Company.

advanced metering infrastructure↗

Data-based and secure switched cyber–physical systems

In this work, we develop a completely model-free moving target defense framework for the detection and mitigation of sensor and/or actuator attacks in cyber–physical systems with dynamics that evolve in discrete-time. We incorporate an intrusion detection mechanism based on an approximate dynamic programming technique that learns the policies for optimal regulation and optimal tracking while simultaneously defending against actuator and sensor attacks in a model-free fashion. Switching rules are leveraged to force proactive and reactive defense mechanisms as well as, guarantee the stability of the equilibrium point. Finally, as a case study, we apply the proposed moving target defense framework to a DC–DC converter that is used in electric vehicles.

42 ENGINEERING↗

Evaluating Function-as-a-Service (FaaS) frameworks for the Accelerator Control System

As particle accelerator control systems evolve in complexity and scale, the need for responsive, scalable, and cost-effective computational infrastructure becomes increasingly critical. Function-as-a-Service (FaaS) offers an alternative to traditional monolithic architecture by enabling event-driven execution, automatic scaling, and fine-grained resource utilization. This paper explores the applicability and performance of FaaS frameworks in the context of a modern particle accelerator control system, with the objective of evaluating their suitability for short lived and triggered workloads. In this paper, we evaluate prominent open-source FaaS platforms in executing functional logic, triggers, and diagnostics routines. Evaluation metrics consist of cold-start latency, scalability, performance, integration with other open-source tools like Kafka. Experimental workloads were designed to simulate real-world control tasks when implemented as stateless FaaS functions. These workloads were benchmarked under various invocation loads and network conditions. Self-hosted FaaS platforms, when deployed within accelerator networks, offer greater control over execution environment, better integration with legacy systems, and support for real-time guarantees when paired with message queues. Based on lessons learned and evaluation metrics, this paper describes reliability of the FaaS framework for the Accelerator Control Systems (ACS).

Jaikar, A. [Fermilab] (ORCID:0000000332046217)↗

Feature Classification for Control System Devices

Control systems are used to automate industrial processes, smart grids, and smart cities. Unfortunately, cyber attacks on control systems are on the rise. Additionally, control systems lack the plethora of tools available for commodity systems for forensic investigation. An important step towards the proper forensic investigation is to analyze device memory. To assist in identifying features of device memory, we present a machine learning-based technique that integrates ontology information for feature classification in a control system device’s memory.

ahmed mithu, M Rayhan↗

Effects of Motion Cues on the Training of Multi-Axis Manual Control Skills

The study described in this paper investigated the effects of two different hexapod motion configurations on the training and transfer of training of a simultaneous roll and pitch control task. Pilots were divided between two groups which trained either under a baseline hexapod motion condition, with motion typically provided by current training simulators, or an optimized hexapod motion condition, with increased fidelity of the motion cues most relevant for the task. All pilots transferred to the same full-motion condition, representing motion experienced in flight. A cybernetic approach was used that gave insights into the development of pilots use of visual and motion cues over the course of training and after transfer. Based on the current results, neither of the hexapod motion conditions can unambiguously be chosen as providing the best motion for training and transfer of training of the used multi-axis control task. However, the optimized hexapod motion condition did allow pilots to generate less visual lead, control with higher gains, and have better disturbance-rejection performance at the end of the training session compared to the baseline hexapod motion condition. Significant adaptations in control behavior still occurred in the transfer phase under the full-motion condition for both groups. Pilots behaved less linearly compared to previous single-axis control-task experiments; however, this did not result in smaller motion or learning effects. Motion and learning effects were more pronounced in pitch compared to roll. Finally, valuable lessons were learned that allow us to improve the adopted approach for future transfer-of-training studies.

flight simulators↗

A comparative study of machine learning models for predicting the state of reactive mixing

Mixing phenomena are important mechanisms controlling flow, species transport, and reaction processes in fluids and porous media. Accurate predictions of reactive mixing are critical for many Earth and environmental science problems such as contaminant fate and remediation, macroalgae growth, and plankton biomass evolution. Here, to investigate the evolution of mixing dynamics under different scenarios (e.g., anisotropy, fluctuating velocity fields), a finite-element-based numerical model was built to solve the fast, irreversible bimolecular reaction-diffusion equations to simulate a range of reactive-mixing scenarios. A total of 2,315 simulations were performed using different sets of model input parameters comprising various spatial scales of vortex structures in the velocity field, time-scales associated with velocity oscillations, the perturbation parameter for the vortex-based velocity, anisotropic dispersion contrast (i.e., ratio of longitudinal-to-transverse dispersion), and molecular diffusion. The outputs comprised concentration profiles of reactants and products. The inputs to and outputs from these simulations were concatenated into feature and label matrices, respectively, to train 20 different machine learning (ML) models intended to emulate system behavior. These 20 ML emulators, based on linear methods, Bayesian methods, ensemble learning methods, and multilayer perceptrons (MLPs), were trained to classify the state of mixing and predict three quantities of interest (QoIs) characterizing species production, decay (i.e., average concentration, square of average concentration), and degree of mixing (i.e., variances of species concentration). Unsurprisingly, linear classifiers and regressors failed to reproduce the QoIs; however, ensemble methods (classifiers and regressors) and the MLP model accurately classified the state of reactive mixing and the QoIs. Among ensemble methods, random forest and decision-tree-based AdaBoost faithfully predicted the QoIs. At run time, trained ML emulators produced results times faster than the finite-element simulations. Due to their low computational expense and high accuracy, ensemble and MLP models are excellent emulators for these numerical simulations and great utilities in uncertainty quantification exercises, which can require 1,000s of forward model runs.

97 MATHEMATICS AND COMPUTING↗

Pd–Methyl Bond Energy─Property Correlations, Noncorrelations, Machine Learning Models, and Application to Polymerization Catalysis

Metal–carbon bonds are a key intermediate in a variety of homogeneous organometallic transformations and often determine the critical thermodynamics and kinetics of catalytic processes. Surprisingly, the influence of different ligands on metal–carbon bond strengths has been largely overlooked. Here, in this study, we evaluated nearly 700 experimental Pd–methyl complexes by calculating their bond dissociation energies using density functional theory (DFT) and compared these bond strengths to several fundamental molecular properties, and this revealed several surprising correlations and noncorrelations. Most surprising was that several fundamental properties, such as the bond length, bond force constant, and bond electron density, have no correlation with bond strength, despite these correlations often holding for main-group compounds. We were indeed able to identify key ligand-dependent chemical features/descriptors that provided a highly accurate machine learning model and provided insight into the general factors that control the Pd–carbon bond strength, such as radical delocalization and nucleophilicity. Insights gained from the Pd–Me bond energy analysis were then applied to CO migratory insertion steps that are part of copolymerization reactions.

binding energy↗