Search NASA⌕ Search

SEARCH · Search NASA

Results for “on-line learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Simulating and Estimating the Behavior of a Neuromorphic Co-Processor

Neuromorphic computing represents one technology likely to be incorporated into future supercomputers. In this work, we present initial results on a potential neuromorphic co-processor, including a preliminary device design that includes memristors, estimates on energy usage for the co-processor, and performance of an on-line learning mechanism. We also present a high-level co-processor simulator used to estimate the performance of the neuromorphic co-processor on real applications. We discuss future use-cases of a potential neuromorphic co-processor in the supercomputing environment, including as an accelerator for supervised learning and for unsupervised, on-line learning tasks. Finally, we discuss plans for future work.

Schuman, Catherine↗

Deep Reinforcement Learning based Model-free On-line Dynamic Multi-Microgrid Formation to Enhance Resilience

Multi-microgrid formation (MMGF) is a promising solution for enhancing power system resilience. This paper proposes a new deep reinforcement learning (RL) based model-free on-line dynamic MMGF scheme. Additionally, the dynamic MMGF problem is formulated as a Markov decision process, and a complete deep RL framework is specially designed for the topologytransformable micro-grids. In order to reduce the large action space caused by flexible switch operations, a topology transformation method is proposed and an action-decoupling Q-value is applied. Then, a convolutional neural network (CNN) based multi-buffer double deep Q-network (CM-DDQN) is developed to further improve the learning ability of the original DQN method. The proposed deep RL method provides real-time computing to support the on-line dynamic MMGF scheme, and the scheme handles a long-term resilience enhancement problem using an adaptive on-line MMGF to defend changeable conditions. The effectiveness of the proposed method is validated using a 7-bus system and the IEEE 123-bus system. The results show strong learning ability, timely response for varying system conditions and convincing resilience enhancement.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Towards Autonomous Experiments by Connecting High Performance Microscopy with High Performance Computing

The digitization of controls, data, and analysis in microscopy is bringing the idea of autonomous microscopes closer to reality than ever before. Automated transmission electron microscopy (TEM) is already fairly routine for some experiments the only require simple repetitive tasks such as imaging biological macromolecules for single particle cryoEM [1], tilt series for electron tomography [2], and movies for crystallography [3]. The vast majority of TEM experiments are conducted completely by human operators who choose the regions of interest, optimize experimental parameters, and make decisions about data quality visually during an experiment. The field is still a long way from having completely autonomous TEMs that can adapt to sample difficulties and tune experimental parameters based on data quality and desired experimental outcomes. Part of the issue is the lack of capability for feeding information learned from on-line, live data analysis back into the on-going experiment [4]. Furthermore, this presentation will discuss current capabilities for large scale data reduction and analysis using high performance computing (i.e. supercomputing) and progress towards developing a true feed-back loop that places data analysis and theory in the experimental loop.

97 MATHEMATICS AND COMPUTING↗

Grid Optimization with Solar (GO-Solar) Experiences With: Data-Driven and Machine Learning Approaches for High-Pen PV Grids

Provides an overview of the innovations and challenges from the algorithm development portion of the GO-Solar project, including plain language introductions to matrix-completion based state estimation, multi-kernel learning based state forecasting, 'slow-scale' voltage-load sensitivity matrix linearized optimal power flow, and 'fast-scale' OPF plan following using on-line Provides an overview of the innovations and challenges from the algorithm development portion of the GO-Solar project, including plain language introductions to matrix-completion based state estimation, multi-kernel learning based state forecasting, 'slow-scale' voltage-load sensitivity matrix linearized optimal power flow, and 'fast-scale' OPF plan following using on-line multi-objective state.

24 POWER TRANSMISSION AND DISTRIBUTION↗

2020 ETI Annual Summer School: Data Science and Engineering

The Consortium for Enabling Technologies & Innovation (ETI) was established in 2019 to address emerging technologies within the context of nuclear nonproliferation. ETI creates a research and education environment to support cross-cutting technologies across three core disciplines: 1) computer and engineering science research specifically in a form of machine learning and high performance computing (HPC), 2) advanced manufacturing, and 3) nuclear detection technologies. For outreach and development, ETI hosted the first of three summer schools from August 24-28, 2020 with the theme of “Data Science and Engineering”. The school was hosted in an on-line format and had over 200 participants. The recorded content is available on-line as a resource for students. The summer school had four modules: 1) Fundamentals of data Applications, 2) Computational Machine Learning, 3) Bayesian Modeling and Inference, and 4) Data Science for Safeguards. Modules contained both lectures as well as student exercises. Poll Everywhere was utilized in some modules as an on-line method to engage large groups of students. Upcoming ETI Summer Schools include Novel Instrumentation in 2021 and Advanced Manufacturing in 2022.

Biegalski, Steven R.↗

In situ Parallel Training of Analog Neural Network Using Electrochemical Random-Access Memory

In-memory computing based on non-volatile resistive memory can significantly improve the energy efficiency of artificial neural networks. However, accurate in situ training has been challenging due to the nonlinear and stochastic switching of the resistive memory elements. One promising analog memory is the electrochemical random-access memory (ECRAM), also known as the redox transistor. Its low write currents and linear switching properties across hundreds of analog states enable accurate and massively parallel updates of a full crossbar array, which yield rapid and energy-efficient training. While simulations predict that ECRAM based neural networks achieve high training accuracy at significantly higher energy efficiency than digital implementations, these predictions have not been experimentally achieved. In this work, we train a 3 × 3 array of ECRAM devices that learns to discriminate several elementary logic gates (AND, OR, NAND). We record the evolution of the network’s synaptic weights during parallel in situ (on-line) training, with outer product updates. Due to linear and reproducible device switching characteristics, our crossbar simulations not only accurately simulate the epochs to convergence, but also quantitatively capture the evolution of weights in individual devices. The implementation of the first in situ parallel training together with strong agreement with simulation results provides a significant advance toward developing ECRAM into larger crossbar arrays for artificial neural network accelerators, which could enable orders of magnitude improvements in energy efficiency of deep neural networks.

97 MATHEMATICS AND COMPUTING↗

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗

Federal Automotive Statistical Tool: FY 2018 Federal Fleet Data Call [Slides]

This presentation provides an overview of collecting federal motor vehicle fleet data at the individual vehicle level for the first time during the fall of 2017, lessons learned related how that data was validated, and changes made during the summer of 2018 based on those lessons in preparation for the now in-progress FY 2018 federal fleet reporting activity. This presentation will be given at the October 2018 FedFleet quarterly meeting (convened on-line on 2018-1024 by GSA's Office of Government-wide Policy). The Federal Automative Statistical Tool (FAST)is a Web-based information system managed by the US Department of Energy, the US General Services Administration, and the Energy Information Administration. FAST is used to collect information about the fleet of motor vehicles used and managed by the Federal government. FAST is developed and maintained by DOE's Idaho National Laboratory (INL).

99 GENERAL AND MISCELLANEOUS↗

Accelerated version of NUBEAM capabilities in DIII-D using neural networks

A neural network model of the effects of neutral beam injection on DIII-D has been developed. The training and testing data used by the model have been generated by the NUBEAM module of TRANSP for experimental discharges from the 2018 DIII-D campaign. Using a principle component analysis to reduce the dimensionality of profile data, the model has been shown to reproduce the results of the Monte Carlo code NUBEAM with a high level of accuracy and an execution time orders of magnitude faster than the execution time of NUBEAM. Furthermore, this makes the neural network model uniquely suited to applications in model-based scenario planning (off-line) and active control (on-line), where a large number of simulation runs are required by the associated optimization tasks that need to be performed before and during the discharge.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The MidAmerica Regional Microgrid Education and Training (MARMET) Consortium

The primary goal of this project was to integrate cutting-edge research and advanced instructional methods to create a flexible, evolving approach to microgrid and distributed energy resources training for all levels of student. This goal entailed the rapid development of modular material to capture and reflect the newest trends in electric power microgrid engineering and to make it available in traditional and non-traditional settings. It was our goal to develop course material that can be readily integrated into either existing courses or organized into new courses. The target audiences include technicians, contractors and consultants, inspectors, policy makers, supervisors, and engineers and undergraduate and graduate students. The main project objectives were to: 1) Perform a gap analysis to identify the research/educational/training needs and define specific implementation plans for these activities in distributed technology and Smart Grid power engineering by working with Department of Energy, the National Network Administrator (NNA) and other Distributed Technology Training Consortia (DTTC). 2) Develop learning content related to, and driven by, microgrid research, consisting of one or more multimedia-based modules. Over the life of the project MARMET provided training to 11,012 students and developed 154,432 contact hours of material (see the IREC NNA, DE-EE0006342, final project report for added details on MARMET evaluation and assessment metrics, as well as an overview of the entire GEARED network. 3) Provide a variety of delivery mechanisms and venues for face-to-face and on-line instruction in power system engineering and related smart grid operations, including university-based courses, short courses, and workshops. 4) Assemble and engage highly-qualified advisory and steering committees of experts from utilities, universities, national laboratories, and product suppliers for this DTTC, to guide and advise the activities of the DTTC, and to assist in creating student internships, coops, research projects and academic competitions for GEARED students within the DTTC and nationally. 5) Convene regular meetings of Consortia partners to disseminate research results among the participants (universities, utilities, and industry). 6) Develop recruitment mechanisms to publicize GEARED student opportunities and highlight the educational benefits of GEARED participation to assure long-term sustainability of student recruitment and retention. 7) Participate in GEARED National Network activities to identify and adopt best practices across all GEARED consortia. 8) Organize, host and manage at least one annual Student-Centered Research Conference on behalf of the GEARED Network during the period of performance; participate in each annual national Student-Centered Research Conference.

14 SOLAR ENERGY↗

Variable Neural Adaptive Robust Control: A Switched System Approach

Variable neural adaptive robust control strategies are proposed for the output tracking control of a class of multi-input multi-output uncertain systems. The controllers incorporate a variable-structure radial basis function (RBF) network as the self-organizing approximator for unknown system dynamics. The variable-structure RBF network solves the problem of structure determination associated with fixed-structure RBF networks. It can determine the network structure on-line dynamically by adding or removing radial basis functions according to the tracking performance. The structure variation is taken into account in the stability analysis of the closed-loop system using a switched system approach with the aid of the piecewise quadratic Lyapunov function. The performance of the proposed variable neural adaptive robust controllers is illustrated with simulations.

adaptive↗

Integration of Solar Training into Allied Professional Development Platforms - Final Technical Report

The Interstate Renewable Energy Council (IREC) designed the “Integration of Solar Training into Allied Professional Development Platforms” project to surmount barriers to the expansion of solar technology caused by gaps in knowledge impacting on-the-job performance of allied professionals. At project start, questionnaires deployed nationally indicated that only 9% of firefighters felt certain they could shut down a PV system to the extent possible, and only a third of code officials thought they could even discern the difference between a PV and solar thermal system. Therefore, the project objective was to measurably and significantly increase the number of code officials and fire service professionals with solar knowledge directly applicable to their job function. IREC identified specific gaps in current knowledge, and integrated research-proven adult learning principles and technology solutions to enable a cost-effect but impactful reach. The project design ensured that solar training is a continuing component of the targeted sector professional development toolkit. To this end, the key partners recruited and cultivated were existing, trusted training partners in the targeted sectors: International Code Council Solar Rating and Certification Corporation (ICC-SRCC), International Association of Electrical Inspectors (IAEI), International Association of Fire Fighters (IAFF) and National Association of State Fire Marshals (NASFM). During the project, IREC held 79 courses in 25 states that trained 4,156 people, offered a PV in the 2017 National Electric Code webinar attended by 787 people, developed on-line training for code officials with 2,298 on-line learners, and developed an on-line training for firefighters with 4,930 on-line learners. In addition, the project participated in 28 conferences and reached over 537,000 professionals with solar information.

14 SOLAR ENERGY↗

Electrochemical Characterization of Molten Salt Chemistry During Atmospheric Ingressions

This report describes the salt chemistry and sedimentation studies that were completed in FY23 as part of the Pyrochemical Fuel Cycles – ANL project. The primary objective of these activities was to employ electrochemical methods in order to quantify and gain insights into the reaction mechanisms associated with the interaction of O2 and moisture impurities with the molten chloride salts used for the pyrochemical processing of nuclear materials. If not monitored and controlled, the ingression of these atmospheric impurities can lead to changes in the salt redox conditions and initiate the formation of oxide particles, potentially resulting in operational and safeguards challenges. By elucidating the mechanisms underlying the formation of oxide particles, we can effectively monitor the conditions of the salt and design systems to mitigate the influence of atmospheric O2 and H2O. To achieve these goals, we designed a test system that allowed for precisely controlled gas ingressions into the molten salt vessel. This system included on-line monitoring provided by electrochemical probes that enable near real-time measurements of the salt conditions throughout the course of the experiment. Using this system, we systematically varied experimental conditions, including O2/Ar flow rates and O2 concentrations, to comprehensively understand their impact on solid particle formation. We also used a particle size and shape analyzer to characterize the particles that were generated. Tests in FY23 concentrated on the formation of CeO2 particles, but we also prepared a separate apparatus targeting UO2 particles for use in FY24. We additionally conducted extensive modeling activities in support of this work. This included multiphysics simulations of the gas ingressions along with the development of a machine learning workflow to enable accelerated molecular dynamics modeling of the molten salt chemistry of LiCl-KCl-UCl3. The combination of experimental and modeling tools has allowed us to begin to get a more complete understanding of the reactions that occur when atmospheric ingressions occur in pyroprocessing systems.

Guo, Jicheng↗

Optimization of WAAM Process to Produce AUSC Components with Increased Service Life

Additive manufacturing has the potential to revolutionize industrial hardware and unlock efficiency gains through the fabrication of geometries and architectures not possible by conventional processing. Wire Arc Additive manufacturing (WAAM) process is a class of directed energy deposition process enabling higher build rate and allowing custom wire feedstock allowing spatial variation of microstructure. The larger spot size and lower speed creates a larger melt pool, reducing residual stress and often time creating directional/columnar microstructure for Ni-superalloy. The use of flexible platform provides freedom in deposition strategy, which can accommodate complex substrates, including feature addition onto existing structures, non-flat layers, and repair methods. However, the certification of the final component needs to match the strength requirement. Hence, the quality of the component produced is stringently monitored to avoid buildup of residual stress, cracks, porosity and to reduce detrimental segregated phases commonly observed during alloy solidification. Simulation plays a huge role in predicting the melt pool dimension and can be used to optimize the process parameter. Similar development is also required to perform physics-based modeling of microstructural development in WAAM that can predict the microstructural features during solidification and can be used to optimize the process more effectively. To move toward this goal, Raytheon Technologies Research Center together with Siemens worked to create a set of computational tools to control the process parameters, enable on-line measurements and acquisition with feedback to the optimized process parameters, and eventually track material evolution through each step of the additive process. Computational fluid dynamics is used for accurate prediction and calibration of the thermal field during WAAM process. and phase field models for microstructure evolution as a function of processing parameters to establish a connection between additive parameters and the final microstructure. Here we report cellular automata (CA) model development to predict the dendritic microstructure evolution with surface and bulk nuclei for single track and multiple layers. The CA model was developed to account for secondary element addition and predict segregation, local melting, and latent heat release as well as prediction of Euler angles from orientation information and validated against experiments. This framework was utilized to tailor spatially-varying composition in a part by appropriately controlling the microstructure evolution during the additive process. Functionally graded Haynes 282 alloy with high Cr content at the surface was tested for oxidation and mechanical properties. An advanced physics-based reaction-diffusion model predicting the simultaneous creation of chromium oxide and alumina is developed and validated to extend life expectancy of the WAAM manufactured high temperature part. A machine-learning data-driven framework establishing the process-structure relationship from a dataset of real microstructure images and corresponding process history data has been developed and implemented in the NX Siemens design system. The digital twin configuration along with the tool path generation enabled prediction of WAAM component buildup time and the techno-economic analysis provided a favorable option for all 4 cases with 15-40% cost reduction.

33 ADVANCED PROPULSION SYSTEMS↗

Hybrid data-driven and model-informed online tool wear detection in milling machines

Precision machining tool wear is responsible for low product throughput and quality. Monitoring the tool wear online is vital to prevent degradation in machining quality. However, direct real-time tool wear measurement is not practical. This paper presents residual-based anomaly detection models, combining a hybrid model comprised of a physics-based model and a data-driven model (a decision tree or a neural network) to predict signals of interest (e.g., power or forces) under nominal conditions, followed by Page’s cumulative sum test for detecting tool wear on-line using the computer numerical control machine measurements. The most informative features are ranked using dynamic programming and its approximation variants from real-time measurements and machine settings, such as the width of cut, depth of cut, feed rate and spindle speed, that serve as inputs to the predictive models. The baseline nominal model is incrementally updated with experimental data via a gradient boosted adaptation model to generate the residuals that account for discrepancies between the actual machine data under normal conditions and the baseline nominal model predictions. The hybrid model is validated against 20 Mazak milling machine experimental tests and one Haas run-to-failure experiment. The proposed anomaly detector is applied to synthetic data from simulations of the physics-based model at different operating conditions, measurement noise levels, and tool wear levels, and the methods were able to achieve an overall 92% accuracy in data with 1% noise. The anomaly detection methods based on hybrid model reduced the false alarms of either the data-driven or physical-based models alone, and are found to be capable of good online detection of tool wear.

42 ENGINEERING↗