Adaptive Machine Learning-based Real-time 3D Inversion for Coherent Diffraction Imaging
Explore the source record for details and available documents.
Scheinker, Alexander↗
SEARCH · Search NASA
Results for “adaptive machine learning”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Adaptively driven X-ray diffraction guided by machine learning for autonomous phase identification
Machine learning (ML) has become a valuable tool to assist and improve materials characterization, enabling automated interpretation of experimental results with techniques such as X-ray diffraction (XRD) and electron microscopy. Because ML models are fast once trained, there is a key opportunity to bring interpretation in-line with experiments and make on-the-fly decisions to achieve optimal measurement effectiveness, which creates broad opportunities for rapid learning and information extraction from experiments. Here, we demonstrate such a capability with the development of autonomous and adaptive XRD. By coupling an ML algorithm with a physical diffractometer, this method integrates diffraction and analysis such that early experimental information is leveraged to steer measurements toward features that improve the confidence of a model trained to identify crystalline phases. We validate the effectiveness of an adaptive approach by showing that ML-driven XRD can accurately detect trace amounts of materials in multi-phase mixtures with short measurement times. The improved speed of phase detection also enables in situ identification of short-lived intermediate phases formed during solid-state reactions using a standard in-house diffractometer. Our findings showcase the advantages of in-line ML for materials characterization and point to the possibility of more general approaches for adaptive experimentation.
36 MATERIALS SCIENCE↗
Machine learning-accelerated discovery of iron cobalt phosphides as rare-earth-free magnets
Here, the discovery of rare-earth-free permanent magnets has been a goal of scientists for decades. The absence of rare-earth elements will alleviate a pressing concern about the availability of rare-earth elements used in permanent magnets. These magnets are crucial for applications such as wind turbines, electric cars, and memory devices. Rare-earth magnets are special owing to a large magnetic anisotropy energy (K 1 ). In contrast, iron cobalt phosphides hold promise since doping P into cubic FeCo can induce anisotropy, leading to a large coercivity, without introducing rare-earth elements. We present a comprehensive search over the Fe-Co-P ternary space for magnets, utilizing recently developed adaptive machine learning feedback to efficiently screen over 850 000 structures. We focus on machine learning acceleration as a paradigm for materials design. Further adaptive genetic algorithm searches and first-principles calculations aid in the identification of 16 new structures below the known convex hull. Five of them possess high magnetic polarization (J s > 1 T). The structures with desirable magnetic properties center on (Fe,Co) 2 P. This supports conventional wisdom, which focuses on the mixture of the two known end compounds: Fe 2 P and Co 2 P. Our work provides guidance for synthesis. We find Fe 7 CoP 4 shows the most promise (J s = 1.03T and K 1 = 0.83MJ/m 3 ).
36 MATERIALS SCIENCE↗
Utilizing a Virtual Sodium-Cooled Fast Reactor Digital Twin to Aid in Diversion Pathway Analysis for International Safeguards Applications
We report digital twin technology has the potential to improve the effectiveness of international safeguards inspectors by providing a tool which can: first, perform an accurate diversion path analysis, identify their indicators, and required sensors to detect them; and second, monitor facilities in real-time using critical data streams that benefit from this safeguards-by-design approach. Safeguards inspectors are required to visit facilities and verify the nuclear material to ensure no diversion has taken place and detect misuse of the facility; however, this analysis and verification effort is time consuming, and with limited funding it is imperative that time spent at a nuclear facility is focused on key areas. A virtual digital twin of three prototypic sodium fast reactors was developed, where diversion and misuse scenarios were explored to determine how a digital twin could provide inspectors with an understanding of how proliferation may occur and where the most likely areas for proliferation would be. For each of the three reactors, an optimization algorithm was able to find core designs which would be difficult to detect via sensors alone; however, the use of a machine learning adapter provided by the digital twin was able to show general trends in where proliferation as likely to take place.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Neurogenesis Deep Learning: Extending deep networks to accommodate new classes
Neural machine learning methods, such as deep neural networks (DNN), have achieved remarkable success in a number of complex data processing tasks. These methods have arguably had their strongest impact on tasks such as image and audio processing – data processing domains in which humans have long held clear advantages over conventional algorithms. In contrast to biological neural systems, which are capable of learning continuously, deep artificial networks have a limited ability for incorporating new information in an already trained network. As a result, methods for continuous learning are potentially highly impactful in enabling the application of deep networks to dynamic data sets. Here, inspired by the process of adult neurogenesis in the hippocampus, we explore the potential for adding new neurons to deep layers of artificial neural networks in order to facilitate their acquisition of novel information while preserving previously trained data representations. Our results on the MNIST handwritten digit dataset and the NIST SD 19 dataset, which includes lower and upper case letters and digits, demonstrate that neurogenesis is well suited for addressing the stability-plasticity dilemma that has long challenged adaptive machine learning algorithms.
59 BASIC BIOLOGICAL SCIENCES↗
Outlook towards deployable continual learning for particle accelerators
Particle accelerators are high power complex machines. To ensure uninterrupted operation of these machines, thousands of pieces of equipment need to be synchronized, which requires addressing many challenges including design, optimization and control, anomaly detection and machine protection. With recent advancements, machine learning (ML) holds promise to assist in more advance prognostics, optimization, and control. While ML based solutions have been developed for several applications in particle accelerators, only few have reached deployment and even fewer to long term usage, due to particle accelerator data distribution drifts caused by changes in both measurable and non-measurable parameters. In this paper, we identify some of the key areas within particle accelerators where continual learning can allow maintenance of ML model performance with distribution drifts. Particularly, we first discuss existing applications of ML in particle accelerators, and their limitations due to distribution drift. Next, we review existing continual learning techniques and investigate their potential applications to address data distribution drifts in accelerators. By identifying the opportunities and challenges in applying continual learning, this paper seeks to open up the new field and inspire more research efforts towards deployable continual learning for particle accelerators.
43 PARTICLE ACCELERATORS↗
Premixed flames subjected to extreme turbulence: Some questions and recent answers
It has been predicted that several changes will occur when premixed flames are subjected to the extreme levels of turbulence that can be found in practical combustors. Our report is a review of recent experimental and DNS results that have been obtained for the range of extreme turbulence, and it includes a discussion of cases that agree or disagree with predictions. “Extreme turbulence” is defined to correspond to a turbulent Reynolds number (Re Τ , based on integral scale) that exceeds 2800 or a turbulent Karlovitz number that exceeds 100, for reasons that are discussed in Section 2.1. Several data bases are described that include measurements made at Lund University, the University of Sydney, the University of Michigan and the U.S. Air Force Research Lab. The data bases also include DNS results from Sandia National Laboratory, the University of New South Wales, Newcastle University, the California Institute of Technology and the University of Cambridge. Several major observations are: (a) DNS now can be achieved for a realistic geometry (of the Lund University jet burner) even for extreme turbulence levels, (b) state relations (conditional mean profiles) from DNS and experiments do tend to agree with laminar profiles, at least for methane-air and hydrogen-air reactants that are not preheated, and (c) regime boundaries have been measured and they do not agree with predicted boundaries. Results indicate that the range of conditions for which flamelet models should be valid is larger than what was previously believed. Additional parameters have been shown to be important; for example, broken reactions occur if the “back-support” is insufficient due to the entrainment of cold gas into the product gas. Turbulent burning velocity measurements have been extended from the previous normalized turbulence levels (u’/S L ) of 24 up to a value of 163. Turbulent burning velocities no longer follow the trend predicted by Shchelkin but they tend to follow the trend predicted by Damköhler. The boundary where flamelet broadening begins was measured to occur at Re Taylor = 13.8, which corresponds to an integral scale Reynolds number (Re T ) of 2800. This measured regime boundary can be explained by the idea that flame structure is altered when the turbulent diffusivity at the Taylor scale exceeds a critical value, rather than the idea that changes occur when Kolmogorov eddies just fit inside a flamelet. A roadmap to extend DNS to complex chemistry and to higher Reynolds numbers is discussed. Exascale computers, machine learning, adaptive mesh refinement and embedded DNS show promise. Some advances are reviewed that have extended the use of line and planar PLIF and CARS laser diagnostics to studies that consider complex hydrocarbon fuels and harsh environments.
42 ENGINEERING↗
shiftNMFk 1.1: Robust Nonnegative matrix factorization with kmeans clustering and signal shift, for allocation of unknown physical sources, toy version for open sourcing with publications
This code is a toy (short) version of CODE-2016-83. From a general perspective, the code represents an unsupervised adaptive machine learning algorithm that allows efficient and high performance de-mixing and feature extraction of a multitude of non-negative signals mixed and recorded by a network of uncorrelated sensor arrays. The code identifies the number of the mixed original signals and their locations. Further, the code also allows deciphering of signals that have been delayed in regards to the mixing process in each sensor. This code is high customizable and it can be efficiently used for a fast macro-analyses of data. The code is applicable to a plethora of distinct problems: chemical decomposition, pressure transient decomposition, unknown sources/signal allocation, EM signal decomposition. An additional procedure for allocation of the unknown sources is incorporated in the code.
Alexandrov, BoianS.↗
ShiftNMFk 1.2
The ShiftNMFk1.2 code, or as we call it, GreenNMFk, represents a hybrid algorithm combining unsupervised adaptive machine learning and Green's function inverse method. GreenNMFk allows an efficient and high performance de-mixing and feature extraction of a multitude of nonnegative signals that change their shape propagating through the medium. The signals are mixed and recorded by a network of uncorrelated sensors. The code couples Non-negative Matrix Factorization (NMF) and inverse-analysis Green's functions method. GreenNMF synergistically performs decomposition of the recorded mixtures, finds the number of the unknown sources and uses the Green's function of the governing partial differential equation to identify the unknown sources and their charecteristics. GreenNMF can be applied directly to any problem controlled by a known partial-differential parabolic equation where mixtures of an unknown number of sources are measured at multiple locations. Full GreenNMFk method is a subject LANL U.S. Patent application S133364.000 August, 2017. The ShiftNMFk 1.2 version here is a toy version of this method that can work with a limited number of unknown sources (4 or less).
Alexandrov, BoianS.↗
shiftNMFk 1.1: Robust Nonnegative matrix factorization with kmeans clustering and signal shift, for allocation of unknown physical sources, toy version for open sourcing with publications
This code is a toy (short) version of CODE-2016-83. From a general perspective, the code represents an unsupervised adaptive machine learning algorithm that allows efficient and high performance de-mixing and feature extraction of a multitude of non-negative signals mixed and recorded by a network of uncorrelated sensor arrays. The code identifies the number of the mixed original signals and their locations. Further, the code also allows deciphering of signals that have been delayed in regards to the mixing process in each sensor. This code is high customizable and it can be efficiently used for a fast macro-analyses of data. The code is applicable to a plethora of distinct problems: chemical decomposition, pressure transient decomposition, unknown sources/signal allocation, EM signal decomposition. An additional procedure for allocation of the unknown sources is incorporated in the code.
Alexandrov, Boian S.↗
Deep-Lynx-ML-Adapter
The Deep Lynx Machine Learning (ML) Adapter is a generic adapter that programmatically runs the ML as continuous data is received. Then, Jupyter Notebooks can be customized according to the project for pre-processing the data, building the machine learning models, prediction analysis of incoming data using an existing model, and forecasting anomalies / failures of the physical asset.
Wilsdon, KatherineN↗
An adaptive approach to machine learning for compact particle accelerators
Abstract Machine learning (ML) tools are able to learn relationships between the inputs and outputs of large complex systems directly from data. However, for time-varying systems, the predictive capabilities of ML tools degrade if the systems are no longer accurately represented by the data with which the ML models were trained. For complex systems, re-training is only possible if the changes are slow relative to the rate at which large numbers of new input-output training data can be non-invasively recorded. In this work, we present an approach to deep learning for time-varying systems that does not require re-training, but uses instead an adaptive feedback in the architecture of deep convolutional neural networks (CNN). The feedback is based only on available system output measurements and is applied in the encoded low-dimensional dense layers of the encoder-decoder CNNs. First, we develop an inverse model of a complex accelerator system to map output beam measurements to input beam distributions, while both the accelerator components and the unknown input beam distribution vary rapidly with time. We then demonstrate our method on experimental measurements of the input and output beam distributions of the HiRES ultra-fast electron diffraction (UED) beam line at Lawrence Berkeley National Laboratory, and showcase its ability for automatic tracking of the time varying photocathode quantum efficiency map. Our method can be successfully used to aid both physics and ML-based surrogate online models to provide non-invasive beam diagnostics.
97 MATHEMATICS AND COMPUTING↗
Adaptive online extreme learning machine by regulating forgetting factor by concept drift map
Not Available
Yu, Hualong (ORCID:0000000196214158)↗
Adaptive Feedback and Machine Learning for Particle Accelerators
Explore the source record for details and available documents.
Scheinker, Alexander↗
Adaptive Feedback and Machine Learning for Particle Accelerators
Explore the source record for details and available documents.
Scheinker, Alexander↗
Machine Learning-Driven Adaptation of OpenMP Applications
Explore the source record for details and available documents.
Computer science↗
Characterizing Defect Dynamics in Silicon Carbide Using Symmetry-Adapted Collective Variables and Machine Learning Interatomic Potentials
Silicon carbide (SiC) divacancies are attractive candidates for spin-defect qubits possessing long coherence times and optical addressability. The high activation barriers associated with SiC defect formation and motion pose challenges for their study by first-principles molecular dynamics. In this work, we develop and deploy machine learning interatomic potentials (MLIPs) to accelerate defect dynamics simulations while retaining ab initio accuracy. We employ an active learning strategy comprising symmetry-adapted collective variable discovery and enhanced sampling to compile configurationally diverse training data, calculation of energies and forces using density functional theory (DFT), and training of an E(3)-equivariant MLIP based on the Allegro model. Here, the trained MLIP reproduces DFT-level accuracy in defect transition activation free energy barriers, enables the efficient and stable simulation of multidefect 216-atom supercells, and permits an analysis of the temperature dependence of defect thermodynamic stability and formation/annihilation kinetics to propose an optimal annealing temperature to maximally stabilize VV divacancies.
Computer simulations↗
Combined Force-Frequency Sampling for Simulation of Systems Having Rugged Free Energy Landscapes.
An adaptive, machine learning-based sampling method is presented for simulation of systems having rugged, multidimensional free energy landscapes. The method's main strength resides in its ability to learn both from the frequency of visits to distinct states and the generalized force estimates that arise in a system as it evolves in phase space. This is accomplished by introducing a self-integrating artificial neural network, which generates an estimate of the free energy directly from its derivatives. The usefulness of the proposed combined approach is examined in the context of two concrete examples, namely, an alanine dipeptide molecule in water and a polymer diffusing through a narrow pore. This new method is found to be robust, faster, and more accurate than approaches that rely only on frequency-based or generalized force-based estimations. After combining the proposed approach with overfill protection and support for sparse data storage and training, the method is shown to be more effective than comparable, previously available techniques and capable of scaling efficiently to larger numbers of collective variables.
Sevgen, Emre↗