Search NASA⌕ Search

Engineering topics

Ratner, Daniel

Publications and source records attributed to Ratner, Daniel.

At least 19 records

Domain Knowledge Guided Bayesian Optimization For Autonomous Alignment Of Complex Scientific Instruments

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where rewards are sparse. In such needle-in-a-haystack scenarios, even advanced methods like trust-region BO (TurBO) often lead to unsatisfactory results. We propose a domain knowledge guided Bayesian Optimization approach, which leverages physical insight to fundamentally simplify the search problem by transforming coordinates to decouple input features and align the active subspaces with the primary search axes. We demonstrate this approach's efficacy on a challenging 12-dimensional, 6-crystal Split-and-Delay optical system, where conventional approaches, including standard BO, TuRBO and multi-objective BO, consistently led to unsatisfactory results. When combined with an reverse annealing exploration strategy, this approach reliably converges to the global optimum. The coordinate transformation itself is the key to this success, significantly accelerating the search by aligning input co-ordinate axes with the problem's active subspaces. As increasingly complex scientific instruments, from large telescopes to new spectrometers at X-ray Free Electron Lasers are deployed, the demand for robust high-dimensional optimization grows. Our results demonstrate a generalizable paradigm: leveraging physical insight to transform high-dimensional, coupled optimization problems into simpler representations can enable rapid and robust automated tuning for consistent high performance while still retaining current optimization algorithms.

FOS: Computer and information sciences↗

Coincidence anomaly detection for unsupervised locating of edge localized modes in the DIII-D tokamak dataset

Using supervised learning to train a machine learning model to predict an on-coming edge localized mode (ELM) requires a large number of labeled samples. Creating an appropriate data set from the very large database of discharges at a long-running tokamak, such as DIII-D, would be a very time-consuming process for a human. Considering this need and difficulty, we use coincidence anomaly detection, an unsupervised learning technique, to train an ELM-identifier to identify and label ELMs in the DIII-D discharge database. This ELM-identifier shows, simultaneously, a precision of 0.68 and a recall of 0.63 (AUC is 0.73) on identifying ELMs in example time series pulled from thousands of discharges spanning five years. In a test set of 50 discharges, the algorithm finds over 26 thousand ELM candidates, more than 5 times the existing catalog of ELMs labeled by humans.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Targeted materials discovery using Bayesian algorithm execution

Rapid discovery and synthesis of future materials requires intelligent data acquisition strategies to navigate large design spaces. A popular strategy is Bayesian optimization, which aims to find candidates that maximize material properties; however, materials design often requires finding specific subsets of the design space which meet more complex or specialized goals. We present a framework that captures experimental goals through straightforward user-defined filtering algorithms. These algorithms are automatically translated into one of three intelligent, parameter-free, sequential data collection strategies (SwitchBAX, InfoBAX, and MeanBAX), bypassing the time-consuming and difficult process of task-specific acquisition function design. Our framework is tailored for typical discrete search spaces involving multiple measured physical properties and short time-horizon decision making. We demonstrate this approach on datasets for TiO 2 nanoparticle synthesis and magnetic materials characterization, and show that our methods are significantly more efficient than state-of-the-art approaches. Overall, our framework provides a practical solution for navigating the complexities of materials design, and helps lay groundwork for the accelerated development of advanced materials.

42 ENGINEERING↗

Differentiable Simulation of a Liquid Argon Time Projection Chamber

Liquid argon time projection chambers (LArTPCs) are widely used in particle detection for their tracking and calorimetric capabilities. The particle physics community actively builds and improves high-quality simulators for such detectors in order to develop physics analyses in a realistic setting. The ability of these simulators to mimic real, measured data is limited by the modeling of the physical detectors used for data collection. This modeling can be improved by performing dedicated calibration measurements. Conventional approaches calibrate individual detector parameters or processes one at a time. However, the impact of detector processes is entangled, making this a poor description of the underlying physics. We introduce a differentiable simulator that enables a gradient-based optimization, allowing for the first time a simultaneous calibration of all detector parameters. We describe the procedure of making a differentiable simulator, highlighting the challenges of retaining the physics quality of the standard, non-differentiable version while providing meaningful gradient information. We further discuss the advantages and drawbacks of using our differentiable simulator for calibration. Finally, we provide a starting point for extensions to our approach, including applications of the differentiable simulator to physics analysis pipelines.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Multipoint-BAX: a new approach for efficiently tuning particle accelerator emittance via virtual objectives

Abstract Although beam emittance is critical for the performance of high-brightness accelerators, optimization is often time limited as emittance calculations, commonly done via quadrupole scans, are typically slow. Such calculations are a type of multipoint query , i.e. each query requires multiple secondary measurements. Traditional black-box optimizers such as Bayesian optimization are slow and inefficient when dealing with such objectives as they must acquire the full series of measurements, but return only the emittance, with each query. We propose a new information-theoretic algorithm, Multipoint-BAX , for black-box optimization on multipoint queries, which queries and models individual beam-size measurements using techniques from Bayesian Algorithm Execution (BAX). Our method avoids the slow multipoint query on the accelerator by acquiring points through a virtual objective , i.e. calculating the emittance objective from a fast learned model rather than directly from the accelerator. We use Multipoint-BAX to minimize emittance at the Linac Coherent Light Source (LCLS) and the Facility for Advanced Accelerator Experimental Tests II (FACET-II). In simulation, our method is 20× faster and more robust to noise compared to existing methods. In live tests, it matched the hand-tuned emittance at FACET-II and achieved a 24% lower emittance than hand-tuning at LCLS. Our method represents a conceptual shift for optimizing multipoint queries, and we anticipate that it can be readily adapted to similar problems in particle accelerators and other scientific instruments.

43 PARTICLE ACCELERATORS↗

Uncertainty Propagation within Chained Models for Machine Learning Reconstruction of Neutrino-LAr Interactions

Sequential or chained models are increasingly prevalent in machine learning for scientific applications, due to their flexibility and ease of development. Chained models are particularly useful when a task is separable into distinct steps with a hierarchy of meaningful intermediate representations. In reliability-critical tasks, it is important to quantify the confidence of model inferences. However, chained models pose an additional challenge for uncertainty quantification, especially when input uncertainties need to be propagated. In such cases, a fully uncertainty-aware chain of models is required, where each step accepts a probability distribution over the input space, and produces a probability distribution over the output space. In this work, we present a case study for adapting a single model within an existing chain, designed for reconstruction within neutrino-Argon interactions, developed for neutrino oscillation experiments such as MicroBooNE, ICARUS, and the future DUNE experiment. We test the performance of an input uncertainty-enabled model against an uncertainty-blinded model using a method for generating synthetic noise. By comparing these two, we assess the increase in inference quality achieved by exposing models to upstream uncertainty estimates.

97 MATHEMATICS AND COMPUTING↗

Nanoscale chemical imaging with structured X-ray illumination

High-resolution imaging with compositional and chemical sensitivity is crucial for a wide range of scientific and engineering disciplines. Although synchrotron X-ray imaging through spectromicroscopy has been tremendously successful and broadly applied, it encounters challenges in achieving enhanced detection sensitivity, satisfactory spatial resolution, and high experimental throughput simultaneously. In this work, based on structured illumination, we develop a single-pixel X-ray imaging approach coupled with a generative image reconstruction model for mapping the compositional heterogeneity with nanoscale resolvability. This method integrates a full-field transmission X-ray microscope with an X-ray fluorescence detector and eliminates the need for nanoscale X-ray focusing and raster scanning. We experimentally demonstrate the effectiveness of our approach by imaging a battery sample composed of mixed cathode materials and successfully retrieving the compositional variations of the imaged cathode particles. Bridging the gap between structural and chemical characterizations using X-rays, this technique opens up vast opportunities in the fields of biology, environmental, and materials science, especially for radiation-sensitive samples.

Li, Jizhou↗

Capturing dynamical correlations using implicit neural representations

Abstract Understanding the nature and origin of collective excitations in materials is of fundamental importance for unraveling the underlying physics of a many-body system. Excitation spectra are usually obtained by measuring the dynamical structure factor, S ( Q , ω ), using inelastic neutron or x-ray scattering techniques and are analyzed by comparing the experimental results against calculated predictions. We introduce a data-driven analysis tool which leverages ‘neural implicit representations’ that are specifically tailored for handling spectrographic measurements and are able to efficiently obtain unknown parameters from experimental data via automatic differentiation. In this work, we employ linear spin wave theory simulations to train a machine learning platform, enabling precise exchange parameter extraction from inelastic neutron scattering data on the square-lattice spin-1 antiferromagnet La 2 NiO 4 , showcasing a viable pathway towards automatic refinement of advanced models for ordered magnetic systems.

36 MATERIALS SCIENCE↗

LCLS RF Station Anomaly Candidates, SLAC, Nov 2020 to Dec 2020, Version 1

The data consists of radio-frequency (RF) station process variables (amplitude and amplitude-mean-out-of-tolerance bit) and beam position monitor (BPM) values for about a month of Linac Coherent Light Source (LCLS) time. The data is all from normal conducting hard X-ray operation. The dataset contains roughly 5000 anomaly “candidates.” For each candidate, we include 3.5 minutes of data from the 82 RF stations and ~20 seconds of data from 4 BPMs. We also include several CSV files with additional information and labels for each candidate.

43 PARTICLE ACCELERATORS↗

Dynamics of particle network in composite battery cathodes

We report that improving composite battery electrodes requires a delicate control of active materials and electrode formulation. The electrochemically active particles fulfill their role as energy exchange reservoirs through interacting with the surrounding conductive network. We formulate a network evolution model to interpret the regulation and equilibration between electrochemical activity and mechanical damage of these particles. Through statistical analysis of thousands of particles using x-ray phase contrast holotomography in a LiNi 0.8 Mn 0.1 Co 0.1 O 2 -based cathode, we found that the local network heterogeneity results in asynchronous activities in the early cycles, and subsequently the particle assemblies move toward a synchronous behavior. Our study pinpoints the chemomechanical behavior of individual particles and enables better designs of the conductive network to optimize the utility of all the particles during operation.

25 ENERGY STORAGE↗

Probing lattice defects in crystalline battery cathode using hard X-ray nanoprobe with data-driven modeling

Lattice defects, e.g., dislocations and grain boundaries, critically impact the properties of crystalline battery cathode materials. A longstanding challenge is to probe the meso–scale heterogeneity and evolution of lattice defects with sensitivity to atomic-scale details. Herein, we tackle this issue with a unique combination of X-ray nanoprobe diffractive imaging and advanced machine learning techniques. The domains with different lattice defect configuration within a single-crystalline LiCoO2 cathode particle are faithfully revealed using our approach. We further visualize the rearrangement of grain boundaries and local crystallinity upon mild thermal annealing. Furthermore, these results pave a direct way to the understanding of crystalline battery materials’ response under external stimuli with high fidelity, which provides valuable empirical guidance to defect-engineering strategies for improving the cathode materials against aggressive battery operation.

36 MATERIALS SCIENCE↗

Automated prediction of lattice parameters from X-ray powder diffraction patterns

A key step in the analysis of powder X-ray diffraction (PXRD) data is the accurate determination of unit-cell lattice parameters. This step often requires significant human intervention and is a bottleneck that hinders efforts towards automated analysis. This work develops a series of one-dimensional convolutional neural networks (1D-CNNs) trained to provide lattice parameter estimates for each crystal system. A mean absolute percentage error of approximately 10% is achieved for each crystal system, which corresponds to a 100- to 1000-fold reduction in lattice parameter search space volume. The models learn from nearly one million crystal structures contained within the Inorganic Crystal Structure Database and the Cambridge Structural Database and, due to the nature of these two complimentary databases, the models generalize well across chemistries. A key component of this work is a systematic analysis of the effect of different realistic experimental non-idealities on model performance. It is found that the addition of impurity phases, baseline noise and peak broadening present the greatest challenges to learning, while zero-offset error and random intensity modulations have little effect. However, appropriate data modification schemes can be used to bolster model performance and yield reasonable predictions, even for data which simulate realistic experimental non-idealities. In order to obtain accurate results, a new approach is introduced which uses the initial machine learning estimates with existing iterative whole-pattern refinement schemes to tackle automated unit-cell solution.

42 ENGINEERING↗

Multiphase, Multiscale Chemomechanics at Extreme Low Temperatures: Battery Electrodes for Operation in a Wide Temperature Range

Understanding the behavior of lithium-ion batteries (LIBs) under extreme conditions, for example, low temperature, is key to broad adoption of LIBs in various application scenarios. LIBs, poor performance at low temperatures is often attributed to the inferior lithium-ion transport in the electrolyte, which has motivated new electrolyte development as well as the battery preheating approach that is popular in electric vehicles. A significant irrevocable capacity loss, however, is not resolved by these measures nor well understood. Herein, multiphase, multiscale chemomechanical behaviors in composite LiNi x Mn y Co z O 2 (NMC, x + y + z = 1) cathodes at extremely low temperatures are systematically elucidated. The low-temperature storage of LIBs can result in irreversible structural damage in active electrodes, which can negatively impact the subsequent battery cycling performance at ambient temperature. Furthermore, beside developing electrolytes that have stable performance, designing batteries for use in a wide temperature range also calls for the development of electrode components that are structurally and morphologically robust when the cell is switched between different temperatures.

25 ENERGY STORAGE↗

Anomaly Detection in Accelerator Facilities Using Machine Learning

Synchrotron light sources are user facilities and usually run about 5000 hours per year to support many beamlines operations in parallel. Reliability is a key parameter to evaluate machine performance. Even many facilities have achieved >95% beam reliability, there are still many hours of unscheduled downtime and every hour lost is a waste of operation costs along with a big impact on individual scheduled user experiments. Preventive maintenance on subsystems and quick recovery from machine trips are the basic strategies to achieve high reliability, which heavily depends on experts’ dedication. Recently, SLAC, APS, and NSLS-II collaborated to develop machine-learning-based approaches aiming to solve both situations, hardware failure prediction and machine failure diagnosis to find the root sources. In this paper, we report our facility operation status, development progress, and plans.

Accelerator Physics↗

Temporal X-ray Reconstruction using Temporal and Spectral Measurements at LCLS

Transverse deflecting structures (TDSs) are widely used in accelerator physics to measure the longitudinal density of particle bunches. When used in combination with a dispersive section, the whole longitudinal phase space density can be imaged. At the Linac Coherent Light Source (LCLS), the installation of such a device downstream of the undulators enables the reconstruction of the X-ray temporal intensity profile by comparing longitudinal phase space distributions with lasing on and lasing off. However, the resolution of this TDS is limited to around 1 fs rms (root mean square), and therefore, it is not possible to resolve single self-amplified spontaneous emission (SASE) spikes within an X-ray photon pulse. By combining the power spectrum from a high resolution photon spectrometer and the temporal structure from the TDS, the overall resolution is enhanced, thus allowing the observation of temporal, single SASE spikes. The combined data from the spectrometer and the TDS is analysed using an iterative algorithm to obtain the actual intensity profile. In this paper, we present some improvements to the reconstruction algorithm as well as real data taken at LCLS.

47 OTHER INSTRUMENTATION↗