Search NASA⌕ Search

Engineering topics

Harder, Ross J.

Publications and source records attributed to Harder, Ross J..

At least 19 records

Opportunities for retrieval and tool augmented large language models in scientific facilities

Upgrades to advanced scientific user facilities such as next-generation x-ray light sources, nanoscience centers, and neutron facilities are revolutionizing our understanding of materials across the spectrum of the physical sciences, from life sciences to microelectronics. However, these facility and instrument upgrades come with a significant increase in complexity. Driven by more exacting scientific needs, instruments and experiments become more intricate each year. This increased operational complexity makes it ever more challenging for domain scientists to design experiments that effectively leverage the capabilities of and operate on these advanced instruments. Large language models (LLMs) can perform complex information retrieval, assist in knowledge-intensive tasks across applications, and provide guidance on tool usage. Using x-ray light sources, leadership computing, and nanoscience centers as representative examples, we describe preliminary experiments with a Context-Aware Language Model for Science (CALMS) to assist scientists with instrument operations and complex experimentation. With the ability to retrieve relevant information from facility documentation, CALMS can answer simple questions on scientific capabilities and other operational procedures. With the ability to interface with software tools and experimental hardware, CALMS can conversationally operate scientific instruments. By making information more accessible and acting on user needs, LLMs could expand and diversify scientific facilities’ users and accelerate scientific output.

97 MATHEMATICS AND COMPUTING↗

Behavior of strain stripe networks in barium titanate nanocrystals on crossing its ferroelectric phase transition

Nanoscale strain networks are reported in BaTi O 3 (BTO) crystals of 300 nm size using Bragg coherent diffractive imaging. BTO nanocrystals with clear facets were chosen to identify the crystallographic directions, allowing the strain field direction and periodicity to be studied in detail. Stripes of strain were observed, which were both stable and preserved in tetragonal and cubic phases at elevated temperatures, above the tetragonal-to-cubic phase transition. A finite element analysis approach was used to simulate the domain structures inside a BTO crystal and to understand the origins of the strain stripes as piezoelectric blocks. A 180 ∘ domain model gives a better qualitative match to the experimental images. Published by the American Physical Society 2024

77 NANOSCIENCE AND NANOTECHNOLOGY↗

AutoFocus: AI-driven alignment of nanofocusing X-ray mirror systems

We describe the application of an AI-driven system to autonomously align complex x-ray-focusing mirror systems, including mirrors systems with variable focus spot sizes. The system has been developed and studied on a digital twin of nanofocusing X-ray beamlines, built using advanced optical simulation tools calibrated with wavefront sensing data collected at the beamline. We experimentally demonstrated that the system is reliably capable of positioning a focused beam on the sample, both by simulating the variation of a beamline with random perturbations due to typical changes in the light source and optical elements over time, and by conducting similar tests on an actual focusing mirror system.

47 OTHER INSTRUMENTATION↗

Anisotropy of antiferromagnetic domains in a spin-orbit Mott insulator

The temperature-dependent behavior of magnetic domains plays an essential role in the magnetic properties of materials, leading to widespread applications. However, experimental methods to access the three-dimensional (3D) magnetic domain structures are very limited, especially for antiferromagnets. Over the past decades, the spin-orbit Mott insulator iridate Sr 2 IrO 4 has attracted particular attention because of its interesting magnetic structure and analogy to superconducting cuprates. Here, in this work, we apply resonant x-ray magnetic Bragg coherent diffraction imaging to track the real-space 3D evolution of antiferromagnetic ordering inside a Sr 2 IrO 4 single crystal as a function of temperature, finding that the antiferromagnetic domain shows anisotropic changes. The anisotropy of the domain shape reveals the underlying anisotropy of the antiferromagnetic coupling strength within Sr 2 IrO 4 . These results demonstrate the high potential significance of 3D domain imaging in magnetism research.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Operando Nanoscale Imaging of Electrochemically Induced Strain in a Locally Polarized Pt Grain

Developing new methods that reveal the structure of electrode materials under polarization is key to constructing robust structure-property relationships. However, many existing methods lack the spatial resolution in structural changes and fidelity to electrochemical operating conditions that are needed to probe catalytically relevant structures. Here, we combine a nanopipette electrochemical cell with three-dimensional X-ray Bragg coherent diffractive imaging to study how strain in a single Pt grain evolves in response to applied potential. During polarization, marked changes in surface strain arise from the Coulombic attraction between the surface charge on the electrode and the electrolyte ions in the electrochemical double layers, while the strain in the bulk of the crystal remains unchanged. The concurrent surface redox reactions have a strong influence on the magnitude and nature of the strain changes under polarization. In conclusion, our studies provide a powerful blueprint to understand how structural evolution influences electrochemical performance at the nanoscale.

36 MATERIALS SCIENCE↗

2022 AI Testbed Expeditions Report

By exploiting the coherent properties of a light source, coherent diffraction imaging (CDI) is able to obtain the sample image at a nanoscale resolution using the measured diffraction pattern. Bragg Coherent Diffraction Imaging (BCDI) has become valuable for recovering the displacement and strain field of crystals, providing a valuable tool in material science and solid-state physics. X-ray ptychography is another emerging CDI technique that can produce a high-resolution image of the extended sample and has become popular in many research areas (e.g., materials science, biology, electronics, and optics characterization). CDI including BCDI and ptychography has become an established technique in Synchrotron Facilities including the Advanced Photon Source (APS) and will greatly benefit from the 100x coherent flux increase of the upcoming APS Upgrade (APSU). The current image formation process in CDI employs iterative phase retrieval algorithms, which is a time-consuming and computationally expensive process. Especially after APSU, the traditional iterative methods will not be able to match the experimental data acquisition speed. We employ deep learning (DL) approach to replace the iterative approaches, therefore allowing hundreds of times faster recovery of the object. We developed AutoPhaseNN, a DL-based approach which learns to solve the inverse problem without labeled data. Taking 3D BCDI as a representative technique, AutoPhaseNN has been demonstrated to be one hundred times faster than traditional iterative phase retrieval methods while providing comparable image quality. The current network is trained with 64 x 64 x 64 data size, to achieve higher resolution imaging, we will need to scale the network to input and train/infer 3D arrays of size 256 x 256 x 256 (today) and of size 2560x2560x2560 (APSU). However, the scalability of the network is restricted due to the memory-intensive training process. To perform the training for a 256 x 256 x 256 data size, the required memory exceeds the capacity of the current machine. In this project, we explore using Sambanova system to train the network for the direct data inversion for CDI.

36 MATERIALS SCIENCE↗

Defect identification in simulated Bragg coherent diffraction imaging by automated AI

X-ray Bragg coherent diffraction imaging is a powerful technique for operando and in situ materials characterization and provides a unique means of quantifying the influence of one-dimensional (1D) and two-dimensional (2D) material defects on material response. However, obtaining full images from raw x-ray diffraction data is nontrivial and computationally intensive, precluding real-time experimental feedback. Here, we present a machine learning approach to identify the presence of crystalline line defects (edge and screw) in samples from the raw, 2D, coherent diffraction data without the need for image reconstruction through iterative phase retrieval. Further, we compare different approaches to designing neural networks for this application and demonstrate the potential of automated ML (autoML) approaches.

36 MATERIALS SCIENCE↗

AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging

Abstract The problem of phase retrieval underlies various imaging methods from astronomy to nanoscale imaging. Traditional phase retrieval methods are iterative and are therefore computationally expensive. Deep learning (DL) models have been developed to either provide learned priors or completely replace phase retrieval. However, such models require vast amounts of labeled data, which can only be obtained through simulation or performing computationally prohibitive phase retrieval on experimental datasets. Using 3D X-ray Bragg coherent diffraction imaging (BCDI) as a representative technique, we demonstrate AutoPhaseNN, a DL-based approach which learns to solve the phase problem without labeled data. By incorporating the imaging physics into the DL model during training, AutoPhaseNN learns to invert 3D BCDI data in a single shot without ever being shown real space images. Once trained, AutoPhaseNN can be effectively used in the 3D BCDI data inversion about 100× faster than iterative phase retrieval methods while providing comparable image quality.

36 MATERIALS SCIENCE↗

In situ Bragg coherent X-ray diffraction imaging of corrosion in a Co–Fe alloy microcrystal

Corrosion is a major concern for many industries, as corrosive environments can induce structural and morphological changes that lead to material dissolution and accelerate material failure. The progression of corrosion depends on nanoscale morphology, stress, and defects present. Experimentally monitoring this complex interplay is challenging. Here we implement in situ Bragg coherent X-ray diffraction imaging (BCDI) to probe the dissolution of a Co-Fe alloy microcrystal exposed to hydrochloric acid (HCl). By measuring five Bragg reflections from a single isolated microcrystal at ambient conditions, we compare the full three-dimensional (3D) strain state before corrosion and the strain along the [111] direction throughout the corrosion process. We find that the strained surface layer of the crystal dissolves to leave a progressively less strained surface. Interestingly, the average strain closer to the centre of the crystal increases during the corrosion process. We determine the localised corrosion rate from BCDI data, revealing the preferential dissolution of facets more exposed to the acid stream, highlighting an experimental geometry effect. These results bring new perspectives to understanding the interplay between crystal strain, morphology, and corrosion; a prerequisite for the design of more corrosion-resistant materials.

36 MATERIALS SCIENCE↗

Three-dimensional coherent X-ray diffraction imaging via deep convolutional neural networks

Abstract As a critical component of coherent X-ray diffraction imaging (CDI), phase retrieval has been extensively applied in X-ray structural science to recover the 3D morphological information inside measured particles. Despite meeting all the oversampling requirements of Sayre and Shannon, current phase retrieval approaches still have trouble achieving a unique inversion of experimental data in the presence of noise. Here, we propose to overcome this limitation by incorporating a 3D Machine Learning (ML) model combining (optional) supervised learning with transfer learning. The trained ML model can rapidly provide an immediate result with high accuracy which could benefit real-time experiments, and the predicted result can be further refined with transfer learning. More significantly, the proposed ML model can be used without any prior training to learn the missing phases of an image based on minimization of an appropriate ‘loss function’ alone. We demonstrate significantly improved performance with experimental Bragg CDI data over traditional iterative phase retrieval algorithms.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Visualizing Intrinsic 3D-Strain Distribution in Gold Coated ZnO Microstructures by Bragg Coherent X-Ray Diffraction Imaging and Transmission Electron Microscopy with Respect to Piezotronic Applications

Novel devices ranging from bio magnetic field sensors to energy harvesting nano machines utilize the piezotronic effect. For optimal function, understanding the interaction of electrical and strain phenomena within the semiconductor crystal is necessary. Here, studies of a model piezotronic system are presented, consisting of a ZnO microrod coated by a thin layer of gold, which forms a Schottky contact with the piezoelectric ZnO material. Coherent X-ray diffraction imaging (CXDI) and transmission electron microscopy (TEM) are used to visualize the structure and strain distribution, showing that the ZnO microrod exhibits strains of multiple origins in the bulk and at the interface. Strain values of -6 × 10 -4 have been measured by CXDI at the ZnO/Au interface. The origin is shown to be a combination of an interface strain, possibly caused by the Schottky contact formation, and distinct, localized electrical fields inside the crystal which are assigned to electron depletion and screening in a bent ZnO/Au piezotronic rod. These findings will contribute to sensor development and to a better understanding of piezotronic applications.

36 MATERIALS SCIENCE↗

Rapid 3D nanoscale coherent imaging via physics-aware deep learning

Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programing framework trained to predict 3D structure and strain, solely from input 3D X-ray coherent scattering data. Our networks are designed to be “physics-aware” in multiple aspects; in that the physics of the X-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods. Our integrated machine learning and differential programing solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Annealing of focused ion beam damage in gold microcrystals: an in situ Bragg coherent X-ray diffraction imaging study

Focused ion beam (FIB) techniques are commonly used to machine, analyse and image materials at the micro- and nanoscale. However, FIB modifies the integrity of the sample by creating defects that cause lattice distortions. Methods have been developed to reduce FIB-induced strain; however, these protocols need to be evaluated for their effectiveness. Here, non-destructive Bragg coherent X-ray diffraction imaging is used to study the in situ annealing of FIB-milled gold microcrystals. Two non-collinear reflections are simultaneously measured for two different crystals during a single annealing cycle, demonstrating the ability to reliably track the location of multiple Bragg peaks during thermal annealing. The thermal lattice expansion of each crystal is used to calculate the local temperature. This is compared with thermocouple readings, which are shown to be substantially affected by thermal resistance. To evaluate the annealing process, each reflection is analysed by considering facet area evolution, cross-correlation maps of the displacement field and binarized morphology, and average strain plots. The crystal's strain and morphology evolve with increasing temperature, which is likely to be caused by the diffusion of gallium in gold below ~280°C and the self-diffusion of gold above ~280°C. The majority of FIB-induced strains are removed by 380–410°C, depending on which reflection is being considered. These observations highlight the importance of measuring multiple reflections to unambiguously interpret material behaviour.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evolution of ferroelastic domain walls during phase transitions in barium titanate nanoparticles

In this work, ferroelastic domain walls inside BaTiO 3 (BTO) tetragonal nanocrystals are distinguished by Bragg peak position and studied with Bragg coherent x-ray diffraction imaging (BCDI). Convergence-related features of the BCDI method for strongly phased objects are reported. A ferroelastic domain wall inside a BTO crystal has been tracked and imaged across the tetragonal-cubic phase transition and proves to be reversible. The linear relationship of relative displacement between two twin domains with temperature is measured and shows a different slope for heating and cooling, while the tetragonality reproduces well over temperature changes in both directions. An edge dislocation is also observed and found to annihilate when heating the crystal close to the phase transition temperature.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

AI-enabled high-resolution scanning coherent diffraction imaging

Ptychographic imaging is a powerful means of imaging beyond the resolution limits of typical x-ray optics. Capturing recovered images from raw ptychographic data, however, requires the solution of an inverse problem, namely, phase retrieval. Phase retrieval algorithms are computationally expensive, which precludes real-time imaging. In this work, we propose PtychoNN, an approach to solve the ptychography data inversion problem based on a deep convolutional neural network. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. Our results demonstrate the practical application of machine learning to recover high fidelity amplitude and phase contrast images of a real sample hundreds of times faster than current ptychography reconstruction packages. Furthermore, by overcoming the constraints of iterative model-based methods, we can significantly relax sampling constraints on data acquisition while still producing an excellent image of the sample. Besides drastically accelerating acquisition and analysis, this capability has profound implications for the imaging of dose sensitive, dynamic, and extremely voluminous samples.

47 OTHER INSTRUMENTATION↗

Anisotropic nano-scale resolution in 3D Bragg coherent diffraction imaging

We demonstrate that the resolution of three-dimensional (3D) real-space images obtained from Bragg coherent x-ray diffraction measurements is direction dependent. We propose and demonstrate the effectiveness of a metric to determine the spatial resolution of images that accounts for the directional dependence. The measured direction dependent resolution of ~4-9 nm is higher than the best previously obtained 3D measurements. Lastly, we quantify the relationship between the resolution of recovered real-space images and dosage and discuss its implications in the light of next generation synchrotrons.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Visualization of the effect of additives on the nanostructures of individual bio-inspired calcite crystals

Soluble additives provide a versatile strategy for controlling crystallization processes, enabling selection of properties including crystal sizes, morphologies, and structures. Here, the additive species can also be incorporated within the crystal lattice, leading for example to enhanced mechanical properties. However, while many techniques are available for analyzing particle shape and structure, it remains challenging to characterize the structural inhomogeneities and defects introduced into individual crystals by these additives, where these govern many important material properties. Here, we exploit Bragg coherent diffraction imaging to visualize the effects of soluble additives on the internal structures of individual crystals on the nanoscale. Investigation of bio-inspired calcite crystals grown in the presence of lysine or magnesium ions reveals that while a single dislocation is observed in calcite crystals grown in the presence of lysine, magnesium ions generate complex strain patterns. Indeed, in addition to the expected homogeneous solid solution of Mg ions in the calcite lattice, we observe two zones comprising alternating lattice contractions and relaxation, where comparable alternating layers of high magnesium calcite have been observed in many magnesium calcite biominerals. Such insight into the structures of nanocomposite crystals will ultimately enable us to understand and control their properties.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Real-time coherent diffraction inversion using deep generative networks

Abstract Phase retrieval, or the process of recovering phase information in reciprocal space to reconstruct images from measured intensity alone, is the underlying basis to a variety of imaging applications including coherent diffraction imaging (CDI). Typical phase retrieval algorithms are iterative in nature, and hence, are time-consuming and computationally expensive, making real-time imaging a challenge. Furthermore, iterative phase retrieval algorithms struggle to converge to the correct solution especially in the presence of strong phase structures. In this work, we demonstrate the training and testing of CDI NN, a pair of deep deconvolutional networks trained to predict structure and phase in real space of a 2D object from its corresponding far-field diffraction intensities alone. Once trained, CDI NN can invert a diffraction pattern to an image within a few milliseconds of compute time on a standard desktop machine, opening the door to real-time imaging.

97 MATHEMATICS AND COMPUTING↗