Search NASA⌕ Search

Engineering topics

Yao, Yudong

Publications and source records attributed to Yao, Yudong.

Deep learning at the edge enables real-time streaming ptychographic imaging

Abstract Coherent imaging techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent imaging methods like ptychography are poised to revolutionize nanoscale materials characterization. However, these advancements are accompanied by significant increase in data and compute needs, which precludes real-time imaging, feedback and decision-making capabilities with conventional approaches. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHz. The proposed AI-enabled workflow eliminates the oversampling constraints, allowing low-dose imaging using orders of magnitude less data than required by traditional methods.

36 MATERIALS SCIENCE↗

Hints of Growth Mechanism Left in Supercrystals

Supercrystals of DNA-functionalized nanoparticles arevisualizedin three dimensions using X-ray ptychographic tomography, and theirreciprocal spaces are mapped with small-angle X-ray scattering inorder to better understand their internal defect structures. X-rayptychographic tomography reveals various types of defects in an assemblythat otherwise exhibits a single crystalline diffraction pattern.On average, supercrystals composed of smaller nanoparticles are smallerin size than supercrystals composed of larger particles. Additionally,supercrystals composed of small nanoparticles are typically aggregatedinto larger "necklace-like" structures. Within theselarger structures, some but not all pairs of connected domains arecoherent in their relative orientations. In contrast, supercrystalscomposed of larger nanoparticles with longer DNA ligands typicallyform faceted crystals. The combination of these two complementaryX-ray techniques reveals that the crystalline assemblies grow by aggregationof smaller assemblies followed by rearrangement of nanoparticles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Attentional Ptycho-Tomography (APT) for three-dimensional nanoscale X-ray imaging with minimal data acquisition and computation time

Abstract Noninvasive X-ray imaging of nanoscale three-dimensional objects, such as integrated circuits (ICs), generally requires two types of scanning: ptychographic, which is translational and returns estimates of the complex electromagnetic field through the IC; combined with a tomographic scan, which collects these complex field projections from multiple angles. Here, we present Attentional Ptycho-Tomography (APT), an approach to drastically reduce the amount of angular scanning, and thus the total acquisition time. APT is machine learning-based, utilizing axial self-Attention for Ptycho-Tomographic reconstruction. APT is trained to obtain accurate reconstructions of the ICs, despite the incompleteness of the measurements. The training process includes regularizing priors in the form of typical patterns found in IC interiors, and the physics of X-ray propagation through the IC. We show that APT with ×12 reduced angles achieves fidelity comparable to the gold standard Simultaneous Algebraic Reconstruction Technique (SART) with the original set of angles. When using the same set of reduced angles, then APT also outperforms Filtered Back Projection (FBP), Simultaneous Iterative Reconstruction Technique (SIRT) and SART. The time needed to compute the reconstruction is also reduced, because the trained neural network is a forward operation, unlike the iterative nature of these alternatives. Our experiments show that, without loss in quality, for a 4.48 × 93.2 × 3.92 µm 3 IC (≃6 × 10 8 voxels), APT reduces the total data acquisition and computation time from 67.96 h to 38 min. We expect our physics-assisted and attention-utilizing machine learning framework to be applicable to other branches of nanoscale imaging, including materials science and biological imaging.

47 OTHER INSTRUMENTATION↗

Three-dimensional nanoscale reduced-angle ptycho-tomographic imaging with deep learning (RAPID)

X-ray ptychographic tomography is a nondestructive method for three dimensional (3D) imaging with nanometer-sized resolvable features. The size of the volume that can be imaged is almost arbitrary, limited only by the penetration depth and the available scanning time. Here we present a method that rapidly accelerates the imaging operation over a given volume through acquiring a limited set of data via large angular reduction and compensating for the resulting ill-posedness through deeply learned priors. The proposed 3D reconstruction method “RAPID” relies initially on a subset of the object measured with the nominal number of required illumination angles and treats the reconstructions from the conventional two-step approach as ground truth. It is then trained to reproduce equal fidelity from much fewer angles. After training, it performs with similar fidelity on the hitherto unexamined portions of the object, previously not shown during training, with a limited set of acquisitions. In our experimental demonstration, the nominal number of angles was 349 and the reduced number of angles was 21, resulting in a x140 aggregate speedup over a volume of 4.48 x 93.18 x 3.92 μm 3 and with (14nm) 3 feature size, i.e. ~ 10 8 voxels. RAPID’s key distinguishing feature over earlier attempts is the incorporation of atrous spatial pyramid pooling modules into the deep neural network framework in an anisotropic way. We found that adjusting the atrous rate improves reconstruction fidelity because it expands the convolutional kernels’ range to match the physics of multi-slice ptychography without significantly increasing the number of parameters.

47 OTHER INSTRUMENTATION↗

2022 AI Testbed Expeditions Report

By exploiting the coherent properties of a light source, coherent diffraction imaging (CDI) is able to obtain the sample image at a nanoscale resolution using the measured diffraction pattern. Bragg Coherent Diffraction Imaging (BCDI) has become valuable for recovering the displacement and strain field of crystals, providing a valuable tool in material science and solid-state physics. X-ray ptychography is another emerging CDI technique that can produce a high-resolution image of the extended sample and has become popular in many research areas (e.g., materials science, biology, electronics, and optics characterization). CDI including BCDI and ptychography has become an established technique in Synchrotron Facilities including the Advanced Photon Source (APS) and will greatly benefit from the 100x coherent flux increase of the upcoming APS Upgrade (APSU). The current image formation process in CDI employs iterative phase retrieval algorithms, which is a time-consuming and computationally expensive process. Especially after APSU, the traditional iterative methods will not be able to match the experimental data acquisition speed. We employ deep learning (DL) approach to replace the iterative approaches, therefore allowing hundreds of times faster recovery of the object. We developed AutoPhaseNN, a DL-based approach which learns to solve the inverse problem without labeled data. Taking 3D BCDI as a representative technique, AutoPhaseNN has been demonstrated to be one hundred times faster than traditional iterative phase retrieval methods while providing comparable image quality. The current network is trained with 64 x 64 x 64 data size, to achieve higher resolution imaging, we will need to scale the network to input and train/infer 3D arrays of size 256 x 256 x 256 (today) and of size 2560x2560x2560 (APSU). However, the scalability of the network is restricted due to the memory-intensive training process. To perform the training for a 256 x 256 x 256 data size, the required memory exceeds the capacity of the current machine. In this project, we explore using Sambanova system to train the network for the direct data inversion for CDI.

36 MATERIALS SCIENCE↗

High-resolution ptychographic imaging enabled by high-speed multi-pass scanning

As a coherent diffraction imaging technique, ptychography provides high-spatial resolution beyond Rayleigh’s criterion of the focusing optics, but it is also sensitively affected by the decoherence coming from the spatial and temporal variations in the experiment. Here we show that high-speed ptychographic data acquisition with short exposure can effectively reduce the impact from experimental variations. To reach a cumulative dose required for a given resolution, we further demonstrate that a continuous multi-pass scan via high-speed ptychography can achieve high-resolution imaging. This low-dose scan strategy is shown to be more dose-efficient, and has potential for radiation-sensitive sample studies and time-resolved imaging.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Confined Growth of DNA-Assembled Superlattice Films

Here, we study the assembly of DNA-functionalized nanocubes under lateral confinement in microscale square trenches on a DNA-functionalized substrate. Microfocus small-angle X-ray scattering (SAXS) and scanning electron microscopy (SEM) are used to characterize the superlattices (SLs). The results indicate that nanocubes form simple-cubic SLs with square-prism morphology and a (100) out-of-plane orientation to maximize DNA bonding. In-plane, SLs align with the template, exposing their {100} side facets, and the degree of alignment depends on trench size. Interestingly, the distribution of in-plane orientations determined from SAXS and SEM do not agree, indicating that the internal and external structures of the SLs differ. To understand this discrepancy, X-ray ptychography is employed to image the internal structures of the SLs, revealing that SLs which appear to be single-crystalline in SEM may have subsurface grain boundaries, depending on trench size. SEM reveals that the SLs grow via nucleation and growth of randomly oriented domains, which then coalesce; this mechanism explains the observed dependence of alignment and defect structure on size. Interestingly, crystallization occurs via an unusual growth mode, whereby continuous SL layers grow on top of several misoriented islands. Overall, this work elucidates the effect of lateral confinement on the crystallization of DNA-functionalized nanoparticles and shows how X-ray ptychography can be used to gain insight into nanoparticle crystallization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dual-shell silicate and alumina coating for long lasting and high capacity lithium ion batteries

In this work we demonstrate a theory-driven, novel dual-shell coating system of Li 2 SrSiO 4 and Al 2 O 3 , achieved via a facile and scalable sol-gel technique on LiCoO 2 electrode particles. The optimal thickness of each coating can lead to increased specific capacity (~185 mAh/g at 0.5 C-rate) at a cut-off potential of 4.5 V, and greater cycling stability at very high C rates (up to 10 C) in half-cells with lithium metal. The mechanism of this superior performance was investigated using a combination of X-ray and electron characterization methods. It shows that the results of this investigation can inform future studies to identify still better dual-shell coating schemes, achieved by such industrially feasible techniques, for application on similar, nickel-rich cathode materials.

25 ENERGY STORAGE↗

Unraveling the advances of trace doping engineering for potassium ion battery anodes via tomography

Doping have been considered as a prominent strategy to stabilize crystal structure of battery materials during the insertion and removal of alkali ions. The instructive knowledge and experience acquired from doping strategies predominate in cathode materials, but doping principle in anodes remains unclear. Here, we demonstrate that trace element doping enables stable conversion-reaction and ensures structural integrity for potassium ion battery (PIB) anodes. With a synergistic combination of X-ray tomography, structural probes, and charge reconfiguration, we encode the physical origins and structural evolution of electro-chemo-mechanical degradation in PIB anodes. By the multiple ion transport pathways created by the orderly hierarchical pores from “surface to bulk” and the homogeneous charge distribution governed in doped nanodomains, the anisotropic expansion can be significantly relieved with trace isoelectronic element doping into the host lattice, maintaining particle mechanical integrity. Our work presents a close relationship between doping chemistry and mechanical reliability, projecting a new pathway to reengineering electrode materials for next-generation energy storage.

25 ENERGY STORAGE↗

Achieving high spatial resolution in a large field-of-view using lensless x-ray imaging

X-ray ptychography, a powerful scanning lensless imaging technique, has become attractive for nondestructively imaging internal structures at nanoscale. Stage positioning overhead in conventional step-scan ptychography is one of the limiting factors on the imaging throughput. In this work, we demonstrate the use of advanced fly scan ptychography to achieve high-resolution ptychograms of modern integrated circuits on a large field-of-view at millimeter scale. By completely removing stage overheads between scan points, the imaging time for millimeter-size sample can be significantly reduced. Furthermore, we implement the orthogonal probe relaxation technique to overcome the variation of illumination across the large scan area as well as local vibrations. The capability of x-ray ptychography shown here is broadly applicable for various studies, which requires both high spatial resolution and large scan area.

47 OTHER INSTRUMENTATION↗

Multi-beam X-ray ptychography for high-throughput coherent diffraction imaging

X-ray ptychography is a rapidly developing coherent diffraction imaging technique that provides nanoscale resolution on extended field-of-view. However, the requirement of coherence and the scanning mechanism limit the throughput of ptychographic imaging. Herein, we propose X-ray ptychography using multiple illuminations instead of single illumination in conventional ptychography. Multiple locations of the sample are simultaneously imaged by spatially separated X-ray beams, therefore, the obtained field-of-view in one scan can be enlarged by a factor equal to the number of illuminations. We have demonstrated this technique experimentally using two X-ray beams focused by a house-made Fresnel zone plate array. Two areas of the object and corresponding double illuminations were successfully reconstructed from diffraction patterns acquired in one scan, with image quality similar with those obtained by conventional single-beam ptychography in sequence. Multi-beam ptychography approach increases the imaging speed, providing an efficient way for high-resolution imaging of large extended specimens.

47 OTHER INSTRUMENTATION↗

Surface regulation enables high stability of single-crystal lithium-ion cathodes at high voltage

Abstract Single-crystal cathode materials for lithium-ion batteries have attracted increasing interest in providing greater capacity retention than their polycrystalline counterparts. However, after being cycled at high voltages, these single-crystal materials exhibit severe structural instability and capacity fade. Understanding how the surface structural changes determine the performance degradation over cycling is crucial, but remains elusive. Here, we investigate the correlation of the surface structure, internal strain, and capacity deterioration by using operando X-ray spectroscopy imaging and nano-tomography. We directly observe a close correlation between surface chemistry and phase distribution from homogeneity to heterogeneity, which induces heterogeneous internal strain within the particle and the resulting structural/performance degradation during cycling. We also discover that surface chemistry can significantly enhance the cyclic performance. Our modified process effectively regulates the performance fade issue of single-crystal cathode and provides new insights for improved design of high-capacity battery materials.

25 ENERGY STORAGE↗

The Velociprobe: An ultrafast hard X-ray nanoprobe for high-resolution ptychographic imaging

Motivated by the advanced photon source upgrade, a new hard X-ray microscope called "Velociprobe" has been recently designed and built for fast ptychographic imaging with high spatial resolution. We are addressing the challenges of high-resolution and fast scanning with novel hardware designs, advanced motion controls, and new data acquisition strategies, including the use of high-bandwidth interferometric measurements. The use of granite, air-bearing-supported stages provides the necessary long travel ranges for coarse motion to accommodate real samples and variable energy operation while remaining highly stable during fine scanning. Scanning the low-mass zone plate enables high-speed and high-precision motion of the probe over the sample. With an advanced control algorithm implemented in a closed-loop feedback system, the setup achieves a position resolution (3σ) of 2 nm. The instrument performance is evaluated by 2D fly-scan ptychography with our developed data acquisition strategies. A spatial resolution of 8.8 nm has been demonstrated on a Au test sample with a detector continuous frame rate of 200 Hz. Using a higher flux X-ray source provided by double-multilayer monochromator, we achieve 10 nm resolution for an integrated circuit sample in an ultrafast scan with a detector's full continuous frame rate of 3000 Hz (0.33 ms per exposure), resulting in an outstanding imaging rate of 9 x 10 4 resolution elements per second

36 MATERIALS SCIENCE↗

Optimized illumination for high-throughput ptychography

As a scanning version of coherent diffraction imaging (CDI), X-ray ptychography has become a popular and very successful method for high-resolution quantitative imaging of extended specimens. The requirements of mostly coherent illumination and the scanning mechanism limit the throughput of ptychographic imaging. In this paper, we will introduce the methods we use at the Advanced Photon Source (APS) to achieve high-throughput ptychography by optimizing the parameters of the illumination beam. One work we have done is increasing the illumination flux by using a double-multilayer monochromator (DMM) optics with about 0.8% bandwidth. Compared with our double-crystal monochromator (DCM) optics with 0.01% bandwidth, this DMM optics provides around 20 times more flux. A multi-wavelength reconstruction method has been implemented to deal with the consequential degraded temporal coherence from such an illumination to ensure high-quality reconstruction. In the other work, we adopt a novel use of flat-top focusing optics to generate a flat-top beam with the diameter of about 1.5 µm on the focal plane. The better uniformity of the probe and the large beam size allow one to significantly increase the step size in ptychography scans and thereby the imaging efficiency.

Broad bandwidth↗