Search NASA⌕ Search

SEARCH · Search NASA

Results for “functional imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Deep generative learning of magnetic frustration in artificial spin ice from magnetic force microscopy images

Increasingly large datasets of microscopic images with nanoscale resolution facilitate the development of machine learning methods to identify and analyze subtle physical phenomena embedded within the images. In this work, microscopic images of honeycomb lattice spin-ice samples serve as datasets from which we automate the calculation of net magnetic moments and directional orientations of spin-ice configurations. In the first stage of our workflow, machine learning models are trained to accurately predict magnetic moments and directions within spin-ice structures. Variational Autoencoders (VAEs), an emergent unsupervised deep learning technique, are employed to generate high-quality synthetic magnetic force microscopy (MFM) images and extract latent feature representations, thereby reducing experimental and segmentation errors. The second stage of proposed methodology enables precise identification and prediction of frustrated vertices and nanomagnetic segments, effectively correlating structural and functional aspects of microscopic images. This facilitates the design of optimized spin-ice configurations with controlled frustration patterns, enabling potential on-demand synthesis.

36 MATERIALS SCIENCE↗

Charge-density based convolutional neural networks for stacking fault energy prediction in concentrated alloys

A descriptor-less machine learning (ML) model based only on charge density images extracted from density functional theory (DFT) is developed to predict stacking fault energies (SFE) in concentrated alloys. The model is based on convolutional neural networks (CNNs) as one of the promising ML techniques for dealing with complex images and data. Identification of correct descriptors is a key bottleneck to develop ML models for predicting materials properties. Often, in most ML models, textbook physical descriptors such as atomic radius, valence charge and electronegativity are used as descriptors which have limitations because these properties change in concentrated alloys when multiple elements are mixed to form a solid solution. Here, we illustrate that, within the scope of DFT, the search for descriptors can be circumvented by electronic charge density, which is the backbone of the Kohn-Sham DFT and describes the system completely. The performance of our model is demonstrated by predicting SFE of concentrated alloys with an RMSE and R 2 of 6.18 mJ/m 2 and 0.87, respectively, validating the accuracy of the proposed approach.

36 MATERIALS SCIENCE↗

Atomic resolution scanning transmission electron microscopy at liquid helium temperatures for quantum materials

Fundamental quantum phenomena in condensed matter, ranging from correlated electron systems to quantum information processors, manifest their emergent characteristics and behaviors predominantly at low temperatures. This necessitates the use of liquid helium (LHe) cooling for experimental observation. Atomic resolution scanning transmission electron microscopy combined with LHe cooling (cryo-STEM) provides a powerful characterization technique to probe local atomic structural modulations and their coupling with charge, spin and orbital degrees-of-freedom in quantum materials. However, achieving atomic resolution in cryo-STEM is exceptionally challenging, primarily due to sample drifts arising from temperature changes and noises associated with LHe bubbling, turbulent gas flow, etc. In this work, we demonstrate atomic resolution cryo-STEM imaging at LHe temperatures using a commercial side-entry LHe cooling holder. Firstly, we examine STEM imaging performance as a function of He gas flow rate, identifying two primary noise sources: He-gas pulsing and He-gas bubbling. Secondly, we propose two strategies to achieve low noise conditions for atomic resolution STEM imaging: either by temporarily suppressing He gas flow rate using the needle valve or by acquiring images during the natural warming process. Lastly, we show the applications of image acquisition methods and image processing techniques in investigating structural phase transitions in Cr 2 Ge 2 Te 6 , CuIr 2 S 4 , and CrCl 3 . In conclusion, our findings represent an advance in the field of atomic resolution electron microscopy imaging for quantum materials and devices at LHe temperatures, which can be applied to other commercial side-entry LHe cooling TEM holders.

36 MATERIALS SCIENCE↗

Methods for delineating cellular regions and classifying regions of histopathology and microanatomy

Embodiments disclosed herein provide methods and systems for delineating cell nuclei and classifying regions of histopathology or microanatomy while remaining invariant to batch effects. These systems and methods can include providing a plurality of reference images of histology sections. A first set of basis functions can then be determined from the reference images. Then, the histopathology or microanatomy of the histology sections can be classified by reference to the first set of basis functions, or reference to human engineered features. A second set of basis functions can then be calculated for delineating cell nuclei from the reference images and delineating the nuclear regions of the histology sections based on the second set of basis functions.

59 BASIC BIOLOGICAL SCIENCES↗

Mechanically flexible mid-wave infrared imagers using black phosphorus ink films

The mid-wave infrared (MWIR) spectral range (λ = 3–8 μm) enables important sensing and imaging applications, including non-invasive bioimaging, night vision, and autonomous navigation. Commercial MWIR photodetectors are limited to rigid imagers based on heteroepitaxial materials. There is an emerging need for mechanically flexible MWIR imagers to broaden their functionality and practicality. Recently, photodetectors using van der Waals (vdW) black phosphorus (BP) flakes have demonstrated highly sensitive room-temperature photodetection. Additionally, vdW materials are solution-processable, facilitating scalable processing and flexible device fabrication. In this work, we present flexible MWIR imagers consisting of photodiodes fabricated on thin plastic substrates using BP ink films. We demonstrate mechanically robust responsivity up to 2.5-mm bending radii and after 5000 bending cycles. Leveraging this flexibility, we achieve full-azimuthal imaging, detecting directional light sources with precision. These results establish a scalable approach for large-area, conformable MWIR imaging and pave the way for integration with flexible electronics.

Wijaya, Theodorus Jonathan↗

Theory and application of the vector pair correlation function for real-space crystallographic analysis of order/disorder correlations from STEM images

Deviations of local structure and chemistry from the average crystalline unit cell are increasingly recognized to have a significant influence on the properties of many technologically important materials. Here, we present the vector pair correlation function (vPCF) as a new real-space crystallographic analysis method, which can be applied to atomic-resolution scanning transmission electron microscopy (STEM) images to quantify and analyze structural order/disorder correlations. Our STEM-based vPCFs have several advantages over radial PCFs and/or 3D pair distribution functions from x-ray total scattering: vPCFs explicitly retain crystallographic orientation information, are spatially resolved, can be applied directly on a sublattice basis, and are suitable for any material that can be imaged with STEM. To show the utility of our approach, we measure partial vPCFs in Ba 5 SmSn 3 Nb 7 O 30 (BSSN), a tetragonal tungsten bronze (TTB) structured complex oxide. Many TTBs are known to be classical or relaxor ferroelectrics, and these properties have been correlated with the presence of superlattice ordering. BSSN, specifically, exhibits relaxor behavior and an incommensurate structural modulation. From the vPCF data, we observe that, of the cation sites, only the Ba (A2) sublattice is structurally modulated. We then infer the local modulation vector and reveal a marked anisotropy in its correlation length. Finally, short-range correlated polar displacements on the B2 cation sites are observed. This work introduces the vPCF as a powerful real-space crystallography technique, which enables direct, robust quantification of short-to-long range order on a sublattice-specific basis and is applicable to a wide range of complex material types.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DECIDER

This software offers methods and functions for building failure detectors for deep image classification models with the aid of vision-language models and LLMs. It includes functionalities for training baseline image classifiers, debiasing classifiers using vision-language models and LLMs, evaluating failure between models along with baselines. Developed using PyTorch, this software is compatible with standard neural network architectures used for imaging data. Additionally, it provides capabilities to compute evaluation metrics for assessing the performance and quality of the detectors.

Narayanaswamy, Vivek Sivaraman↗

Computational scanning tunneling microscope image database

We introduce the systematic database of scanning tunneling microscope (STM) images obtained using density functional theory (DFT) for two-dimensional (2D) materials, calculated using the Tersoff-Hamann method. It currently contains data for 716 exfoliable 2D materials. Examples of the five possible Bravais lattice types for 2D materials and their Fourier-transforms are discussed. All the computational STM images generated in this work are made available on the JARVIS-STM website ( https://jarvis.nist.gov/jarvisstm ). We find excellent qualitative agreement between the computational and experimental STM images for selected materials. As a first example application of this database, we train a convolution neural network model to identify the Bravais lattice from the STM images. We believe the model can aid high-throughput experimental data analysis. These computational STM images can directly aid the identification of phases, analyzing defects and lattice-distortions in experimental STM images, as well as be incorporated in the autonomous experiment workflows.

47 OTHER INSTRUMENTATION↗

Scintillator detector characterization for laser-driven proton beam imaging

The spatial resolution and imaging characteristics of plastic scintillators are characterized using laser-driven proton beams. Laser-driven proton beams typically have broad energy spectra and are accompanied by relativistic electrons and high-energy photons, both potentially contributing to background noise. Different types and thicknesses of Eljen Technology scintillators are compared to determine their intrinsic point spread function. Point-projection imaging of a mesh is used to compare the imaging resolution of the scintillator to the usual imaging detector, radiochromic film, and is found to be reasonably comparable and sufficient for many experimental applications.

47 OTHER INSTRUMENTATION↗

Brighter-fatter Effect in Near-infrared Detectors—III. Fourier-domain Treatment of Flat Field Correlations and Application to WFIRST

Weak gravitational lensing has emerged as a leading probe of the growth of cosmic structure. However, the shear signal is very small and accurate measurement depends critically on our ability to understand how non-ideal instrumental effects affect astronomical images. The Wide-Field Infrared Survey Telescope (WFIRST) will fly a focal plane containing 18 Teledyne H4RG-10 near-infrared detector arrays, which present different instrument calibration challenges from previous weak lensing observations. Previous work [Paper I: Hirata & Choi, PASP, 132, 014501 (2020); and Paper II: Choi & Hirata, PASP, 132, 014502 (2020)] has shown that correlation functions of flat field images, including cross-correlations between different time slices that are enabled by the non-destructive read capability of the infrared detectors, are effective tools for disentangling linear and nonlinear inter-pixel capacitance (IPC) and the brighter-fatter effect (BFE). Here we present a Fourier-domain treatment of the flat field correlations, which allows us to expand the previous formalism to all orders in IPC, BFE, and classical nonlinearity. We show that biases in simulated flat field analyses in Paper I are greatly reduced through the use of this formalism. We then apply this updated formalism to flat field data from three WFIRST flight candidate detectors, and explore the robustness to variations in the analysis. We find that the BFE is present in all three detectors, and that its contribution to the flat field correlations dominates over the nonlinear IPC, in accordance with the results from Paper II on a development detector. The magnitude of the BFE is such that the effective area of a pixel is increased by (3.54 ± 0.03) × 10 -7 for every electron deposited in a neighboring pixel (sensor chip assembly [SCA] 20829, statistical error, not IPC-deconvolved). We compare IPC maps from flat field autocorrelation measurements to those obtained from the single pixel reset method and find a median difference of 0.113% for SCA 20829. After further diagnosis of this difference, we ascribe it largely to an additional source of cross-talk, the vertical trailing pixel effect, and recommend further work to develop a model for this effect. These results represent a significant step toward calibration of the non-ideal effects in WFIRST detectors.

79 ASTRONOMY AND ASTROPHYSICS↗

Advancing 3D surface imaging: single-axis structured light illumination plenoptic camera with machine learning integration

Structured light illumination (SLI) is a configurable 3D surface imaging modality that can function largely independently of surface texture. At the same time, machine learning (ML) approaches are providing new ways to capture relevant information from SLI patterns, avoiding the need to develop advanced computer vision algorithms. By projecting an optical pattern onto a surface and measuring the apparent distortion of that pattern, one can determine surface topography from a single image. Common realizations of SLI 3D imaging use off-axis SLI to allow for parallax-based determination of depth; however, in constrained geometries, the ability to make single-axis measurements can be of major benefit. While plenoptic imaging (PI) cameras have long been developed for the purpose of single-axis 3D imaging, they are generally reliant on the surface texture of the measured object, thus making them unreliable in certain experimental conditions. Therefore, we present a single-axis 3D SLI plenoptic camera, which combines the single-axis benefits of PI technology while using coaxial SLI to maintain indifference to surface conditions. We also present a study of the camera capabilities paired with the development of several algorithms, including traditional feature tracking methods as well as ML methods, which are found to enhance resolution and range. We report depth sensitivity down to 0.2% $\frac{dz}{z_0}$. The single-axis SLI 3D plenoptic camera demonstrates potential applicability for in-situ topographical measurements under a wide range of conditions including, but not limited to, objects without trackable surface texture, high temperatures, and constrained geometry environments.

Imaging systems↗

Using distributions to understand neutron and x-ray production in ICF ignition capsules and other high energy density plasmas

Here this paper describes how x-ray and neutron distribution functions can be useful tools to visualize the conditions measured in many types of plasma physics experiments. In particular, we model a standard inertial confinement fusion ignition capsule that consists of a Si doped plastic ablator surrounding a layer of deuterium–tritium (DT) ice as the yield varies from 18 kJ to 16.7 MJ and use the distribution functions to show that neutrons and high energy x rays (15 keV) are produced under similar conditions when the yield is low. However, as the capsule starts to support a propagating burn due to alpha heating, the x rays and neutrons are produced under somewhat different conditions in different parts of the plasma. In particular, the x-ray production takes place mainly in the hot plastic ablator for the full yield ignition capsule under quite different plasma conditions from the DT region producing the 14 MeV neutrons, which results in x-ray images with larger radii than the corresponding neutron images. These same distribution functions can be applied to many other plasma physics experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Nanoscale x-ray and electron tomography

We present that three-dimensional (3D) tomographic imaging of the structural, chemical, and physical properties of a material provides key knowledge that links the structure of a material to both its processing and structure that is central to studies across a broad spectrum of materials. For many decades, tomography using x-rays or electrons has proven to be an essential 3D characterization tool. In recent years, advances in technology have significantly pushed the envelope of these techniques in many respects, enabling new imaging capabilities at the nanometer and atomic scale. This article highlights several such developments in nanoscale x-ray and electron tomography. The five articles that appear in this issue of MRS Bulletin discuss research frontiers that include multimodal x-ray tomography at the nanoscale, x-ray spectroscopic tomography, dark-field x-ray microscopy, electron nanotomography for functional nanomaterials, and atomistic imaging by electron tomography. Lastly, these articles give a holistic view of the status of these techniques and promising future directions, as well highlighting their applications for scientific problems.

36 MATERIALS SCIENCE↗

Understanding Twinning and Deformation in High Entropy Alloys

A combination of high strength and high ductility has been observed in multi-principal element alloys due to twin formation attributed to low stacking fault energy (SFE). In the pursuit of low SFE alloys, a key bottleneck is the lack of understanding of the composition–SFE cor- relations that would guide tailoring SFE via alloy composition. Using density functional theory (DFT), we show that dopant radius, which have been postulated as a key descriptor for SFE in dilute alloys, does not fully explain SFE trends across different host metals. Instead, charge density is a much more central descriptor. It allows us to (1) explain contrasting SFE trends in Ni and Cu host metals due to various dopants in dilute concentrations, (2) explain the large SFE variations observed in the literature even within a given alloy composition due to the nearest neighbor environments in “model” concentrated alloys, and (3) develop a machine learning model that can be used to predict SFEs in multi-elemental alloys. This model opens a possibility to use charge density as a descriptor for predicting SFE in alloys. Furthermore, a descriptor-less machine learning (ML) model based only on charge density images extracted from density functional theory (DFT) is developed to predict stacking fault energies (SFE) in concentrated alloys. The model is based on convolutional neural networks (CNNs) as one of the promising ML techniques for dealing with complex images and data. Identification of correct descriptors is a key bottleneck to develop ML models for predicting materials properties. Often, in most ML models, textbook physical descriptors such as atomic radius, valence charge and electronegativity are used as descriptors which have limitations because these properties change in concentrated alloys when multiple elements are mixed to form a solid solution. We illustrate that, within the scope of DFT, the search for descriptors can be circumvented by electronic charge density, which is the backbone of the Kohn-Sham DFT and describes the system completely. The performance of our model is demonstrated by predicting SFE of concentrated alloys with an RMSE and R2 of 6.18 mJ/m2 and 0.87, respectively, validating the accuracy of the proposed approach.

36 MATERIALS SCIENCE↗

Nanoscale Mass Spectrometry Multimodal Imaging via Tip-Enhanced Photothermal Desorption

Materials ranging from adhesives, pharmaceuticals, lubricants, and personal care products are traditionally studied using macroscopic characterization techniques. However, their functionality is in reality defined by details of chemical organization on often noncrystalline matter with characteristic length scales on the order of microns to nanometers. Additionally, these materials are traditionally difficult to analyze using standard vacuum-based approaches that provide nanoscale chemical characterization due to their volatile and beam-sensitive nature. Therefore, approaches that operate under ambient conditions need to be developed that allow probing of nanoscale chemical phenomena and correlated functionality. Here, we demonstrate a tool for probing and visualizing local chemical environments and correlating them to material structure and functionality using advanced multimodal chemical imaging on a combined atomic force microscopy (AFM) and mass spectrometry (MS) system using tip-enhanced photothermal desorption with atmospheric pressure chemical ionization (APCI). We demonstrate enhanced performance metrics of the technique for correlated imaging and point sampling and illustrate the applicability for the analysis of trace chemicals on a human hair, additives in adhesives on paper, and pharmaceuticals samples notoriously difficult to analyze in a vacuum environment. Overall, this approach of correlating local chemical environments to structure and functionality is key to advancing research in many fields ranging from biology, to medicine, to material science.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Scattered-light uniformity imager for diagnosing laser absorption asymmetries on OMEGA

Light scattered from a target is the most-direct measurement for diagnosing laser absorption in a direct-drive implosion. Observations from OMEGA implosions show much larger scattered-light asymmetries than predictions. A new instrument has been developed to absolutely measure the scattered-light intensity and nonuniformity for the purpose of diagnosing the asymmetry. The scattered-light uniformity imager (SLUI) diagnostic records the variation in scattered-light intensity over a transmission diffuser using a charge-coupled device (CCD)/lens assembly. At the standard operating position, an 11.3° (f/2.5) cone of light is collected. A stray light baffle, debris shield, and antireflection absorbing filter are also incorporated into the diagnostic payload inserted into the target chamber. The imaging parts of the diagnostic (light baffle, vacuum window, filters, lens, and CCD camera) are located outside the target chamber. Five SLUIs have been built and deployed in OMEGA’s ten-inch manipulator diagnostic ports, covering almost 5% of the emission surface, enabling an absolute scattered-light measurement should be within a few percent of the global average. Each SLUI system is calibrated offline, providing absolute scattered-light intensity measurements. Based on the measured point spread function, each diffuser plate image contains over 20 000 independent scattered-light absolute-intensity measurements of the variation over the collection cone. SLUI provides a platform to study scattered light and absorption asymmetries, and their possible sources.

47 OTHER INSTRUMENTATION↗

Quantitative x ray phase contrast imaging of oblique shock wave–interface interactions

Oblique shock wave–interface interactions of gases and liquids have been extensively studied in shock tubes using optical methods to measure equation-of-state (EOS) parameters. However, this is difficult with solids due to their opaqueness to visible light. X ray phase contrast imaging (XPCI) has the penetrative strength to probe solids while still being sensitive to mass density and enhancing the visibility of material boundaries. We investigate the accuracy and repeatability of measuring the mean value of the average mass density (areal density divided by thickness) over region S (B S ) and flow deflection angle (θ) from XPCI images of a sample. To that end, a Hough transform-based method for measuring θ is developed. To measure B S , the XPCI image intensity probability density function (PDF) is modeled accounting for the spatial distribution of x ray energy, scintillator response, and pulse-to-pulse variation in the x ray intensity. In addition, a Monte Carlo-based algorithm for computing the B S PDF is developed. Both methods are validated on an impact-generated oblique shock wave interacting at a solid polymer-to-polymer interface. Furthermore this is accomplished through a comparison to hydrodynamic simulations using well-established EOS. Under the modeling framework for the XPCI image intensity, B S is computed with an accuracy of < 0.1% and precision of 3%–5%, while θ has an uncertainty of 0.2°, respectively. This shows that the XPCI-based model that is developed here could be an invaluable tool for high-fidelity testing of hydrodynamic models in shock polar configurations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

New Orthophoto Generation Strategies from UAV and Ground Remote Sensing Platforms for High-Throughput Phenotyping

Remote sensing platforms have become an effective data acquisition tool for digital agriculture. Imaging sensors onboard unmanned aerial vehicles (UAVs) and tractors are providing unprecedented high-geometric-resolution data for several crop phenotyping activities (e.g., canopy cover estimation, plant localization, and flowering date identification). Among potential products, orthophotos play an important role in agricultural management. Traditional orthophoto generation strategies suffer from several artifacts (e.g., double mapping, excessive pixilation, and seamline distortions). The above problems are more pronounced when dealing with mid- to late-season imagery, which is often used for establishing flowering date (e.g., tassel and panicle detection for maize and sorghum crops, respectively). In response to these challenges, this paper introduces new strategies for generating orthophotos that are conducive to the straightforward detection of tassels and panicles. The orthophoto generation strategies are valid for both frame and push-broom imaging systems. The target function of these strategies is striking a balance between the improved visual appearance of tassels/panicles and their geolocation accuracy. The new strategies are based on generating a smooth digital surface model (DSM) that maintains the geolocation quality along the plant rows while reducing double mapping and pixilation artifacts. Moreover, seamline control strategies are applied to avoid having seamline distortions at locations where the tassels and panicles are expected. The quality of generated orthophotos is evaluated through visual inspection as well as quantitative assessment of the degree of similarity between the generated orthophotos and original images. Several experimental results from both UAV and ground platforms show that the proposed strategies do improve the visual quality of derived orthophotos while maintaining the geolocation accuracy at tassel/panicle locations.

54 ENVIRONMENTAL SCIENCES↗