Search NASA⌕ Search

SEARCH · Search NASA

Results for “3d imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Fast GPU 3D diffeomorphic image registration

3D image registration is one of the most fundamental and computationally expensive operations in medical image analysis. Here, we present a mixed-precision, Gauss–Newton–Krylov solver for diffeomorphic registration of two images. Our work extends the publicly available CLAIRE library to GPU architectures. Despite the importance of image registration, only a few implementations of large deformation diffeomorphic registration packages support GPUs. Our contributions are new algorithms to significantly reduce the run time of the two main computational kernels in CLAIRE: calculation of derivatives and scattered-data interpolation. Additionally, we deploy (i) highly-optimized, mixed-precision GPU-kernels for the evaluation of scattered-data interpolation, (ii) replace Fast-Fourier-Transform (FFT)-based first-order derivatives with optimized 8th-order finite differences, and (iii) compare with state-of-the-art CPU and GPU implementations. As a highlight, we demonstrate that we can register clinical images in less than 6 s on a single NVIDIA Tesla V100. This amounts to over 20 speed-up over the current version of CLAIRE and over 30 speed-up over existing GPU implementations.

97 MATHEMATICS AND COMPUTING↗

Development of high throughput light-sheet fluorescence lifetime imaging microscopy for 3D functional imaging of metabolic pathways in plant and microorganisms (Final Technical Report)

This research program will enable new biochemical contrast in the nanosecond lifetime domain through use of the recently demonstrated electro-optic fluorescence lifetime imaging technique (EO-FLIM) for wide-field lifetime imaging. The Stanford/Stanford Linear Accelerator Center multidisciplinary collaboration -- physics, applied physics, and structural biology -- will develop a light-sheet fluorescence lifetime imaging microscope for functional studies of microbial and plant metabolic pathways and dynamic interactions between plants and microorganisms in the rhizosphere. The proposed approach overcomes the imaging time bottleneck associated with existing fluorescence lifetime imaging methods. Initial demonstrations have shown a factor of 100,000 improvement in photon throughput compared to existing methods. High photon efficiency allowed the first wide-field fluorescence lifetime imaging of single molecules. Recent work has improved the technique’s repetition rate to enable compatibility with mode-locked lasers and demonstrated the combination of wide-field fluorescence lifetime imaging with super-resolution localization microscopy, observations of single molecule dynamics, and observation of donor lifetime quenching in single-molecule imaging. These results were achieved on standard camera sensors and would not have been possible with other wide-field approaches. The throughput and photon economy of the EO-FLIM method enables new BER-relevant imaging opportunities. In particular, scanned single- and two-photon light-sheet excitation will be used to achieve volumetric imaging with time-domain contrast.

47 OTHER INSTRUMENTATION↗

Advancing 3D surface imaging: single-axis structured light illumination plenoptic camera with machine learning integration

Structured light illumination (SLI) is a configurable 3D surface imaging modality that can function largely independently of surface texture. At the same time, machine learning (ML) approaches are providing new ways to capture relevant information from SLI patterns, avoiding the need to develop advanced computer vision algorithms. By projecting an optical pattern onto a surface and measuring the apparent distortion of that pattern, one can determine surface topography from a single image. Common realizations of SLI 3D imaging use off-axis SLI to allow for parallax-based determination of depth; however, in constrained geometries, the ability to make single-axis measurements can be of major benefit. While plenoptic imaging (PI) cameras have long been developed for the purpose of single-axis 3D imaging, they are generally reliant on the surface texture of the measured object, thus making them unreliable in certain experimental conditions. Therefore, we present a single-axis 3D SLI plenoptic camera, which combines the single-axis benefits of PI technology while using coaxial SLI to maintain indifference to surface conditions. We also present a study of the camera capabilities paired with the development of several algorithms, including traditional feature tracking methods as well as ML methods, which are found to enhance resolution and range. We report depth sensitivity down to 0.2% $\frac{dz}{z_0}$. The single-axis SLI 3D plenoptic camera demonstrates potential applicability for in-situ topographical measurements under a wide range of conditions including, but not limited to, objects without trackable surface texture, high temperatures, and constrained geometry environments.

Imaging systems↗

Multimodal Imaging of Autofluorescent Sites Reveals Varied Chemical Speciation in SSZ-13 Crystals

In this report a multimodal imaging study of chabazite is used to analyse emissive deposits. A notable difference is seen in the morphology of agglomerated surface deposits and larger subsurface deposits. Comparison of the distribution of organic residue throughout the crystal volume and XRF mapping is demonstrating that a fluorescence-based technique can also be used to indirectly comment on the compositional chemistry of the inorganic framework. A multimodal imaging study of chabazite is used to show the distribution of and discriminate between different emissive deposits arising as a result of the detemplation process. Confocal imaging, 3D fluorescence lifetime imaging, 3D multispectral fluorescence imaging, and Raman mapping are used to show three different types of emissive behaviours each characterised by different spatial distributions, trends in lifetime, spectral signals, and Raman signatures. A notable difference is seen in the morphology of agglomerated surface deposits and larger subsurface deposits, which experience lifetime augmentation due to spatial confinement. The distribution of organic residue throughout the crystal volume is comparable to XRF mapping that shows Si enrichment on the outer edges and higher Al content through the centre, demonstrating that a fluorescence-based technique can also be used to indirectly comment on the compositional chemistry of the inorganic framework.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accurate surface estimation from high-resolution 3D microwave images

Active millimeter and microwave imaging techniques can be used to create a high-resolution 3D image volume of a target’s reflectivity. Millimeter-wave imaging is commonly used for personnel security screening and numerous other applications. Backprojection based image reconstruction techniques form a 3D complex-valued volume. The complex-valued volume is commonly reduced to a real-valued volume by taking the magnitude. For anomaly detection and cross image registration of an object it is beneficial to generate an accurate representation of an object’s surface. Extracting a smooth and accurate surface from a magnitude only image is challenging. One difficulty is the magnitude image has limited resolution in the depth direction which normally limits precision to a moderate fraction of the depth resolution. Another difficulty is that the magnitude of the image depends heavily on the geometry and orientation of the object being imaged. The phase information in a complex-valued image volume provides a means to decouple the magnitude of the image from the geometry of an object and provide precision much finer than the depth resolution would indicate. This enables the generation of a smooth and accurate point cloud representation of the surface of an imaged object. A method to extract a point cloud from the phase information in a 3D complex-valued millimeter-wave image volume is developed and results with simulated and experimental data are presented.

Clark, Richard T.↗

Developing a camera-based 3D momentum imaging system capable of 1 Mhits/s

A camera-based three-dimensional (3D) imaging system with a superb time-of-flight (TOF) resolution and multi-hit capability was recently developed for electron/ion imaging [Lee et al. J. Chem. Phys. 141, 221101 (2014)]. In this work, we report further improvement of the event rate of the system by adopting an event-driven camera, Tpx3Cam, for detecting the 2D positions of electrons, while a high-speed digitizer provides highly accurate (~30 ps) TOF information for each event at a rate approaching 1 Mhits/sec.

47 OTHER INSTRUMENTATION↗

Ultra-Structural Imaging Provides 3D Organization of 46 Chromosomes of a Human Lymphocyte Prophase Nucleus

Three dimensional (3D) ultra-structural imaging is an important tool for unraveling the organizational structure of individual chromosomes at various stages of the cell cycle. Performing hitherto uninvestigated ultra-structural analysis of the human genome at prophase, we used serial block-face scanning electron microscopy (SBFSEM) to understand chromosomal architectural organization within 3D nuclear space. Acquired images allowed us to segment, reconstruct, and extract quantitative 3D structural information about the prophase nucleus and the preserved, intact individual chromosomes within it. Our data demonstrate that each chromosome can be identified with its homolog and classified into respective cytogenetic groups. Thereby, we present the first 3D karyotype built from the compact axial structure seen on the core of all prophase chromosomes. The chromosomes display parallel-aligned sister chromatids with familiar chromosome morphologies with no crossovers. Furthermore, the spatial positions of all 46 chromosomes revealed a pattern showing a gene density-based correlation and a neighborhood map of individual chromosomes based on their relative spatial positioning. A comprehensive picture of 3D chromosomal organization at the nanometer level in a single human lymphocyte cell is presented.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Snapshot multifocal light field microscopy

Light field microscopy (LFM) is an emerging technology for high-speed wide-field 3D imaging by capturing 4D light field of 3D volumes. However, its 3D imaging capability comes at a cost of lateral resolution. In addition, the lateral resolution is not uniform across depth in the light field dconvolution reconstructions. To address these problems, here, we propose a snapshot multifocal light field microscopy (MFLFM) imaging method. The underlying concept of the MFLFM is to collect multiple focal shifted light fields simultaneously. We show that by focal stacking those focal shifted light fields, the depth-of-field (DOF) of the LFM can be further improved but without sacrificing the lateral resolution. Also, if all differently focused light fields are utilized together in the deconvolution, the MFLFM could achieve a high and uniform lateral resolution within a larger DOF. We present a house-built MFLFM system by placing a diffractive optical element at the Fourier plane of a conventional LFM. The optical performance of the MFLFM are analyzed and given. Both simulations and proof-of-principle experimental results are provided to demonstrate the effectiveness and benefits of the MFLFM. We believe that the proposed snapshot MFLFM has potential to enable high-speed and high resolution 3D imaging applications.

He, Kuan↗

Vision-based inspection of prefabricated components using camera poses: Addressing inherent limitations of image-based 3D reconstruction

Modular construction can lead to additional cost overruns and delays when a defect is found on the construction site and is not easily repairable. Researchers have developed various methods that use image-based 3D reconstruction for quality assessment, but they have inherent limitations, such as inconsistency and dealing with surfaces with reflectivity and limited visual features. Therefore, this paper presents a vision-based quality assessment method using cameras for prefabricated components by addressing these limitations. Specifically, this paper proposes a novel quality inspection method with sub-millimeter accuracy using cameras focused on leveraging camera poses (as opposed to 3D point clouds that are often not consistent in quality) from the image-based 3D reconstruction. The 3D point estimation by computing triangulation was used for achieving accurate measurement. The proposed method is validated using six different variances and two case studies – an aluminum pipe with a reflective surface and a fabricated concrete column. Furthermore, the results demonstrate the accuracy and effectiveness of the proposed method.

42 ENGINEERING↗

Few-view computed tomography reconstruction using deep neural network inference

A system for generating 2D slices of a 3D image of a target volume is provided. The system receives a target sinogram collected during a computed tomography scan of the target volume. The system inputs the target sinogram to a convolutional neural network (CNN) to generate predicted 2D slices of the 3D image. The CNN is trained using training 2D slices of training 3D images. The system initializes 2D slices to the predicted 2D slices. The system reconstructs 2D slices of the 3D image from the target sinogram and the initialized 2D slices.

Kim, Hyojin↗

Surface 3D Electrical Resistivity Tomography Inversion of 2005 BC Cribs and Trenches Datasets

Hydrogeophysics, Inc. (HGI) conducted an electrical resistivity tomography (ERT) dataset at the BC Cribs and Trenches site, located in the Central Plateau of the Hanford Site. The 20 trenches and 6 cribs received large volumes of liquid inorganic waste in the 1950s, resulting in a large inventory of contaminants in the vadose zone. The objective of the ERT survey was to map plume extents resulting from the legacy discharges. The HGI interpretation of the resistivity data was performed using geometric inversion to interpolate 2D lines into a 3D image. To demonstrate a newly developed geophysical code capability (E4D), the resistivity data were re-processed to fit a full 3D model of the bulk electrical conductivity. This proof-of-concept model inversion was executed in calendar year 2011, as the large dataset was well-suited for the use of high-performance computing. The 3D re-processing of the BC Cribs and Trenches ERT data conducted in 2011 resolved the true bulk electrical conductivity. This means that all of the resistivity data were fit to a single model of the bulk electrical conductivity, with true horizontal and vertical dimensions. This differed from the HGI data interpretation approach that used geometric inversion to process 2D lines independently, which were then interpolated into a 3D image. Both the full 3D re-processing and the 2D interpolation to a 3D image demonstrated a higher electrical conductivity observed immediately beneath the trenches and cribs. The electrical conductivity is strongly correlated with nitrate concentrations, indicating the presence of nitrate and other co-located contaminants.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

3D Optical Coherence Tomography image processing in BISCAP: characterization of biofilm structure and properties

Abstract Motivation BISCAP is a state-of-the-art tool for automatically characterizing biofilm images obtained from Optical Coherence Tomography. Limited availability of other software tools is reported in the field. BISCAP’s first version processes 2D images only. Processing 3D images is a problem of greater scientific relevance since it deals with the entire structure of biofilms instead of their 2D slices. Results Building on the image-processing principles and algorithms proposed earlier for 2D images, these were adapted to the 3D case, and a more general implementation of BISCAP was developed. The primary goal concerns the extension of the initial methodology to incorporate the depth axis in 3D images; multiple improvements were also made to boost computational performance. The calculation of structural properties and visual outputs was extended to offer new insights into the 3D structure of biofilms. BISCAP was tested using 3D images of biofilms with different morphologies, consistently delivering accurate characterizations of 3D structures in a few minutes using standard laptop machines. Low user dependency is required for image analysis. Availability and implementation BISCAP is available from https://github.com/diogonarciso/BISCAP. All images used in the tutorials and the validation examples are available from https://web.fe.up.pt/∼fgm/biscap3d.

Narciso, Diogo A. C. (ORCID:0000000227767477)↗

High-resolution 3D microwave imaging using an optically tracked linear array

Active three-dimensional microwave or millimeter-wave imaging is typically performed using a linear array that is mechanically scanned over a uniform planar or cylindrical aperture. However, an image can also be formed with a linear array that is scanned over a non-uniform irregular aperture. This requires that the precise position of the array be known for each radar sample. This paper explores high-resolution 3D microwave imaging of stationary targets using an optically tracked manually scanned linear array. The image reconstruction techniques necessary to account for a non-uniform irregular aperture are also developed.

Clark, Richard T.↗

Optimal 3D chemical imaging with multimodal electron tomography

Accurate mapping of nanoscale chemistry in three dimensions (3D) has been a longstanding challenge. Modern electron microscopy provides chemical images by electron energy loss spectroscopy (EELS) and energy dispersive x-ray spectrometry (EDX) but requires high fluences that damage specimens. In 3D, the requirements are worse; electron tomography demands many high-fluence chemical maps for reconstruction, creating a tradeoff between resolution, accuracy, and sample survival. Fused multimodal electron tomography (MM-ET) alleviates this requirement by leveraging lower-fluence high-angle annular dark-field (HAADF) images alongside a few chemical maps to dramatically improve chemical resolution. Here, experimental and computational parameter space is systematically explored to determine when MM-ET performs best. Ideal imaging conditions balance sample survival with resolution and chemical specificity; we recommend a tilt range of at least ± 70°, acquiring 40 equally spaced HAADF projections (signal-to-noise > 10), and 7 EELS/EDX maps of each chemistry (signal-to-noise > 4).

36 MATERIALS SCIENCE↗

Cohesive phase-field chemo-mechanical simulations of inter- and trans- granular fractures in polycrystalline NMC cathodes via image-based 3D reconstruction

The optimal design and durable utilization of lithium-ion batteries necessitates an objective modeling approach to understand fracture and failure mechanisms. This paper presents a comprehensive chemo-mechanical modeling study focused on elucidating fracture-induced damage and degradation phenomena in the polycrystalline Li $\mathcal{x}$ Ni 0.5 Mn 0.3 Co 0.2 O 2 (NMC532) cathode. An innovative approach that utilizes image-based reconstructed 3D geometry as finite element (FE) mesh input is employed to enhance the precision in capturing the convoluted architecture and morphological features. For accurately representing the intricate crack configurations within the polycrystalline system, we adopted the cohesive phase-field fracture (CPF) model. Through the integration of advanced image-based geometry reconstruction technique and the promising CPF modeling approach, lithium (de)intercalation induced crack evolution (e.g., nucleation, propagation, branching and diverse modes including inter-/trans-(intra-) granular patterns) and the resulting chemical degradation can be precisely captured, which is also compared and validated with numerical predictions using a continuum damage model. In particular, this model predicts fracture induced degradation under varying fracture properties of grain boundaries and charging rates; the conclusion that NMC particles comprised of larger grains are predicted to have less degradation than those with smaller grains can also be drawn. This comprehensive analysis provides valuable insights into the fracture and degradation within polycrystalline NMC cathodes.

25 ENERGY STORAGE↗

An Algorithm to Retrieve Total Precipitable Water Vapor in the Atmosphere from FengYun 3D Medium Resolution Spectral Imager 2 (FY-3D MERSI-2) Data

The atmosphere has substantial effects on optical remote sensing imagery of the Earth’s surface from space. These effects come through the functioning of atmospheric particles on the radiometric transfer from the Earth’s surface through the atmosphere to the sensor in space. Precipitable water vapor (PWV), CO 2 , ozone, and aerosol in the atmosphere are very important among the particles through their functioning. This study presented an algorithm to retrieve total PWV from the Chinese second-generation polar-orbiting meteorological satellite FengYun 3D Medium Resolution Spectral Imager 2 (FY-3D MERSI-2) data, which have three near-infrared (NIR) water vapor absorbing channels, i.e., channel 16, 17, and 18. The algorithm was improved from the radiance ratio technique initially developed for Moderate-Resolution Imaging Spectroradiometer (MODIS) data. MODTRAN 5 was used to simulate the process of radiant transfer from the ground surfaces to the sensor at various atmospheric conditions for estimation of the coefficients of ratio technique, which was achieved through statistical regression analysis between the simulated radiance and transmittance values for FY-3D MERSI-2 NIR channels. The algorithm was then constructed as a linear combination of the three-water vapor absorbing channels of FY-3D MERSI-2. Measurements from two ground-based reference datasets were used to validate the algorithm: the sun photometer measurements of Aerosol Robotic Network (AERONET) and the microwave radiometer measurements of Energy’s Atmospheric Radiation Measurement Program (ARMP). The validation results showed that the algorithm performs very well when compared with the ground-based reference datasets. The estimated PWV values come with root mean square error (RMSE) of 0.28 g/cm 2 for the ARMP and 0.26 g/cm 2 for the AERONET datasets, with bias of 0.072 g/cm 2 and 0.096 g/cm 2 for the two reference datasets, respectively. The accuracy of the proposed algorithm revealed a better consistency with ground-based reference datasets. Thus, the proposed algorithm could be used as an alternative to retrieve PWV from FY-3D MERSI-2 data for various remote sensing applications such as agricultural monitoring, climate change, hydrologic cycle, and so on at various regional and global scales.

54 ENVIRONMENTAL SCIENCES↗

DEEPER: An Intergrated Platform for Deeper Roots

Crops with deeper roots would have multiple benefits, including better drought tolerance, reduced requirement for nitrogen fertilizer, and better sequestration of atmospheric CO 2 . DEEPER is an integrated platform of phenomic, genomic, and in silico technologies to generate maize lines with deeper roots. DEEPER is: LEADER (Leaf Elemental Accumulation from Deep Roots) is a breakthrough technology to nondestructively measure rooting depth by using the plant itself as a sensor. LEADER uses handheld X-ray Fluorescence spectrometry to quantify foliar accumulation of elements that are differentially distributed in the soil profile. LEADER is nondestructive and is orders of magnitude cheaper, faster, and more precise than any competing assay of rooting depth in the field. LEADER is able to distinguish deep-rooted from shallow-rooted maize lines in the field without the need for costly and noisy soil coring. RootRobot/DIRT3D, to automatically phenotype root architecture in any field, combining RootRobot, a mechatronics platform to excavate, clean, section, and image mature root crowns, with DIRT3D, software to quantify architectural traits in 3D. Anatomics, a high-throughput platform to phenotype root anatomy, combining LAT 2.0, a technology for 3D imaging of root anatomy and composition, with RootScan3D, software to automatically extract 3D anatomical and cell wall composition metrics from LAT 2.0 output. Using this platform we discovered two novel root traits, parenchyma cell wall thickness and multiseriate cortical sclerenchyma, that improve rooting depth and drought tolerance in maize and wheat. OpenSimRoot/Deep, software to simulate root interaction with hard subsoils. Using this platform we discovered novel concepts regarding how to increase crop rooting depth by modulating how individual root axes respond to hard soil. DeepGenes, a toolkit of genes, parent lines, and genomic selection strategies to enable breeding hybrids with deeper roots. We discovered 3 novel root genes that increase rooting depth in maize and wheat. DEEPER discovered novel root phenotypes for deeper rooting, and delivered validated ideotypes for deeper-rooted maize; novel technologies to rapidly assess root depth, root architecture and anatomy in field-grown plants; novel software tools for root modeling and 3D image analysis of root architecture and anatomy; and validated genes and genomic selection models to deploy traits for deeper rooting in maize breeding. Each DEEPER technology is transformative in its own right, and exceeds existing technologies. They are mutually synergistic, deployable for field-grown plants, and are ready for application. The phenotyping and modeling technologies are readily applicable to many crops, and genetic leads in maize may have utility in other grasses. Taken as a whole they represent a transformative platform to develop deeper-rooted crops, with greater drought tolerance, reduced fertilizer requirement, and greater carbon sequestration.

59 BASIC BIOLOGICAL SCIENCES↗