Search NASA⌕ Search

SEARCH · Search NASA

Results for “3d imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Accurate surface estimation from high-resolution 3D microwave images

Active millimeter and microwave imaging techniques can be used to create a high-resolution 3D image volume of a target’s reflectivity. Millimeter-wave imaging is commonly used for personnel security screening and numerous other applications. Backprojection based image reconstruction techniques form a 3D complex-valued volume. The complex-valued volume is commonly reduced to a real-valued volume by taking the magnitude. For anomaly detection and cross image registration of an object it is beneficial to generate an accurate representation of an object’s surface. Extracting a smooth and accurate surface from a magnitude only image is challenging. One difficulty is the magnitude image has limited resolution in the depth direction which normally limits precision to a moderate fraction of the depth resolution. Another difficulty is that the magnitude of the image depends heavily on the geometry and orientation of the object being imaged. The phase information in a complex-valued image volume provides a means to decouple the magnitude of the image from the geometry of an object and provide precision much finer than the depth resolution would indicate. This enables the generation of a smooth and accurate point cloud representation of the surface of an imaged object. A method to extract a point cloud from the phase information in a 3D complex-valued millimeter-wave image volume is developed and results with simulated and experimental data are presented.

Clark, Richard T.↗

Systems and Methods for Automated Vessel Navigation Using Sea State Prediction

Systems and methods for sea state prediction and autonomous navigation in accordance with embodiments of the invention are disclosed. One embodiment of the invention includes a method of predicting a future sea state including generating a sequence of at least two 3D images of a sea surface using at least two image sensors, detecting peaks and troughs in the 3D images using a processor, identifying at least one wavefront in each 3D image based upon the detected peaks and troughs using the processor, characterizing at least one propagating wave based upon the propagation of wavefronts detected in the sequence of 3D images using the processor, and predicting a future sea state using at least one propagating wave characterizing the propagation of wavefronts in the sequence of 3D images using the processor. Another embodiment includes a method of autonomous vessel navigation based upon a predicted sea state and target location.

Huntsberger, Terrance L.↗

Systems and Methods for Automated Vessel Navigation Using Sea State Prediction

Systems and methods for sea state prediction and autonomous navigation in accordance with embodiments of the invention are disclosed. One embodiment of the invention includes a method of predicting a future sea state including generating a sequence of at least two 3D images of a sea surface using at least two image sensors, detecting peaks and troughs in the 3D images using a processor, identifying at least one wavefront in each 3D image based upon the detected peaks and troughs using the processor, characterizing at least one propagating wave based upon the propagation of wavefronts detected in the sequence of 3D images using the processor, and predicting a future sea state using at least one propagating wave characterizing the propagation of wavefronts in the sequence of 3D images using the processor. Another embodiment includes a method of autonomous vessel navigation based upon a predicted sea state and target location.

Huntsberger, Terrance L.↗

Developing a camera-based 3D momentum imaging system capable of 1 Mhits/s

A camera-based three-dimensional (3D) imaging system with a superb time-of-flight (TOF) resolution and multi-hit capability was recently developed for electron/ion imaging [Lee et al. J. Chem. Phys. 141, 221101 (2014)]. In this work, we report further improvement of the event rate of the system by adopting an event-driven camera, Tpx3Cam, for detecting the 2D positions of electrons, while a high-speed digitizer provides highly accurate (~30 ps) TOF information for each event at a rate approaching 1 Mhits/sec.

47 OTHER INSTRUMENTATION↗

Ultra-Structural Imaging Provides 3D Organization of 46 Chromosomes of a Human Lymphocyte Prophase Nucleus

Three dimensional (3D) ultra-structural imaging is an important tool for unraveling the organizational structure of individual chromosomes at various stages of the cell cycle. Performing hitherto uninvestigated ultra-structural analysis of the human genome at prophase, we used serial block-face scanning electron microscopy (SBFSEM) to understand chromosomal architectural organization within 3D nuclear space. Acquired images allowed us to segment, reconstruct, and extract quantitative 3D structural information about the prophase nucleus and the preserved, intact individual chromosomes within it. Our data demonstrate that each chromosome can be identified with its homolog and classified into respective cytogenetic groups. Thereby, we present the first 3D karyotype built from the compact axial structure seen on the core of all prophase chromosomes. The chromosomes display parallel-aligned sister chromatids with familiar chromosome morphologies with no crossovers. Furthermore, the spatial positions of all 46 chromosomes revealed a pattern showing a gene density-based correlation and a neighborhood map of individual chromosomes based on their relative spatial positioning. A comprehensive picture of 3D chromosomal organization at the nanometer level in a single human lymphocyte cell is presented.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Advanced Three-Dimensional Display System

A desktop-scale, computer-controlled display system, initially developed for NASA and now known as the VolumeViewer(TradeMark), generates three-dimensional (3D) images of 3D objects in a display volume. This system differs fundamentally from stereoscopic and holographic display systems: The images generated by this system are truly 3D in that they can be viewed from almost any angle, without the aid of special eyeglasses. It is possible to walk around the system while gazing at its display volume to see a displayed object from a changing perspective, and multiple observers standing at different positions around the display can view the object simultaneously from their individual perspectives, as though the displayed object were a real 3D object. At the time of writing this article, only partial information on the design and principle of operation of the system was available. It is known that the system includes a high-speed, silicon-backplane, ferroelectric-liquid-crystal spatial light modulator (SLM), multiple high-power lasers for projecting images in multiple colors, a rotating helix that serves as a moving screen for displaying voxels [volume cells or volume elements, in analogy to pixels (picture cells or picture elements) in two-dimensional (2D) images], and a host computer. The rotating helix and its motor drive are the only moving parts. Under control by the host computer, a stream of 2D image patterns is generated on the SLM and projected through optics onto the surface of the rotating helix. The system utilizes a parallel pixel/voxel-addressing scheme: All the pixels of the 2D pattern on the SLM are addressed simultaneously by laser beams. This parallel addressing scheme overcomes the difficulty of achieving both high resolution and a high frame rate in a raster scanning or serial addressing scheme. It has been reported that the structure of the system is simple and easy to build, that the optical design and alignment are not difficult, and that the system can be built by use of commercial off-the-shelf products. A prototype of the system displays an image of 1,024 by 768 by 170 (=133,693,440) voxels. In future designs, the resolution could be increased. The maximum number of voxels that can be generated depends upon the spatial resolution of SLM and the speed of rotation of the helix. For example, one could use an available SLM that has 1,024 by 1,024 pixels. Incidentally, this SLM is capable of operation at a switching speed of 300,000 frames per second. Implementation of full-color displays in future versions of the system would be straightforward: One could use three SLMs for red, green, and blue, respectively, and the colors of the voxels could be automatically controlled. An optically simpler alternative would be to use a single red/green/ blue light projector and synchronize the projection of each color with the generation of patterns for that color on a single SLM.

Geng, Jason↗

Systems and Methods for Automated Water Detection Using Visible Sensors

Systems and methods are disclosed that include automated machine vision that can utilize images of scenes captured by a 3D imaging system configured to image light within the visible light spectrum to detect water. One embodiment includes autonomously detecting water bodies within a scene including capturing at least one 3D image of a scene using a sensor system configured to detect visible light and to measure distance from points within the scene to the sensor system, and detecting water within the scene using a processor configured to detect regions within each of the at least one 3D images that possess at least one characteristic indicative of the presence of water.

Rankin, Arturo L.↗

Snapshot multifocal light field microscopy

Light field microscopy (LFM) is an emerging technology for high-speed wide-field 3D imaging by capturing 4D light field of 3D volumes. However, its 3D imaging capability comes at a cost of lateral resolution. In addition, the lateral resolution is not uniform across depth in the light field dconvolution reconstructions. To address these problems, here, we propose a snapshot multifocal light field microscopy (MFLFM) imaging method. The underlying concept of the MFLFM is to collect multiple focal shifted light fields simultaneously. We show that by focal stacking those focal shifted light fields, the depth-of-field (DOF) of the LFM can be further improved but without sacrificing the lateral resolution. Also, if all differently focused light fields are utilized together in the deconvolution, the MFLFM could achieve a high and uniform lateral resolution within a larger DOF. We present a house-built MFLFM system by placing a diffractive optical element at the Fourier plane of a conventional LFM. The optical performance of the MFLFM are analyzed and given. Both simulations and proof-of-principle experimental results are provided to demonstrate the effectiveness and benefits of the MFLFM. We believe that the proposed snapshot MFLFM has potential to enable high-speed and high resolution 3D imaging applications.

He, Kuan↗

FluidCam 1 & 2 - UAV-based Fluid Lensing Instruments for High-Resolution 3D Subaqueous Imaging and Automated Remote Biosphere Assessment of Reef Ecosystems

We present NASA ESTO FluidCam 1 & 2, Visible and NIR Fluid-Lensing-enabled imaging payloads for Unmanned Aerial Vehicles (UAVs). Developed as part of a focused 2014 earth science technology grant, FluidCam 1&2 are Fluid-Lensing-based computational optical imagers designed for automated 3D mapping and remote sensing of underwater coastal targets from airborne platforms. Fluid Lensing has been used to map underwater reefs in 3D in American Samoa and Hamelin Pool, Australia from UAV platforms at sub-cm scale, which has proven a valuable tool in modern marine research for marine biosphere assessment and conservation. We share FluidCam 1&2 instrument validation and testing results as well as preliminary processed data from field campaigns. Petabyte-scale aerial survey efforts using Fluid Lensing to image at-risk reefs demonstrate broad applicability to large-scale automated species identification, morphology studies and reef ecosystem characterization for shallow marine environments and terrestrial biospheres, of crucial importance to improving bathymetry data for physical oceanographic models and understanding climate change’s impact on coastal zones, global oxygen production, carbon sequestration.

Chirayath, Ved↗

Vision-based inspection of prefabricated components using camera poses: Addressing inherent limitations of image-based 3D reconstruction

Modular construction can lead to additional cost overruns and delays when a defect is found on the construction site and is not easily repairable. Researchers have developed various methods that use image-based 3D reconstruction for quality assessment, but they have inherent limitations, such as inconsistency and dealing with surfaces with reflectivity and limited visual features. Therefore, this paper presents a vision-based quality assessment method using cameras for prefabricated components by addressing these limitations. Specifically, this paper proposes a novel quality inspection method with sub-millimeter accuracy using cameras focused on leveraging camera poses (as opposed to 3D point clouds that are often not consistent in quality) from the image-based 3D reconstruction. The 3D point estimation by computing triangulation was used for achieving accurate measurement. The proposed method is validated using six different variances and two case studies – an aluminum pipe with a reflective surface and a fabricated concrete column. Furthermore, the results demonstrate the accuracy and effectiveness of the proposed method.

42 ENGINEERING↗

Few-view computed tomography reconstruction using deep neural network inference

A system for generating 2D slices of a 3D image of a target volume is provided. The system receives a target sinogram collected during a computed tomography scan of the target volume. The system inputs the target sinogram to a convolutional neural network (CNN) to generate predicted 2D slices of the 3D image. The CNN is trained using training 2D slices of training 3D images. The system initializes 2D slices to the predicted 2D slices. The system reconstructs 2D slices of the 3D image from the target sinogram and the initialized 2D slices.

Kim, Hyojin↗

Surface 3D Electrical Resistivity Tomography Inversion of 2005 BC Cribs and Trenches Datasets

Hydrogeophysics, Inc. (HGI) conducted an electrical resistivity tomography (ERT) dataset at the BC Cribs and Trenches site, located in the Central Plateau of the Hanford Site. The 20 trenches and 6 cribs received large volumes of liquid inorganic waste in the 1950s, resulting in a large inventory of contaminants in the vadose zone. The objective of the ERT survey was to map plume extents resulting from the legacy discharges. The HGI interpretation of the resistivity data was performed using geometric inversion to interpolate 2D lines into a 3D image. To demonstrate a newly developed geophysical code capability (E4D), the resistivity data were re-processed to fit a full 3D model of the bulk electrical conductivity. This proof-of-concept model inversion was executed in calendar year 2011, as the large dataset was well-suited for the use of high-performance computing. The 3D re-processing of the BC Cribs and Trenches ERT data conducted in 2011 resolved the true bulk electrical conductivity. This means that all of the resistivity data were fit to a single model of the bulk electrical conductivity, with true horizontal and vertical dimensions. This differed from the HGI data interpretation approach that used geometric inversion to process 2D lines independently, which were then interpolated into a 3D image. Both the full 3D re-processing and the 2D interpolation to a 3D image demonstrated a higher electrical conductivity observed immediately beneath the trenches and cribs. The electrical conductivity is strongly correlated with nitrate concentrations, indicating the presence of nitrate and other co-located contaminants.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Volumetric 3D Display System with Static Screen

Current display technology has relied on flat, 2D screens that cannot truly convey the third dimension of visual information: depth. In contrast to conventional visualization that is primarily based on 2D flat screens, the volumetric 3D display possesses a true 3D display volume, and places physically each 3D voxel in displayed 3D images at the true 3D (x,y,z) spatial position. Each voxel, analogous to a pixel in a 2D image, emits light from that position to form a real 3D image in the eyes of the viewers. Such true volumetric 3D display technology provides both physiological (accommodation, convergence, binocular disparity, and motion parallax) and psychological (image size, linear perspective, shading, brightness, etc.) depth cues to human visual systems to help in the perception of 3D objects. In a volumetric 3D display, viewers can watch the displayed 3D images from a completely 360 view without using any special eyewear. The volumetric 3D display techniques may lead to a quantum leap in information display technology and can dramatically change the ways humans interact with computers, which can lead to significant improvements in the efficiency of learning and knowledge management processes. Within a block of glass, a large amount of tiny dots of voxels are created by using a recently available machining technique called laser subsurface engraving (LSE). The LSE is able to produce tiny physical crack points (as small as 0.05 mm in diameter) at any (x,y,z) location within the cube of transparent material. The crack dots, when illuminated by a light source, scatter the light around and form visible voxels within the 3D volume. The locations of these tiny voxels are strategically determined such that each can be illuminated by a light ray from a high-resolution digital mirror device (DMD) light engine. The distribution of these voxels occupies the full display volume within the static 3D glass screen. This design eliminates any moving screen seen in previous approaches, so there is no image jitter, and has an inherent parallel mechanism for 3D voxel addressing. High spatial resolution is possible with a full color display being easy to implement. The system is low-cost and low-maintenance.

Geng, Jason↗

3D Microwave Imaging of Impact Damage in Composites

This presentation presents the results of detecting impact damage in woven composites using a 3D microwave imaging system. The microwave results are compared to laser scanner results. After demonstrating the system on two composite samples, the multi-functionality of the system is discussed. They microwave systems ability to detect changes in permittivity of dielectrics is demonstrated by imaging RTV underneath space shuttle tiles, and the detection of sintered regolith simulant when buried in loose regolith simulant.

William (Cy) Wilson↗

ICER-3D Hyperspectral Image Compression Software

Software has been developed to implement the ICER-3D algorithm. ICER-3D effects progressive, three-dimensional (3D), wavelet-based compression of hyperspectral images. If a compressed data stream is truncated, the progressive nature of the algorithm enables reconstruction of hyperspectral data at fidelity commensurate with the given data volume. The ICER-3D software is capable of providing either lossless or lossy compression, and incorporates an error-containment scheme to limit the effects of data loss during transmission. The compression algorithm, which was derived from the ICER image compression algorithm, includes wavelet-transform, context-modeling, and entropy coding subalgorithms. The 3D wavelet decomposition structure used by ICER-3D exploits correlations in all three dimensions of sets of hyperspectral image data, while facilitating elimination of spectral ringing artifacts, using a technique summarized in "Improving 3D Wavelet-Based Compression of Spectral Images" (NPO-41381), NASA Tech Briefs, Vol. 33, No. 3 (March 2009), page 7a. Correlation is further exploited by a context-modeling subalgorithm, which exploits spectral dependencies in the wavelet-transformed hyperspectral data, using an algorithm that is summarized in "Context Modeler for Wavelet Compression of Hyperspectral Images" (NPO-43239), which follows this article. An important feature of ICER-3D is a scheme for limiting the adverse effects of loss of data during transmission. In this scheme, as in the similar scheme used by ICER, the spatial-frequency domain is partitioned into rectangular error-containment regions. In ICER-3D, the partitions extend through all the wavelength bands. The data in each partition are compressed independently of those in the other partitions, so that loss or corruption of data from any partition does not affect the other partitions. Furthermore, because compression is progressive within each partition, when data are lost, any data from that partition received prior to the loss can be used to reconstruct that partition at lower fidelity. By virtue of the compression improvement it achieves relative to previous means of onboard data compression, this software enables (1) increased return of hyperspectral scientific data in the presence of limits on the rates of transmission of data from spacecraft to Earth via radio communication links and/or (2) reduction in spacecraft radio-communication power and/or cost through reduction in the amounts of data required to be downlinked and stored onboard prior to downlink. The software is also suitable for compressing hyperspectral images for ground storage or archival purposes.

Xie, Hua↗

3D Optical Coherence Tomography image processing in BISCAP: characterization of biofilm structure and properties

Abstract Motivation BISCAP is a state-of-the-art tool for automatically characterizing biofilm images obtained from Optical Coherence Tomography. Limited availability of other software tools is reported in the field. BISCAP’s first version processes 2D images only. Processing 3D images is a problem of greater scientific relevance since it deals with the entire structure of biofilms instead of their 2D slices. Results Building on the image-processing principles and algorithms proposed earlier for 2D images, these were adapted to the 3D case, and a more general implementation of BISCAP was developed. The primary goal concerns the extension of the initial methodology to incorporate the depth axis in 3D images; multiple improvements were also made to boost computational performance. The calculation of structural properties and visual outputs was extended to offer new insights into the 3D structure of biofilms. BISCAP was tested using 3D images of biofilms with different morphologies, consistently delivering accurate characterizations of 3D structures in a few minutes using standard laptop machines. Low user dependency is required for image analysis. Availability and implementation BISCAP is available from https://github.com/diogonarciso/BISCAP. All images used in the tutorials and the validation examples are available from https://web.fe.up.pt/∼fgm/biscap3d.

Narciso, Diogo A. C. (ORCID:0000000227767477)↗

High-resolution 3D microwave imaging using an optically tracked linear array

Active three-dimensional microwave or millimeter-wave imaging is typically performed using a linear array that is mechanically scanned over a uniform planar or cylindrical aperture. However, an image can also be formed with a linear array that is scanned over a non-uniform irregular aperture. This requires that the precise position of the array be known for each radar sample. This paper explores high-resolution 3D microwave imaging of stationary targets using an optically tracked manually scanned linear array. The image reconstruction techniques necessary to account for a non-uniform irregular aperture are also developed.

Clark, Richard T.↗

Optimal 3D chemical imaging with multimodal electron tomography

Accurate mapping of nanoscale chemistry in three dimensions (3D) has been a longstanding challenge. Modern electron microscopy provides chemical images by electron energy loss spectroscopy (EELS) and energy dispersive x-ray spectrometry (EDX) but requires high fluences that damage specimens. In 3D, the requirements are worse; electron tomography demands many high-fluence chemical maps for reconstruction, creating a tradeoff between resolution, accuracy, and sample survival. Fused multimodal electron tomography (MM-ET) alleviates this requirement by leveraging lower-fluence high-angle annular dark-field (HAADF) images alongside a few chemical maps to dramatically improve chemical resolution. Here, experimental and computational parameter space is systematically explored to determine when MM-ET performs best. Ideal imaging conditions balance sample survival with resolution and chemical specificity; we recommend a tilt range of at least ± 70°, acquiring 40 equally spaced HAADF projections (signal-to-noise > 10), and 7 EELS/EDX maps of each chemistry (signal-to-noise > 4).

36 MATERIALS SCIENCE↗