SEARCH · Search NASA

Results for “3d imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

NASA NTRS1995

Full resolution hologram-like autostereoscopic display

Under this program, Dimension Technologies Inc. (DTI) developed a prototype display that uses a proprietary illumination technique to create autostereoscopic hologram-like full resolution images on an LCD operating at 180 fps. The resulting 3D image possesses a resolution equal to that of the LCD along with properties normally associated with holograms, including change of perspective with observer position and lack of viewing position restrictions. Furthermore, this autostereoscopic technique eliminates the need to wear special glasses to achieve the parallax effect. Under the program a prototype display was developed which demonstrates the hologram-like full resolution concept. To implement such a system, DTI explored various concept designs and enabling technologies required to support those designs. Specifically required were: a parallax illumination system with sufficient brightness and control; an LCD with rapid address and pixel response; and an interface to an image generation system for creation of computer graphics. Of the possible parallax illumination system designs, we chose a design which utilizes an array of fluorescent lamps. This system creates six sets of illumination areas to be imaged behind an LCD. This controlled illumination array is interfaced to a lenticular lens assembly which images the light segments into thin vertical light lines to achieve the parallax effect. This light line formation is the foundation of DTI's autostereoscopic technique. The David Sarnoff Research Center (Sarnoff) was subcontracted to develop an LCD that would operate with a fast scan rate and pixel response. Sarnoff chose a surface mode cell technique and produced the world's first large area pi-cell active matrix TFT LCD. The device provided adequate performance to evaluate five different perspective stereo viewing zones. A Silicon Graphics' Iris Indigo system was used for image generation which allowed for static and dynamic multiple perspective image rendering. During the development of the prototype display, we identified many critical issues associated with implementing such a technology. Testing and evaluation enabled us to prove that this illumination technique provides autostereoscopic 3D multi perspective images with a wide range of view, smooth transition, and flickerless operation given suitable enabling technologies.

Eichenlaub, Jesse B.↗

DOE OSTI2021

Quantifying the unknown impact of segmentation uncertainty on image-based simulations

Abstract Image-based simulation, the use of 3D images to calculate physical quantities, relies on image segmentation for geometry creation. However, this process introduces image segmentation uncertainty because different segmentation tools (both manual and machine-learning-based) will each produce a unique and valid segmentation. First, we demonstrate that these variations propagate into the physics simulations, compromising the resulting physics quantities. Second, we propose a general framework for rapidly quantifying segmentation uncertainty. Through the creation and sampling of segmentation uncertainty probability maps, we systematically and objectively create uncertainty distributions of the physics quantities. We show that physics quantity uncertainty distributions can follow a Normal distribution, but, in more complicated physics simulations, the resulting uncertainty distribution can be surprisingly nontrivial. We establish that bounding segmentation uncertainty can fail in these nontrivial situations. While our work does not eliminate segmentation uncertainty, it improves simulation credibility by making visible the previously unrecognized segmentation uncertainty plaguing image-based simulation.

42 ENGINEERING↗

DOE OSTI2024

Fine-tuning TrailMap: The utility of transfer learning to improve the performance of deep learning in axon segmentation of light-sheet microscopy images

Light-sheet microscopy has made possible the 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual undertaking. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through optimizing transfer learning. We fine-tuned the existing TrailMap model using expert-labeled data from noradrenergic axonal structures in the mouse brain. By changing the cross-entropy weights and using augmentation, we demonstrate a generally improved adjusted F1-score over using the originally trained TrailMap model within our test datasets.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Rapid 3D nanoscale coherent imaging via physics-aware deep learning

Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programing framework trained to predict 3D structure and strain, solely from input 3D X-ray coherent scattering data. Our networks are designed to be “physics-aware” in multiple aspects; in that the physics of the X-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods. Our integrated machine learning and differential programing solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2023

Evaluation of Electron Tomography Capabilities for Shale Imaging

Despite the advantageous resolution of electron tomography (ET), reconstruction of three-dimensional (3D) images from multiple two-dimensional (2D) projections presents several challenges, including small signal-to-noise ratios, and a limited projection range. This study evaluates the capabilities of ET for thin sections of shale, a complex nanoporous medium. A numerical phantom with 1.24 nm pixel size is constructed based on the tomographic reconstruction of a Barnett shale. A dataset of 2D projection images is numerically generated from the 3D phantom and studied over a range of conditions. First, common reconstruction techniques are used to reconstruct the shale structure. The reconstruction uncertainty is quantified by comparing overall values of storage and transport metrics, as well as the misclassification of pore voxels compared to the phantom. We then select the most robust reconstruction technique and we vary the acquisition conditions to quantify the effect of artifacts. We find a strong agreement for large pores over the different acquisition workflows, while a wider variability exists for nanometer-scale features. Furthermore, the limited projection range and reconstruction are identified as the main experimental bottlenecks, thereby suggesting that sample thinning, advanced holders, and advanced reconstruction algorithms offer opportunities for improvement.

3D scanning transmission electron microscopy↗

DOE OSTI2025

Stochastic 3D reconstruction of cracked polycrystalline NMC particles using 2D SEM data

Li-ion battery performance is strongly influenced by the 3D microstructure of its cathode particles. Cracks within these particles develop during calendaring and cycling, reducing connectivity but increasing reactive surface, making their impact on battery performance complex. Understanding these contradictory effects requires a quantitative link between particle morphology and battery performance. However, informative 3D imaging techniques are time-consuming, costly and rarely available, such that analyses often have to rely on 2D image data. This paper presents a novel stereological approach for generating virtual 3D cathode particles exhibiting crack networks that are statistically equivalent to those observed in 2D sections of experimentally measured particles. Consequently, 2D image data suffices for deriving a full 3D characterization of cracked cathodes particles. Such virtually generated 3D particles could serve as geometry input for spatially resolved electro-chemo-mechanical simulations to enhance our understanding of structure-property relationships of cathodes in Li-ion batteries.

36 MATERIALS SCIENCE↗

DOE OSTI2025

3D quantum ghost imaging microscope

Quantum ghost imaging uses quantum-entangled photons to generate a two-dimensional image with only a bucket detector at the sample. Here we expand on this approach to generate a three-dimensional image without scanning. A quantum-entangled light source directly links information between a pair of 2D sensors, one of which captures a standard image from one perspective and a second sensor which captures a ghost image from a perpendicular perspective. By correlating the spatial information from the two detectors for each photon pair, we obtain three dimensions of spatial information (x, y, and z) for each scattered photon. We demonstrate that this system can study microscopic environments by imaging scattering from metallic nanoparticle clusters. This approach has the potential to greatly reduce the flux of light required to obtain a 3D image of a biological sample and thereby extend the number of images that can be obtained before photodamaging the sample.

Eshun, Audrey [Lawrence Livermore National Laborat↗

DOE OSTI2022

Data-driven Mapping of the Mouse Connectome: The utility of transfer learning to improve the performance of deep learning models performing axon segmentation on light-sheet microscopy images

Light sheet microscopy has made possible the high temporal and spatial 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual process. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through the application of refinements such as transfer learning.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Multi-modal Free-moving Data Fusion (MFDF) v1.0

Multi-modal Free-moving Data Fusion (MFDF) is a python package that implements low and high-level functionality for performing qualitative and quantitative gamma-ray imaging analyses. Such analyses enable the use of gamma-ray spectrometers and/or imagers to estimate the distribution and quantity of radiological materials in an environment. Free-moving 3D imaging requires additional information about the 3D trajectory and orientation of the system, however all of these methods can be applied to 2D static gamma-ray imaging as well. The package includes methods (MLEM and MAP) for distributed source reconstruction, methods (PSL) for point source reconstruction, the ability to ingest and utilize quantitative detector response functions (for absolute analyses), and the ability to perform 3D estimation of dose-rates from quantitative reconstructions.

Joshi, Tenzing↗

NASA NTRS2002

Fast interactive real-time volume rendering of real-time three-dimensional echocardiography: an implementation for low-end computers

Real-time three-dimensional echocardiography (RT3DE) is an innovative cardiac imaging modality. However, partly due to lack of user-friendly software, RT3DE has not been widely accepted as a clinical tool. The object of this study was to develop and implement a fast and interactive volume renderer of RT3DE datasets designed for a clinical environment where speed and simplicity are not secondary to accuracy. Thirty-six patients (20 regurgitation, 8 normal, 8 cardiomyopathy) were imaged using RT3DE. Using our newly developed software, all 3D data sets were rendered in real-time throughout the cardiac cycle and assessment of cardiac function and pathology was performed for each case. The real-time interactive volume visualization system is user friendly and instantly provides consistent and reliable 3D images without expensive workstations or dedicated hardware. We believe that this novel tool can be used clinically for dynamic visualization of cardiac anatomy.

NASA Discipline Cardiopulmonary↗

DOE OSTI2024

Semi-automatic image annotation using 3D LiDAR projections and depth camera data

Efficient image annotation is necessary to utilize deep learning object recognition neural networks in nuclear safeguards, such as for the detection and localization of target objects like nuclear material containers (NMCs). This capability can help automate the inventory accounting of different types of NMCs within nuclear storage facilities. The conventional manual annotation process is labor-intensive and time-consuming, hindering the rapid deployment of deep learning models for NMC identifications. This paper introduces a novel semi-automatic method for annotating 2D images of nuclear material containers (NMCs) by combining 3D light detection and ranging (LiDAR) data with color and depth camera images collected from a handheld scan system. The annotation pipeline involves an operator manually marking new target objects on a LiDAR-generated map, and projecting these 3D locations to images, thereby automatically creating annotations from the projections. The semi-automatic approach significantly reduces manual efforts and the expertise in image annotation that is required to perform the task, allowing deep learning models to be trained on-site within a few hours. The paper compares the performance of models trained on datasets annotated through various methods, including semi-automatic, manual, and commercial annotation services. The evaluation demonstrates that the semi-automatic annotation method achieves comparable or superior results, with a mean average precision (mAP) above 0.9, showcasing its efficiency in training object recognition models. Additionally, the paper explores the application of the proposed method to instance segmentation, achieving promising results in detecting multiple types of NMCs in various formations.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DOE OSTI2024

Optical Extinction-Based 3D Nano-Imaging of WS 2 on Gold

Broad band nano-extinction images recorded in the tip-enhanced optical spectroscopy geometry track the 3D topography of a single layer of WS 2 on Au substrate. The described nano-optical method is complementary to conventional AFM and offers additional information about the buried material-metal interface that is not accessible using conventional topographic imaging. Beyond 3D optical imaging, we observe large variations in the junction plasmon resonance on the nanoscale. The latter is important to understand and account for in tip-enhanced Raman and photoluminescence studies that target low-dimensional materials specifically. Further, our observations and (coherent) optical scattering-based method are also relevant to emerging efforts aimed at exploring strong coupling and Fano interferences in hybrid plasmonic-low dimensional quantum material systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS2007

Hybrid-dual-fourier tomographic algorithm for a fast three-dimensionial optical image reconstruction in turbid media

A reconstruction technique for reducing computation burden in the 3D image processes, wherein the reconstruction procedure comprises an inverse and a forward model. The inverse model uses a hybrid dual Fourier algorithm that combines a 2D Fourier inversion with a 1D matrix inversion to thereby provide high-speed inverse computations. The inverse algorithm uses a hybrid transfer to provide fast Fourier inversion for data of multiple sources and multiple detectors. The forward model is based on an analytical cumulant solution of a radiative transfer equation. The accurate analytical form of the solution to the radiative transfer equation provides an efficient formalism for fast computation of the forward model.

Alfano, Robert R.↗

DOE OSTI2023

Three-dimensional nanoscale reduced-angle ptycho-tomographic imaging with deep learning (RAPID)

X-ray ptychographic tomography is a nondestructive method for three dimensional (3D) imaging with nanometer-sized resolvable features. The size of the volume that can be imaged is almost arbitrary, limited only by the penetration depth and the available scanning time. Here we present a method that rapidly accelerates the imaging operation over a given volume through acquiring a limited set of data via large angular reduction and compensating for the resulting ill-posedness through deeply learned priors. The proposed 3D reconstruction method “RAPID” relies initially on a subset of the object measured with the nominal number of required illumination angles and treats the reconstructions from the conventional two-step approach as ground truth. It is then trained to reproduce equal fidelity from much fewer angles. After training, it performs with similar fidelity on the hitherto unexamined portions of the object, previously not shown during training, with a limited set of acquisitions. In our experimental demonstration, the nominal number of angles was 349 and the reduced number of angles was 21, resulting in a x140 aggregate speedup over a volume of 4.48 x 93.18 x 3.92 μm 3 and with (14nm) 3 feature size, i.e. ~ 10 8 voxels. RAPID’s key distinguishing feature over earlier attempts is the incorporation of atrous spatial pyramid pooling modules into the deep neural network framework in an anisotropic way. We found that adjusting the atrous rate improves reconstruction fidelity because it expands the convolutional kernels’ range to match the physics of multi-slice ptychography without significantly increasing the number of parameters.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Fracturing process of micro-concrete under uniaxial and triaxial compression: Insights from in-situ X-ray mechanical tests

This paper presents an experimental study of concrete at meso-scale (aggregates, macro-pores and mortar matrix) in order to get a better understanding of the local failure mechanisms known to drive the macroscopic mechanical behaviour of the material. The main originality comes from conducting in-situ X-ray mechanical tests on micro-concrete samples of realistic composition (including cement, sand, aggregates and water), under uniaxial compression and, for the first time, under triaxial compression at 5 MPa, 10 MPa and 15 MPa confining pressures. A timeseries analysis of the set of 3D images coming from each test allows for the measurement of the 3D kinematic fields (displacement and strain fields) throughout the experiments. The different failure patterns observed for each loading path are discussed, along with a quantification of the 3D fracturing processes at the scale of the largest heterogeneities (aggregates and macro-pores). With an increasing level of confinement, the transition from brittle to ductile response is observed, as well as an increase of the strength of the material. The pronounced impact of the meso-scale heterogeneities of concrete on their local failure mechanisms is highlighted. It is shown that strain localisation mainly originates between aggregates and mortar matrix, with the shape and location of the largest aggregates and macro-pores essentially driving the propagation of the cracking network.

36 MATERIALS SCIENCE↗

NASA NTRS2014

Three-Dimensional Imaging and Numerical Reconstruction of Graphite/Epoxy Composite Microstructure Based on Ultra-High Resolution X-Ray Computed Tomography

A combined experimental and computational study aimed at high-resolution 3D imaging, visualization, and numerical reconstruction of fiber-reinforced polymer microstructures at the fiber length scale is presented. To this end, a sample of graphite/epoxy composite was imaged at sub-micron resolution using a 3D X-ray computed tomography microscope. Next, a novel segmentation algorithm was developed, based on concepts adopted from computer vision and multi-target tracking, to detect and estimate, with high accuracy, the position of individual fibers in a volume of the imaged composite. In the current implementation, the segmentation algorithm was based on Global Nearest Neighbor data-association architecture, a Kalman filter estimator, and several novel algorithms for virtualfiber stitching, smoothing, and overlap removal. The segmentation algorithm was used on a sub-volume of the imaged composite, detecting 508 individual fibers. The segmentation data were qualitatively compared to the tomographic data, demonstrating high accuracy of the numerical reconstruction. Moreover, the data were used to quantify a) the relative distribution of individual-fiber cross sections within the imaged sub-volume, and b) the local fiber misorientation relative to the global fiber axis. Finally, the segmentation data were converted using commercially available finite element (FE) software to generate a detailed FE mesh of the composite volume. The methodology described herein demonstrates the feasibility of realizing an FE-based, virtual-testing framework for graphite/fiber composites at the constituent level.

Czabaj, M. W.↗

NASA NTRS2010

Examination of Scanning Electron Microscope and Computed Tomography Images of PICA

Micrographs of PICA (Phenolic Impregnated Carbon Ablator) taken using a Scanning Electron Microscope (SEM) and 3D images taken with a Computed Tomography (CT) system are examined. PICA is a carbon fiber based composite (Fiberform ) with a phenolic polymer matrix. The micrographs are taken at different surface depths and at different magnifications in a sample after arc jet testing and show different levels of oxidative removal of the charred matrix (Figs 1 though 13). CT scans, courtesy of Xradia, Inc. of Concord CA, were captured for samples of virgin PICA, charred PICA and raw Fiberform (Fig. 14). We use these images to calculate the thermal conductivity (TC) of these materials using correlation function (CF) methods. CF methods give a mathematical description of how one material is embedded in another and is thus ideally suited for modeling composites like PICA. We will evaluate how the TC of the materials changes as a function of surface depth. This work is in collaboration with ETH-Zurich, which has expertise in high temperature materials and TC modeling (including CF methods).

Lawson, John W.↗

NASA NTRS2018

Stereo Imaging Miniature Endoscope with Single Imaging Chip and Conjugated Multi-Bandpass Filters

A dual objective endoscope for insertion into a cavity of a body for providing a stereoscopic image of a region of interest inside of the body including an imaging device at the distal end for obtaining optical images of the region of interest (ROI), and processing the optical images for forming video signals for wired and/or wireless transmission and display of 3D images on a rendering device. The imaging device includes a focal plane detector array (FPA) for obtaining the optical images of the ROI, and processing circuits behind the FPA. The processing circuits convert the optical images into the video signals. The imaging device includes right and left pupil for receiving a right and left images through a right and left conjugated multi-band pass filters. Illuminators illuminate the ROI through a multi-band pass filter having three right and three left pass bands that are matched to the right and left conjugated multi-band pass filters. A full color image is collected after three or six sequential illuminations with the red, green and blue lights.

Shahinian, Hrayr Karnig↗