Search NASA⌕ Search

SEARCH · Search NASA

Results for “3d imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

The 3D model control of image processing

Telerobotics studies remote control of distant robots by a human operator using supervisory or direct control. Even if the robot manipulators has vision or other senses, problems arise involving control, communications, and delay. The communication delays that may be expected with telerobots working in space stations while being controlled from an Earth lab have led to a number of experiments attempting to circumvent the problem. This delay in communication is a main motivating factor in moving from well understood instantaneous hands-on manual control to less well understood supervisory control; the ultimate step would be the realization of a fully autonomous robot. The 3-D model control plays a crucial role in resolving many conflicting image processing problems that are inherent in resolving in the bottom-up approach of most current machine vision processes. The 3-D model control approach is also capable of providing the necessary visual feedback information for both the control algorithms and for the human operator.

Nguyen, An H.↗

(Almost) Featureless Stereo: Calibration and Dense 3D Reconstruction Using Whole Image Operations

The conventional approach to shape from stereo is via feature extraction and correspondences. This results in estimates of the camera parameters and a typically spare estimate of the surface. Given a set of calibrated images, a dense surface reconstruction is possible by minimizing the error between the observed image and the image rendered from the estimated surface with respect to the surface model parameters. Given an uncalibrated image and an estimated surface, the camera parameters can be estimated by minimizing the error between the observed and rendered images a function of the camera parameters. We use a very small dense set of matched features to provide camera parameter estimates for the initial dense surface estimate. We then re-estimate the camera parameters as described above, and then re-estimate the surface. This process is iterated. Whilst it can not be proven to converge, we have found that around three iterations results in excellent surface and camera parameters estimates.

Smelyanskiy, V. N.↗

Phase-Conjugate Receiver for Gaussian-State Quantum Illumination

An active optical sensor probes a region of free space that is engulfed in bright thermal noise to determine the presence (or absence) of a weakly reflecting target. The returned light (which is just thermal noise if no target is present, and thermal noise plus a weak reflection of the probe beam if a target is present) is measured and processed by a receiver and a decision is made on whether a target is present. It has been shown that generating an entangled pair of photons (which is a highly nonclassical state of light), using one photon as the probe beam and storing the other photon for comparison to the returned light, has superior performance to the traditional classical-light (coherent-state) target detection sensors. An entangled-photon transmitter and optimal receiver combination can yield up to a factor of 4 (i.e., 6 dB) gain in the error-probability exponent over a coherent state transmitter and optimal receiver combination, in a highly lossy and noisy scenario (when both sensors have the same number of transmitted photons). However, the receiver that achieves this advantage is not known. One structured receiver can close half of the 6-dB gap (i.e., a 3-dB improvement). It is based on phase-conjugating the returned light, then performing dual-balanced difference detection with the stored half of the entangled-photon pair. Active optical sensors are of tremendous value to NASA s missions. Although this work focuses on target detection, it can be extended to imaging (2D, 3D, hyperspectral, etc.) scenarios as well, where the image quality can be better than that offered by traditional active sensors. Although the current work is theoretical, NASA s future missions could benefit significantly from developing and demonstrating this capability. This is an optical receiver design whose components are, in principle, all implementable. However, the work is currently entirely theoretical. It is necessary to: 1. Demonstrate a bench-top proof of the theoretical principle, 2. Create an operational prototype off-the-bench, and 3. Build a practical sensor that can fly in a mission.

Erkmen, Baris I.↗

Influence of Pore Water on the Fracture of Silica Sand at Particle Scale

The fracture of particles has a significant influence on the engineering behavior of granular materials. There are no reported conclusive answers in the literature to explain the influence of pore water on the fracture of sand, gravel, railroad ballast rock, aggregates, rockfill, and so on. Here, in this paper, two novel techniques were adopted to investigate the influence of pore water on the fracture of natural silica sand at the particle scale. The three-dimensional (3D) synchrotron microcomputed tomography (SMT) imaging technique was used to acquire and analyze multiple 3D images of specimens composed of wetted silica sand that were subjected to confined one-dimensional (1D) compression loading up to the fracture stage. A few representative particles were identified and digitally separated from the liquid water and gas phases. The 3D SMT images offer clear experimental evidence of the phase transition of water from liquid to gas within the opening cracks. In addition, a computational fluid dynamics numerical simulation framework for water flow into an opening crack was adopted and the results show that the fast opening of the crack induced cavitation, water phase transition, and water hammer effects. The results of the numerical simulations agree with the confined 1D compression experiments where the onset of the bubbles (gas phase) within the crack is mainly generated during the secondary cavitation stage, and the generated bubble near the crack mouth opening resulted from the primary cavitation, which was directly caused by the crack expansion. The results reported in this paper present a new cavitation phenomenon that occurs during particle fracture, which offers a physics-based explanation of why water-wetted sand fractures at smaller stresses than dry and can pave the way for more in-depth future studies on the fracture of water-wetted sand.

cavitation↗

Three-Dimensional Optical Coherence Tomography

Three-dimensional (3D) optical coherence tomography (OCT) is an advanced method of noninvasive infrared imaging of tissues in depth. Heretofore, commercial OCT systems for 3D imaging have been designed principally for external ophthalmological examination. As explained below, such systems have been based on a one-dimensional OCT principle, and in the operation of such a system, 3D imaging is accomplished partly by means of a combination of electronic scanning along the optical (Z) axis and mechanical scanning along the two axes (X and Y) orthogonal to the optical axis. In 3D OCT, 3D imaging involves a form of electronic scanning (without mechanical scanning) along all three axes. Consequently, the need for mechanical adjustment is minimal and the mechanism used to position the OCT probe can be correspondingly more compact. A 3D OCT system also includes a probe of improved design and utilizes advanced signal- processing techniques. Improvements in performance over prior OCT systems include finer resolution, greater speed, and greater depth of field.

Gutin, Mikhail↗

AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging

Abstract The problem of phase retrieval underlies various imaging methods from astronomy to nanoscale imaging. Traditional phase retrieval methods are iterative and are therefore computationally expensive. Deep learning (DL) models have been developed to either provide learned priors or completely replace phase retrieval. However, such models require vast amounts of labeled data, which can only be obtained through simulation or performing computationally prohibitive phase retrieval on experimental datasets. Using 3D X-ray Bragg coherent diffraction imaging (BCDI) as a representative technique, we demonstrate AutoPhaseNN, a DL-based approach which learns to solve the phase problem without labeled data. By incorporating the imaging physics into the DL model during training, AutoPhaseNN learns to invert 3D BCDI data in a single shot without ever being shown real space images. Once trained, AutoPhaseNN can be effectively used in the 3D BCDI data inversion about 100× faster than iterative phase retrieval methods while providing comparable image quality.

36 MATERIALS SCIENCE↗

Reconstituted Three-Dimensional Interactive Imaging

A method combines two-dimensional images, enhancing the images as well as rendering a 3D, enhanced, interactive computer image or visual model. Any advanced compiler can be used in conjunction with any graphics library package for this method, which is intended to take digitized images and virtually stack them so that they can be interactively viewed as a set of slices. This innovation can take multiple image sources (film or digital) and create a "transparent" image with higher densities in the image being less transparent. The images are then stacked such that an apparent 3D object is created in virtual space for interactive review of the set of images. This innovation can be used with any application where 3D images are taken as slices of a larger object. These could include machines, materials for inspection, geological objects, or human scanning. Illuminous values were stacked into planes with different transparency levels of tissues. These transparency levels can use multiple energy levels, such as density of CT scans or radioactive density. A desktop computer with enough video memory to produce the image is capable of this work. The memory changes with the size and resolution of the desired images to be stacked and viewed.

Hamilton, Joseph↗

Thermal images collected during large-scale 3D printing with Ingersoll MasterPrint

This data set contains images produced to test the performance of anomaly and fault detection methods in the context of additive manufacturing. Two print jobs were executed using the Ingersoll MasterPrint with the Model 30 Strangpresse extruder. The material used was Techmer compounded polylactic acid (PLA) with wood flour as a filler (80/20 PLA/WF by weight). The first print job consists of the 3D printing of a hexagonal cylinder with a two-bead wall. This print was sliced at a gantry velocity of 3000 millimeter per minute, and an extruder screw speed of 68.14 rotations per minute. This are considered the normal operating conditions. A second hexagonal cylinder was printed using a reduced extruder screw speed, 15% lower than under normal operating conditions. The images were collected with a Teledyne FLIR Lepton 3.5 infra-red camera, a small form factor radiometric long-wave infrared camera with a spectral range of 8 µm to 14 µm. Sensor resolution was 160x120 pixels, with a pixel size of 12 µm, a temperature range of -10 - 450°C, and an accuracy of +/- 10°C in its low gain configuration. Images in this data set were collected with cameras oriented at the printer nozzle. The nozzle camera setup consisted of two cameras located 12.5cm from the nozzle center. These were mounted directly to the print head, so that the camera positions relative to the print direction would remain constant as it rotated around its C-axis to follow the print path. One camera was placed ahead of the nozzle to capture the previous layer immediately before being covered by the new layer of material, while the second camera was placed behind the nozzle and captured the freshly extruded bead. Images are collecting during each phase of the print: (a) idle (i.e., no material deposited), (b) extrusion (i.e., to prime the extruder), and (c) printing (deposition of material to manufacture the hexagonal cylinder).

36 MATERIALS SCIENCE↗

Improving 3D Wavelet-Based Compression of Hyperspectral Images

Two methods of increasing the effectiveness of three-dimensional (3D) wavelet-based compression of hyperspectral images have been developed. (As used here, images signifies both images and digital data representing images.) The methods are oriented toward reducing or eliminating detrimental effects of a phenomenon, referred to as spectral ringing, that is described below. In 3D wavelet-based compression, an image is represented by a multiresolution wavelet decomposition consisting of several subbands obtained by applying wavelet transforms in the two spatial dimensions corresponding to the two spatial coordinate axes of the image plane, and by applying wavelet transforms in the spectral dimension. Spectral ringing is named after the more familiar spatial ringing (spurious spatial oscillations) that can be seen parallel to and near edges in ordinary images reconstructed from compressed data. These ringing phenomena are attributable to effects of quantization. In hyperspectral data, the individual spectral bands play the role of edges, causing spurious oscillations to occur in the spectral dimension. In the absence of such corrective measures as the present two methods, spectral ringing can manifest itself as systematic biases in some reconstructed spectral bands and can reduce the effectiveness of compression of spatially-low-pass subbands. One of the two methods is denoted mean subtraction. The basic idea of this method is to subtract mean values from spatial planes of spatially low-pass subbands prior to encoding, because (a) such spatial planes often have mean values that are far from zero and (b) zero-mean data are better suited for compression by methods that are effective for subbands of two-dimensional (2D) images. In this method, after the 3D wavelet decomposition is performed, mean values are computed for and subtracted from each spatial plane of each spatially-low-pass subband. The resulting data are converted to sign-magnitude form and compressed in a manner similar to that of a baseline hyperspectral- image-compression method. The mean values are encoded in the compressed bit stream and added back to the data at the appropriate decompression step. The overhead incurred by encoding the mean values only a few bits per spectral band is negligible with respect to the huge size of a typical hyperspectral data set. The other method is denoted modified decomposition. This method is so named because it involves a modified version of a commonly used multiresolution wavelet decomposition, known in the art as the 3D Mallat decomposition, in which (a) the first of multiple stages of a 3D wavelet transform is applied to the entire dataset and (b) subsequent stages are applied only to the horizontally-, vertically-, and spectrally-low-pass subband from the preceding stage. In the modified decomposition, in stages after the first, not only is the spatially-low-pass, spectrally-low-pass subband further decomposed, but also spatially-low-pass, spectrally-high-pass subbands are further decomposed spatially. Either method can be used alone to improve the quality of a reconstructed image (see figure). Alternatively, the two methods can be combined by first performing modified decomposition, then subtracting the mean values from spatial planes of spatially-low-pass subbands.

Klimesh, Matthew↗

DeepPatent2: A Large-Scale Benchmarking Corpus for Technical Drawing Understanding

Abstract Recent advances in computer vision (CV) and natural language processing have been driven by exploiting big data on practical applications. However, these research fields are still limited by the sheer volume, versatility, and diversity of the available datasets. CV tasks, such as image captioning, which has primarily been carried out on natural images, still struggle to produce accurate and meaningful captions on sketched images often included in scientific and technical documents. The advancement of other tasks such as 3D reconstruction from 2D images requires larger datasets with multiple viewpoints. We introduce DeepPatent2, a large-scale dataset, providing more than 2.7 million technical drawings with 132,890 object names and 22,394 viewpoints extracted from 14 years of US design patent documents. We demonstrate the usefulness of DeepPatent2 with conceptual captioning. We further provide the potential usefulness of our dataset to facilitate other research areas such as 3D image reconstruction and image retrieval.

97 MATHEMATICS AND COMPUTING↗

Biases associated with a particular image volume metric

Image analysis area and volume metrics A 80 and V 80 , used by others, are studied as a function of image morphology, a 3D feature, and Monte Carlo noise in simulated images. The A 80 area metric is found to be stable, with consistent results (and meaning) obtainable without a detailed understanding of 3D features and/or simulation noise levels. However, the V 80 volume metric varies significantly with image morphology, 3D features, and simulation noise. If an experimental image set gives A 80 area inferences that are consistent with 2D image simulations, but V 80 volume inferences that are significantly larger than those corresponding to simulated images, then issues related to 3D features and simulation noise should be explored before conclusions are drawn related to a possible mismatch in the real physical size of experimental and simulated source volumes.

47 OTHER INSTRUMENTATION↗

Direct observation of 3D topological spin textures and their interactions using soft x-ray vector ptychography

Magnetic topological defects are energetically stable spin configurations characterized by symmetry breaking. Vortices and skyrmions are two well-known examples of 2D spin textures that have been actively studied for both fundamental interest and practical applications. However, experimental evidence of the 3D spin textures has been largely indirect or qualitative to date, due to the difficulty of quantitively characterizing them within nanoscale volumes. Here, we develop soft x-ray vector ptychography to quantitatively image the 3D magnetization vector field in a frustrated superlattice with 10 nm spatial resolution. By applying homotopy theory to the experimental data, we quantify the topological charge of hedgehogs and anti-hedgehogs as emergent magnetic monopoles and probe their interactions inside the frustrated superlattice. We also directly observe virtual hedgehogs and anti-hedgehogs created by magnetically inert voids. We expect that this new quantitative imaging method will open the door to study 3D topological spin textures in a broad class of magnetic materials. Our work also demonstrates that magnetically frustrated superlattices could be used as a new platform to investigate hedgehog interactions and dynamics and to exploit optimized geometries for information storage and transport applications.

Rana, A↗

Synchrotron CT imaging of lattice structures with engineered defects

Understanding mechanical failure, crack propagation, and compressive behavior at the micrometer scale is essential for tailoring material properties for structural performance in cellular materials. Typically, modeling of traditional polymer foam materials is clouded by the lack of control in material morphology and its inherent stochastic structure. Additive manufacturing with sub-micrometer resolution provides a direct path for experimenters to specifically tailor structures needed by modelers to explicitly probe mechanical performance. Using laboratory-based 3D X-ray computed tomographic imaging (CT), the examination of deformation and damage provides a critical path to understand how these soft materials behave. Additionally, synchrotron CT yields realistic information at higher strain rates to directly validate the robustness of our finite element modeling. For this study, nanolithographic printing was employed to generate a series of engineered lattices with increasing levels of defects through the random removal of ligaments. These structures were mechanically tested and imaged with laboratory-based microCT. Additionally, synchrotron experiments were conducted in which the structures were imaged in 3D at 14 Hz during compression at a 0.4 s –1 strain rate. These 3D images show the changes in the structure as the ligaments bend, buckle and fracture in real time. This technique provides a robust framework for developing our methodologies and future exploration of engineered structures.

36 MATERIALS SCIENCE↗

Machine Learning for Automated Extraction of Building Geometry

As data science comes to buildings, the promise of using machine learning and novel sources of data has received much attention. Advances in machine learning and computer vision algorithms, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics – cost-effectively, and at scale. Acquisition of features such as footprint are time consuming and costly to acquire with today’s manual methods, but can be streamlined through intelligent software-based solutions applied to satellite images. When combined with aerial RGB and thermal images, full 3D geometries and thermal maps can be constructed to determine additional characteristics such as window to wall ratio, height, number of stories and envelope thermal characteristics. In this paper we present three contributions to accelerate these high potential opportunities: (1) a methodical analysis of how these features can be integrated into today’s simulation and data driven software tools to enhance efficiency measure identification and owner/operator decision making; (2) development and accuracy testing of open source deep neural network methods to extract building footprints from satellite imagery, including the curation and application of openly available GIS datasets for training and continued development by others; and (3) an open framework for drone-based image capture and creation of 3D building geometries. This work represents an important bridge between high-level studies that span diverse application areas and those that detail point solutions yet cannot be easily replicated or extended.

Touzani, Samir↗

Analysis of core asymmetries in inertial confinement fusion implosions using three-dimensional hot-spot reconstruction

Three-dimensional effects play a crucial role during the hot-spot formation in inertial confinement fusion (ICF) implosions. A data analysis technique for 3D hot-spot reconstruction from experimental observables has been developed to characterize the effects of low modes on 3D hot-spot formations. In nuclear measurements, the effective flow direction, governed by the maximum eigenvalue in the velocity variance of apparent ion temperatures, has been found to agree with the measured hot-spot flows for implosions dominated by mode ℓ = 1. Asymmetries in areal-density (ρR) measurements were found to be characterized by a unique cosine variation along the hot-spot flow axis. In x-ray images, a 3D hot-spot x-ray emission tomography method was developed to reconstruct the 3D hot-spot plasma emissivity using a generalized spherical-harmonic Gaussian function. The gradient-descent algorithm was used to optimize the mapping between the projections from the 3D hot-spot emission model and the measured x-ray images along multiple views. Furthermore, this work establishes a platform to analyze 3D low-mode core asymmetries in ICF.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multiphysics and Multiscale Simulation Methods for Electromagnetic Energy Assisted Fossil Fuel to Hydrogen Conversion (Final Scientific/Technical Report)

This report summarizes the technical accomplishments of the four-year research project “Multiphysics and Multiscale Simulation Methods for Electromagnetic Energy Assisted Fossil Fuel to Hydrogen Conversion” (Award No. DE-FE0032092), conducted at Howard University and the University of Houston (subawardee) from September 2021 to August 2025. The project successfully achieved all four major objectives: 1. 3D Structural Characterization – Developed 3D optical imaging and mechanical sectioning methods to characterize catalyst distribution and support morphology in nickel foam substrates. Successfully reconstructed 3D geometries and imported them into COMSOL Multiphysics for electromagnetic simulations. 2. EM Hotspot Simulation – Created all-frequency stable electromagnetic formulations and 3D nodal discontinuous Galerkin (NDG) methods for coupled electromagnetic-thermal-fluid problems in multiscale catalytic media. Demonstrated stable solutions from DC to microwave frequencies. 3. Multiphysics Coupling – Developed multiscale simulation methods coupling FEM electromagnetic solvers with thermal transport equations. Reactive molecular dynamics (ReaxFF MD) simulations were performed to investigate catalytic reaction mechanisms at the atomistic level. Demonstrated electromagnetic-thermal co-simulation capabilities for porous catalyst structures. 4. System Optimization – Designed and optimized EM-assisted catalytic systems using nickel foam and carbon foam structures, demonstrating significant temperature increases due to microwave heating. Observed and characterized plasma generation in carbon fiber catalysts. Investigated multiple reaction chamber geometries for improved microwave energy deposition. The project produced significant scientific contributions including 15+ peer-reviewed publications, trained multiple Ph.D. students and undergraduate researchers, and advanced the understanding of microwave-assisted hydrogen production from fossil fuels.

08 HYDROGEN↗