Search NASA⌕ Search

SEARCH · Search NASA

Results for “3D image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Stereo Imaging Miniature Endoscope with Single Imaging Chip and Conjugated Multi-Bandpass Filters

A dual objective endoscope for insertion into a cavity of a body for providing a stereoscopic image of a region of interest inside of the body including an imaging device at the distal end for obtaining optical images of the region of interest (ROI), and processing the optical images for forming video signals for wired and/or wireless transmission and display of 3D images on a rendering device. The imaging device includes a focal plane detector array (FPA) for obtaining the optical images of the ROI, and processing circuits behind the FPA. The processing circuits convert the optical images into the video signals. The imaging device includes right and left pupil for receiving a right and left images through a right and left conjugated multi-band pass filters. Illuminators illuminate the ROI through a multi-band pass filter having three right and three left pass bands that are matched to the right and left conjugated multi-band pass filters. A full color image is collected after three or six sequential illuminations with the red, green and blue lights.

Shahinian, Hrayr Karnig↗

Extending Hypersonic Diagnostics to the Third Dimension

The design, construction, and initial testing of a high-magnification, long working-distance plenoptic camera is reported. A plenoptic camera uses a microlens array to enable resolution of the spatial and angular information of the incoming light field. With this, instantaneous images can be numerically refocused and perspective shifted in post-processing to enable instantaneous three-dimensional (3D) resolution of a scene. Prior to this work, most applications of plenoptic imaging were limited to relatively low magnifications (1× or less) or small working distances. Here, a unique system is developed with enables 5× magnification at a working distance of over a quarter meter. Experimental results demonstrate ~25 m spatial resolution with 3D imaging capabilities. This technology is demonstrated on two practical applications. First, burning aluminum particles on the order of 100 m in diameter are imaged near the reacting surface of a combusting solid rocket propellant. The long working distance is particularly advantageous for protection of the experimental hardware in this extremely hazardous environment. Next, background oriented schlieren is used to resolve the 3D structure of an underexpanded free jet. This demonstrates the ability to resolve index-of-refraction gradients at the working distances and spatial scales necessary to meet our ultimate goal of resolving 3D turbulent transition in the boundary layer of Sandia’s Hypersonic Wind Tunnel (HWT).

47 OTHER INSTRUMENTATION↗

The Porous Microstructure Analysis (PuMA) software

The open-source Porous Microstructure Analysis (PuMA) software was implemented to offer an efficient framework for determining material characteristics from 3D microstructures. Its development was inspired by progress in X-ray microtomography, an imaging technology that captures the internal structure of materials in 3D, and even in a 4D temporal context. Over recent years, this method has transformed the domain of materials science due to its capability to non-destructively examine material microstructures while presenting digital data about their geometrical details. It has provided insights into materials relevant to several NASA missions, including heatshields, parachute fabrics, meteorites, and other advanced composites. PuMA, in its current version 3, delivers an array of features, spanning from basic geometric insights of a microstructure to intricate anisotropic thermo-elastic and chemical behavior. Specifically, the software evaluates morphological attributes (specific surface area, volume fractions, mean intercept lengths, orientation) and physical characteristics (conductivity, elasticity, permeability, and tortuosity). Additionally, it can model material degradation processes, such as oxidation and surface chemistry interactions. The software can generate synthetic microstructures, from straightforward geometrical designs to intricate woven and non-woven geometries. Coupling material generation and characterization enable parametric studies and sensitivity analysis to optimize the microstructural performance and inform design decisions and reliability assessment based on uncertainty quantification. A recent addition to PuMA includes the TomoSAM plugin, devised to incorporate the cutting-edge Segment Anything Model (SAM). SAM is a promptable deep learning model that can identify objects and create image masks in a zero-shot manner, based only on a few user clicks. The synergy between these tools aids in the segmentation of complex 3D datasets from tomography or other imaging techniques, which would otherwise require a laborious manual segmentation process.

Tomography↗

ShrinkWrap: 3D model abstraction for remote sensing simulation

Remote sensing simulations often require the use of 3D models of objects of interest. There are a multitude of these models available from various commercial sources. There are image processing, computational, database storage, and . data access advantages to having a regularized, encapsulating, triangular mesh representing the surface of a 3D object model. However, this is usually not how these models are stored. They can have too much detail in some areas, and not enough detail in others. They can have a mix of planar geometric primitives (triangles, quadrilaterals, n-sided polygons) representing not only the surface of the model, but also interior features. And the exterior mesh is usually not regularized nor encapsulating. This paper presents a method called SHRlNKWRAP which can be used to process 3D object models to achieve output models having the aforementioned desirable traits. The method works by collapsing an encapsulating sphere, which has a regularized triangular mesh on its surface, onto the surface of the model. A GUI has been developed to make it easy to leverage this capability. The SHRlNKWRAP processing chain and use of the GUI are described and illustrated.

97 MATHEMATICS AND COMPUTING↗

3-D advanced gas-cooled nuclear reactor fuel channel reconstruction using structure-from-motion - 110

During planned, periodic outages, a selection of fuel channels within the UK fleet of Advanced Gas-cooled Reactor (AGR) cores are inspected using specialist tools which record video footage and other sensory data for each channel which undergoes inspection. Current visualization techniques comprise of manually produced montages by inspection engineers of points of interest (i.e. structural defects) and 2-D panoramic images of the fuel channels automatically produced using bespoke image stitching software. Both techniques however provide limited structural information due to the loss of depth data as a result of the image formation process. By recovering the depth information from the footage, a 3D model could be constructed and subsequently, allow for more accurate profiling of specific defects observed during inspection in addition to obtaining the fuel channels structure using existing footage. This work explores the preliminary application of a 3-D visualization technique known as Structure-from-Motion (SfM) which aims to obtain 3-D information by exploiting image correspondences across multiple viewpoints of the same scene in the RVI footage. This paper investigates the difficulties of applying state-of-the-art SfM to RVI footage and we present new techniques to improve feature correspondence searching in repetitive, nondescript environments. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

The simulation of 3D microcalcification clusters in 2D digital mammography and breast tomosynthesis

Purpose: This work proposes a new method of building 3D models of microcalcification clusters and describes the validation of their realistic appearance when simulated into 2D digital mammograms and into breast tomosynthesis images. Methods: A micro-CT unit was used to scan 23 breast biopsy specimens of microcalcification clusters with malignant and benign characteristics and their 3D reconstructed datasets were segmented to obtain 3D models of microcalcification clusters. These models were then adjusted for the x-ray spectrum used and for the system resolution and simulated into 2D projection images to obtain mammograms after image processing and into tomographic sequences of projection images, which were then reconstructed to form 3D tomosynthesis datasets. Six radiologists were asked to distinguish between 40 real and 40 simulated clusters of microcalcifications in two separate studies on 2D mammography and tomosynthesis datasets. Receiver operating characteristic (ROC) analysis was used to test the ability of each observer to distinguish between simulated and real microcalcification clusters. The kappa statistic was applied to assess how often the individual simulated and real microcalcification clusters had received similar scores (''agreement'') on their realistic appearance in both modalities. This analysis was performed for all readers and for the real and the simulated group of microcalcification clusters separately. ''Poor'' agreement would reflect radiologists' confusion between simulated and real clusters, i.e., lesions not systematically evaluated in both modalities as either simulated or real, and would therefore be interpreted as a success of the present models. Results: The area under the ROC curve, averaged over the observers, was 0.55 (95% confidence interval [0.44, 0.66]) for the 2D study, and 0.46 (95% confidence interval [0.29, 0.64]) for the tomosynthesis study, indicating no statistically significant difference between real and simulated lesions (p > 0.05). Agreement between allocated lesion scores for 2D mammography and those for the tomosynthesis series was poor. Conclusions: The realistic appearance of the 3D models of microcalcification clusters, whether malignant or benign clusters, was confirmed for 2D digital mammography images and the breast tomosynthesis datasets; this database of clusters is suitable for use in future observer performance studies related to the detectability of microcalcification clusters. Such studies include comparing 2D digital mammography to breast tomosynthesis and comparing different reconstruction algorithms.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

The Porous Microstructure Analysis (PuMA) software

The open-source Porous Microstructure Analysis (PuMA) software was created to offer an efficient framework for determining material properties from 3D microstructures. Its development was inspired by progress in X-ray microtomography, an imaging technology that captures the internal structure of materials in 3D, and even in a 4D temporal context. Over recent years, this method has transformed the domain of materials science due to its capability to non-destructively examine material microstructures while presenting digital data about their geometrical details. It has provided insights into materials relevant to several NASA missions, including heatshields, parachute fabrics, meteorites, and other advanced composites. PuMA, in its current version 3, delivers an array of features, spanning from basic geometric insights of a microstructure to intricate anisotropic thermo-elastic and chemical behavior. Specifically, the software evaluates morphological attributes (specific surface area, volume fractions, mean intercept lengths, orientation) and physical characteristics (conductivity, elasticity, permeability, and tortuosity). Additionally, it can model material degradation processes, such as oxidation and surface chemistry interactions. The software can generate synthetic microstructures, from straightforward geometrical designs to intricate woven and non-woven geometries. Coupling material generation and characterization enables parametric studies and sensitivity analysis to optimize the microstructural performance and inform design decisions and reliability assessment based on uncertainty quantification. A recent addition to PuMA includes the TomoSAM plugin, devised to incorporate the cutting-edge Segment Anything Model (SAM) into our image segmentation workflow. SAM is a promptable deep learning model that can identify objects and create image masks in a zero-shot manner, based only on a few user clicks. The synergy between these tools aids in the segmentation of complex 3D datasets from tomography and other imaging techniques, which would otherwise require a laborious manual segmentation process.

Tomography↗

Reconstruction of a cone-beam CT image via forward iterative projection matching

Purpose: To demonstrate the feasibility of reconstructing a cone-beam CT (CBCT) image by deformably altering a prior fan-beam CT (FBCT) image such that it matches the anatomy portrayed in the CBCT projection data set. Methods: A prior FBCT image of the patient is assumed to be available as a source image. A CBCT projection data set is obtained and used as a target image set. A parametrized deformation model is applied to the source FBCT image, digitally reconstructed radiographs (DRRs) that emulate the CBCT projection image geometry are calculated and compared to the target CBCT projection data, and the deformation model parameters are adjusted iteratively until the DRRs optimally match the CBCT projection data set. The resulting deformed FBCT image is hypothesized to be an accurate representation of the patient's anatomy imaged by the CBCT system. The process is demonstrated via numerical simulation. A known deformation is applied to a prior FBCT image and used to create a synthetic set of CBCT target projections. The iterative projection matching process is then applied to reconstruct the deformation represented in the synthetic target projections; the reconstructed deformation is then compared to the known deformation. The sensitivity of the process to the number of projections and the DRR/CBCT projection mismatch is explored by systematically adding noise to and perturbing the contrast of the target projections relative to the iterated source DRRs and by reducing the number of projections. Results: When there is no noise or contrast mismatch in the CBCT projection images, a set of 64 projections allows the known deformed CT image to be reconstructed to within a nRMS error of 1% and the known deformation to within a nRMS error of 7%. A CT image nRMS error of less than 4% is maintained at noise levels up to 3% of the mean projection intensity, at which the deformation error is 13%. At 1% noise level, the number of projections can be reduced to 8 while maintaining CT image and deformation errors of less than 4% and 13%, respectively. The method is sensitive to contrast mismatch between the simulated projections and the target projections when the soft-tissue contrast in the projections is low. Conclusions: By using prior knowledge available in a FBCT image, the authors show that a CBCT image can be iteratively reconstructed from a comparatively small number of projection images, thus saving acquisition time and reducing imaging dose. This will enable more frequent daily imaging during radiation therapy. Because the process preserves the CT numbers of the FBCT image, the resulting 3D image intensities will be more accurate than a CBCT image reconstructed via conventional backprojection methods. Reconstruction errors are insensitive to noise at levels beyond what would typically be found in CBCT projection data, but are sensitive to contrast mismatch errors between the CBCT projection data and the DRRs.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A synchrotron study of defect and strain inhomogeneity in laser-assisted three-dimensionally-printed Ni-based superalloy

Synchrotron X-ray microdiffraction was employed to investigate the inhomogeneous distribution of defect and residual strain in the transitional region between the dendritic and stray grains in a laser-assisted 3D printed Ni-based superalloy. The dendritic region was found to be under tensile strain transversely to the primary dendrite arm directions. The dendrite edges, where high level of strains and geometrically necessary dislocations were detected, were discerned as low angle grain boundaries. Lastly, high angle grain boundaries were observed in the stray grain region, and the orientation of the strain tensor in this region varied dramatically at the micron scale, in contrast with the more or less homogeneous distribution in the dendritic region.

36 MATERIALS SCIENCE↗

A Two-Tier Convolutional Neural Network for Combined Detection and Segmentation in Biological Imagery

Deep learning techniques have been useful for modern microscopy imaging techniques to further study and analyze biological structures and organs. Convolutional neural networks (CNN) have improved 2D object detection, localization, and segmentation. For imagery containing biological structures with depth, it is especially desirable to perform these tasks in 3D. Traditionally, performing these tasks simultaneously in 3D has proven to be computationally expensive. Currently available methodologies thus largely work to segment 3D objects from 2D images (without context from captured 3D volumes). In this work, we present a novel approach to perform fast and accurate localization, detection, and segmentation of volumes containing cells. Specifically, in our method, we modify and tune two state-of-the-art CNNs, namely 2D YOLOv2 and 3D U-Net, and combine them with a new fusion and image processing algorithms. Annotated volumes in this space are limited, and we have created synthetic data that mimics actual structures for training and testing our proposed approach. Promising results on this test data demonstrate the value of the technique and offers a methodology for 3D cell analysis in real microscopy imagery.

Ziabari, Amir↗

Neutron tomography of porous aluminum electrodes used in electrocoagulation of groundwater

In this work, neutron computed tomography (CT) is employed to investigate the dissolution of porous aluminum electrodes during electrocoagulation (EC). Porous electrodes were chosen in efforts to reduce electric power requirements by using larger surface-area electrodes, having both inner and outer surface, for the EC process. Neutron CT allowed 3D reconstruction of the porous electrodes, and image analysis provided the volume of each electrode vs. thickness, which can indicate whether the inner surface is effectively involved in EC reactions. For the anode, the volume decreased uniformly throughout the thickness of the electrode, indicating that both the outer and inner surface participated in electrochemical dissolution, while the volume of the cathode increased uniformly vs. thickness, indicating deposition of material on both the outer and inner surface. The attenuation coefficient vs. thickness, increased for both anode and cathode, indicating surface chemistry changes. For the anode, the attenuation coefficient increased slightly but uniformly, probably due to aluminum oxide formation on the surface of the anode. For the cathode, the attenuation coefficient increased more than for the anode and nonuniformly. The higher increase in the attenuation coefficient for the cathode is due to precipitation of aluminum hydroxide on the electrode surface, which added hydrogen. Image analysis also showed that, although the attenuation coefficient increased throughout the thickness of the electrode, most of the hydroxide deposition occurred on the outer surface. Energy analysis showed that porous electrodes can be used to reduce process energy requirements by as much as 4 times compared to solid electrodes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

3D nanolithography with metalens arrays and spatially adaptive illumination

The growing demand for advanced materials, miniaturized devices and integrated microsystems calls for the reliable fabrication of complex, multiscale, three-dimensional (3D) architectures, a need increasingly addressed through light-based and laser-based processes. However, owing to the field-of-view (FOV) limitations of conventional imaging optics, existing 3D laser nanofabrication techniques face fundamental challenges in throughput, proximity error and stitching defects on the path to scaling. Here, in this study, we present a scalable 3D nanofabrication platform that uses a metalens-generated focal spot array to parallelize two-photon lithography (TPL) beyond centimetre-scale write field areas. Metalenses are ideally suited for producing submicron-scale focal spots for high-throughput nanolithography, as they uniquely feature large numerical apertures (NAs), immersion media compatibility and large-scale manufacturability. We experimentally demonstrate a printing system that uses a 12-cm 2 metalens array to produce more than 120,000 cooperative focal spots, corresponding to a throughput exceeding 10 8 voxels s −1 . By programmatically patterning the focal spot array using a spatial light modulator (SLM), an adaptive parallel printing strategy is developed for precise greyscale linewidth modulation and choreographed printing of semiperiodic and fully aperiodic 3D geometries. We demonstrate parallel printing of replicated microstructures (>50 M microparticles per day), centimetre-scale 3D architectures with feature sizes down to 113 nm, and photonic and mechanical metamaterials. This work demonstrates the potential of 3D nanolithography towards wafer-scale production, showing how TPL could be used at scale for applications in microelectronics, biomedicine, quantum technology and high-energy laser targets.

Materials science↗

Vision System Measures Motions of Robot and External Objects

A prototype of an advanced robotic vision system both (1) measures its own motion with respect to a stationary background and (2) detects other moving objects and estimates their motions, all by use of visual cues. Like some prior robotic and other optoelectronic vision systems, this system is based partly on concepts of optical flow and visual odometry. Whereas prior optoelectronic visual-odometry systems have been limited to frame rates of no more than 1 Hz, a visual-odometry subsystem that is part of this system operates at a frame rate of 60 to 200 Hz, given optical-flow estimates. The overall system operates at an effective frame rate of 12 Hz. Moreover, unlike prior machine-vision systems for detecting motions of external objects, this system need not remain stationary: it can detect such motions while it is moving (even vibrating). The system includes a stereoscopic pair of cameras mounted on a moving robot. The outputs of the cameras are digitized, then processed to extract positions and velocities. The initial image-data-processing functions of this system are the same as those of some prior systems: Stereoscopy is used to compute three-dimensional (3D) positions for all pixels in the camera images. For each pixel of each image, optical flow between successive image frames is used to compute the two-dimensional (2D) apparent relative translational motion of the point transverse to the line of sight of the camera. The challenge in designing this system was to provide for utilization of the 3D information from stereoscopy in conjunction with the 2D information from optical flow to distinguish between motion of the camera pair and motions of external objects, compute the motion of the camera pair in all six degrees of translational and rotational freedom, and robustly estimate the motions of external objects, all in real time. To meet this challenge, the system is designed to perform the following image-data-processing functions: The visual-odometry subsystem (the subsystem that estimates the motion of the camera pair relative to the stationary background) utilizes the 3D information from stereoscopy and the 2D information from optical flow. It computes the relationship between the 3D and 2D motions and uses a least-mean-squares technique to estimate motion parameters. The least-mean-squares technique is suitable for real-time implementation when the number of external-moving-object pixels is smaller than the number of stationary-background pixels.

Talukder, Ashit↗

Online coupled camera pose estimation and dense reconstruction from video

A product may receive each image in a stream of video image of a scene, and before processing the next image, generate information indicative of the position and orientation of an image capture device that captured the image at the time of capturing the image. The product may do so by identifying distinguishable image feature points in the image; determining a coordinate for each identified image feature point; and for each identified image feature point, attempting to identify one or more distinguishable model feature points in a three dimensional (3D) model of at least a portion of the scene that appears likely to correspond to the identified image feature point. Thereafter, the product may find each of the following that, in combination, produce a consistent projection transformation of the 3D model onto the image: a subset of the identified image feature points for which one or more corresponding model feature points were identified; and, for each image feature point that has multiple likely corresponding model feature points, one of the corresponding model feature points. The product may update a 3D model of at least a portion of the scene following the receipt of each video image and before processing the next video image base on the generated information indicative of the position and orientation of the image capture device at the time of capturing the received image. The product may display the updated 3D model after each update to the model.

97 MATHEMATICS AND COMPUTING↗

Imaging mechanism for hyperspectral scanning probe microscopy via Gaussian process modelling

We investigate the ability to reconstruct and derive spatial structure from sparsely sampled 3D piezoresponse force microcopy data, captured using the band-excitation (BE) technique, via Gaussian Process (GP) methods. Even for weakly informative priors, GP methods allow unambiguous determination of the characteristic length scales of the imaging process both in spatial and frequency domains. We further show that BE data set tends to be oversampled in the spatial domains, with ~30% of original data set sufficient for high-quality reconstruction, potentially enabling faster BE imaging. At the same time, reliable reconstruction along the frequency domain requires the resonance peak to be within the measured band. This behavior suggests the optimal strategy for the BE imaging on unknown samples. Finally, we discuss how GP can be used for automated experimentation in SPM, by combining GP regression with non-rectangular scans.

47 OTHER INSTRUMENTATION↗

Earth Science Multimedia Theater

The presentation will begin with the latest 1998 NASA Earth Science Vision for the next 25 years. A compilation of the 10 days of animations of Hurricane Georges which were supplied daily on NASA to Network television will be shown. NASA's visualizations of Hurricane Bonnie which appeared in the Sept 7 1998 issue of TIME magazine. Highlights will be shown from the NASA hurricane visualization resource video tape that has been used repeatedly this season on network TV. Results will be presented from a new paper on automatic wind measurements in Hurricane Luis from 1 -min GOES images that will appear in the October BAMS. The visualizations are produced by the Goddard Visualization & Analysis Laboratory, and Scientific Visualization Studio, as well as other Goddard and NASA groups using NASA, NOAA, ESA, and NASDA Earth science datasets. Visualizations will be shown from the "Digital-HyperRes-Panorama" Earth Science ETheater'98 recently presented in Tokyo, Paris and Phoenix. The presentation in Paris used a SGI/CRAY Onyx Infinite Reality Super Graphics Workstation at 2560 X 1024 resolution with dual synchronized video Epson 71 00 projectors on a 20ft wide screen. Earth Science Electronic Theater '999 is being prepared for a December 1 st showing at NASA HQ in Washington and January presentation at the AMS meetings in Dallas. The 1999 version of the Etheater will be triple wide with at resolution of 3840 X 1024 on a 60 ft wide screen. Visualizations will also be featured from the new Earth Today Exhibit which was opened by Vice President Gore on July 2, 1998 at the Smithsonian Air & Space Museum in Washington, as well as those presented for possible use at the American Museum of Natural History (NYC), Disney EPCOT, and other venues. New methods are demonstrated for visualizing, interpreting, comparing, organizing and analyzing immense Hyperimage remote sensing datasets and three dimensional numerical model results. We call the data from many new Earth sensing satellites, Hyperimage datasets, because they have such high resolution in the spectral, temporal, spatial, and dynamic range domains. The traditional numerical spreadsheet paradigm has been extended to develop a scientific visualization approach for processing Hyperimage datasets and 3D model results interactively. The advantages of extending the powerful spreadsheet style of computation to multiple sets of images and organizing image processing were demonstrated using the Distributed Image SpreadSheet (DISS).

Hasler, A. F.↗

A knowledge-based object recognition system for applications in the space station

A knowledge-based three-dimensional (3D) object recognition system is being developed. The system uses primitive-based hierarchical relational and structural matching for the recognition of 3D objects in the two-dimensional (2D) image for interpretation of the 3D scene. At present, the pre-processing, low-level preliminary segmentation, rule-based segmentation, and the feature extraction are completed. The data structure of the primitive viewing knowledge-base (PVKB) is also completed. Algorithms and programs based on attribute-trees matching for decomposing the segmented data into valid primitives were developed. The frame-based structural and relational descriptions of some objects were created and stored in a knowledge-base. This knowledge-base of the frame-based descriptions were developed on the MICROVAX-AI microcomputer in LISP environment. The simulated 3D scene of simple non-overlapping objects as well as real camera data of images of 3D objects of low-complexity have been successfully interpreted.

Dhawan, Atam P.↗

Application of Plasma FIB to Analyze a Single Oxide Inclusion in Steel

We demonstrate that Plasma Dual Beam focused ion beam (PFIB) milling can be used for high-resolution three-dimensional chemical study of a single non-metallic inclusion in steel. A CaO-Al{sub 2}O{sub 3}-MgO inclusion (~ 10 μm) on a polished cross-section of steel sample was located and milled using a Xe{sup +} ion beam. A secondary electron image and EDS map of every section were recorded and subsequently processed to show the 3D chemistry and morphology of the inclusion.

36 MATERIALS SCIENCE↗