Search NASA⌕ Search

SEARCH · Search NASA

Results for “3D image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

MO-A-9A-01: Innovation in Medical Physics Practice: 3D Printing Applications

3D printing, also called additive manufacturing, has great potential to advance the field of medicine. Many medical uses have been exhibited from facial reconstruction to the repair of pulmonary obstructions. The strength of 3D printing is to quickly convert a 3D computer model into a physical object. Medical use of 3D models is already ubiquitous with technologies such as computed tomography and magnetic resonance imaging. Thus tailoring 3D printing technology to medical functions has the potential to impact patient care. This session will discuss applications to the field of Medical Physics. Topics discussed will include introduction to 3D printing methods as well as examples of real-world uses of 3D printing spanning clinical and research practice in diagnostic imaging and radiation therapy. The session will also compare 3D printing to other manufacturing processes and discuss a variety of uses of 3D printing technology outside the field of Medical Physics. Learning Objectives: Understand the technologies available for 3D Printing Understand methods to generate 3D models Identify the benefits and drawbacks to rapid prototyping / 3D Printing Understand the potential issues related to clinical use of 3D Printing.

60 APPLIED LIFE SCIENCES↗

CSAPR2 Optimized Convective Cell Tracking Data during TRACER

One of the challenges in analyzing convective cell properties is to observe the quick evolution of individual convective cells. While the operational radar data provide a volumetric data set to analyze radar observables of convective precipitation clouds, previous studies also suggested the quick evolution of cell life cycle that might not be captured by conventional radar volume scan strategies that take ~5-7 minutes. Aiming at enhancing our understanding of the links between convective cloud kinematic and microphysical processes as well as life cycles, the Tracking Aerosol Convection Interactions ExpeRiment (TRACER; Jensen et al. 2019) was conducted at Houston, Texas, in 2022. The TRACER campaign deployed the 2nd generation C-band Scanning ARM Precipitation Radar (CSAPR2), which performed frequent updates of range height indicator (RHI) and sector plan position indicator (PPI) scans to track individual convective cells every < 2 minutes, guided by a new cell tracking framework, Multisensor Agile Adaptive Sampling (MAAS; Kollias et al. 2020). This allows for capturing fast-evolving radar observables. We provide the processed CSAPR2 cell tracking data in CfRadial format collected during the TRACER field campaign from June to September 2022. The data files include processed radar variables: noise-masked reflectivity and differential reflectivity corrected for rain attenuation and systematic biases, noise-masked dealiased radial velocity, specific differential phase, locations of target cells (latitude, longitude, radar range), and radar-echo classification. Figure 1 provides an example of a 3D image of CSAPR2 reflectivity from the lowest PPI scan and an RHI scan after data processing.

54 ENVIRONMENTAL SCIENCES↗

Awake Animal Imaging Motion Tracking Software

The Awake Animal Motion Tracking Software code calculates the 3D movement of the head motion of a live, awake animal during a medical imaging scan. In conjunction with markers attached to the head, images acquired from multiple cameras are processed and marker locations precisely determined. Using off-line camera calibration data, the 3D positions of the markers are calculated along with a 6 degree of freedom position and orientation (pose) relative to a fixed initial position. This calculation is performed in real time at frame rates up to 30 frames per second. A time stamp with microsecond accuracy from a time base source is attached to each pose measurement.

Goddard, James↗

Anatomy of an agricultural antagonist: Feeding complex structure and function of three xylem sap‐feeding insects illuminated with synchrotron‐based 3D imaging

Abstract Many insects feed on xylem or phloem sap of vascular plants. Although physical damage to the plant is minimal, the process of insect feeding can transmit lethal viruses and bacterial pathogens. Disparities between insect‐mediated pathogen transmission efficiency have been identified among xylem sap‐feeding insects; however, the mechanistic drivers of these trends are unclear. Identifying and understanding the structural factors and associated integrated functional components that may ultimately determine these disparities are critical for managing plant diseases. Here, we applied synchrotron‐based X‐ray microcomputed tomography to digitally reconstruct the morphology of three xylem sap‐feeding insect vectors of plant pathogens: Graphocephala atropunctata (blue‐green sharpshooter; Hemiptera, Cicadellidae) and Homalodisca vitripennis (glassy‐winged sharpshooter; Hemiptera, Cicadellidae), and the spittlebug Philaenus spumarius (meadow spittlebug; Hemiptera, Aphrophoridae). The application of this technique revealed previously undescribed anatomical features of these organisms, such as key components of the salivary complex. The visualization of the 3D structure of the precibarial valve led to new insights into the mechanism of how this structure functions. Morphological disparities with functional implications between taxa were highlighted as well, including the morphology and volume of the cibarial dilator musculature responsible for extracting xylem sap, which has implications for force application capabilities. These morphological insights will be used to target analyses illuminating functional differences in feeding behavior.

3D imaging↗

MO-C-18A-01: Advances in Model-Based 3D Image Reconstruction

Recent years have seen the emergence of CT image reconstruction techniques that exploit physical models of the imaging system, photon statistics, and even the patient to achieve improved 3D image quality and/or reduction of radiation dose. With numerous advantages in comparison to conventional 3D filtered backprojection, such techniques bring a variety of challenges as well, including: a demanding computational load associated with sophisticated forward models and iterative optimization methods; nonlinearity and nonstationarity in image quality characteristics; a complex dependency on multiple free parameters; and the need to understand how best to incorporate prior information (including patient-specific prior images) within the reconstruction process. The advantages, however, are even greater – for example: improved image quality; reduced dose; robustness to noise and artifacts; task-specific reconstruction protocols; suitability to novel CT imaging platforms and noncircular orbits; and incorporation of known characteristics of the imager and patient that are conventionally discarded. This symposium features experts in 3D image reconstruction, image quality assessment, and the translation of such methods to emerging clinical applications. Dr. Chen will address novel methods for the incorporation of prior information in 3D and 4D CT reconstruction techniques. Dr. Pan will show recent advances in optimization-based reconstruction that enable potential reduction of dose and sampling requirements. Dr. Stayman will describe a “task-based imaging” approach that leverages models of the imaging system and patient in combination with a specification of the imaging task to optimize both the acquisition and reconstruction process. Dr. Samei will describe the development of methods for image quality assessment in such nonlinear reconstruction techniques and the use of these methods to characterize and optimize image quality and dose in a spectrum of clinical applications. Learning Objectives: Learn the general methodologies associated with model-based 3D image reconstruction. Learn the potential advantages in image quality and dose associated with model-based image reconstruction. Learn the challenges associated with computational load and image quality assessment for such reconstruction methods. Learn how imaging task can be incorporated as a means to drive optimal image acquisition and reconstruction techniques. Learn how model-based reconstruction methods can incorporate prior information to improve image quality, ease sampling requirements, and reduce dose.

60 APPLIED LIFE SCIENCES↗

Rapid 3D nanoscale coherent imaging via physics-aware deep learning

Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programing framework trained to predict 3D structure and strain, solely from input 3D X-ray coherent scattering data. Our networks are designed to be “physics-aware” in multiple aspects; in that the physics of the X-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods. Our integrated machine learning and differential programing solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Automated Serial Sectioning for 3D Reconstruction

Some aspects of an apparatus and method for automated serial sectioning of a specimen of a solder, aluminum, or other relatively soft opaque material are discussed. The apparatus includes a small milling machine (micromiller) that takes precise, shallow cuts (increments of depth as small as 1 micron) to expose successive sections. A microscope equipped with an electronic camera, mounted in a fixed position on the micromiller, takes pictures of the newly exposed specimen surface at each increment of depth. The images are digitized, and the resulting data are subsequently processed to reconstruct three-dimensional (3D) features of the specimen.

Alkemper, Jen↗

High Speed In-situ X-ray Imaging of 3D Freeze Printing of Aerogels

3D freeze printing (3DFP) combines drop-on-demand (DOD) inkjet printing with freeze casting to fabricate lightweight and multifunctional aerogels with customized geometries. Freeze casting is an efficient and easily implemented method capable of fabricating porous, sponge-like structures for many different applications. This process enables tailoring the microstructure of the final product (i.e., pore morphology, alignment, average size distribution, etc.) by controlling the fabrication conditions and freezing kinetics. Furthermore, its combination with DOD printing provides the capability of engineering the macrostructure without relying on a mold as reported for 3D freeze-printed aerogels made from graphene, silver nanowires, and other nanocomposites. In this paper, we performed in-situ X-ray imaging to understand the inside process dynamics in 3DFP using a commercially available colloidal silica ink. We investigated the 3DFP process with the following hierarchy: first, single droplets; then, uniform lines obtained from coalescence of droplets; and finally, three consecutive lines deposited layer by layer. With the help of X-ray imaging, the importance of the balance between material deposition and freezing rates was shown in-situ by the observation inside of the freeze front following the tip of the printed line. The effects of the substrate temperature on the elimination of undesired interfacial boundaries were also shown by the observed ice crystals penetrating from lower to upper layer.

36 MATERIALS SCIENCE↗

End-to-end orientation estimation from 2D cryo-EM1images

Cryo-electron microscopy (cryo-EM) is a Nobel Prize-winning technique for deter-mining high-resolution 3D structures of biological macromolecules. A 3D structure is reconstructed from hundreds of thousands of noisy 2D projection images. However, existing 3D reconstruction methods are still time-consuming, and one of the major computational bottlenecks is to recover the unknown orientation of the particle in16each 2D image. The dominant methods typically exploit expensive global search on each image to estimate the missing orientations. Here, a novel end-to-end supervised learning method is introduced to directly recover the missing orientations from 2D cryo-EM images. A neural network is used to approximate the mapping from images to orientations. Furthermore, a robust loss function is proposed for optimizing the parameters of the network, which can handle both asymmetric and symmetric 3D structures. Experiments on synthetic datasets with various symmetry types confirm that the neural network is capable of recovering orientations from 2D cryo-EM images, and the results on one real cryo-EM dataset further demonstrate its potential in more challenging imaging conditions.

3D reconstruction↗

Applications of Automation Methods for Nonlinear Fracture Test Analysis

Using automated and standardized computer tools to calculate the pertinent test result values has several advantages such as: 1. allowing high-fidelity solutions to complex nonlinear phenomena that would be impractical to express in written equation form, 2. eliminating errors associated with the interpretation and programing of analysis procedures from the text of test standards, 3. lessening the need for expertise in the areas of solid mechanics, fracture mechanics, numerical methods, and/or finite element modeling, to achieve sound results, 4. and providing one computer tool and/or one set of solutions for all users for a more "standardized" answer. In summary, this approach allows a non-expert with rudimentary training to get the best practical solution based on the latest understanding with minimum difficulty.Other existing ASTM standards that cover complicated phenomena use standard computer programs: 1. ASTM C1340/C1340M-10- Standard Practice for Estimation of Heat Gain or Loss Through Ceilings Under Attics Containing Radiant Barriers by Use of a Computer Program 2. ASTM F 2815 - Standard Practice for Chemical Permeation through Protective Clothing Materials: Testing Data Analysis by Use of a Computer Program 3. ASTM E2807 - Standard Specification for 3D Imaging Data Exchange, Version 1.0 The verification, validation, and round-robin processes required of a computer tool closely parallel the methods that are used to ensure the solution validity for equations included in test standard. The use of automated analysis tools allows the creation and practical implementation of advanced fracture mechanics test standards that capture the physics of a nonlinear fracture mechanics problem without adding undue burden or expense to the user. The presented approach forms a bridge between the equation-based fracture testing standards of today and the next generation of standards solving complex problems through analysis automation.

Allen, Phillip A.↗

Tensor-Dictionary Learning with Deep Kruskal-Factor Analysis

We introduce new dictionary learning methods for tensor-variate data of any order. We represent each data item as a sum of Kruskal decomposed dictionary atoms within the framework of beta-process factor analysis (BPFA). Our model is nonparametric and can infer the tensor-rank of each dictionary atom. This Kruskal-Factor Analysis (KFA) is a natural generalization of BPFA. We also extend KFA to a deep convolutional setting and develop online learning methods. We test our approach on image processing and classification tasks achieving state of the art results for 2D & 3D inpainting and Caltech 101. The experiments also show that atom-rank impacts both overcompleteness and sparsity.

Stevens, Andrew J.↗

Using Visual Odometry to Estimate Position and Attitude

A computer program in the guidance system of a mobile robot generates estimates of the position and attitude of the robot, using features of the terrain on which the robot is moving, by processing digitized images acquired by a stereoscopic pair of electronic cameras mounted rigidly on the robot. Developed for use in localizing the Mars Exploration Rover (MER) vehicles on Martian terrain, the program can also be used for similar purposes on terrestrial robots moving in sufficiently visually textured environments: examples include low-flying robotic aircraft and wheeled robots moving on rocky terrain or inside buildings. In simplified terms, the program automatically detects visual features and tracks them across stereoscopic pairs of images acquired by the cameras. The 3D locations of the tracked features are then robustly processed into an estimate of overall vehicle motion. Testing has shown that by use of this software, the error in the estimate of the position of the robot can be limited to no more than 2 percent of the distance traveled, provided that the terrain is sufficiently rich in features. This software has proven extremely useful on the MER vehicles during driving on sandy and highly sloped terrains on Mars.

Maimone, Mark↗

Twin related domains in 3D microstructures of conventionally processed and grain boundary engineered materials

The concept of twin-limited microstructures has been explored in the literature as a crystallographically constrained grain boundary network connected via only coincident site lattice (CSL) boundaries. The advent of orientation imaging has made classification of twin-related domains (TRD) or any other orientation cluster experimentally accessible in 2D using EBSD. With the emergence of 3D orientation mapping, a comparison of TRDs in measured 3D microstructures is performed in this paper and compared against their 2D counterparts. The TRD analysis is performed on a conventionally processed (CP) and a grain boundary engineered (EM) high purity copper sample that have been subjected to successive anneal procedures to promote grain growth. Finally, the EM sample shows extremely large TRDs which begin to approach that of a twin-limited microstructure, while the TRDs in the CP sample remain relatively small and remote.

36 MATERIALS SCIENCE↗

Rendering Three-Dimensional Solar Coronal Structures

An X-ray or EUV image of the corona or chromosphere is a 2D representation of an extended 3D complex for which a general inversion process is impossible. A specific model must be incorporated in order to understand the full 3D structure. We approach this problem by modeling a set of optically-thin 3D plasma flux tubes which we render these as synthetic images. The resulting images allow the interpretation of the X-ray/EUV observations to obtain information on (1) the 3D structure of X-ray images, i.e., the geometric structure of the flux tubes, and on (2) the internal structure using specific plasma characteristics, i.e., the physical structure of the flux tubes. The data-analysis technique uses magnetograms to characterize photospheric magnetic fields and extrapolation techniques to form the field lines. Using a new set of software tools, we have generated 3D flux tube structures around these field lines and integrated the plasma emission along the line of sight to obtain a rendered image. A set of individual flux-tube images is selected by a non-negative least-squares technique to Provide a match with an observed X-ray image. The scheme minimizes the squares of the differences between the synthesized image and the observed image with a non-negative constraint on the coefficients of the brightness of the individual flux-tube loops. The derived images are used to determine the specific photospheric foot points and physical data, i.e., scaling laws for densities and loop lengths. The development has led to Computer efficient integration and display software that is compatible for comparison with observations (e.g., Yohkoh SXT data, NIXT, or EIT). This analysis is important in determining directly the magnetic field configuration, which provides the structure of coronal loops, and indirectly the electric currents or waves, which provide the energy for the heating of the plasma. We have used very simple assumptions (i.e., potential magnetic fields and isothermal corona) to provide an initial test of the techniques before complex models are introduced. We have separated the physical and geometric contributions of the emission for a set of flux tubes and concentrated, in this initial study, on the geometric contributions by making approximations to the physical contributions. The initial results are consistent with the scaling laws derived from Yohkoh SXT data.

Gary, G. Allen↗

Rapid sensing of hidden objects and defects using a single-pixel diffractive terahertz sensor

Abstract Terahertz waves offer advantages for nondestructive detection of hidden objects/defects in materials, as they can penetrate most optically-opaque materials. However, existing terahertz inspection systems face throughput and accuracy restrictions due to their limited imaging speed and resolution. Furthermore, machine-vision-based systems using large-pixel-count imaging encounter bottlenecks due to their data storage, transmission and processing requirements. Here, we report a diffractive sensor that rapidly detects hidden defects/objects within a 3D sample using a single-pixel terahertz detector, eliminating sample scanning or image formation/processing. Leveraging deep-learning-optimized diffractive layers, this diffractive sensor can all-optically probe the 3D structural information of samples by outputting a spectrum, directly indicating the presence/absence of hidden structures or defects. We experimentally validated this framework using a single-pixel terahertz time-domain spectroscopy set-up and 3D-printed diffractive layers, successfully detecting unknown hidden defects inside silicon samples. This technique is valuable for applications including security screening, biomedical sensing and industrial quality control.

Li, Jingxi (ORCID:0000000165958680)↗

Simultaneous 3D–2D image registration and C-arm calibration: Application to endovascular image-guided interventions

Purpose: Three-dimensional to two-dimensional (3D–2D) image registration is a key to fusion and simultaneous visualization of valuable information contained in 3D pre-interventional and 2D intra-interventional images with the final goal of image guidance of a procedure. In this paper, the authors focus on 3D–2D image registration within the context of intracranial endovascular image-guided interventions (EIGIs), where the 3D and 2D images are generally acquired with the same C-arm system. The accuracy and robustness of any 3D–2D registration method, to be used in a clinical setting, is influenced by (1) the method itself, (2) uncertainty of initial pose of the 3D image from which registration starts, (3) uncertainty of C-arm’s geometry and pose, and (4) the number of 2D intra-interventional images used for registration, which is generally one and at most two. The study of these influences requires rigorous and objective validation of any 3D–2D registration method against a highly accurate reference or “gold standard” registration, performed on clinical image datasets acquired in the context of the intervention. Methods: The registration process is split into two sequential, i.e., initial and final, registration stages. The initial stage is either machine-based or template matching. The latter aims to reduce possibly large in-plane translation errors by matching a projection of the 3D vessel model and 2D image. In the final registration stage, four state-of-the-art intrinsic image-based 3D–2D registration methods, which involve simultaneous refinement of rigid-body and C-arm parameters, are evaluated. For objective validation, the authors acquired an image database of 15 patients undergoing cerebral EIGI, for which accurate gold standard registrations were established by fiducial marker coregistration. Results: Based on target registration error, the obtained success rates of 3D to a single 2D image registration after initial machine-based and template matching and final registration involving C-arm calibration were 36%, 73%, and 93%, respectively, while registration accuracy of 0.59 mm was the best after final registration. By compensating in-plane translation errors by initial template matching, the success rates achieved after the final stage improved consistently for all methods, especially if C-arm calibration was performed simultaneously with the 3D–2D image registration. Conclusions: Because the tested methods perform simultaneous C-arm calibration and 3D–2D registration based solely on anatomical information, they have a high potential for automation and thus for an immediate integration into current interventional workflow. One of the authors’ main contributions is also comprehensive and representative validation performed under realistic conditions as encountered during cerebral EIGI.

60 APPLIED LIFE SCIENCES↗

Nanoscale x-ray and electron tomography

We present that three-dimensional (3D) tomographic imaging of the structural, chemical, and physical properties of a material provides key knowledge that links the structure of a material to both its processing and structure that is central to studies across a broad spectrum of materials. For many decades, tomography using x-rays or electrons has proven to be an essential 3D characterization tool. In recent years, advances in technology have significantly pushed the envelope of these techniques in many respects, enabling new imaging capabilities at the nanometer and atomic scale. This article highlights several such developments in nanoscale x-ray and electron tomography. The five articles that appear in this issue of MRS Bulletin discuss research frontiers that include multimodal x-ray tomography at the nanoscale, x-ray spectroscopic tomography, dark-field x-ray microscopy, electron nanotomography for functional nanomaterials, and atomistic imaging by electron tomography. Lastly, these articles give a holistic view of the status of these techniques and promising future directions, as well highlighting their applications for scientific problems.

36 MATERIALS SCIENCE↗

Evaluation of similarity measures for use in the intensity-based rigid 2D-3D registration for patient positioning in radiotherapy

Purpose: Rigid 2D-3D registration is an alternative to 3D-3D registration for cases where largely bony anatomy can be used for patient positioning in external beam radiation therapy. In this article, the authors evaluated seven similarity measures for use in the intensity-based rigid 2D-3D registration using a variation in Skerl's similarity measure evaluation protocol. Methods: The seven similarity measures are partitioned intensity uniformity, normalized mutual information (NMI), normalized cross correlation (NCC), entropy of the difference image, pattern intensity (PI), gradient correlation (GC), and gradient difference (GD). In contrast to traditional evaluation methods that rely on visual inspection or registration outcomes, the similarity measure evaluation protocol probes the transform parameter space and computes a number of similarity measure properties, which is objective and optimization method independent. The variation in protocol offers an improved property in the quantification of the capture range. The authors used this protocol to investigate the effects of the downsampling ratio, the region of interest, and the method of the digitally reconstructed radiograph (DRR) calculation [i.e., the incremental ray-tracing method implemented on a central processing unit (CPU) or the 3D texture rendering method implemented on a graphics processing unit (GPU)] on the performance of the similarity measures. The studies were carried out using both the kilovoltage (kV) and the megavoltage (MV) images of an anthropomorphic cranial phantom and the MV images of a head-and-neck cancer patient. Results: Both the phantom and the patient studies showed the 2D-3D registration using the GPU-based DRR calculation yielded better robustness, while providing similar accuracy compared to the CPU-based calculation. The phantom study using kV imaging suggested that NCC has the best accuracy and robustness, but its slow function value change near the global maximum requires a stricter termination condition for an optimization method. The phantom study using MV imaging indicated that PI, GD, and GC have the best accuracy, while NCC and NMI have the best robustness. The clinical study using MV imaging showed that NCC and NMI have the best robustness. Conclusions: The authors evaluated the performance of seven similarity measures for use in 2D-3D image registration using the variation in Skerl's similarity measure evaluation protocol. The generalized methodology can be used to select the best similarity measures, determine the optimal or near optimal choice of parameter, and choose the appropriate registration strategy for the end user in his specific registration applications in medical imaging.

62 RADIOLOGY AND NUCLEAR MEDICINE↗