Search NASA⌕ Search

SEARCH · Search NASA

Results for “3D image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

In Situ 3D Imaging of Catalysis Induced Strain in Gold Nanoparticles

Multielectron transfer processes are crucially important in energy and biological science but require favorable catalysts to achieve fast kinetics. Nanostructuring catalysts can dramatically improve their properties, which can be difficult to understand due to strain- and size-dependent thermodynamics, the influence of defects, and substrate-dependent activities. Here, we report three-dimensional (3D) imaging of single gold nanoparticles during catalysis of ascorbic acid decomposition using Bragg coherent diffractive imaging (BCDI). Local strains were measured in single nanoparticles and modeled using reactive molecular dynamics (RMD) simulations and finite element analysis (FEA) simulations. RMD reveals the pathway for local strain generation in the gold lattice: chemisorption of hydroxyl ions. FEA reveals that the RMD results are transferable to the nanocrystal sizes studied in the experiment. Our study probes the strain-activity connection and opens a powerful avenue for theoretical and experimental studies of nanocrystal catalysis.

Ulvestad, Andrew↗

Reconstruction of shapes of near symmetric and asymmetric objects

A system processes 2D images of 2D or 3D objects, creating a model of the object that is consistent with the image and as veridical as the perception of the 2D image by humans. Vertices of the object that are hidden in the image are recovered by using planarity and symmetry constraints. The 3D shape is recovered by maximizing 3D compactness of the recovered object and minimizing its surface area. In some embodiments, these two criteria are weighted by using the geometric mean.

97 MATHEMATICS AND COMPUTING↗

Reconstruction of shapes of near symmetric and asymmetric objects

A system processes 2D images of 2D or 3D objects, creating a model of the object that is consistent with the image and as veridical as the perception of the 2D image by humans. Vertices of the object that are hidden in the image are recovered by using planarity and symmetry constraints. The 3D shape is recovered by maximizing 3D compactness of the recovered object and minimizing its surface area. In some embodiments, these two criteria are weighted by using the geometric mean.

97 MATHEMATICS AND COMPUTING↗

Characterization, comparison, and optimization of lattice light sheets

Lattice light sheet microscopy excels at the noninvasive imaging of three-dimensional (3D) dynamic processes at high spatiotemporal resolution within cells and developing embryos. Recently, several papers have called into question the performance of lattice light sheets relative to the Gaussian sheets most common in light sheet microscopy. Here, we undertake a theoretical and experimental analysis of various forms of light sheet microscopy, which demonstrates and explains why lattice light sheets provide substantial improvements in resolution and photobleaching reduction. The analysis provides a procedure to select the correct light sheet for a desired experiment and specifies the processing that maximizes the use of all fluorescence generated within the light sheet excitation envelope for optimal resolution while minimizing image artifacts and photodamage. We also introduce a new type of “harmonic balanced” lattice light sheet that improves performance at all spatial frequencies within its 3D resolution limits and maintains this performance over lengthened propagation distances allowing for expanded fields of view.

59 BASIC BIOLOGICAL SCIENCES↗

Aerial 3D Building Reconstruction from Drone Imagery (A3DBR) v1

This toolkit is composed of several modules for extracting buildings geometrical and thermal characteristics from RGB and thermal imagery captured using a drone. - Building 3D reconstruction module: leverage a photogrammetry software to construct a 3D point cloud from RGB drone imagery, which is then used in conjunction with image processing and geometric methods to extract building footprint and building height (i.e., 3D model of the building). - Windows to wall ratio estimation module: leverage deep learning semantic segmentation modeling to detect windows on 2D drone RGB images. The detected windows are then projected onto the extracted building 3D model (using building 3D reconstruction module) and their area is computed to obtain window to wall ratio estimation. - Thermal anomalies detection module: leverage image processing and machine learning algorithm to detect on 2D drone thermal images potential thermal anomalies within building's facades and roofs.

Granderson, Jessica↗

Influence of Vegetation Canopy Architecture on Dynamics of Spatiotemporal Light Distribution and its Effect on Land-Biosphere-Atmosphere Fluxes of Energy, Carbon, and Water

The dynamic spatiotemporal distribution of light and micro climatic variables (wind speed, atmospheric CO 2 concentration, humidity, pressure, and air temperature) within the plant canopy as determined by the canopy architecture play a critical role in land-biosphere-atmosphere (LBA) photosynthetic carbon uptake, transpiratory water loss and energy partitioning. Vegetation models that include effects of sun and shade flecks, leaf temperature and energy balance partitioning between sensible and latent heat fluxes, and reduced turbulent mixing in dense vegetation canopies can accurately predict canopy performance, particularly its shaded leaves, which can constitute 80% of leaf area and contribute up to 50% of carbon update and 65% of water loss. However, current vegetation models with their bulk characterization of shaded leaves poorly represent the complex three dimensional (3D) canopy architecture are insufficient to capture the spatiotemporal dynamics of shaded leaves. Here, we propose to employ an x-ray computed tomography (XCT) imaging technique in combination with an automated, high throughput, image processing pipeline (3DArch, to be developed) to obtain an explicit 3D triangulated surface mesh of a plant canopy (Fig 1). 3DArch would provide a much needed technological jump in 3D LBA modeling where computer generated artificial 3D models suffer from lack of high resolution detailed canopy architecture parameters. The 3D canopy surface mesh output from 3DArch is coupled with an explicit 3D forward ray tracing model (fastTracer) to obtain a high resolution representation of the dynamic spatiotemporal light environment within the canopy over the course of a day (Fig 1). The results from the light attenuation model are then coupled with a process based multi-scale bio-physical canopy and leaf model of photosynthesis (PlantGro) to get fluxes of carbon, water and energy at the leaf and canopy scale, in addition to estimating whole plant carbon uptake, and water loss. Our proposed model framework would be the first of its kind to provide a breakthrough capability in the field of process-based plant modeling that bridges the key technological gap in shaded leaf modeling through explicit representation of 3D canopy architecture. Computer generated artificial 3D model canopy simulations on grasses show that the canopy light distribution does not follow an exponential behavior as assumed in most 1D vegetation models, but rather exhibits a heterogeneous behavior, with a small but significant portion of interior canopy leaves experiencing peak light levels due to sun flecks while the rest of the canopy receives substantially lower light levels. These results indicate a bias in traditional models that overestimates shaded leaf contribution towards whole canopy photosynthesis by up to 15% and underestimate transpiration by up to 12% with an associated increase in sensible heat fluxes since photosynthesis, transpiration and energy partitioning are tightly coupled processes. However, these test results need to be validated using the 3D architecture obtained from a real plant imaged in 3D using 3DArch, rather than an artificial model plant. Our proposed model framework would allow us to identify inefficiencies in canopy light distribution and prescribe optimal canopy architectures (leaf optical properties, leaf area, leaf angles, row spacing, planting density, etc.) to traditional and genetic engineering based crop breeders, for maximizing target functions such as light use efficiency, water use efficiency, drought tolerance, crop yield, crop resilience etc., with important applications in biofuel crops such as sorghum, and switchgrass. Our model can also be applied for designing optimal canopy architecture that increase surface albedo as a mitigation strategy for global warming and projections of crop yield for future food and water security under climate change.

59 BASIC BIOLOGICAL SCIENCES↗

PhytoOracle: Scalable, modular phenomics data processing pipelines

As phenomics data volume and dimensionality increase due to advancements in sensor technology, there is an urgent need to develop and implement scalable data processing pipelines. Current phenomics data processing pipelines lack modularity, extensibility, and processing distribution across sensor modalities and phenotyping platforms. To address these challenges, we developed PhytoOracle (PO), a suite of modular, scalable pipelines for processing large volumes of field phenomics RGB, thermal, PSII chlorophyll fluorescence 2D images, and 3D point clouds. PhytoOracle aims to ( i ) improve data processing efficiency; ( ii ) provide an extensible, reproducible computing framework; and ( iii ) enable data fusion of multi-modal phenomics data. PhytoOracle integrates open-source distributed computing frameworks for parallel processing on high-performance computing, cloud, and local computing environments. Each pipeline component is available as a standalone container, providing transferability, extensibility, and reproducibility. The PO pipeline extracts and associates individual plant traits across sensor modalities and collection time points, representing a unique multi-system approach to addressing the genotype-phenotype gap. To date, PO supports lettuce and sorghum phenotypic trait extraction, with a goal of widening the range of supported species in the future. At the maximum number of cores tested in this study (1,024 cores), PO processing times were: 235 minutes for 9,270 RGB images (140.7 GB), 235 minutes for 9,270 thermal images (5.4 GB), and 13 minutes for 39,678 PSII images (86.2 GB). These processing times represent end-to-end processing, from raw data to fully processed numerical phenotypic trait data. Repeatability values of 0.39-0.95 (bounding area), 0.81-0.95 (axis-aligned bounding volume), 0.79-0.94 (oriented bounding volume), 0.83-0.95 (plant height), and 0.81-0.95 (number of points) were observed in Field Scanalyzer data. We also show the ability of PO to process drone data with a repeatability of 0.55-0.95 (bounding area).

59 BASIC BIOLOGICAL SCIENCES↗

SU-F-J-54: Towards Real-Time Volumetric Imaging Using the Treatment Beam and KV Beam

Purpose: Existing real-time imaging uses dual (orthogonal) kV beam fluoroscopies and may result in significant amount of extra radiation to patients, especially for prolonged treatment cases. In addition, kV projections only provide 2D information, which is insufficient for in vivo dose reconstruction. We propose real-time volumetric imaging using prior knowledge of pre-treatment 4D images and real-time 2D transit data of treatment beam and kV beam. Methods: The pre-treatment multi-snapshot volumetric images are used to simulate 2D projections of both the treatment beam and kV beam, respectively, for each treatment field defined by the control point. During radiation delivery, the transit signals acquired by the electronic portal image device (EPID) are processed for every projection and compared with pre-calculation by cross-correlation for phase matching and thus 3D snapshot identification or real-time volumetric imaging. The data processing involves taking logarithmic ratios of EPID signals with respect to the air scan to reduce modeling uncertainties in head scatter fluence and EPID response. Simulated 2D projections are also used to pre-calculate confidence levels in phase matching. Treatment beam projections that have a low confidence level either in pre-calculation or real-time acquisition will trigger kV beams so that complementary information can be exploited. In case both the treatment beam and kV beam return low confidence in phase matching, a predicted phase based on linear regression will be generated. Results: Simulation studies indicated treatment beams provide sufficient confidence in phase matching for most cases. At times of low confidence from treatment beams, kV imaging provides sufficient confidence in phase matching due to its complementary configuration. Conclusion: The proposed real-time volumetric imaging utilizes the treatment beam and triggers kV beams for complementary information when the treatment beam along does not provide sufficient confidence for phase matching. This strategy minimizes the use of extra radiation to patients. This project is partially supported by a Varian MRA grant.

60 APPLIED LIFE SCIENCES↗

Clean localization super-resolution microscopy for 3D biological imaging

We propose clean localization microscopy (a variant of fPALM) using a molecule filtering technique. Localization imaging involves acquiring a large number of images containing single molecule signatures followed by one-to-one mapping to render a super-resolution image. In principle, this process can be repeated for other z-planes to construct a 3D image. But, single molecules observed from off-focal planes result in false representation of their presence in the focal plane, resulting in incorrect quantification and analysis. We overcome this with a single molecule filtering technique that imposes constraints on the diffraction limited spot size of single molecules in the image plane. Calibration with sub-diffraction size beads puts a natural cutoff on the actual diffraction-limited size of single molecules in the focal plane. This helps in distinguishing beads present in the focal plane from those in the off-focal planes thereby providing an estimate of the single molecules in the focal plane. We study the distribution of actin (labeled with a photoactivatable CAGE 552 dye) in NIH 3T3 mouse fibroblast cells.

60 APPLIED LIFE SCIENCES↗

Three-dimensional electron temperature measurement of inertial confinement fusion hotspots using x-ray emission tomography

Here we present a novel approach to reconstruct three-dimensional (3D) electron temperature distributions of inertially confined fusion plasma hotspots at the National Ignition Facility. Using very limited number of two-dimensional (2D) x-ray imaging lines of sight, we perform 3D reconstructions of x-ray emission distributions from different x-ray energy channels ranging from 20 to 30 keV. 2D time-integrated x-ray images are processed using the algebraic reconstruction technique to reconstruct a 3D hotspot x-ray emission distribution that is self-consistent with the input images. 3D electron temperatures are computed using the energy channel ratios. We demonstrate the high accuracy and applicability of this method with different complex hotspot geometries in both synthetic and experimental results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SU-E-J-55: End-To-End Effectiveness Analysis of 3D Surface Image Guided Voluntary Breath-Holding Radiotherapy for Left Breast

Purpose To evaluate the effectiveness of using 3D-surface-image to guide breath-holding (BH) left-side breast treatment. Methods Two 3D surface image guided BH procedures were implemented and evaluated: normal-BH, taking BH at a comfortable level, and deep-inspiration-breath-holding (DIBH). A total of 20 patients (10 Normal-BH and 10 DIBH) were recruited. Patients received a BH evaluation using a commercialized 3D-surface- tracking-system (VisionRT, London, UK) to quantify the reproducibility of BH positions prior to CT scan. Tangential 3D/IMRT plans were conducted. Patients were initially setup under free-breathing (FB) condition using the FB surface obtained from the untaged CT to ensure a correct patient position. Patients were then guided to reach the planned BH position using the BH surface obtained from the BH CT. Action-levels were set at each phase of treatment process based on the information provided by the 3D-surface-tracking-system for proper interventions (eliminate/re-setup/ re-coaching). We reviewed the frequency of interventions to evaluate its effectiveness. The FB-CBCT and port-film were utilized to evaluate the accuracy of 3D-surface-guided setups. Results 25% of BH candidates with BH positioning uncertainty > 2mm are eliminated prior to CT scan. For >90% of fractions, based on the setup deltas from3D-surface-trackingsystem, adjustments of patient setup are needed after the initial-setup using laser. 3D-surface-guided-setup accuracy is comparable as CBCT. For the BH guidance, frequency of interventions (a re-coaching/re-setup) is 40%(Normal-BH)/91%(DIBH) of treatments for the first 5-fractions and then drops to 16%(Normal-BH)/46%(DIBH). The necessity of re-setup is highly patient-specific for Normal-BH but highly random among patients for DIBH. Overall, a −0.8±2.4 mm accuracy of the anterior pericardial shadow position was achieved. Conclusion 3D-surface-image technology provides effective intervention to the treatment process and ensures favorable day-to-day setup accuracy. DIBH setup appears to be more uncertain and this would be the patient group who will definitely benefit from the extra information of 3D surface setup.

60 APPLIED LIFE SCIENCES↗

X-ray Computed Tomography on UNESE Core: FY2020 Data Report to Support Fracture and Multiphase Fluid Flow Studies

Natural and induced fractures are potential preferential pathways for migration of radioactive gases to earths surface from underground nuclear explosions (UNEs). This report documents X-ray computed tomography (XRCT) imaging on 26 samples of rock core that was collected to support the Underground Nuclear Explosion Signatures Experiment (UNESE) program. The XRCT datasets are intended to help fill a data gap on the three-dimensional (3D) characteristics of natural and/or induced fractures at the centimeter and smaller scale, which may strongly influence multiphase fluid flow and transport properties of preferential flow paths and interaction with the matrix of the surrounding host rock. Pre- and post-UNE rock samples were carefully chosen to enable comparison of fractures as a function of lithologic and petrophysical properties, as well as distance to the past UNEs. This report serves as documentation for the data, including an introduction with the research motivation, a methods and materials section, descriptions of the XRCT datasets without post-processing, and recommendations for 3D quantification via image analysis and digital rock physics.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Sparse measurement medical CT reconstruction using multi-fused block matching denoising priors

A major challenge for medical X-ray CT imaging is reducing the number of X-ray projections to lower radiation dosage and reduce scan times without compromising image quality. However these under-determined inverse imaging problems rely on the formulation of an expressive prior model to constrain the solution space while remaining computationally tractable. Traditional analytical reconstruction methods like Filtered Back Projection (FBP) often fail with sparse measurements, producing artifacts due to their reliance on the Shannon-Nyquist Sampling Theorem. Consensus Equilibrium, which is a generalization of Plug and Play, is a recent advancement in Model-Based Iterative Reconstruction (MBIR), has facilitated the use of multiple denoisers are prior models in an optimization free framework to capture complex, non-linear prior information. However, 3D prior modelling in a Plug and Play approach for volumetric image reconstruction requires long processing time due to high computing requirement. Instead of directly using a 3D prior, this work proposes a BM3D Multi Slice Fusion (BM3D-MSF) prior that uses multiple 2D image denoisers fused to act as a fully 3D prior model in Plug and Play reconstruction approach. Our approach does not require training and are thus able to circumvent ethical issues related with patient training data and are readily deployable in varying noise and measurement sparsity levels. In addition, reconstruction with the BM3D-MSF prior achieves similar reconstruction image quality as fully 3D image priors, but with significantly reduced computational complexity. We test our method on clinical CT data and demonstrate that our approach improves reconstructed image quality.

Hossain, Maliha [ORNL]↗

Computational imaging using a mode-mixing cavity at microwave frequencies

We present a 3D computational imaging system based on a mode-mixing cavity at microwave frequencies. The core component of this system is an electrically large rectangular cavity with one corner re-shaped to catalyze mode mixing, often called a Sinai Billiard. The front side of the cavity is perforated with a grid of periodic apertures that sample the cavity modes and project them into the imaging scene. The radiated fields are scattered by the scene and are measured by low gain probe antennas. The complex radiation patterns generated by the cavity thus encode the scene information onto a set of frequency modes. Assuming the first Born approximation for scattering dynamics, the received signal is processed using computational methods to reconstruct a 3D image of the scene with resolution determined by the diffraction limit. The proposed mode-mixing cavity is simple to fabricate, exhibits low losses, and can generate highly diverse measurement modes. The imaging system demonstrated in this letter can find application in security screening and medical diagnostic imaging.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

MO-G-BRE-01: A Real-Time Virtual Delivery System for Photon Radiotherapy Delivery Monitoring

Purpose: Treatment delivery monitoring is important for radiotherapy, which enables catching dosimetric error at the earliest possible opportunity. This project develops a virtual delivery system to monitor the dose delivery process of photon radiotherapy in real-time using GPU-based Monte Carlo (MC) method. Methods: The simulation process consists of 3 parallel CPU threads. A thread T1 is responsible for communication with a linac, which acquires a set of linac status parameters, e.g. gantry angles, MLC configurations, and beam MUs every 20 ms. Since linac vendors currently do not offer interface to acquire data in real time, we mimic this process by fetching information from a linac dynalog file at the set frequency. Instantaneous beam fluence map (FM) is calculated. A FM buffer is also created in T1 and the instantaneous FM is accumulated to it. This process continues, until a ready signal is received from thread T2 on which an inhouse developed MC dose engine executes on GPU. At that moment, the accumulated FM is transferred to T2 for dose calculations, and the FM buffer in T1 is cleared. Once the calculation finishes, the resulting 3D dose distribution is directed to thread T3, which displays it in three orthogonal planes overlaid on the CT image for treatment monitoring. This process continues to monitor the 3D dose distribution in real-time. Results: An IMRT and a VMAT cases used in our patient-specific QA are studied. Maximum dose differences between our system and treatment planning system are 0.98% and 1.58% for the two cases, respectively. The average time per MC calculation is 0.1sec with <2% relative uncertainty. The update frequency of ∼10Hz is considered as real time. Conclusion: By embedding a GPU-based MC code in a novel data/work flow, it is possible to achieve real-time MC dose calculations to monitor delivery process.

60 APPLIED LIFE SCIENCES↗

Individualized 3D Reconstruction of Normal Tissue Dose for Patients With Long-term Follow-up: A Step Toward Understanding Dose Risk for Late Toxicity

Purpose: Understanding the relationship between normal tissue dose and delayed radiation toxicity is an important component of developing more effective radiation therapy. Late outcome data are generally available only for patients who have undergone 2-dimensional (2D) treatment plans. The purpose of this study was to evaluate the accuracy of 3D normal tissue dosimetry derived from reconstructed 2D treatment plans in Hodgkin's lymphoma (HL) patients. Methods and Materials: Three-dimensional lung, heart, and breast volumes were reconstructed from 2D planning radiographs for HL patients who received mediastinal radiation therapy. For each organ, a reference 3D organ was modified with patient-specific structural information, using deformable image processing software. Radiation therapy plans were reconstructed by applying treatment parameters obtained from patient records to the reconstructed 3D volumes. For each reconstructed organ mean dose (D{sub mean}) and volumes covered by at least 5 Gy (V{sub 5}) and 20Gy (V{sub 20}) were calculated. This process was performed for 15 patients who had both 2D and 3D planning data available to compare the reconstructed normal tissue doses with those derived from the primary CT planning data and also for 10 historically treated patients with only 2D imaging available. Results: For patients with 3D planning data, the normal tissue doses could be reconstructed accurately using 2D planning data. Median differences in D{sub mean} between reconstructed and actual plans were 0.18 Gy (lungs), -0.15 Gy (heart), and 0.30 Gy (breasts). Median difference in V{sub 5} and V{sub 20} were less than 2% for each organ. Reconstructed 3D dosimetry was substantially higher in historical mantle-field treatments than contemporary involved-field mediastinal treatments: average D{sub mean} values were 15.2 Gy vs 10.6 Gy (lungs), 27.0 Gy vs 14.3 Gy (heart), and 8.0 Gy vs 3.2 Gy (breasts). Conclusions: Three-dimensional reconstruction of absorbed dose to organs at risk can be estimated accurately many years after exposure by using limited 2D data. Compared to contemporary involved-field treatments, normal tissue doses were significantly higher in historical mantle-field treatments. These methods build capacity to quantify the relationship between 3D normal tissue dose and observed late effects.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Method for measurement of TRISO kernel and layer volumes by X-ray computed tomography

Layer dimensions are key parameters for as-fabricated tristructural-isotropic (TRISO) particle fuel as well as for post-irradiation examination of particle performance. Layer thicknesses are typically measured by optical microscopy of the particle cross section near mid-plane, while layer volumes are estimated with serial sectioning and microscopy. This method for measuring layer volumes is limited due to the resolution limit imposed by slice thickness and the effect of the polishing process on delicate irradiated particle microstructures. In this study, image processing software has been developed to segregate the three-dimensional (3D) TRISO particle images provided by x-ray computed tomography (XCT) into high-resolution volumetric data for the kernel, all particle layers, and any internal voids introduced during irradiation. These data can be used to analyze key in-reactor behaviors of TRISO particles such as kernel swelling or buffer shrinkage, which are important inputs for fuel performance modeling.

36 MATERIALS SCIENCE↗