Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image segmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

A novel statistical methodology for quantifying the spatial arrangements of axons in peripheral nerves

A thorough understanding of the neuroanatomy of peripheral nerves is required for a better insight into their function and the development of neuromodulation tools and strategies. In biophysical modeling, it is commonly assumed that the complex spatial arrangement of myelinated and unmyelinated axons in peripheral nerves is random, however, in reality the axonal organization is inhomogeneous and anisotropic. Present quantitative neuroanatomy methods analyze peripheral nerves in terms of the number of axons and the morphometric characteristics of the axons, such as area and diameter. In this study, we employed spatial statistics and point process models to describe the spatial arrangement of axons and Sinkhorn distances to compute the similarities between these arrangements (in terms of first- and second-order statistics) in various vagus and pelvic nerve cross-sections. We utilized high-resolution transmission electron microscopy (TEM) images that have been segmented using a custom-built high-throughput deep learning system based on a highly modified U-Net architecture. Our findings show a novel and innovative approach to quantifying similarities between spatial point patterns using metrics derived from the solution to the optimal transport problem. We also present a generalizable pipeline for quantitative analysis of peripheral nerve architecture. Our data demonstrate differences between male- and female-originating samples and similarities between the pelvic and abdominal vagus nerves.

59 BASIC BIOLOGICAL SCIENCES↗

Ultra-Structural Imaging Provides 3D Organization of 46 Chromosomes of a Human Lymphocyte Prophase Nucleus

Three dimensional (3D) ultra-structural imaging is an important tool for unraveling the organizational structure of individual chromosomes at various stages of the cell cycle. Performing hitherto uninvestigated ultra-structural analysis of the human genome at prophase, we used serial block-face scanning electron microscopy (SBFSEM) to understand chromosomal architectural organization within 3D nuclear space. Acquired images allowed us to segment, reconstruct, and extract quantitative 3D structural information about the prophase nucleus and the preserved, intact individual chromosomes within it. Our data demonstrate that each chromosome can be identified with its homolog and classified into respective cytogenetic groups. Thereby, we present the first 3D karyotype built from the compact axial structure seen on the core of all prophase chromosomes. The chromosomes display parallel-aligned sister chromatids with familiar chromosome morphologies with no crossovers. Furthermore, the spatial positions of all 46 chromosomes revealed a pattern showing a gene density-based correlation and a neighborhood map of individual chromosomes based on their relative spatial positioning. A comprehensive picture of 3D chromosomal organization at the nanometer level in a single human lymphocyte cell is presented.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

An Imaging Spectrometric Observatory (ISO)

The Imaging Spectrometric Observatory (ISO) is designed for low light level spectroscopy of both the day and night side of the earth. The instrument is composed of five spectrometers, each of which covers part of the total wavelength range of 30 to 1300 nm spanned by the instrument. Wavelength resolution varies between 0.2 and 0.6 nm over the spectral range. The five spectrometers are each optimized for a portion of the spectrum by the choice of mirror reflective coatings and detector photocathode materials. The full spectral range for each spectrometer is covered in a total of 11 grating steps. The Imaging Spectrometric Observatory was flown for the first time on the Spacelab 1 mission during which it acquired almost 40 hr of observations. The ISO investigation to be flown on the Atmospheric Laboratory for Applications and Science (ATLAS 1) mission will draw on the experience gained from the data gathered on Spacelab 1. The detector system in each spectrometer was upgraded to provide both higher sensitivity at low light levels and simultaneous imaging over larger spectral segments than was achieved on Spacelab 1. In addition, the instrument and the observing sequences were modified to allow observation of the sun in the extreme ultraviolet. A summary of ISO parameters for ATLAS 1 (scheduled for late 1990) is given.

Torr, M. R.↗

Commissioning Results on the JWST Testbed Telescope

The one-meter 18 segment JWST Testbed Telescope (TBT) has been developed at Ball Aerospace to facilitate commissioning operations for the JWST Observatory. Eight different commissioning activities were tested on the TBT: telescope focus sweep, segment ID and Search, image array, global alignment, image stacking, coarse phasing, fine phasing, and multi-field phasing. This paper describes recent commissioning results from experiments performed on the TBT.

Dean, Bruce H.↗

Deep Learning Segmentation of Complex Features in Atomic-Resolution Phase-Contrast Transmission Electron Microscopy Images

Phase-contrast transmission electron microscopy (TEM) is a powerful tool for imaging the local atomic structure of materials. TEM has been used heavily in studies of defect structures of two-dimensional materials such as monolayer graphene due to its high dose efficiency. However, phase-contrast imaging can produce complex nonlinear contrast, even for weakly scattering samples. It is, therefore, difficult to develop fully automated analysis routines for phase-contrast TEM studies using conventional image processing tools. For automated analysis of large sample regions of graphene, one of the key problems is segmentation between the structure of interest and unwanted structures such as surface contaminant layers. In this study, we compare the performance of a conventional Bragg filtering method with a deep learning routine based on the U-Net architecture. We show that the deep learning method is more general, simpler to apply in practice, and produces more accurate and robust results than the conventional algorithm. We provide easily adaptable source code for all results in this paper and discuss potential applications for deep learning in fully automated TEM image analysis.

47 OTHER INSTRUMENTATION↗

SU-D-202-02: Quantitative Imaging: Correlation Between Image Feature Analysis and the Accuracy of Manually Drawn Contours On PET Images

Purpose: To evaluate the correlation between image features and the accuracy of manually drawn target contours on synthetic PET images Methods: A digital PET phantom was used in combination with Monte Carlo simulation to create a set of 26 simulated PET images featuring a variety of tumor shapes and activity heterogeneity. These tumor volumes were used as a gold standard in comparisons with manual contours delineated by 10 radiation oncologist on the simulated PET images. Metrics used to evaluate segmentation accuracy included the dice coefficient, false positive dice, false negative dice, symmetric mean absolute surface distance, and absolute volumetric difference. Image features extracted from the simulated tumors consisted of volume, shape complexity, mean curvature, and intensity contrast along with five texture features derived from the gray-level neighborhood difference matrices including contrast, coarseness, busyness, strength, and complexity. Correlation between these features and contouring accuracy were examined. Results: Contour accuracy was reasonably well correlated with a variety of image features. Dice coefficient ranged from 0.7 to 0.90 and was correlated closely with contrast (r=0.43, p=0.02) and complexity (r=0.5, p<0.001). False negative dice ranged from 0.10 to 0.50 and was correlated closely with contrast (r=0.68, p<0.001) and complexity (r=0.66, p<0.001). Absolute volumetric difference ranged from 0.0002 to 0.67 and was correlated closely with coarseness (r=0.46, p=0.02) and complexity (r=0.49, p=0.008). Symmetric mean absolute difference ranged from 0.02 to 1 and was correlated closely with mean curvature (r=0.57, p=0.02) and contrast (r=0.6, p=0.001). Conclusion: The long term goal of this study is to assess whether contouring variability can be reduced by providing feedback to the practitioner based on image feature analysis. The results are encouraging and will be used to develop a statistical model which will enable a prediction of contour accuracy based purely on image feature analysis.

60 APPLIED LIFE SCIENCES↗

A Comparison of Local Variance, Fractal Dimension, and Moran's I as Aids to Multispectral Image Classification

The accuracy of traditional multispectral maximum-likelihood image classification is limited by the skewed statistical distributions of reflectances from the complex heterogenous mixture of land cover types in urban areas. This work examines the utility of local variance, fractal dimension and Moran's I index of spatial autocorrelation in segmenting multispectral satellite imagery. Tools available in the Image Characterization and Modeling System (ICAMS) were used to analyze Landsat 7 imagery of Atlanta, Georgia. Although segmentation of panchromatic images is possible using indicators of spatial complexity, different land covers often yield similar values of these indices. Better results are obtained when a surface of local fractal dimension or spatial autocorrelation is combined as an additional layer in a supervised maximum-likelihood multispectral classification. The addition of fractal dimension measures is particularly effective at resolving land cover classes within urbanized areas, as compared to per-pixel spectral classification techniques.

Emerson, Charles W.↗

The potential of positron emission tomography for intratreatment dynamic lung tumor tracking: A phantom study

Purpose: This study aims to evaluate the potential and feasibility of positron emission tomography for dynamic lung tumor tracking during radiation treatment. The authors propose a center of mass (CoM) tumor tracking algorithm using gated-PET images combined with a respiratory monitor and investigate the geometric accuracy of the proposed algorithm. Methods: The proposed PET dynamic lung tumor tracking algorithm estimated the target position information through the CoM of the segmented target volume on gated PET images reconstructed from accumulated coincidence events. The information was continuously updated throughout a scan based on the assumption that real-time processing was supported (actual processing time at each frame ≈10 s). External respiratory motion and list-mode PET data were acquired from a phantom programmed to move with measured respiratory traces (external respiratory motion and internal target motion) from human subjects, for which the ground truth target position was known as a function of time. The phantom was cylindrical with six hollow sphere targets (10, 13, 17, 22, 28, and 37 mm in diameter). The measured respiratory traces consisted of two sets: (1) 1D-measured motion from ten healthy volunteers and (2) 3D-measured motion from four lung cancer patients. The authors evaluated the geometric accuracy of the proposed algorithm by quantifying estimation errors (Euclidean distance) between the actual motion of targets (1D-motion and 3D-motion traces) and CoM trajectories estimated by the proposed algorithm as a function of time. Results: The time-averaged error of 1D-motion traces over all trajectories of all targets was 1.6 mm. The error trajectories decreased with time as coincidence events were accumulated. The overall error trajectory of 1D-motion traces converged to within 2 mm in approximately 90 s. As expected, more accurate results were obtained for larger targets. For example, for the 37 mm target, the average error over all 1D-motion traces was 1.1 mm; and for the 10 mm target, the average error over all 1D-motion traces was 2.8 mm. The overall time-averaged error of 3D-motion traces was 1.6 mm, which was comparable to that of the 1D-motion traces. There were small variations in the errors between the 3D-motion traces, although the motion trajectories were very different. The accuracy of the estimates was consistent for all targets except for the smallest. Conclusions: The authors developed an algorithm for dynamic lung tumor tracking using list-mode PET data and a respiratory motion signal, and demonstrated proof-of-principle for PET-guided lung tumor tracking. The overall tracking error in phantom studies is less than 2 mm.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Methods for increasing the sensitivity of gamma-ray imagers

Methods are presented that increase the position resolution and granularity of double sided segmented semiconductor detectors. These methods increase the imaging resolution capability of such detectors, either used as Compton cameras, or as position sensitive radiation detectors in imagers such as SPECT, PET, coded apertures, multi-pinhole imagers, or other spatial or temporal modulated imagers.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Automated segmentation of cerebral vasculature with aneurysms in 3DRA and TOF-MRA using geodesic active regions: An evaluation study

Purpose: To evaluate the suitability of an improved version of an automatic segmentation method based on geodesic active regions (GAR) for segmenting cerebral vasculature with aneurysms from 3D x-ray reconstruction angiography (3DRA) and time of flight magnetic resonance angiography (TOF-MRA) images available in the clinical routine. Methods: Three aspects of the GAR method have been improved: execution time, robustness to variability in imaging protocols, and robustness to variability in image spatial resolutions. The improved GAR was retrospectively evaluated on images from patients containing intracranial aneurysms in the area of the Circle of Willis and imaged with two modalities: 3DRA and TOF-MRA. Images were obtained from two clinical centers, each using different imaging equipment. Evaluation included qualitative and quantitative analyses of the segmentation results on 20 images from 10 patients. The gold standard was built from 660 cross-sections (33 per image) of vessels and aneurysms, manually measured by interventional neuroradiologists. GAR has also been compared to an interactive segmentation method: isointensity surface extraction (ISE). In addition, since patients had been imaged with the two modalities, we performed an intermodality agreement analysis with respect to both the manual measurements and each of the two segmentation methods. Results: Both GAR and ISE differed from the gold standard within acceptable limits compared to the imaging resolution. GAR (ISE) had an average accuracy of 0.20 (0.24) mm for 3DRA and 0.27 (0.30) mm for TOF-MRA, and had a repeatability of 0.05 (0.20) mm. Compared to ISE, GAR had a lower qualitative error in the vessel region and a lower quantitative error in the aneurysm region. The repeatability of GAR was superior to manual measurements and ISE. The intermodality agreement was similar between GAR and the manual measurements. Conclusions: The improved GAR method outperformed ISE qualitatively as well as quantitatively and is suitable for segmenting 3DRA and TOF-MRA images from clinical routine.

60 APPLIED LIFE SCIENCES↗

Automatic Feature Extraction from Planetary Images

With the launch of several planetary missions in the last decade, a large amount of planetary images has already been acquired and much more will be available for analysis in the coming years. The image data need to be analyzed, preferably by automatic processing techniques because of the huge amount of data. Although many automatic feature extraction methods have been proposed and utilized for Earth remote sensing images, these methods are not always applicable to planetary data that often present low contrast and uneven illumination characteristics. Different methods have already been presented for crater extraction from planetary images, but the detection of other types of planetary features has not been addressed yet. Here, we propose a new unsupervised method for the extraction of different features from the surface of the analyzed planet, based on the combination of several image processing techniques, including a watershed segmentation and the generalized Hough Transform. The method has many applications, among which image registration and can be applied to arbitrary planetary images.

Troglio, Giulia↗

Multispectral imaging of the lunar regolith core samples - Preliminary results for 74002

Multispectral images of a lunar core segment are a new form of continuous data along the length of the core. A new laboratory arrangement was developed to obtain these images. Data processing and initial data analysis for core section 74002 were performed. The images are sensitive to variations in mineralogy and/or maturity of the soil and are easily used (1) in stratigraphic studies of the lunar regolith, (2) for sample selection of representative material, and (3) as ground truth for remote sensing studies.

Pieters, C. M.↗

Four dimensional magnetic resonance imaging with retrospective k-space reordering: A feasibility study

Purpose: Current four dimensional magnetic resonance imaging (4D-MRI) techniques lack sufficient temporal/spatial resolution and consistent tumor contrast. To overcome these limitations, this study presents the development and initial evaluation of a new strategy for 4D-MRI which is based on retrospective k-space reordering. Methods: We simulated a k-space reordered 4D-MRI on a 4D digital extended cardiac-torso (XCAT) human phantom. A 2D echo planar imaging MRI sequence [frame rate (F) = 0.448 Hz; image resolution (R) = 256 × 256; number of k-space segments (N{sub KS}) = 4] with sequential image acquisition mode was assumed for the simulation. Image quality of the simulated “4D-MRI” acquired from the XCAT phantom was qualitatively evaluated, and tumor motion trajectories were compared to input signals. In particular, mean absolute amplitude differences (D) and cross correlation coefficients (CC) were calculated. Furthermore, to evaluate the data sufficient condition for the new 4D-MRI technique, a comprehensive simulation study was performed using 30 cancer patients’ respiratory profiles to study the relationships between data completeness (C{sub p}) and a number of impacting factors: the number of repeated scans (N{sub R}), number of slices (N{sub S}), number of respiratory phase bins (N{sub P}), N{sub KS}, F, R, and initial respiratory phase at image acquisition (P{sub 0}). As a proof-of-concept, we implemented the proposed k-space reordering 4D-MRI technique on a T2-weighted fast spin echo MR sequence and tested it on a healthy volunteer. Results: The simulated 4D-MRI acquired from the XCAT phantom matched closely to the original XCAT images. Tumor motion trajectories measured from the simulated 4D-MRI matched well with input signals (D = 0.83 and 0.83 mm, and CC = 0.998 and 0.992 in superior–inferior and anterior–posterior directions, respectively). The relationship between C{sub p} and N{sub R} was found best represented by an exponential function (C{sub P}=100(1−e{sup −0.18N{sub R}}), when N{sub S} = 30, N{sub P} = 6). At a C{sub P} value of 95%, the relative error in tumor volume was 0.66%, indicating that N{sub R} at a C{sub P} value of 95% (N{sub R,95%}) is sufficient. It was found that N{sub R,95%} is approximately linearly proportional to N{sub P} (r = 0.99), and nearly independent of all other factors. The 4D-MRI images of the healthy volunteer clearly demonstrated respiratory motion in the diaphragm region with minimal motion induced noise or aliasing. Conclusions: It is feasible to generate respiratory correlated 4D-MRI by retrospectively reordering k-space based on respiratory phase. This new technology may lead to the next generation 4D-MRI with high spatiotemporal resolution and optimal tumor contrast, holding great promises to improve the motion management in radiotherapy of mobile cancers.

60 APPLIED LIFE SCIENCES↗

Effect of color coding and subtraction on the accuracy of contrast echocardiography

BACKGROUND: Contrast echocardiography may be used to assess myocardial perfusion. However, gray scale assessment of myocardial contrast echocardiography (MCE) is difficult because of variations in regional backscatter intensity, difficulties in distinguishing varying shades of gray, and artifacts or attenuation. We sought to determine whether the assessment of rest myocardial perfusion by MCE could be improved with subtraction and color coding. METHODS AND RESULTS: MCE was performed in 31 patients with previous myocardial infarction with a 2nd generation agent (NC100100, Nycomed AS), using harmonic triggered or continuous imaging and gain settings were kept constant throughout the study. Digitized images were post processed by subtraction of baseline from contrast data and colorized to reflect the intensity of myocardial contrast. Gray scale MCE alone, MCE images combined with baseline and subtracted colorized images were scored independently using a 16 segment model. The presence and severity of myocardial contrast abnormalities were compared with perfusion defined by rest MIBI-SPECT. Segments that were not visualized by continuous (17%) or triggered imaging (14%) after color processing were excluded from further analysis. The specificity of gray scale MCE alone (56%) or MCE combined with baseline 2D (47%) was significantly enhanced by subtraction and color coding (76%, p<0.001) of triggered images. The accuracy of the gray scale approaches (respectively 52% and 47%) was increased to 70% (p<0.001). Similarly, for continuous images, the specificity of gray scale MCE with and without baseline comparison was 23% and 42% respectively, compared with 60% after post processing (p<0.001). The accuracy of colorized images (59%) was also significantly greater than gray scale MCE (43% and 29%, p<0.001). The sensitivity of MCE for both acquisitions was not altered by subtraction. CONCLUSION: Post-processing with subtraction and color coding significantly improves the accuracy and specificity of MCE for detection of perfusion defects.

Multicenter Study↗

Tree, Shrub, and Grass Classification Using Only RGB Images

In this work, a semantic segmentation-based deep learning method, DeepLabV3+, is applied to classify three vegetation land covers, which are tree, shrub, and grass using only three band color (RGB) images. DeepLabV3+’s detection performance has been studied on low and high resolution datasets that both contain tree, shrub, and grass and some other land cover types. The two datasets are heavily imbalanced where shrub pixels are much fewer than tree and grass pixels. A simple weighting strategy known as median frequency weighting was incorporated into DeepLabV3+ to mitigate the data imbalance issue, which originally used uniform weights. The tree, shrub, grass classification performances are compared when all land cover types are included in the classification and also when classification is limited to the three vegetation classes with both uniform and median frequency weights. Among the three vegetation types, shrub is found to be the most challenging one to classify correctly whereas correct classification accuracy was highest for tree. It is observed that even though the median frequency weighting did not improve the overall accuracy, it resulted in better classification accuracy for the underrepresented classes such as shrub in our case and it also significantly increased the average class accuracy. The classification performance and computation time comparison of DeepLabV3+ with two other pixel-based classification methods on sampled pixels of the three vegetation classes showed that DeepLabV3+ achieves significantly higher accuracy than these methods with a trade-off for longer model training time.

58 GEOSCIENCES↗

Characterization of masses in digital breast tomosynthesis: Comparison of machine learning in projection views and reconstructed slices

Purpose: In digital breast tomosynthesis (DBT), quasi-three-dimensional (3D) structural information is reconstructed from a small number of 2D projection view (PV) mammograms acquired over a limited angular range. The authors developed preliminary computer-aided diagnosis (CADx) methods for classification of malignant and benign masses and compared the effectiveness of analyzing lesion characteristics in the reconstructed DBT slices and in the PVs. Methods: A data set of MLO view DBT of 99 patients containing 107 masses (56 malignant and 51 benign) was collected at the Massachusetts General Hospital with IRB approval. The DBTs were obtained with a GE prototype system which acquired 11 PVs over a 50 deg. arc. The authors reconstructed the DBTs at 1 mm slice interval using a simultaneous algebraic reconstruction technique. The region of interest (ROI) containing the mass was marked by a radiologist in the DBT volume and the corresponding ROIs on the PVs were derived based on the imaging geometry. The subsequent processes were fully automated. For classification of masses using the DBT-slice approach, the mass on each slice was segmented by an active contour model initialized with adaptive k-means clustering. A spiculation likelihood map was generated by analysis of the gradient directions around the mass margin and spiculation features were extracted from the map. The rubber band straightening transform (RBST) was applied to a band of pixels around the segmented mass boundary. The RBST image was enhanced by Sobel filtering in the horizontal and vertical directions, from which run-length statistics texture features were extracted. Morphological features including those from the normalized radial length were designed to describe the mass shape. A feature space composed of the spiculation features, texture features, and morphological features extracted from the central slice alone and seven feature spaces obtained by averaging the corresponding features from three to 19 slices centered at the central slice were compared. For classification of masses using the PV approach, a feature extraction process similar to that described above for the DBT approach was performed on the ROIs from the individual PVs. Six feature spaces obtained from the central PV alone and by averaging the corresponding features from three to 11 PVs were formed. In each feature space for either the DBT-slice or the PV approach, a linear discriminant analysis classifier with stepwise feature selection was trained and tested using a two-loop leave-one-case-out resampling procedure. Simplex optimization was used to guide feature selection automatically within the training set in each leave-one-case-out cycle. The performance of the classifiers was evaluated by the area (A{sub z}) under the receiver operating characteristic curve. Results: The test A{sub z} values from the DBT-slice approach ranged from 0.87{+-}0.03 to 0.93{+-}0.02, while those from the PV approach ranged from 0.78{+-}0.04 to 0.84{+-}0.04. The highest test A{sub z} of 0.93{+-}0.02 from the nine-DBT-slice feature space was significantly (p=0.006) better than the highest test A{sub z} of 0.84{+-}0.04 from the nine-PV feature space. Conclusion: The features of breast lesions extracted from the DBT slices consistently provided higher classification accuracy than those extracted from the PV images.

60 APPLIED LIFE SCIENCES↗

TU-F-CAMPUS-I-02: Contrast Enhanced Cone Beam CT Imaging with Dual- Gantry Image Acquisition and Constrained Iterative Reconstruction-a Simulation Study for Liver Imaging Application

Purpose: Contrast time-density curves may help differentiate malignant tumors from normal tissues or benign tumors. Repetitive scans using conventional CT or cone beam CT techniques, which Result in unacceptably high dose, may not achieve the desired temporal resolution. In this study we describe and demonstrate a 4D imaging technique for imaging and quantifying contrast flows requiring only one or two 360° scans. Methods: A dual-gantry system is used to simultaneously acquire two projection images at orthogonal orientations. Following the scan, each or both of the two 360° projection sets are used to reconstruct an average contrast enhanced image set which is then segmented to form a 3D contrast map. Alternatively, a pre-injection scan may be made and used to reconstruct a pre-injection image set which is subtracted from the post-injection image set to form the 3D contrast map. Each of the two 360° projection sets is divided into 12 subsets, thus creating 12 pairs of 30° limited angle projection sets, each corresponding to a time spanning over 1/12 of the scanning time. Each pair of the projection sets are reconstructed as a time specific 3D image set with the maximum likelihood estimation iterative algorithm using the contrast map as the constraint. As a demonstration, a 4D abdominal phantom was constructed from clinical CT images with blood flow through the normal tissue and a tumor modeled and imaging process simulated. Results: We have successfully generated a 4D image phantom, and calculated the projection images. The time density curves derived from the reconstructed image set matched well with the flow model used to generate the phantom. Conclusion: Dual-gantry image acquisition and constrained iterative reconstruction algorithm may help to obtain time-density curves of contrast agents in blood flows, which may help differentiate malignant tumors from normal tissues or benign tumors.

60 APPLIED LIFE SCIENCES↗