Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image processing.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗

Assessment of the displacement field along a surface crack in a flat plate using optical techniques

Structural components may contain cracks, and for these components a crack tip represents a highly singular stress. The evaluation of the associated strain gradient is difficult to achieve with experimental discrete methods. An efficient alternative are the optical techniques which are non-contact, and so delivering continuous information of the displacement fields and associated derivatives for strain evaluation. This paper describes some experimental methods to fully characterize the displacement field near a crack tip existing in flat plates. Three optical field techniques based on image analysis were used in the present work; respectively, Electronic Speckle Pattern Interferometry, Moiré Interferometry, and Digital Image Correlation. These methods allow different resolutions which can be adjusted according to the expected strain gradient. While the first method depends on the laser wavelength and position of the illumination sources, the second depends on the grating pitch and the last on the surface texture or painted speckle. Algorithms to derivate and filtering the displacement field are developed to compute the strain field and will be used for further works.

36 MATERIALS SCIENCE↗

Quantitative order-parameter measurement in lattice-mismatched AlInP using precession electron diffraction

Precession electron diffraction (PED) was used to measure the long-range order parameter in lattice-mismatched AlInP epitaxial films under investigation for solid-state-lighting applications. Both double- and single-variant films grown at 620, 650, and 680°C were analyzed in TEM cross-section. PED patterns were acquired in selected-area-diffraction mode through external microscope control using serial acquisition, which allows inline image processing. The integrated peak intensities from experimental patterns were fit using dynamical simulations of diffraction from the ordered domain structures. Included in the structure-factor calculations were mean atomic displacements of the anions (P) due to ordering, which were found by valence-force-field calculations to have a nearly linear dependence on order parameter. A maximum order parameter of S = 0.36 was measured for a double-variant specimen grown at 650°C.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

OPEN leaf : an open‐source cloud‐based phenotyping system for tracking dynamic changes at leaf‐specific resolution in Arabidopsis

SUMMARY The first draft of the Arabidopsis genome was released more than 20 years ago and despite intensive molecular research, more than 30% of Arabidopsis genes remained uncharacterized or without an assigned function. This is in part due to gene redundancy within gene families or the essential nature of genes, where their deletion results in lethality (i.e., thedark genome). High‐throughput plant phenotyping (HTPP) offers an automated and unbiased approach to characterize subtle or transient phenotypes resulting from gene redundancy or inducible gene silencing; however, access to commercial HTPP platforms remains limited. Here we describe the design and implementation ofOPEN leaf, an open‐source phenotyping system with cloud connectivity and remote bilateral communication to facilitate data collection, sharing and processing.OPEN leaf, coupled with our SMART imaging processing pipeline was able to consistently document and quantify dynamic changes at the whole rosette level and leaf‐specific resolution when plants experienced changes in nutrient availability. Our data also demonstrate that VIS sensors remain underutilized and can be used in high‐throughput screens to identify and characterize previously unidentified phenotypes in a leaf‐specific time‐dependent manner. Moreover, the modular and open‐source design ofOPEN leafallows seamless integration of additional sensors based on users and experimental needs.

Plant Sciences↗

PT -symmetry in kagome photonic lattices

Photonic lattices composed of balanced gain and loss waveguides have attracted considerable attention due of their potential applications in optical beam engineering and image processing. These photonic lattices belong to a larger class of intriguing active metamaterials that exhibit the parity-time ( PT ) symmetry. Kagome lattice is a two-dimensional network of corner-sharing triangles and is often associated with geometrical frustration. In particular, the frustrated coupling between waveguide modes in a kagome array leads to a dispersionless flat band consisting of spatially localized modes. Recently, a PT -symmetric photonics lattice based on the kagome structure has been proposed by placing PT -symmetric dimers at the kagome lattice points. Each dimer corresponds to a pair of strongly coupled waveguides. With balanced arrangement of gain and loss on individual dimers, the system exhibits a PT -symmetric phase for finite gain/loss parameter up to a critical value. Here we discuss the linear and nonlinear optical beam propagations in this novel PT -symmetric kagome system. The linear beam evolution in this complex kagome waveguide array exhibits a novel oscillatory rotation of optical power along the propagation distance. Long-lived local chiral structures originating from the nearly flat bands of the kagome structure are observed when the lattice is subject to a narrow beam excitation. We further show that inclusion of Kerr-type nonlinearity leads to novel optical solitons.

42 ENGINEERING↗

Snapshot 3D tracking of insulin granules in live cells

Rapid and accurate volumetric imaging remains a challenge, yet has the potential to enhance understanding of cell function. We developed and used a multifocal microscope (MFM) for 3D snapshot imaging to allow 3D tracking of insulin granules labeled with mCherry in MIN6 cells. MFM employs a special diffractive optical element (DOE) to simultaneously image multiple focal planes. This simultaneous acquisition of information deteunines the 3D location of single objects at a speed only limited by the array detector's frame rate. We validated the accuracy of MFM imaging/tracking with fluorescence beads; the 3D positions and trajectories of single fluorescence beads can be detelinined accurately over a wide range of spatial and temporal scales. The 3D positions and trajectories of single insulin granules in a 3.2um deep volume were deteunined with imaging processing that combines 3D decovolution, shift correction, and finally tracking using the Imaris software package. We find that the motion of the granules is super diffusive, but less so in 3D than 2D for cells grown on coverslip surfaces, suggesting an anisotropy in the cytoskeleton (e.g. microtubules and action).

3D tracking↗

Terahertz time-domain spectroscopy imaging of pancreatic ductal adenocarcinoma tissues

Pancreatic ductal adenocarcinoma (PDAC) ranks among the malignancies with the highest fatality and morbidity rates. This is predominantly attributable to an absence of understanding the intricate and diverse microenvironment of the tumor. We use terahertz time-domain spectroscopy (THz-TDS) imaging in transmission geometry to probe ex-vivo the heterogenous microenvironment of the genetically modified murine PDAC tissue that closely resembles the PDAC heterogeneity in human malignancy. We introduced a maximum a-posteriori probability estimation algorithm to objectively the tumor’s heterogenous microenvironment using the average values of refractive index and absorption coefficient within the useable terahertz bandwidth as imaging markers. Furthermore, direct comparison of stained histopathologic images and the refractive index and the absorption coefficient high-resolution, two dimensional maps of the same PDAC samples confirms the high potential of the THz-TDS method for tumor tissue characterization.

absorption↗

A new generic method for the semi-automatic extraction of river and road networks in low and mid-resolution satellite images

This paper addresses the problem of semi-automatic extraction of road or hydrographic networks in satellite images. For that purpose, we propose an approach combining concepts arising from mathematical morphology and hydrology. The method exploits both geometrical and topological characteristics of rivers/roads and their tributaries in order to reconstruct the complete networks. It assumes that the images satisfy the following two general assumptions, which are the minimum conditions for a road/river network to be identifiable and are usually verified in low- to mid-resolution satellite images: (i) visual constraint: most pixels composing the network have similar spectral signature that is distinguishable from most of the surrounding areas; (ii) geometric constraint: a line is a region that is relatively long and narrow, compared with other objects in the image. While this approach fully exploits local (roads/rivers are modeled as elongated regions with a smooth spectral signature in the image and a maximum width) and global (they are structured like a tree) characteristics of the networks, further directional information about the image structures is incorporated. Namely, an appropriate anisotropic metric is designed by using both the characteristic features of the target network and the eigen-decomposition of the gradient structure tensor of the image. Following, the geodesic propagation from a given network seed with this metric is combined with hydrological operators for overland flow simulation to extract the paths which contain most line evidence and identify them with the target network.

47 OTHER INSTRUMENTATION↗

Tomographic image via background subtraction using an x-ray projection image and a priori computed tomography

Kilovoltage x-ray projection images (kV images for brevity) are increasingly available in image guided radiotherapy (IGRT) for patient positioning. These images are two-dimensional (2D) projections of a three-dimensional (3D) object along the x-ray beam direction. Projecting a 3D object onto a plane may lead to ambiguities in the identification of anatomical structures and to poor contrast in kV images. Therefore, the use of kV images in IGRT is mainly limited to bony landmark alignments. This work proposes a novel subtraction technique that isolates a slice of interest (SOI) from a kV image with the assistance of a priori information from a previous CT scan. The method separates structural information within a preselected SOI by suppressing contributions to the unprocessed projection from out-of-SOI-plane structures. Up to a five-fold increase in the contrast-to-noise ratios (CNRs) was observed in selected regions of the isolated SOI, when compared to the original unprocessed kV image. The tomographic image via background subtraction (TIBS) technique aims to provide a quick snapshot of the slice of interest with greatly enhanced image contrast over conventional kV x-ray projections for fast and accurate image guidance of radiation therapy. With further refinements, TIBS could, in principle, provide real-time tumor localization using gantry-mounted x-ray imaging systems without the need for implanted markers.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

2D-3D registration for prostate radiation therapy based on a statistical model of transmission images

Purpose: In external beam radiation therapy of pelvic sites, patient setup errors can be quantified by registering 2D projection radiographs acquired during treatment to a 3D planning computed tomograph (CT). We present a 2D-3D registration framework based on a statistical model of the intensity values in the two imaging modalities. Methods: The model assumes that intensity values in projection radiographs are independently but not identically distributed due to the nonstationary nature of photon counting noise. Two probability distributions are considered for the intensity values: Poisson and Gaussian. Using maximum likelihood estimation, two similarity measures, maximum likelihood with a Poisson (MLP) and maximum likelihood with Gaussian (MLG), distribution are derived. Further, we investigate the merit of the model-based registration approach for data obtained with current imaging equipment and doses by comparing the performance of the similarity measures derived to that of the Pearson correlation coefficient (ICC) on accurately collected data of an anthropomorphic phantom of the pelvis and on patient data. Results: Registration accuracy was similar for all three similarity measures and surpassed current clinical requirements of 3 mm for pelvic sites. For pose determination experiments with a kilovoltage (kV) cone-beam CT (CBCT) and kV projection radiographs of the phantom in the anterior-posterior (AP) view, registration accuracies were 0.42 mm (MLP), 0.29 mm (MLG), and 0.29 mm (ICC). For kV CBCT and megavoltage (MV) AP portal images of the same phantom, registration accuracies were 1.15 mm (MLP), 0.90 mm (MLG), and 0.69 mm (ICC). Registration of a kV CT and MV AP portal images of a patient was successful in all instances. Conclusions: The results indicate that high registration accuracy is achievable with multiple methods including methods that are based on a statistical model of a 3D CT and 2D projection images.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Evaluation of scatter effects on image quality for breast tomosynthesis

Digital breast tomosynthesis uses a limited number (typically 10-20) of low-dose x-ray projections to produce a pseudo-three-dimensional volume tomographic reconstruction of the breast. The purpose of this investigation was to characterize and evaluate the effect of scattered radiation on the image quality for breast tomosynthesis. In a simulation, scatter point spread functions generated by a Monte Carlo simulation method were convolved over the breast projection to estimate the distribution of scatter for each angle of tomosynthesis projection. The results demonstrate that in the absence of scatter reduction techniques, images will be affected by cupping artifacts, and there will be reduced accuracy of attenuation values inferred from the reconstructed images. The effect of x-ray scatter on the contrast, noise, and lesion signal-difference-to-noise ratio (SDNR) in tomosynthesis reconstruction was measured as a function of the tumor size. When a with-scatter reconstruction was compared to one without scatter for a 5 cm compressed breast, the following results were observed. The contrast in the reconstructed central slice image of a tumorlike mass (14 mm in diameter) was reduced by 30%, the voxel value (inferred attenuation coefficient) was reduced by 28%, and the SDNR fell by 60%. The authors have quantified the degree to which scatter degrades the image quality over a wide range of parameters relevant to breast tomosynthesis, including x-ray beam energy, breast thickness, breast diameter, and breast composition. They also demonstrate, though, that even without a scatter rejection device, the contrast and SDNR in the reconstructed tomosynthesis slice are higher than those of conventional mammographic projection images acquired with a grid at an equivalent total exposure.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Three-dimensional ultrasound system for guided breast brachytherapy

Breast-conserving surgery combined with subsequent radiation therapy is a standard procedure in breast cancer treatment. The disadvantage of whole-breast beam irradiation is that it requires 20-25 treatment days, which is inconvenient for patients with limited mobility or who reside far from the treatment center. However, interstitial high-dose-rate (HDR) brachytherapy is an irradiation method requiring only 5 treatment days and that delivers a lower radiation dose to the surrounding healthy tissue. It involves delivering radiation through {sup 192}Ir seeds placed inside the catheters, which are inserted into the breast. The catheters are attached to a HDR afterloader, which controls the seed placement within the catheters and irradiation times to deliver the proper radiation dose. One disadvantage of using HDR brachytherapy is that it requires performing at least one CT scan during treatment planning. The procedure at our institution involves the use of two CT scans. Performing CT scans requires moving the patient from the brachytherapy suite with catheters inserted in their breasts. One alternative is using three-dimensional ultrasound (3DUS) to image the patient. In this study, the authors developed a 3DUS translation scanning system for use in breast brachytherapy. The new system was validated using CT, the current clinical standard, to image catheters in a breast phantom. Once the CT and 3DUS images were registered, the catheter trajectories were then compared. The results showed that the average angular separation between catheter trajectories was 2.4 deg., the average maximum trajectory separation was 1.0 mm, and the average mean trajectory separation was found to be 0.7 mm. In this article, the authors present the 3DUS translation scanning system's capabilities as well as its potential to be used as the primary treatment planning imaging modality in breast brachytherapy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Coronary centerline extraction from CT coronary angiography images using a minimum cost path approach

Purpose: The application and large-scale evaluation of minimum cost path approaches for coronary centerline extraction from computed tomography coronary angiography (CTCA) data and the development and evaluation of a novel method to reduce the user-interaction time. Methods: A semiautomatic method based on a minimum cost path approach is evaluated for two different cost functions. The first cost function is based on a frequently used vesselness measure and intensity information, and the second is a recently proposed cost function based on region statistics. User interaction is minimized to one or two mouse clicks distally in the coronary artery. The starting point for the minimum cost path search is automatically determined using a newly developed method that finds a point in the center of the aorta in one of the axial slices. This step ensures that all computationally expensive parts of the algorithm can be precomputed. Results: The performance of the aorta localization procedure was demonstrated by a success rate of 100% in 75 images. The success rate and accuracy of centerline extraction was quantitatively evaluated on 48 coronary arteries in 12 images by comparing extracted centerlines with a manually annotated reference standard. The method was able to extract 88% and 47% of the vessel centerlines correctly using the vesselness/intensity and region statistics cost function, respectively. For only the proximal part of the vessels these values were 97% and 86%, respectively. Accuracy of centerline extraction, defined as the average distance from correctly automatically extracted parts of the centerline to the reference standard, was 0.64 mm for the vesselness/intensity and 0.51 mm for the region statistics cost function. The interobserver variability was 99% for the success rate measure and 0.42 mm for the accuracy measure. Qualitative evaluation using the best performing cost function resulted in successful centerline extraction for 233 out of the 252 coronaries (92%) in 63 additional CTCA images. Conclusions: The presented results, in combination with minimal user interaction and low computation time, show that minimum cost path approaches can effectively be applied as a preprocessing step for subsequent analysis in clinical practice and biomedical research.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Correcting magnetic resonance k-space data for in-plane motion using an optical position tracking system

Purpose: Motion is a major confound of image quality in MRI. A method of retrospectively correcting the effects of rotations and translations on the acquired k-space data is presented. Methods: In two phantom experiments of well-controlled translation and rotation, two MRI-compatible infrared cameras recorded motion data that were used subsequently to correct the position and phase of recorded k-space samples. Motion data can be acquired with a temporal resolution of 60 Hz and spatial accuracy of 0.1 mm for translations and 0.2 deg. for rotations. Results: Significant improvements of image quality are demonstrated. Conclusions: The key advantages of the technique are that it is easy to implement, does not interfere with or complicate MR data acquisition, and is capable of correcting distortions within a single slice. Therefore, the technique has the potential to improve upon approaches that rely on the registration or realignment of successive imaging slices.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Partial scan artifact reduction (PSAR) for the assessment of cardiac perfusion in dynamic phase-correlated CT

Purpose: Cardiac CT achieves its high temporal resolution by lowering the scan range from 2{pi} to {pi} plus fan angle (partial scan). This, however, introduces CT-value variations, depending on the angular position of the {pi} range. These partial scan artifacts are of the order of a few HU and prevent the quantitative evaluation of perfusion measurements. The authors present the new algorithm partial scan artifact reduction (PSAR) that corrects a dynamic phase-correlated scan without a priori information. Methods: In general, a full scan does not suffer from partial scan artifacts since all projections in [0, 2{pi}] contribute to the data. To maintain the optimum temporal resolution and the phase correlation, PSAR creates an artificial full scan p{sub n}{sup AF} by projectionwise averaging a set of neighboring partial scans p{sub n}{sup P} from the same perfusion examination (typically N{approx_equal}30 phase-correlated partial scans distributed over 20 s and n=1,...,N). Corresponding to the angular range of each partial scan, the authors extract virtual partial scans p{sub n}{sup V} from the artificial full scan p{sub n}{sup AF}. A standard reconstruction yields the corresponding images f{sub n}{sup P}, f{sub n}{sup AF}, and f{sub n}{sup V}. Subtracting the virtual partial scan image f{sub n}{sup V} from the artificial full scan image f{sub n}{sup AF} yields an artifact image that can be used to correct the original partial scan image: f{sub n}{sup C}=f{sub n}{sup P}-f{sub n}{sup V}+f{sub n}{sup AF}, where f{sub n}{sup C} is the corrected image. Results: The authors evaluated the effects of scattered radiation on the partial scan artifacts using simulated and measured water phantoms and found a strong correlation. The PSAR algorithm has been validated with a simulated semianthropomorphic heart phantom and with measurements of a dynamic biological perfusion phantom. For the stationary phantoms, real full scans have been performed to provide theoretical reference values. The improvement in the root mean square errors between the full and the partial scans with respect to the errors between the full and the corrected scans is up to 54% for the simulations and 90% for the measurements. Conclusions: The phase-correlated data now appear accurate enough for a quantitative analysis of cardiac perfusion.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Technical Note: Deformable image registration on partially matched images for radiotherapy applications

In radiation therapy applications, deformable image registrations (DIRs) are often carried out between two images that only partially match. Image mismatching could present as superior-inferior coverage differences, field-of-view (FOV) cutoffs, or motion crossing the image boundaries. In this study, the authors propose a method to improve the existing DIR algorithms so that DIR can be carried out in such situations. The basic idea is to extend the image volumes and define the extension voxels (outside the FOV or outside the original image volume) as NaN (not-a-number) values that are transparent to all floating-point computations in the DIR algorithms. Registrations are then carried out with one additional rule that NaN voxels can match any voxels. In this way, the matched sections of the images are registered properly, and the mismatched sections of the images are registered to NaN voxels. This method makes it possible to perform DIR on partially matched images that otherwise are difficult to register. It may also improve DIR accuracy, especially near or in the mismatched image regions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Noise texture and signal detectability in propagation-based x-ray phase-contrast tomography

Purpose: X-ray phase-contrast tomography (PCT) is a rapidly emerging imaging modality for reconstructing estimates of an object's three-dimensional x-ray refractive index distribution. Unlike conventional x-ray computed tomography methods, the statistical properties of the reconstructed images in PCT remain unexplored. The purpose of this work is to quantitatively investigate noise propagation in PCT image reconstruction. Methods: The authors derived explicit expressions for the autocovariance of the reconstructed absorption and refractive index images to characterize noise texture and understand how the noise properties are influenced by the imaging geometry. Concepts from statistical detection theory were employed to understand how the imaging geometry-dependent statistical properties affect the signal detection performance in a signal-known-exactly/background-known-exactly task. Results: The analytical formulas for the phase and absorption autocovariance functions were implemented numerically and compared to the corresponding empirical values, and excellent agreement was found. They observed that the reconstructed refractive images are highly spatially correlated, while the absorption images are not. The numerical results confirm that the strength of the covariance is scaled by the detector spacing. Signal detection studies were conducted, employing a numerical observer. The detection performance was found to monotonically increase as the detector-plane spacing was increased. Conclusions: The authors have conducted the first quantitative investigation of noise propagation in PCT image reconstruction. The reconstructed refractive images were found to be highly spatially correlated, while absorption images were not. This is due to the presence of a Fourier space singularity in the reconstruction formula for the refraction images. The statistical analysis may facilitate the use of task-based image quality measures to further develop and optimize this emerging modality for specific applications.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Dynamic multiple thresholding breast boundary detection algorithm for mammograms

Purpose: Automated detection of breast boundary is one of the fundamental steps for computer-aided analysis of mammograms. In this study, the authors developed a new dynamic multiple thresholding based breast boundary (MTBB) detection method for digitized mammograms. Methods: A large data set of 716 screen-film mammograms (442 CC view and 274 MLO view) obtained from consecutive cases of an Institutional Review Board approved project were used. An experienced breast radiologist manually traced the breast boundary on each digitized image using a graphical interface to provide a reference standard. The initial breast boundary (MTBB-Initial) was obtained by dynamically adapting the threshold to the gray level range in local regions of the breast periphery. The initial breast boundary was then refined by using gradient information from horizontal and vertical Sobel filtering to obtain the final breast boundary (MTBB-Final). The accuracy of the breast boundary detection algorithm was evaluated by comparison with the reference standard using three performance metrics: The Hausdorff distance (HDist), the average minimum Euclidean distance (AMinDist), and the area overlap measure (AOM). Results: In comparison with the authors' previously developed gradient-based breast boundary (GBB) algorithm, it was found that 68%, 85%, and 94% of images had HDist errors less than 6 pixels (4.8 mm) for GBB, MTBB-Initial, and MTBB-Final, respectively. 89%, 90%, and 96% of images had AMinDist errors less than 1.5 pixels (1.2 mm) for GBB, MTBB-Initial, and MTBB-Final, respectively. 96%, 98%, and 99% of images had AOM values larger than 0.9 for GBB, MTBB-Initial, and MTBB-Final, respectively. The improvement by the MTBB-Final method was statistically significant for all the evaluation measures by the Wilcoxon signed rank test (p<0.0001). Conclusions: The MTBB approach that combined dynamic multiple thresholding and gradient information provided better performance than the breast boundary detection algorithm that mainly used gradient information.

62 RADIOLOGY AND NUCLEAR MEDICINE↗