Search NASA⌕ Search

SEARCH · Search NASA

Results for “image alignment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Depth-resolved registration of transesophageal echo to x-ray fluoroscopy using an inverse geometry fluoroscopy system

Purpose: Image registration between standard x-ray fluoroscopy and transesophageal echocardiography (TEE) has recently been proposed. Scanning-beam digital x-ray (SBDX) is an inverse geometry fluoroscopy system designed for cardiac procedures. This study presents a method for 3D registration of SBDX and TEE images based on the tomosynthesis and 3D tracking capabilities of SBDX. Methods: The registration algorithm utilizes the stack of tomosynthetic planes produced by the SBDX system to estimate the physical 3D coordinates of salient key-points on the TEE probe. The key-points are used to arrive at an initial estimate of the probe pose, which is then refined using a 2D/3D registration method adapted for inverse geometry fluoroscopy. A phantom study was conducted to evaluate probe pose estimation accuracy relative to the ground truth, as defined by a set of coregistered fiducial markers. This experiment was conducted with varying probe poses and levels of signal difference-to-noise ratio (SDNR). Additional phantom and in vivo studies were performed to evaluate the correspondence of catheter tip positions in TEE and x-ray images following registration of the two modalities. Results: Target registration error (TRE) was used to characterize both pose estimation and registration accuracy. In the study of pose estimation accuracy, successful pose estimates (3D TRE < 5.0 mm) were obtained in 97% of cases when the SDNR was 5.9 or higher in seven out of eight poses. Under these conditions, 3D TRE was 2.32 ± 1.88 mm, and 2D (projection) TRE was 1.61 ± 1.36 mm. Probe localization error along the source-detector axis was 0.87 ± 1.31 mm. For the in vivo experiments, mean 3D TRE ranged from 2.6 to 4.6 mm and mean 2D TRE ranged from 1.1 to 1.6 mm. Anatomy extracted from the echo images appeared well aligned when projected onto the SBDX images. Conclusions: Full 6 DOF image registration between SBDX and TEE is feasible and accurate to within 5 mm. Future studies will focus on real-time implementation and application-specific analysis.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

WE-H-207A-05: Spatial Co-Localization of F-18 NaF Vs. F-18 FDG Defined Disease Volumes

Purpose: Both [F-18]NaF and [F-18]FDG show promise for quantitative PET/CT assessment in metastatic prostate cancer to bone. Broad agreement between the tracers has been shown but voxel-wise correspondence has not been explored in depth. This study evaluates the spatial co-localization of [F-18]NaF PET and [F-18]FDG PET in bone lesions. Methods: Seventy-three lesion contours were identified in six patients receiving dynamic NaF PET/CT and FDG PET/CT scans two hours apart using identical fields-of-view. Tracer uptake (SUV) reflecting 60 minutes post-injection was modeled from kinetic parameters. Lesions were segmented by a physician separately on NaF PET and FDG PET. PET images were rigidly aligned using skeletal references on CT images. Lesion size, degree of overlap, voxel-wise tracer uptake values (SUV), and CT density distributions were compared using Dice coefficient, Positive Predictive Value (PPV), and Spearman rank correlation tests. Results: Across all patients, 42 lesions were identified on NaF PET (median 1.4 cm{sup 3}, range <1–204 cm{sup 3}) compared to 31 using FDG PET (median 1.8 cm{sup 3}, range <1–244 cm{sup 3}). Spatial cooccurrence was found in 25 lesion pairs. Lesions on NaF PET had PPV of 0.91 and on FDG a PPV of 0.65. Overall, NaF-defined lesions were 47% (±24%) larger by volume with moderate overlap to FDG, resulting in mean Dice coefficient of 34% (±22%). In areas of overlap, voxel-wise correlation of NaF and FDG SUV was moderate (ρ=0.56). Expanding to regions of non-spatial overlap, voxels contained in FDG-only contours were almost exclusively low HU (median 118), compared to dense regions of NaF-only voxels (median 250). In sclerotic sub-volumes (HU > 300) NaF-defined contours encompassed 83% of total FDG volume. Conclusion: Moderate voxel-wise correlation of FDG and NaF PET/CT uptake was observed. Spatial discrepancies in FDG and NaF PET/CT imaging of boney metastases could be influenced by poor sensitivity of FDG PET/CT in sclerotic regions. Funded by Prostate Cancer Foundation.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Polyolefin blends with co-continuous architectures enabled by dynamic covalent crosslinking

Blending polymers produces brittle materials due to macrophase separation and poor interfacial adhesion, which is exemplified by mixtures of polyolefins. This presents a formidable challenge for the mechanical recycling of mixed plastic waste. Here, we demonstrate that dynamic covalent crosslinking of immiscible polyolefin blends creates macrophase separated co-continuous architectures, yet they display excellent mechanical properties, which challenges the conventional wisdom regarding morphology-property relationships in polymer blend compatibilization. We find that the position and orientation of dynamic crosslinks and their influence on crystallinity are key to understanding the structure-morphology-property relationships. In particular, high-resolution microscopy imaging reveals alignment of crystallite planes with strong orientational preference, particularly at polymer-polymer interfaces, which contribute to material performance. We further demonstrate that changes in crosslinker density and valency allow the properties of binary and ternary polyolefin blends to be tuned in a modular fashion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Toward Improving the Generation Quality of Autoregressive Slot VAEs

Unconditional scene inference and generation are challenging to learn jointly with a single compositional model. Despite encouraging progress on models that extract object-centric representations (“slots”) from images, unconditional generation of scenes from slots has received less attention. This is primarily because learning the multiobject relations necessary to imagine coherent scenes is difficult. We hypothesize that most existing slot-based models have a limited ability to learn object correlations. We propose two improvements that strengthen object correlation learning. The first is to condition the slots on a global, scene-level variable that captures higher-order correlations between slots. Second, we address the fundamental lack of a canonical order for objects in images by proposing to learn a consistent order to use for the autoregressive generation of scene objects. Specifically, we train an autoregressive slot prior to sequentially generate scene objects following a learned order. Ordered slot inference entails first estimating a randomly ordered set of slots using existing approaches for extracting slots from images, then aligning those slots to ordered slots generated autoregressively with the slot prior. Our experiments across three multiobject environments demonstrate clear gains in unconditional scene generation quality. Detailed ablation studies are also provided that validate the two proposed improvements.

MATHEMATICS AND COMPUTING↗
NASA NTRS1994

The Transition Region And Coronal Explorer (TRACE)

The objectives and the characteristics of TRACE, selected as a NASA small explorer mission for development and flight in late 1997, is presented. The TRACE science investigation explores the connections between fine-scale magnetic fields and the associated plasma structures on the sun. The instrument collects images of solar plasmas at temperatures from 10(exp 4) to 10(exp 7) K, with an arc second spatial resolution and good temporal resolution and continuum. TRACE and SOHO will gather simultaneous, digital measurements of all temperature regimes of the solar atmospheric, in both high-resolution imaging and spectroscopy, and magnetogram to photosphere. The 30 cm aperture TRACE telescope uses three normal-incidence coatings for the extreme ultraviolet and one for the ultraviolet on quadrants of the primary and secondary mirrors. Interference filters isolate five different ultraviolet bands. The images are aligned and internally stabilized against spacecraft jitter. TRACE will be launched into a sun-synchronous orbit, allowing continuous observing for eight months of the baseline one-year mission. It will be operated in coordination with the SOHO experiment operations facility.

Tarbell, T. D.↗
NASA NTRS1995

Laser-Beam-Alignment Controller

In laser-beam-alignment controller, images from video camera compared to reference patterns by fuzzy-logic pattern comparator. Results processed by fuzzy-logic microcontroller, which sends control signals to motor driver adjusting lens and pinhole in spatial filter.

Krasowski, M. J.↗
NASA NTRS2000

Poster Presentation: Optical Test of NGST Developmental Mirrors

An Optical Testing System (OTS) has been developed to measure the figure and radius of curvature of NGST developmental mirrors in the vacuum, cryogenic environment of the X-Ray Calibration Facility (XRCF) at Marshall Space Flight Center (MSFC). The OTS consists of a WaveScope Shack-Hartmann sensor from Adaptive Optics Associates as the main instrument, a Point Diffraction Interferometer (PDI), a Point Spread Function (PSF) imager, an alignment system, a Leica Disto Pro distance measurement instrument, and a laser source palette (632.8 nm wavelength) that is fiber-coupled to the sensor instruments. All of the instruments except the laser source palette are located on a single breadboard known as the Wavefront Sensor Pallet (WSP). The WSP is located on top of a 5-DOF motion system located at the center of curvature of the test mirror. Two PC's are used to control the OTS. The error in the figure measurement is dominated by the WaveScope's measurement error. An analysis using the absolute wavefront gradient error of 1/50 wave P-V (at 0.6328 microns) provided by the manufacturer leads to a total surface figure measurement error of approximately 1/100 wave rms. This easily meets the requirement of 1/10 wave P-V. The error in radius of curvature is dominated by the Leica's absolute measurement error of VI.5 mm and the focus setting error of Vi.4 mm, giving an overall error of V2 mm. The OTS is currently being used to test the NGST Mirror System Demonstrators (NMSD's) and the Subscale Beryllium Mirror Demonstrator (SBNM).

Hadaway, James B.↗
NASA NTRS2003

Three-Dimensional Morphological Analysis of ALH84001 Magnetite Using Electron Tomography

We report here the crystal morphologies of MV-1 and ALH84001 magnetites as calculated by back-projection using electron tomography. In the present study, we used a 300 keV TEM with a field emission gun (Tecnai F-30 from FEI Inc.), equipped with a 2048 x 2048 pixel CCD camera from Gatan Inc. to image magnetite crystals over tilt ranges of approx. +/- 72 deg in 2 deg tilt intervals. The images were aligned for back-projection, either manually, or through the use of fiducial 5 nm Au spheres affixed to the specimen prior to microscopy. Three-dimensional (3-D) reconstructions were computed using weighted back-projection of the tilted views. The tomograms were viewed and analyzed as a series of slices 1.0 nm thick, taken parallel to the specimen-supporting grid, using the IMOD software package. The shape of each magnetite crystal was determined by defining the external contour of a given magnetite in each slice and assembling a stack of these contours in 3-D. To aid in visualization, the stacked contour array was reduced to an optimal mesh by Delaunay triangulation. The surface normal to each of the triangles in the mesh was calculated and the triangle faces colored according to the orientation of that surface normal relative to the principal crystallographic axis of magnetite. Green surfaces correspond to {111} orientations, blue surfaces to {100} orientations, and red surfaces to {110} orientations. Triangles whose surface normal did not correspond to one of the principal axes were colored gray. Within the experimental and numerical uncertainties of the deconvolution, the tomographic reconstruction of both MV-1 and ALH84001 magnetites are equivalent and correspond to a truncated hexa-octahedral morphology.

Thomas-Keprta, Kathie L.↗
DOE OSTI2026

INR-TEM: Robust cavity detection in multifocus TEM images via implicit neural representations

When characterizing materials using transmission electron microscopy (TEM) images, detecting and quantifying small features in microstructures, such as cavities, pose significant challenges. Off-the-shelf object detection models, including YOLOv8, show considerable performance degradation, particularly when images vary in resolution and the objects of interest possess a low percentage of the total image region of interest. In this study, we introduce a novel detection pipeline that incorporates an implicit neural representation (INR)-based detection method, INR-TEM, and two-modality imaging (e.g., under-focused and over-focused images typically acquired during materials characterization) to improve object detection performance. The INR-TEM method incorporates a pixel-wise prediction principle inspired by pixel-wise centerness weighting. INR-TEM demonstrates superior robustness to resolution variability, maintaining high detection accuracy even at low image resolutions compared to YOLOv8. To leverage INR-TEM effectively in real-world two-modality characterization applications, we further integrate a two-stage motion correction pipeline designed explicitly for aligning multifocus TEM images. The alignment process, comprising keypoint (based on scale-invariant feature transform, SIFT) and intensity matching, significantly mitigates the adverse effects of perceived motion-induced image degradation during through-focal TEM imaging, directly enhancing INR-TEM’s detection capability over conventional single-focus images. Our integrated INR-TEM cavity detection framework notably improves performance across various cavity sizes, outperforming off-the-shelf YOLOv8 detections that rely on a single image modality.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2016

Precision Instrument Targeting via Image Registration for the Mars 2020 Rover

A key component of Mars exploration is the operation of robotic instruments on the surface, such as those on board the Mars Exploration Rovers, the Mars Science Laboratory (MSL), and the planned Mars 2020 Rover. As the instruments carried by these rovers have become more advanced, the area targeted by some instruments becomes smaller, revealing more fine-grained details about the geology and chemistry of rocks on the surface. However, thermal fluctuations, rover settling or slipping, and inherent inaccuracies in pointing mechanisms all lead to pointing error that is on the order of the target size (several millimeters) or larger. We show that given a target located on a previously acquired image, the rover can align this with a new image to visually locate the target and refine the current pointing. Due to round-trip communication constraints, this visual targeting must be done efficiently on board the rover using relatively limited computing hardware. We employ existing ORB features for landmark-based image registration, describe and theoretically justify a novel approach to filtering false landmark matches, and employ a random forest classifier to automatically reject failed alignments. We demonstrate the efficacy of our approach using over 3,800 images acquired by Remote Micro-Imager on board the “Curiosity” rover.

Doran, Gary↗
NASA NTRS2005

Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery

The problem of image registration, or the alignment of two or more images representing the same scene or object, has to be addressed in various disciplines that employ digital imaging. In the area of remote sensing, just like in medical imaging or computer vision, it is necessary to design robust, fast, and widely applicable algorithms that would allow automatic registration of images generated by various imaging platforms at the same or different times and that would provide subpixel accuracy. One of the main issues that needs to be addressed when developing a registration algorithm is what type of information should be extracted from the images being registered, to be used in the search for the geometric transformation that best aligns them. The main objective of this paper is to evaluate several wavelet pyramids that may be used both for invariant feature extraction and for representing images at multiple spatial resolutions to accelerate registration. We find that the bandpass wavelets obtained from the steerable pyramid due to Simoncelli performs best in terms of accuracy and consistency, while the low-pass wavelets obtained from the same pyramid give the best results in terms of the radius of convergence. Based on these findings, we propose a modification of a gradient-based registration algorithm that has recently been developed for medical data. We test the modified algorithm on several sets of real and synthetic satellite imagery.

Evaluation Studies↗
DOE OSTI2015

THE DIFFERENCE IMAGING PIPELINE FOR THE TRANSIENT SEARCH IN THE DARK ENERGY SURVEY

We describe the operation and performance of the difference imaging pipeline (DiffImg) used to detect transients in deep images from the Dark Energy Survey Supernova program (DES-SN) in its first observing season from 2013 August through 2014 February. DES-SN is a search for transients in which ten 3 deg{sup 2} fields are repeatedly observed in the g, r, i, z passbands with a cadence of about 1 week. The observing strategy has been optimized to measure high-quality light curves and redshifts for thousands of Type Ia supernovae (SNe Ia) with the goal of measuring dark energy parameters. The essential DiffImg functions are to align each search image to a deep reference image, do a pixel-by-pixel subtraction, and then examine the subtracted image for significant positive detections of point-source objects. The vast majority of detections are subtraction artifacts, but after selection requirements and image filtering with an automated scanning program, there are ∼130 detections per deg{sup 2} per observation in each band, of which only ∼25% are artifacts. Of the ∼7500 transients discovered by DES-SN in its first observing season, each requiring a detection on at least two separate nights, Monte Carlo (MC) simulations predict that 27% are expected to be SNe Ia or core-collapse SNe. Another ∼30% of the transients are artifacts in which a small number of observations satisfy the selection criteria for a single-epoch detection. Spectroscopic analysis shows that most of the remaining transients are AGNs and variable stars. Fake SNe Ia are overlaid onto the images to rigorously evaluate detection efficiencies and to understand the DiffImg performance. The DiffImg efficiency measured with fake SNe agrees well with expectations from a MC simulation that uses analytical calculations of the fluxes and their uncertainties. In our 8 “shallow” fields with single-epoch 50% completeness depth ∼23.5, the SN Ia efficiency falls to 1/2 at redshift z ≈ 0.7; in our 2 “deep” fields with mag-depth ∼24.5, the efficiency falls to 1/2 at z ≈ 1.1. A remaining performance issue is that the measured fluxes have additional scatter (beyond Poisson fluctuations) that increases with the host galaxy surface brightness at the transient location. This bright-galaxy issue has minimal impact on the SNe Ia program, but it may lower the efficiency for finding fainter transients on bright galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1987

Calibrating AIS images using the surface as a reference

A method of evaluating the initial assumptions and uncertainties of the physical connection between Airborne Imaging Spectrometer (AIS) image data and laboratory/field spectrometer data was tested. The Tuscon AIS-2 image connects to lab reference spectra by an alignment to the image spectral endmembers through a system gain and offset for each band. Images were calibrated to reflectance so as to transform the image into a measure that is independent of the solar radiant flux. This transformation also makes the image spectra directly comparable to data from lab and field spectrometers. A method was tested for calibrating AIS images using the surface as a reference. The surface heterogeneity is defined by lab/field spectral measurements. It was found that the Tuscon AIS-2 image is consistent with each of the initial hypotheses: (1) that the AIS-2 instrument calibration is nearly linear; (2) the spectral variance is caused by sub-pixel mixtures of spectrally distinct materials and shade, and (3) that sub-pixel mixtures can be treated as linear mixtures of pure endmembers. It was also found that the image can be characterized by relatively few endmembers using the AIS-2 spectra.

Smith, M. O.↗
NASA NTRS2005

CEDAR/TIMED: Thermospheric Vertical Wind Observations from Three Sites in the Northern Auroral Zone

The objective of this project was to operate ground based Fabry-Perot Interferometers at several points under the auroral zone to analyze and quantify the vertical wind in the thermosphere. These measurements were made in conjunction with TIMED, especially GUVI data, to relate the observed wind to the resulting mixing and compositional changes in the thermosphere. The ground based wind measurements were obtained from a scanning Doppler imager (SDI) in Poker Flat, and a vertically aligned Fabry Perot Imager (FPI) in Inuvik. A third FPI at Eagle, Alaska, was operated for a brief overlapping period as well. The SDI at Poker Flat had been in operation for several years, and was continued to run with little support from this grant. The much more expensive operation, maintenance, and data acquisition of the remote Inuvik FPI was made possible with funds from this project. During the 2003/2004 and 2004/2005 seasons, we operated the Inuvik FPI from September to April during hours of darkness. Two trips to service the instrument were required per year, and a local caretaker was funded to help keep the instrument going during the winter seasons. The data were transfered via modem and phone line to Poker Flat and were then analyzed to obtain wind and temperature at the altitude of the auroral green line OI(557.7 nm). The final data product was archived and transferred to the GEDDS system at Poker Flat were it is available on the web: http://gedds.pfrr.alaska.edu/. The data set is also available from the CEDAR data base: http://cedarweb.hao.ucar.edu/.

Lummerzheim, D.↗
DOE OSTI2015

SU-E-J-112: Intensity-Based Pulmonary Image Registration: An Evaluation Study

Purpose: Accurate alignment of thoracic CT images is essential for dose tracking and to safely implement adaptive radiotherapy in lung cancers. At the same time it is challenging given the highly elastic nature of lung tissue deformations. The objective of this study was to assess the performances of three state-of-art intensity-based algorithms in terms of their ability to register thoracic CT images subject to affine, barrel, and sinusoid transformation. Methods: Intensity similarity measures of the evaluated algorithms contained sum-of-squared difference (SSD), local mutual information (LMI), and residual complexity (RC). Five thoracic CT scans obtained from the EMPIRE10 challenge database were included and served as reference images. Each CT dataset was distorted by realistic affine, barrel, and sinusoid transformations. Registration performances of the three algorithms were evaluated for each distortion type in terms of intensity root mean square error (IRMSE) between the reference and registered images in the lung regions. Results: For affine distortions, the three algorithms differed significantly in registration of thoracic images both visually and nominally in terms of IRMSE with a mean of 0.011 for SSD, 0.039 for RC, and 0.026 for LMI (p<0.01; Kruskal-Wallis test). For barrel distortion, the three algorithms showed nominally no significant difference in terms of IRMSE with a mean of 0.026 for SSD, 0.086 for RC, and 0.054 for LMI (p=0.16) . A significant difference was seen for sinusoid distorted thoracic CT data with mean lung IRMSE of 0.039 for SSD, 0.092 for RC, and 0.035 for LMI (p=0.02). Conclusion: Pulmonary deformations might vary to a large extent in nature in a daily clinical setting due to factors ranging from anatomy variations to respiratory motion to image quality. It can be appreciated from the results of the present study that the suitability of application of a particular algorithm for pulmonary image registration is deformation-dependent.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2002

Subsystem Imaging Performance and Modeling of the Infrared Multi-Object Spectrograph

The Infrared Multi-Object Spectrograph (IRMOS) is a facility instrument for the Kitt Peak National Observatory Mayall Telescope (3.8 meter). IRMOS is a near-IR (0.8 - 2.5 micron) spectrograph with low to mid resolution (R=lambda/delta, lambda = 300 - 3800). The IRMOS spectrograph produces simultaneous spectra of - 100 objects in its 2.8 x 2.0 arc-min field of view using a commercial MEMS multi-mirror array device (MMA). The IRMOS optical design consists of two imaging systems, or "stages." The focal reducer, stage one, images the focal plane of the telescope onto the MMA. The spectrograph, stage two, images the MMA onto the detector. We describe the breadboard alignment method and imaging and scattered light performance for both the focal reducer and spectrograph. This testing provides verification of the optomechanical alignment method, and a measurement of the contribution of scattered light in the system due to mirror small scale surface error. After the stage I and 2 optics are integrated with the instrument, our test results will make it possible to distinguish between scattered light from the mirrors and the MMA. Image testing will be done at four wavelengths in the visible and near-IR. A mercury-argon pencil lamp will provide spectral lines at 546.1 and 1012 nm, and a blackbody radiation source lines at 1600 and 2200 nm. A CCD camera will be used as a detector for the visible wavelengths, and an IR photodiode will be used for the IR wavelengths. We compare our data with a theoretical analysis using a commercial software package. Mirror surface error is modeled by treating each surface as a superposition of various gratings (e.g., diamond turning tool marks, features due to the impurities of Al 6061, and periodic mid-frequency errors due to drift during machining).

Connelly, Joseph A.↗