Search NASA⌕ Search

SEARCH · Search NASA

Results for “IMAGE ALIGNMENT”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS1991

Efficient visual grasping alignment for cylinders

Monocular information from a gripper-mounted camera is used to servo the robot gripper to grasp a cylinder. The fundamental concept for rapid pose estimation is to reduce the amount of information that needs to be processed during each vision update interval. The grasping procedure is divided into four phases: learn, recognition, alignment, and approach. In the learn phase, a cylinder is placed in the gripper and the pose estimate is stored and later used as the servo target. This is performed once as a calibration step. The recognition phase verifies the presence of a cylinder in the camera field of view. An initial pose estimate is computed and uncluttered scan regions are selected. The radius of the cylinder is estimated by moving the robot a fixed distance toward the cylinder and observing the change in the image. The alignment phase processes only the scan regions obtained previously. Rapid pose estimates are used to align the robot with the cylinder at a fixed distance from it. The relative motion of the cylinder is used to generate an extrapolated pose-based trajectory for the robot controller. The approach phase guides the robot gripper to a grasping position. The cylinder can be grasped with a minimal reaction force and torque when only rough global pose information is initially available.

Nicewarner, Keith E.↗
NASA NTRS1992

Efficient visual grasping alignment for cylinders

Monocular information from a gripper-mounted camera is used to servo the robot gripper to grasp a cylinder. The fundamental concept for rapid pose estimation is to reduce the amount of information that needs to be processed during each vision update interval. The grasping procedure is divided into four phases: learn, recognition, alignment, and approach. In the learn phase, a cylinder is placed in the gripper and the pose estimate is stored and later used as the servo target. This is performed once as a calibration step. The recognition phase verifies the presence of a cylinder in the camera field of view. An initial pose estimate is computed and uncluttered scan regions are selected. The radius of the cylinder is estimated by moving the robot a fixed distance toward the cylinder and observing the change in the image. The alignment phase processes only the scan regions obtained previously. Rapid pose estimates are used to align the robot with the cylinder at a fixed distance from it. The relative motion of the cylinder is used to generate an extrapolated pose-based trajectory for the robot controller. The approach phase guides the robot gripper to a grasping position. The cylinder can be grasped with a minimal reaction force and torque when only rough global pose information is initially available.

Nicewarner, Keith E.↗
NASA NTRS2004

Examples of Current and Future Uses of Neural-Net Image Processing for Aerospace Applications

Feed forward artificial neural networks are very convenient for performing correlated interpolation of pairs of complex noisy data sets as well as detecting small changes in image data. Image-to-image, image-to-variable and image-to-index applications have been tested at Glenn. Early demonstration applications are summarized including image-directed alignment of optics, tomography, flow-visualization control of wind-tunnel operations and structural-model-trained neural networks. A practical application is reviewed that employs neural-net detection of structural damage from interference fringe patterns. Both sensor-based and optics-only calibration procedures are available for this technique. These accomplishments have generated the knowledge necessary to suggest some other applications for NASA and Government programs. A tomography application is discussed to support Glenn's Icing Research tomography effort. The self-regularizing capability of a neural net is shown to predict the expected performance of the tomography geometry and to augment fast data processing. Other potential applications involve the quantum technologies. It may be possible to use a neural net as an image-to-image controller of an optical tweezers being used for diagnostics of isolated nano structures. The image-to-image transformation properties also offer the potential for simulating quantum computing. Computer resources are detailed for implementing the black box calibration features of the neural nets.

Decker, Arthur J.↗
NASA NTRS2009

Cryogenic Pupil Alignment Test Architecture for Aberrated Pupil Images

A document describes cryogenic test architecture for the James Webb Space Telescope (JWST) integrated science instrument module (ISIM). The ISIM element primarily consists of a mechanical metering structure, three science instruments, and a fine guidance sensor. One of the critical optomechanical alignments is the co-registration of the optical telescope element (OTE) exit pupil with the entrance pupils of the ISIM instruments. The test architecture has been developed to verify that the ISIM element will be properly aligned with the nominal OTE exit pupil when the two elements come together. The architecture measures three of the most critical pupil degrees-of-freedom during optical testing of the ISIM element. The pupil measurement scheme makes use of specularly reflective pupil alignment references located inside the JWST instruments, ground support equipment that contains a pupil imaging module, an OTE simulator, and pupil viewing channels in two of the JWST flight instruments. Pupil alignment references (PARs) are introduced into the instrument, and their reflections are checked using the instrument's mirrors. After the pupil imaging module (PIM) captures a reflected PAR image, the image will be analyzed to determine the relative alignment offset. The instrument pupil alignment preferences are specularly reflective mirrors with non-reflective fiducials, which makes the test architecture feasible. The instrument channels have fairly large fields of view, allowing PAR tip/tilt tolerances on the order of 0.5deg.

Bos, Brent↗
DOE OSTI2016

SU-F-T-118: Characterization of Change in Fractional Anisotropy After Radiation Therapy: Does Nearby Disruption Predict for White Matter Damage?

Purpose: We investigated predictors of fractional anisotropy (FA) change in the corticospinal white matter tract (CST) following radiation therapy (RT). Methods: Diffusion tensor imaging (DTI) is a non-invasive modality which models water diffusion properties. FA quantifies the extent of directional bias—a decrease indicates disrupted white matter integrity. Fifteen patients with high-grade glioma underwent DTI scans before, and ten months after RT to 59.4–60 Gy. The CST was segmented using an automated atlas-based algorithm on all DTI images. Treatment planning CT and DTI images were aligned using non-linear registration allowing for baseline FA, follow-up FA, and absorbed dose to be determined in each voxel. Relative FA change was dichotomized into a binary outcome using 25% decrease as cutoff. Three metrics were assessed as predictors: voxel dose, distance from the voxel to the center of the CST (Rc), and the number of neighboring voxels (Nadj from 0 to 26) with ≥25% decrease in FA. Logistic regression and the area under the receiver-operating characteristics curve (AUC) analysis were performed for each patient. Results: Median age of the cohort was 59 years (range: 40–85). The average number of voxels in the CST amongst all patients was 1181 (±172, SD). In logistic regression, the probability of FA change was highly associated with Nadj in all 15 patients with corresponding AUCs between 0.81 and 0.97. With all three metrics included in the logistic regression models, Nadj was highly significant (p<0.001) in all patients, voxel dose significant (p<0.05) in 3/15 patients, and Rc significant in 12/15 patients (p<0.05). Conclusion: The number of neighboring voxels with change in FA was the dominant predictor of FA change at any given voxel. This suggests that the microenvironment of surrounding white matter disruption after radiation therapy may drive local effects along a white matter tract. Pettersson and Cervino are funded by a Varian Medical Systems grant.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

WE-H-207A-05: Spatial Co-Localization of F-18 NaF Vs. F-18 FDG Defined Disease Volumes

Purpose: Both [F-18]NaF and [F-18]FDG show promise for quantitative PET/CT assessment in metastatic prostate cancer to bone. Broad agreement between the tracers has been shown but voxel-wise correspondence has not been explored in depth. This study evaluates the spatial co-localization of [F-18]NaF PET and [F-18]FDG PET in bone lesions. Methods: Seventy-three lesion contours were identified in six patients receiving dynamic NaF PET/CT and FDG PET/CT scans two hours apart using identical fields-of-view. Tracer uptake (SUV) reflecting 60 minutes post-injection was modeled from kinetic parameters. Lesions were segmented by a physician separately on NaF PET and FDG PET. PET images were rigidly aligned using skeletal references on CT images. Lesion size, degree of overlap, voxel-wise tracer uptake values (SUV), and CT density distributions were compared using Dice coefficient, Positive Predictive Value (PPV), and Spearman rank correlation tests. Results: Across all patients, 42 lesions were identified on NaF PET (median 1.4 cm{sup 3}, range <1–204 cm{sup 3}) compared to 31 using FDG PET (median 1.8 cm{sup 3}, range <1–244 cm{sup 3}). Spatial cooccurrence was found in 25 lesion pairs. Lesions on NaF PET had PPV of 0.91 and on FDG a PPV of 0.65. Overall, NaF-defined lesions were 47% (±24%) larger by volume with moderate overlap to FDG, resulting in mean Dice coefficient of 34% (±22%). In areas of overlap, voxel-wise correlation of NaF and FDG SUV was moderate (ρ=0.56). Expanding to regions of non-spatial overlap, voxels contained in FDG-only contours were almost exclusively low HU (median 118), compared to dense regions of NaF-only voxels (median 250). In sclerotic sub-volumes (HU > 300) NaF-defined contours encompassed 83% of total FDG volume. Conclusion: Moderate voxel-wise correlation of FDG and NaF PET/CT uptake was observed. Spatial discrepancies in FDG and NaF PET/CT imaging of boney metastases could be influenced by poor sensitivity of FDG PET/CT in sclerotic regions. Funded by Prostate Cancer Foundation.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Polyolefin blends with co-continuous architectures enabled by dynamic covalent crosslinking

Blending polymers produces brittle materials due to macrophase separation and poor interfacial adhesion, which is exemplified by mixtures of polyolefins. This presents a formidable challenge for the mechanical recycling of mixed plastic waste. Here, we demonstrate that dynamic covalent crosslinking of immiscible polyolefin blends creates macrophase separated co-continuous architectures, yet they display excellent mechanical properties, which challenges the conventional wisdom regarding morphology-property relationships in polymer blend compatibilization. We find that the position and orientation of dynamic crosslinks and their influence on crystallinity are key to understanding the structure-morphology-property relationships. In particular, high-resolution microscopy imaging reveals alignment of crystallite planes with strong orientational preference, particularly at polymer-polymer interfaces, which contribute to material performance. We further demonstrate that changes in crosslinker density and valency allow the properties of binary and ternary polyolefin blends to be tuned in a modular fashion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Toward Improving the Generation Quality of Autoregressive Slot VAEs

Unconditional scene inference and generation are challenging to learn jointly with a single compositional model. Despite encouraging progress on models that extract object-centric representations (“slots”) from images, unconditional generation of scenes from slots has received less attention. This is primarily because learning the multiobject relations necessary to imagine coherent scenes is difficult. We hypothesize that most existing slot-based models have a limited ability to learn object correlations. We propose two improvements that strengthen object correlation learning. The first is to condition the slots on a global, scene-level variable that captures higher-order correlations between slots. Second, we address the fundamental lack of a canonical order for objects in images by proposing to learn a consistent order to use for the autoregressive generation of scene objects. Specifically, we train an autoregressive slot prior to sequentially generate scene objects following a learned order. Ordered slot inference entails first estimating a randomly ordered set of slots using existing approaches for extracting slots from images, then aligning those slots to ordered slots generated autoregressively with the slot prior. Our experiments across three multiobject environments demonstrate clear gains in unconditional scene generation quality. Detailed ablation studies are also provided that validate the two proposed improvements.

MATHEMATICS AND COMPUTING↗
NASA NTRS1994

The Transition Region And Coronal Explorer (TRACE)

The objectives and the characteristics of TRACE, selected as a NASA small explorer mission for development and flight in late 1997, is presented. The TRACE science investigation explores the connections between fine-scale magnetic fields and the associated plasma structures on the sun. The instrument collects images of solar plasmas at temperatures from 10(exp 4) to 10(exp 7) K, with an arc second spatial resolution and good temporal resolution and continuum. TRACE and SOHO will gather simultaneous, digital measurements of all temperature regimes of the solar atmospheric, in both high-resolution imaging and spectroscopy, and magnetogram to photosphere. The 30 cm aperture TRACE telescope uses three normal-incidence coatings for the extreme ultraviolet and one for the ultraviolet on quadrants of the primary and secondary mirrors. Interference filters isolate five different ultraviolet bands. The images are aligned and internally stabilized against spacecraft jitter. TRACE will be launched into a sun-synchronous orbit, allowing continuous observing for eight months of the baseline one-year mission. It will be operated in coordination with the SOHO experiment operations facility.

Tarbell, T. D.↗
NASA NTRS1995

Laser-Beam-Alignment Controller

In laser-beam-alignment controller, images from video camera compared to reference patterns by fuzzy-logic pattern comparator. Results processed by fuzzy-logic microcontroller, which sends control signals to motor driver adjusting lens and pinhole in spatial filter.

Krasowski, M. J.↗
NASA NTRS2000

Poster Presentation: Optical Test of NGST Developmental Mirrors

An Optical Testing System (OTS) has been developed to measure the figure and radius of curvature of NGST developmental mirrors in the vacuum, cryogenic environment of the X-Ray Calibration Facility (XRCF) at Marshall Space Flight Center (MSFC). The OTS consists of a WaveScope Shack-Hartmann sensor from Adaptive Optics Associates as the main instrument, a Point Diffraction Interferometer (PDI), a Point Spread Function (PSF) imager, an alignment system, a Leica Disto Pro distance measurement instrument, and a laser source palette (632.8 nm wavelength) that is fiber-coupled to the sensor instruments. All of the instruments except the laser source palette are located on a single breadboard known as the Wavefront Sensor Pallet (WSP). The WSP is located on top of a 5-DOF motion system located at the center of curvature of the test mirror. Two PC's are used to control the OTS. The error in the figure measurement is dominated by the WaveScope's measurement error. An analysis using the absolute wavefront gradient error of 1/50 wave P-V (at 0.6328 microns) provided by the manufacturer leads to a total surface figure measurement error of approximately 1/100 wave rms. This easily meets the requirement of 1/10 wave P-V. The error in radius of curvature is dominated by the Leica's absolute measurement error of VI.5 mm and the focus setting error of Vi.4 mm, giving an overall error of V2 mm. The OTS is currently being used to test the NGST Mirror System Demonstrators (NMSD's) and the Subscale Beryllium Mirror Demonstrator (SBNM).

Hadaway, James B.↗
NASA NTRS2003

Three-Dimensional Morphological Analysis of ALH84001 Magnetite Using Electron Tomography

We report here the crystal morphologies of MV-1 and ALH84001 magnetites as calculated by back-projection using electron tomography. In the present study, we used a 300 keV TEM with a field emission gun (Tecnai F-30 from FEI Inc.), equipped with a 2048 x 2048 pixel CCD camera from Gatan Inc. to image magnetite crystals over tilt ranges of approx. +/- 72 deg in 2 deg tilt intervals. The images were aligned for back-projection, either manually, or through the use of fiducial 5 nm Au spheres affixed to the specimen prior to microscopy. Three-dimensional (3-D) reconstructions were computed using weighted back-projection of the tilted views. The tomograms were viewed and analyzed as a series of slices 1.0 nm thick, taken parallel to the specimen-supporting grid, using the IMOD software package. The shape of each magnetite crystal was determined by defining the external contour of a given magnetite in each slice and assembling a stack of these contours in 3-D. To aid in visualization, the stacked contour array was reduced to an optimal mesh by Delaunay triangulation. The surface normal to each of the triangles in the mesh was calculated and the triangle faces colored according to the orientation of that surface normal relative to the principal crystallographic axis of magnetite. Green surfaces correspond to {111} orientations, blue surfaces to {100} orientations, and red surfaces to {110} orientations. Triangles whose surface normal did not correspond to one of the principal axes were colored gray. Within the experimental and numerical uncertainties of the deconvolution, the tomographic reconstruction of both MV-1 and ALH84001 magnetites are equivalent and correspond to a truncated hexa-octahedral morphology.

Thomas-Keprta, Kathie L.↗
DOE OSTI2026

INR-TEM: Robust cavity detection in multifocus TEM images via implicit neural representations

When characterizing materials using transmission electron microscopy (TEM) images, detecting and quantifying small features in microstructures, such as cavities, pose significant challenges. Off-the-shelf object detection models, including YOLOv8, show considerable performance degradation, particularly when images vary in resolution and the objects of interest possess a low percentage of the total image region of interest. In this study, we introduce a novel detection pipeline that incorporates an implicit neural representation (INR)-based detection method, INR-TEM, and two-modality imaging (e.g., under-focused and over-focused images typically acquired during materials characterization) to improve object detection performance. The INR-TEM method incorporates a pixel-wise prediction principle inspired by pixel-wise centerness weighting. INR-TEM demonstrates superior robustness to resolution variability, maintaining high detection accuracy even at low image resolutions compared to YOLOv8. To leverage INR-TEM effectively in real-world two-modality characterization applications, we further integrate a two-stage motion correction pipeline designed explicitly for aligning multifocus TEM images. The alignment process, comprising keypoint (based on scale-invariant feature transform, SIFT) and intensity matching, significantly mitigates the adverse effects of perceived motion-induced image degradation during through-focal TEM imaging, directly enhancing INR-TEM’s detection capability over conventional single-focus images. Our integrated INR-TEM cavity detection framework notably improves performance across various cavity sizes, outperforming off-the-shelf YOLOv8 detections that rely on a single image modality.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2016

Precision Instrument Targeting via Image Registration for the Mars 2020 Rover

A key component of Mars exploration is the operation of robotic instruments on the surface, such as those on board the Mars Exploration Rovers, the Mars Science Laboratory (MSL), and the planned Mars 2020 Rover. As the instruments carried by these rovers have become more advanced, the area targeted by some instruments becomes smaller, revealing more fine-grained details about the geology and chemistry of rocks on the surface. However, thermal fluctuations, rover settling or slipping, and inherent inaccuracies in pointing mechanisms all lead to pointing error that is on the order of the target size (several millimeters) or larger. We show that given a target located on a previously acquired image, the rover can align this with a new image to visually locate the target and refine the current pointing. Due to round-trip communication constraints, this visual targeting must be done efficiently on board the rover using relatively limited computing hardware. We employ existing ORB features for landmark-based image registration, describe and theoretically justify a novel approach to filtering false landmark matches, and employ a random forest classifier to automatically reject failed alignments. We demonstrate the efficacy of our approach using over 3,800 images acquired by Remote Micro-Imager on board the “Curiosity” rover.

Doran, Gary↗
NASA NTRS2005

Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery

The problem of image registration, or the alignment of two or more images representing the same scene or object, has to be addressed in various disciplines that employ digital imaging. In the area of remote sensing, just like in medical imaging or computer vision, it is necessary to design robust, fast, and widely applicable algorithms that would allow automatic registration of images generated by various imaging platforms at the same or different times and that would provide subpixel accuracy. One of the main issues that needs to be addressed when developing a registration algorithm is what type of information should be extracted from the images being registered, to be used in the search for the geometric transformation that best aligns them. The main objective of this paper is to evaluate several wavelet pyramids that may be used both for invariant feature extraction and for representing images at multiple spatial resolutions to accelerate registration. We find that the bandpass wavelets obtained from the steerable pyramid due to Simoncelli performs best in terms of accuracy and consistency, while the low-pass wavelets obtained from the same pyramid give the best results in terms of the radius of convergence. Based on these findings, we propose a modification of a gradient-based registration algorithm that has recently been developed for medical data. We test the modified algorithm on several sets of real and synthetic satellite imagery.

Evaluation Studies↗
NASA NTRS1987

Calibrating AIS images using the surface as a reference

A method of evaluating the initial assumptions and uncertainties of the physical connection between Airborne Imaging Spectrometer (AIS) image data and laboratory/field spectrometer data was tested. The Tuscon AIS-2 image connects to lab reference spectra by an alignment to the image spectral endmembers through a system gain and offset for each band. Images were calibrated to reflectance so as to transform the image into a measure that is independent of the solar radiant flux. This transformation also makes the image spectra directly comparable to data from lab and field spectrometers. A method was tested for calibrating AIS images using the surface as a reference. The surface heterogeneity is defined by lab/field spectral measurements. It was found that the Tuscon AIS-2 image is consistent with each of the initial hypotheses: (1) that the AIS-2 instrument calibration is nearly linear; (2) the spectral variance is caused by sub-pixel mixtures of spectrally distinct materials and shade, and (3) that sub-pixel mixtures can be treated as linear mixtures of pure endmembers. It was also found that the image can be characterized by relatively few endmembers using the AIS-2 spectra.

Smith, M. O.↗
NASA NTRS2005

CEDAR/TIMED: Thermospheric Vertical Wind Observations from Three Sites in the Northern Auroral Zone

The objective of this project was to operate ground based Fabry-Perot Interferometers at several points under the auroral zone to analyze and quantify the vertical wind in the thermosphere. These measurements were made in conjunction with TIMED, especially GUVI data, to relate the observed wind to the resulting mixing and compositional changes in the thermosphere. The ground based wind measurements were obtained from a scanning Doppler imager (SDI) in Poker Flat, and a vertically aligned Fabry Perot Imager (FPI) in Inuvik. A third FPI at Eagle, Alaska, was operated for a brief overlapping period as well. The SDI at Poker Flat had been in operation for several years, and was continued to run with little support from this grant. The much more expensive operation, maintenance, and data acquisition of the remote Inuvik FPI was made possible with funds from this project. During the 2003/2004 and 2004/2005 seasons, we operated the Inuvik FPI from September to April during hours of darkness. Two trips to service the instrument were required per year, and a local caretaker was funded to help keep the instrument going during the winter seasons. The data were transfered via modem and phone line to Poker Flat and were then analyzed to obtain wind and temperature at the altitude of the auroral green line OI(557.7 nm). The final data product was archived and transferred to the GEDDS system at Poker Flat were it is available on the web: http://gedds.pfrr.alaska.edu/. The data set is also available from the CEDAR data base: http://cedarweb.hao.ucar.edu/.

Lummerzheim, D.↗