Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image registration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Multi-Image Registration for an Enhanced Vision System

An Enhanced Vision System (EVS) utilizing multi-sensor image fusion is currently under development at the NASA Langley Research Center. The EVS will provide enhanced images of the flight environment to assist pilots in poor visibility conditions. Multi-spectral images obtained from a short wave infrared (SWIR), a long wave infrared (LWIR), and a color visible band CCD camera, are enhanced and fused using the Retinex algorithm. The images from the different sensors do not have a uniform data structure: the three sensors not only operate at different wavelengths, but they also have different spatial resolutions, optical fields of view (FOV), and bore-sighting inaccuracies. Thus, in order to perform image fusion, the images must first be co-registered. Image registration is the task of aligning images taken at different times, from different sensors, or from different viewpoints, so that all corresponding points in the images match. In this paper, we present two methods for registering multiple multi-spectral images. The first method performs registration using sensor specifications to match the FOVs and resolutions directly through image resampling. In the second method, registration is obtained through geometric correction based on a spatial transformation defined by user selected control points and regression analysis.

Hines, Glenn↗

Image Registration: A Necessary Evil

Registration of test and reference images is a key component of nearly all PSP data reduction techniques. This is done to ensure that a test image pixel viewing a particular point on the model is ratioed by the reference image pixel which views the same point. Typically registration is needed to account for model motion due to differing airloads when the wind-off and wind-on images are taken. Registration is also necessary when two cameras are used for simultaneous acquisition of data from a dual-frequency paint. This presentation will discuss the advantages and disadvantages of several different image registration techniques. In order to do so, it is necessary to propose both an accuracy requirement for image registration and a means for measuring the accuracy of a particular technique. High contrast regions in the unregistered images are most sensitive to registration errors, and it is proposed that these regions be used to establish the error limits for registration. Once this is done, the actual registration error can be determined by locating corresponding points on the test and reference images, and determining how well a particular registration technique matches them. An example of this procedure is shown for three transforms used to register images of a semispan model. Thirty control points were located on the model. A subset of the points were used to determine the coefficients of each registration transform, and the error with which each transform aligned the remaining points was determined. The results indicate the general superiority of a third-order polynomial over other candidate transforms, as well as showing how registration accuracy varies with number of control points. Finally, it is proposed that image registration may eventually be done away with completely. As more accurate image resection techniques and more detailed model surface grids become available, it will be possible to map raw image data onto the model surface accurately. Intensity ratio data can then be obtained by a "model surface ratio," rather than an image ratio. The problems and advantages of this technique will be discussed.

Bell, James↗

Agile Multi-Scale Decompositions for Automatic Image Registration

In recent works, the first and third authors developed an automatic image registration algorithm based on a multiscale hybrid image decomposition with anisotropic shearlets and isotropic wavelets. This prototype showed strong performance, improving robustness over registration with wavelets alone. However, this method imposed a strict hierarchy on the order in which shearlet and wavelet features were used in the registration process, and also involved an unintegrated mixture of MATLAB and C code. In this paper, we introduce a more agile model for generating features, in which a flexible and user-guided mix of shearlet and wavelet features are computed. Compared to the previous prototype, this method introduces a flexibility to the order in which shearlet and wavelet features are used in the registration process. Moreover, the present algorithm is now fully coded in C, making it more efficient and portable than the MATLAB and C prototype. We demonstrate the versatility and computational efficiency of this approach by performing registration experiments with the fully-integrated C algorithm. In particular, meaningful timing studies can now be performed, to give a concrete analysis of the computational costs of the flexible feature extraction. Examples of synthetically warped and real multi-modal images are analyzed.

Science Data Processing↗

Agile Multi-Scale Decompositions for Automatic Image Registration

In recent works, the first and third authors developed an automatic image registration algorithm based on a multiscale hybrid image decomposition with anisotropic shearlets and isotropic wavelets. This prototype showed strong performance, improving robustness over registration with wavelets alone. However, this method imposed a strict hierarchy on the order in which shearlet and wavelet features were used in the registration process, and also involved an unintegrated mixture of MATLAB and C code. In this paper, we introduce a more agile model for generating features, in which a flexible and user-guided mix of shearlet and wavelet features are computed. Compared to the previous prototype, this method introduces a flexibility to the order in which shearlet and wavelet features are used in the registration process. Moreover, the present algorithm is now fully coded in C, making it more efficient and portable than the MATLAB and C prototype. We demonstrate the versatility and computational efficiency of this approach by performing registration experiments with the fully-integrated C algorithm. In particular, meaningful timing studies can now be performed, to give a concrete analysis of the computational costs of the flexible feature extraction. Examples of synthetically warped and real multi-modal images are analyzed.

Science Data Processing↗

Digital image registration method using boundary maps

A new method of automatic image registration (matching) is presented. It requires that the original single or multichannel images first be converted to binary boundary maps having elements equal to zero or unity. The method corrects for both translational and rotational errors. One feature of the technique is the rapid calculation of a pseudo correlation matrix NCOR using only integer additions. It is argued that the use of boundary maps is advisable when the data from the two images are acquired under different conditions; i.e., weather conditions, lighting conditions, etc.

Andrus, J. F.↗

Absolute image registration for geosynchronous satellites

A procedure for the absolute registration of earth images acquired by cameras on geosynchronous satellites is described. A conventional least squares process is used to estimate navigational parameters and camera pointing biases from observed minus computed landmark line and element numbers. These estimated parameters along with orbit and attitude dynamic models are used to register images, employing an automated grey-level correlation technique, inside the span represented by the landmark data. Experimental results obtained from processing the SMS-2 observation data base covering May 2, 1979 through May 20, 1979 show registration accuracies with a standard deviation of less than two pixels if the registration is within the landmark data span. It is also found that accurate registration can be expected for images obtained up to 48 hours outside of the landmark data span.

Nankervis, R.↗

Exploiting Measurement Uncertainty Estimation in Evaluation of GOES-R ABI Image Navigation Accuracy Using Image Registration Techniques

In evaluating GOES-R Advanced Baseline Imager (ABI) image navigation quality, upsampled sub-images of ABI images are translated against downsampled Landsat 8 images of localized, high contrast earth scenes to determine the translations in the East-West and North-South directions that provide maximum correlation. The native Landsat resolution is much finer than that of ABI, and Landsat navigation accuracy is much better than ABI required navigation accuracy and expected performance. Therefore, Landsat images are considered to provide ground truth for comparison with ABI images, and the translations of ABI sub-images that produce maximum correlation with Landsat localized images are interpreted as ABI navigation errors. The measured local navigation errors from registration of numerous sub-images with the Landsat images are averaged to provide a statistically reliable measurement of the overall navigation error of the ABI image. The dispersion of the local navigation errors is also of great interest, since ABI navigation requirements are specified as bounds on the 99.73rd percentile of the magnitudes of per pixel navigation errors. However, the measurement uncertainty inherent in the use of image registration techniques tends to broaden the dispersion in measured local navigation errors, masking the true navigation performance of the ABI system. We have devised a novel and simple method for estimating the magnitude of the measurement uncertainty in registration error for any pair of images of the same earth scene. We use these measurement uncertainty estimates to filter out the higher quality measurements of local navigation error for inclusion in statistics. In so doing, we substantially reduce the dispersion in measured local navigation errors, thereby better approximating the true navigation performance of the ABI system.

navigation performance↗

Image registration for accurate electrode deformation analysis in operando microscopy of battery materials

Operando imaging techniques have become increasingly valuable in both battery research and manufacturing. However, the reliability of these methods can be compromised by instabilities in the imaging setup and operando cells, particularly when utilizing high-resolution imaging systems. The acquired imaging data often include features arising from both undesirable system vibrations and drift, as well as the scientifically relevant deformations occurring in the battery sample during cell operation. For meaningful analysis, it is crucial to distinguish and separately evaluate these two factors. To address these challenges, we employ a suite of advanced image-processing techniques. These include fast Fourier transform analysis in the frequency domain, power spectrum-based assessments for image quality, as well as rigid and non-rigid image-registration methods. These techniques allow us to identify and exclude blurred images, correct for displacements caused by motor vibrations and sample holder drift and, thus, prevent unwanted image artifacts from affecting subsequent analyses and interpretations. Additionally, we apply optical flow analysis to track the dynamic deformation of battery electrode materials during electrochemical cycling. This enables us to observe and quantify the evolving mechanical responses of the electrodes, offering deeper insights into battery degradation. Together, these methods ensure more accurate image analysis and enhance our understanding of the chemomechanical interplay in battery performance and longevity.

Sun, Tianxiao↗

Digital image registration by correlation techniques.

This study considers the translation problem associated with digital image registration and develops a means for comparing commonly used correlation techniques. Using suitably defined constraints, an optimum and four suboptimum registration techniques are defined and evaluated. A computational comparison is made and Gaussian image statistics are used to compare the selected techniques in terms of radial position location error.

Popp, D. J.↗

Scope and applications of translation invariant wavelets to image registration

The first part of this article introduces the notion of translation invariance in wavelets and discusses several wavelets that have this property. The second part discusses the possible applications of such wavelets to image registration. In the case of registration of affinely transformed images, we would conclude that the notion of translation invariance is not really necessary. What is needed is affine invariance and one way to do this is via the method of moment invariants. Wavelets or, in general, pyramid processing can then be combined with the method of moment invariants to reduce the computational load.

Chettri, Samir↗

Iterative edge- and wavelet-based image registration of AVHRR and GOES satellite imagery

Most automatic registration methods are either correlation-based, feature-based, or a combination of both. Examples of features which can be utilized for automatic image registration are edges, regions, corners, or wavelet-extracted features. In this paper, we describe two proposed approaches, based on edge or edge-like features, which are very appropriate to highlight regions of interest such as coastlines. The two iterative methods utilize the Normalized Cross-Correlation of edge and wavelet features and are applied to such problems as image-to-map registration, landmarking, and channel-to-channel co-registration, utilizing test data, AVHRR data, as well as GOES image data.

LeMoigne, Jacqueline↗

Image registration for luminescent paint applications

The use of pressure sensitive luminescent paints is a viable technique for the measurement of surface pressure on wind tunnel models. This technique requires data reduction of images obtained under known as well as test conditions and spatial transformation of the images. A general transform which registers images to subpixel accuracy is presented and the general characteristics of transforms for image registration and their derivation are discussed. Image resection and its applications are described. The mapping of pressure data to the three dimensional model surface for small wind tunnel models to a spatial accuracy of 0.5 percent of the model length is demonstrated.

Bell, James H.↗

State estimation and absolute image registration for geosynchronous satellites

Spacecraft state estimation and the absolute registration of Earth images acquired by cameras onboard geosynchronous satellites are described. The basic data type of the procedure consists of line and element numbers of image points called landmarks whose geodetic coordinates, relative to United States Geodetic Survey topographic maps, are known. A conventional least squares process is used to estimate navigational parameters and camera pointing biases from observed minus computed landmark line and element numbers. These estimated parameters along with orbit and attitude dynamic models are used to register images, using an automated grey level correlation technique, inside the span represented by the landmark data. In addition, the dynamic models can be employed to register images outside of the data span in a near real time mode. An important application of this mode is in support of meteorological studies where rapid data reduction is required for the rapid tracking and predicting of dynamic phenomena.

Nankervis, R.↗

Automatic digital image registration

This paper introduces a general procedure for automatic registration of two images which may have translational, rotational, and scaling differences. This procedure involves (1) segmentation of the images, (2) isolation of dominant objects from the images, (3) determination of corresponding objects in the two images, and (4) estimation of transformation parameters using the center of gravities of objects as control points. An example is given which uses this technique to register two images which have translational, rotational, and scaling differences.

Goshtasby, A.↗

Image registration - Similarity measure and preprocessing method comparisons

An experimental comparison of several similarity measures and preprocessing techniques used for the registration of temporally differing images is carried out. It is found that preprocessing of the images via a gradient operator improves the registration performance. This is in agreement with a derived optimal processor based upon image and temporal difference characteristics.

Svedlow, M.↗

Evaluation of Landsat image registration accuracy

The Large Area Crop Inventory Experiment (LACIE) is an attempt to demonstrate the capability to forecast the annual production of major crops such as wheat and corn. Good image registration of data acquired on different dates is one of the key assumptions made in LACIE. This paper describes an algorithm to measure the accuracy of the current registration procedure. This algorithm employs a modified version of sequential similarity detection algorithm (SSDA). Based on over 264 registration checks, it was found that the root-mean-square of registration errors was 1.0 pixel. The failure rate of our registration checking algorithm was less than 10 per cent and the standard deviation of the accuracy of this algorithm was less than 0.2 picture element.

Kaneko, T.↗

Precision Instrument Targeting via Image Registration for the Mars 2020 Rover

A key component of Mars exploration is the operation of robotic instruments on the surface, such as those on board the Mars Exploration Rovers, the Mars Science Laboratory (MSL), and the planned Mars 2020 Rover. As the instruments carried by these rovers have become more advanced, the area targeted by some instruments becomes smaller, revealing more fine-grained details about the geology and chemistry of rocks on the surface. However, thermal fluctuations, rover settling or slipping, and inherent inaccuracies in pointing mechanisms all lead to pointing error that is on the order of the target size (several millimeters) or larger. We show that given a target located on a previously acquired image, the rover can align this with a new image to visually locate the target and refine the current pointing. Due to round-trip communication constraints, this visual targeting must be done efficiently on board the rover using relatively limited computing hardware. We employ existing ORB features for landmark-based image registration, describe and theoretically justify a novel approach to filtering false landmark matches, and employ a random forest classifier to automatically reject failed alignments. We demonstrate the efficacy of our approach using over 3,800 images acquired by Remote Micro-Imager on board the “Curiosity” rover.

Doran, Gary↗