Search NASASearch

SEARCH · Search NASA

Results for “image alignment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Cross-correlation and image alignment for multi-band IR sensors

We present the development of a cross-­‐correlation algorithm for correlating objects in the long wave, mid wave and short wave Infrared sensor arrays. The goal is to align the images in the multi-­‐ sensor suite by correlating multiple key features in the images. Due to the wavelength differences, the object appears very differently in the sensor images even the sensors focus on the same object. In order to perform accurate correlation of the same object in the multi-­‐band images, we perform image processing on the images so that the features of the object become similar to each other. Fourier domain band pass filters are used to enhance the images. Mexican Hat and Gaussian Derivative Wavelets are used to further enhance the features of the object. A Python based QT graphical user interface has been implemented to carry out the process. We show reliable results of the cross-­‐correlation of the objects in multiple band videos.

Torres, Gilbert

Experimental image alignment system

A microcomputer-based instrument for image alignment with respect to a reference image is described which uses the DEFT sensor (Direct Electronic Fourier Transform) for image sensing and preprocessing. The instrument alignment algorithm which uses the two-dimensional Fourier transform as input is also described. It generates signals used to steer the stage carrying the test image into the correct orientation. This algorithm has computational advantages over algorithms which use image intensity data as input and is suitable for a microcomputer-based instrument since the two-dimensional Fourier transform is provided by the DEFT sensor.

Moyer, A. L.

Image Alignment and Flat-Field Correction of Film and Computed Radiography Images on the LLNL Flash Testbed

Computed radiography (CR) imaging plates and film are used in HEAF firing tanks and in the NDE group. The imaging plates allow for the creation of high-resolution digital images with flash X-ray (FXR). A typical treatment of flash X-ray radiographs is flat-field correction, where the image from an experiment is normalized by a “flat-field” or “bright-field” image. This flat-field image is taken in an identical configuration to the experimental image, but without the object or experiment in the field of view (FOV). This treatment reduces spatial effects from the FXR spot size and detector misalignment, as each pixel value in the corrected image represents a ratio of collected radiation with the object in FOV to the collected radiation without the object in FOV. One challenge in the creation of a corrected image is the misalignment of the CR plate or film pack between capturing the flat-field image and the experimental image. Fiducial structures can remedy this issue. Small (3.18mm) stainless steel ball bearings serve as good fiducial structures due to their small size and high radiographic contrast. Spheres are view-agnostic geometry, always presenting a circular cross section no matter the orientation. This process was developed for images from the flash X-ray testbed. The flash testbed was used to compare the X-ray transmission at different thicknesses of aluminum and copper step wedges. Each step wedge section is a rectangular shape, so evaluation is made much simpler if the rectangles are not rotated with respect to the image. This alignment process aligns the object and flat-field images together and leaves the rectangles of each step aligned with the image.

36 MATERIALS SCIENCE

Static stereo vision depth distortions in teleoperation

A major problem in high-precision teleoperation is the high-resolution presentation of depth information. Stereo television has so far proved to be only a partial solution, due to an inherent trade-off among depth resolution, depth distortion and the alignment of the stereo image pair. Converged cameras can guarantee image alignment but suffer significant depth distortion when configured for high depth resolution. Moving the stereo camera rig to scan the work space further distorts depth. The 'dynamic' (camera-motion induced) depth distortion problem was solved by Diner and Von Sydow (1987), who have quantified the 'static' (camera-configuration induced) depth distortion. In this paper, a stereo image presentation technique which yields aligned images, high depth resolution and low depth distortion is demonstrated, thus solving the trade-off problem.

Diner, D. B.

Image processing workflow yielding high contrast synchrotron nanoscale computed tomography data from Ni-YSZ electrodes

The operating lifetime of Ni-YSZ fuel electrodes used in solid oxide electrolysis cells and fuel cells (SOECs and SOFCs) is limited by Ni redistribution, one of the primary degradation mechanisms that must be overcome to extend the longevity and maximize the performance of SOECs and SOFCs. To achieve this, 3D microstructural data is needed to relate both initial performance and performance loss over time to microstructural properties and their evolution throughout operation under various conditions. However, 3D microstructure data remains relatively scarce within the literature due to multiple challenges in acquiring and analyzing such data reliably. This work presents a workflow for acquiring and processing synchrotron X-ray nanoscale computed tomography (nano-CT) data from Ni-YSZ electrodes. Parameters for each step in the nano-CT workflow are described up to the final result (a 3D reconstruction), with particular emphasis on image alignment using freely available software. Following the results of a parametric sweep of the image alignment step, high contrast, low signal-to-noise 3D nano-CT data is obtained with relatively short compute times. While the exact methods best suited to samples with different microstructural qualities, or similar Ni-YSZ nano-CT data obtained from other sources may deviate from the solution found herein, this work also generalizes the decision points and evaluation of each step to provide a starting point to adapt this workflow to other datasets.

08 HYDROGEN

Commissioning Results on the JWST Testbed Telescope

The one-meter 18 segment JWST Testbed Telescope (TBT) has been developed at Ball Aerospace to facilitate commissioning operations for the JWST Observatory. Eight different commissioning activities were tested on the TBT: telescope focus sweep, segment ID and Search, image array, global alignment, image stacking, coarse phasing, fine phasing, and multi-field phasing. This paper describes recent commissioning results from experiments performed on the TBT.

Dean, Bruce H.

Response Classification Images in Vernier Acuity

Orientation selective and local sign mechanisms have been proposed as the basis for vernier acuity judgments. Linear image features contributing to discrimination can be determined for a two choice task by adding external noise to the images and then averaging the noises separately for the four types of stimulus/response trials. This method is applied to a vernier acuity task with different spatial separations to compare the predictions of the two theories. Three well-practiced observers were presented around 5000 trials of a vernier stimulus consisting of two dark horizontal lines (5 min by 0.3 min) within additive low-contrast white noise. Two spatial separations were tested, abutting and a 10 min horizontal separation. The task was to determine whether the target lines were aligned or vertically offset. The noises were averaged separately for the four stimulus/response trial types (e.g., stimulus = offset, response = aligned). The sum of the two 'not aligned' images was then subtracted from the sum of the 'aligned' images to obtain an overall image. Spatially smoothed images were quantized according to expected variability in the smoothed images to allow estimation of the statistical significance of image features. The response images from the 10 min separation condition are consistent with the local sign theory, having the appearance of two linear operators measuring vertical position with opposite sign. The images from the abutting stimulus have the same appearance with the two operators closer together. The image predicted by an oriented filter model is similar, but has its greatest weight in the abutting region, while the response images fall to nonsignificance there. The response correlation image method, previously demonstrated for letter discrimination, clarifies the features used in vernier acuity.

Ahumada, Albert J., Jr.

Composite x-ray image assembly for large-field digital mammography with one- and two-dimensional positioning of a focal plane array

To demonstrate the feasibility of a novel large-field digital mammography technique, a 1024 x 1024 pixel Loral charge-coupled device (CCD) focal plane array (FPA) was positioned in a mammographic field with one- and two-dimensional scan sequences to obtain 950 x 1800 pixel and 3600 x 3600 pixel composite images, respectively. These experiments verify that precise positioning of FPAs produced seamless composites and that the CCD mosaic concept has potential for high-resolution, large-field imaging. The proposed CCD mosaic concept resembles a checkerboard pattern with spacing left between the CCDs for the driver and readout electronics. To obtain a complete x-ray image, the mosaic must be repositioned four times, with an x-ray exposure at each position. To reduce the patient dose, a lead shield with appropriately patterned holes is placed between the x-ray source and the patient. The high-precision motorized translation stages and the fiber-coupled-scintillating-screen-CCD sensor assembly were placed in the position usually occupied by the film cassette. Because of the high mechanical precision, seamless composites were constructed from the subimages. This paper discusses the positioning, image alignment procedure, and composite image results. The paper only addresses the formation of a seamless composite image from subimages and will not consider the effects of the lead shield, multiple CCDs, or the speed of motion.

Mammography/methods/statistics & numerical data

Multi-Image Registration for an Enhanced Vision System

An Enhanced Vision System (EVS) utilizing multi-sensor image fusion is currently under development at the NASA Langley Research Center. The EVS will provide enhanced images of the flight environment to assist pilots in poor visibility conditions. Multi-spectral images obtained from a short wave infrared (SWIR), a long wave infrared (LWIR), and a color visible band CCD camera, are enhanced and fused using the Retinex algorithm. The images from the different sensors do not have a uniform data structure: the three sensors not only operate at different wavelengths, but they also have different spatial resolutions, optical fields of view (FOV), and bore-sighting inaccuracies. Thus, in order to perform image fusion, the images must first be co-registered. Image registration is the task of aligning images taken at different times, from different sensors, or from different viewpoints, so that all corresponding points in the images match. In this paper, we present two methods for registering multiple multi-spectral images. The first method performs registration using sensor specifications to match the FOVs and resolutions directly through image resampling. In the second method, registration is obtained through geometric correction based on a spatial transformation defined by user selected control points and regression analysis.

Hines, Glenn

Patch-Based Convolutional Neural Networks for Multiple Microstructural Features Detection in FIB-SEM Micrographs of Irradiated Nuclear Fuel

Focused ion beam scanning electron microscopy (FIB-SEM) tomography has increasingly been utilized for acquiring three-dimensional (3D) microstructure features at the sub-micron scale in irradiated nuclear materials. This technique involves sequential ion beam slicing followed by electron beam imaging and compositional mapping using energy dispersive spectroscopy (EDS). Despite its growing use, several challenges persist. These include the time-intensive nature of data collection of EDS data, difficulties in distinguishing between various microstructures, and issues with image alignment. These challenges currently limit the broader application of FIB-SEM tomography in the field. To overcome these limitations, we propose using convolutional neural networks (CNNs) to automate microstructure identification in SEM images. Our study introduces a new framework for identifying microstructures in irradiated U-10Zr (wt. %) metallic fuel with limited annotated data. The framework includes the creation of a reliable annotated dataset with paired SEM and ground truth data from EDS maps, the applications of CNNs for microstructure identification, and the validation of model performance. Specifically, we employed the Segment Anything Model (SAM) to align SEM images with corresponding EDS maps and focused ion beam (FIB) tomography SEM data. We evaluate several models, including Patch-based U-Net, Attention U-Net, and Residual U-Net, finding that patch-based U-Net exhibits superior segmentation performance and consistency. This approach reduces reliance on EDS detectors and aids in accelerating nuclear material analysis process, highlighting the potential of advanced deep learning techniques to improve microstructural understanding in nuclear material. This is the first framework to integrate SAM and Patch-based CNN models for semantic segmentation of irradiated nuclear materials, with potential applicability to other tomography datasets.

36 - MATERIALS SCIENCE

Phase Retrieval Using a Genetic Algorithm on the Systematic Image-Based Optical Alignment Testbed

NASA s Marshall Space Flight Center s Systematic Image-Based Optical Alignment (SIBOA) Testbed was developed to test phase retrieval algorithms and hardware techniques. Individuals working with the facility developed the idea of implementing phase retrieval by breaking the determination of the tip/tilt of each mirror apart from the piston motion (or translation) of each mirror. Presented in this report is an algorithm that determines the optimal phase correction associated only with the piston motion of the mirrors. A description of the Phase Retrieval problem is first presented. The Systematic Image-Based Optical Alignment (SIBOA) Testbeb is then described. A Discrete Fourier Transform (DFT) is necessary to transfer the incoming wavefront (or estimate of phase error) into the spatial frequency domain to compare it with the image. A method for reducing the DFT to seven scalar/matrix multiplications is presented. A genetic algorithm is then used to search for the phase error. The results of this new algorithm on a test problem are presented.

Taylor, Jaime R.

3D GeoWall Analysis System for Shuttle External Tank Foreign Object Debris Events

An analytical, advanced imaging method has been developed for the initial monitoring and identification of foam debris and similar anomalies that occur post-launch in reference to the space shuttle s external tank (ET). Remote sensing technologies have been used to perform image enhancement and analysis on high-resolution, true-color images collected with the DCS 760 Kodak digital camera located in the right umbilical well of the space shuttle. Improvements to the camera, using filters, have added sharpness/definition to the image sets; however, image review/analysis of the ET has been limited by the fact that the images acquired by umbilical cameras during launch are two-dimensional, and are usually nonreferenceable between frames due to rotation translation of the ET as it falls away from the space shuttle. Use of stereo pairs of these images can enable strong visual indicators that can immediately portray depth perception of damaged areas or movement of fragments between frames is not perceivable in two-dimensional images. A stereoscopic image visualization system has been developed to allow 3D depth perception of stereo-aligned image pairs taken from in-flight umbilical and handheld digital shuttle cameras. This new system has been developed to augment and optimize existing 2D monitoring capabilities. Using this system, candidate sequential image pairs are identified for transformation into stereo viewing pairs. Image orientation is corrected using control points (similar points) between frames to place the two images in proper X-Y viewing perspective. The images are then imported into the WallView stereo viewing software package. The collected control points are used to generate a transformation equation that is used to re-project one image and effectively co-register it to the other image. The co-registered, oriented image pairs are imported into a WallView image set and are used as a 3D stereo analysis slide show. Multiple sequential image pairs can be used to allow forensic review of temporal phenomena between pairs. The observer, while wearing linear polarized glasses, is able to review image pairs in passive 3D stereo.

Brown, Richard

The Inter-Calibration of the DSCOVR EPIC Imager 2 with Aqua-MODIS and NPP-VIIRS

The Deep Space Climate Observatory (DSCOVR) Earth Polychromatic Imaging Camera (EPIC) continuously observes the illuminated disk from the Lagrange-1 point. The EPIC sensor was designed to monitor the diurnal variation of ozone, clouds, aerosols, and vegetation, especially those features that benefit from observation near-backscatter conditions. The EPIC sensor does not contain any onboard calibration systems. This study describes the inter-calibration of EPIC channels 5 (0.44 μm), 6 (0.55 μm), 7 (0.68 μm), and 10 (0.78 μm) with respect to Aqua-MODIS and NPP-VIIRS. The calibration is transferred using coincident ray-matched reflectance pairs over all-sky tropical ocean (ATO) and deep convective cloud (DCC) targets. A robust and automated image-alignment technique based on feature matching was formulated to improve the navigation quality of the EPIC images. The EPIC V02 dataset exhibits improved navigation over V01. Because the visible channels display similar spatial features, a single visible channel can be used to co-register the remaining visible bands. The VIIRS-referenced EPIC ATO and DCC ray-matched calibration coefficients are within 0.3%. The EPIC four-year calibration trends based on VIIRS are within 0.15%/year. The MODIS-based EPIC calibration coefficients were compared against the Geogdzhayev and Marshak 2018 published calibration coefficients and are found to be within 1.6%.

DSCOVR

Methodology for the Elimination of Reflection and System Vibration Effects in Particle Image Velocimetry Data Processing

A methodology to eliminate model reflection and system vibration effects from post processed particle image velocimetry data is presented. Reflection and vibration lead to loss of data, and biased velocity calculations in PIV processing. A series of algorithms were developed to alleviate these problems. Reflections emanating from the model surface caused by the laser light sheet are removed from the PIV images by subtracting an image in which only the reflections are visible from all of the images within a data acquisition set. The result is a set of PIV images where only the seeded particles are apparent. Fiduciary marks painted on the surface of the test model were used as reference points in the images. By locating the centroids of these marks it was possible to shift all of the images to a common reference frame. This image alignment procedure as well as the subtraction of model reflection are performed in a first algorithm. Once the images have been shifted, they are compared with a background image that was recorded under no flow conditions. The second and third algorithms find the coordinates of fiduciary marks in the acquisition set images and the background image and calculate the displacement between these images. The final algorithm shifts all of the images so that fiduciary mark centroids lie in the same location as the background image centroids. This methodology effectively eliminated the effects of vibration so that unbiased data could be used for PIV processing. The PIV data used for this work was generated at the NASA Langley Research Center Quiet Flow Facility. The experiment entailed flow visualization near the flap side edge region of an airfoil model. Commercial PIV software was used for data acquisition and processing. In this paper, the experiment and the PIV acquisition of the data are described. The methodology used to develop the algorithms for reflection and system vibration removal is stated, and the implementation, testing and validation of these algorithms are presented.

Bremmer, David M.

Support Routines for In Situ Image Processing

This software consists of a set of application programs that support ground-based image processing for in situ missions. These programs represent a collection of utility routines that perform miscellaneous functions in the context of the ground data system. Each one fulfills some specific need as determined via operational experience. The most unique aspect to these programs is that they are integrated into the large, in situ image processing system via the PIG (Planetary Image Geometry) library. They work directly with space in situ data, understanding the appropriate image meta-data fields and updating them properly. The programs themselves are completely multimission; all mission dependencies are handled by PIG. This suite of programs consists of: (1)marscahv: Generates a linearized, epi-polar aligned image given a stereo pair of images. These images are optimized for 1-D stereo correlations, (2) marscheckcm: Compares the camera model in an image label with one derived via kinematics modeling on the ground, (3) marschkovl: Checks the overlaps between a list of images in order to determine which might be stereo pairs. This is useful for non-traditional stereo images like long-baseline or those from an articulating arm camera, (4) marscoordtrans: Translates mosaic coordinates from one form into another, (5) marsdispcompare: Checks a Left Right stereo disparity image against a Right Left disparity image to ensure they are consistent with each other, (6) marsdispwarp: Takes one image of a stereo pair and warps it through a disparity map to create a synthetic opposite- eye image. For example, a right eye image could be transformed to look like it was taken from the left eye via this program, (7) marsfidfinder: Finds fiducial markers in an image by projecting their approximate location and then using correlation to locate the markers to subpixel accuracy. These fiducial markets are small targets attached to the spacecraft surface. This helps verify, or improve, the pointing of in situ cameras, (8) marsinvrange: Inverse of marsrange . given a range file, re-computes an XYZ file that closely matches the original. . marsproj: Projects an XYZ coordinate through the camera model, and reports the line/sample coordinates of the point in the image, (9) marsprojfid: Given the output of marsfidfinder, projects the XYZ locations and compares them to the found locations, creating a report showing the fiducial errors in each image. marsrad: Radiometrically corrects an image, (10) marsrelabel: Updates coordinate system or camera model labels in an image, (11) marstiexyz: Given a stereo pair, allows the user to interactively pick a point in each image and reports the XYZ value corresponding to that pair of locations. marsunmosaic: Extracts a single frame from a mosaic, which will be created such that it could have been an input to the original mosaic. Useful for creating simulated input frames using different camera models than the original mosaic used, and (12) merinverter: Uses an inverse lookup table to convert 8-bit telemetered data to its 12-bit original form. Can be used in other missions despite the name.

Deen, Robert G.

Characterization of Measurement Error Sources in Doppler Global Velocimetry

Doppler global velocimetry uses the absorption characteristics of iodine vapor to provide instantaneous three-component measurements of flow velocity within a plane defined by a laser light sheet. Although the technology is straightforward, its utilization as a flow diagnostics tool requires hardening of the optical system and careful attention to detail during data acquisition and processing if routine use in wind tunnel applications is to be achieved. A development program that reaches these goals is presented. Theoretical and experimental investigations were conducted on each technology element to determine methods that increase measurement accuracy and repeatability. Enhancements resulting from these investigations included methods to ensure iodine vapor calibration stability, single frequency operation of the laser and image alignment to sub-pixel accuracies. Methods were also developed to improve system calibration, and eliminate spatial variations of optical frequency in the laser output, spatial variations in optical transmissivity and perspective and optical distortions in the data images. Each of these enhancements is described and experimental examples given to illustrate the improved measurement performance obtained by the enhancement. The culmination of this investigation was the measured velocity profile of a rotating wheel resulting in a 1.75% error in the mean with a standard deviation of 0.5 m/s. Comparing measurements of a jet flow with corresponding Pitot measurements validated the use of these methods for flow field applications.

Meyers, James F.

Automation of Laser Plasma Focused Ion Beam Microscopy for Next-Gen Energy Materials

Automation can revolutionize the use of ultrafast laser ablation and plasma-focused ion beam (PFIB) techniques for high-throughput, reproducible cross-sectioning and various sample preparation in materials characterization. As these methods become essential for analyzing complex energy materials and next-generation devices, efficient, standardized workflows are needed to minimize variability and enhance precision. This work highlights our advancements in developing automated processes for sample preparation that integrates machine learning, workflow optimization, and large-scale data acquisition to improve efficiency and scalability in applications such as electrolyzers, photovoltaic cells, and microelectronics. To streamline cross-sectioning and lamella fabrication, we have implemented fully automated workflows that standardize laser ablation and PFIB milling sequences. These workflows incorporate pre-programmed protocols for material removal, alignment, and thinning, reducing user intervention and ensuring consistency across different sample types. Machine learning algorithms further enhance automation by predicting optimal milling strategies and adapting parameters based on material properties and sectioning requirements. This approach significantly improves throughput while maintaining the structural integrity of prepared samples for high-resolution imaging and analysis, including transmission electron microscopy. Beyond sample preparation, our automation platform enables the acquisition of large, high-resolution datasets through serial sectioning, image alignment, and 3D reconstruction. These automated routines facilitate multi-scale characterization, capturing structural and compositional details from the nanoscale to the device level. By reducing variability and increasing efficiency, our automated approach enhances defect analysis, failure diagnostics, and process optimization, accelerating advancements in materials research and device engineering.

36 MATERIALS SCIENCE

Surface Reconstruction of a Challenging Region with Permanent Shadows on the Moon

As the Earth is orbiting the Sun, there is the region a sunlight can't be reached on the Moon, a satellite of the Earth. Usually, the permanent shadows are located near a pole area and the surface reconstruction in the permanent shadows region is challenging because of the lack of sunlight.In this research, the reconstruction method containing the permanent shadows is suggested. To apply this method, the time-varying shadow region and a permanently shadowed region are needed to be separated. In the time-varying shadow region, the pixel intensity of the image can be composed of the albedo and the reflectance model. Using the light source direction from ISIS3 of USGS, the shape of the region can be extracted from the reflectance model. Though this region is visible in the camera, the change of illumination is quite large in this region, it is hard to reconstruct the shape using stereo-photogrammetry or SfS. So, it is needed of collecting more surface normal information from several pixel level-aligned images. In this process, the albedo information can be initialized and enhanced easily from many images.In the middle of permanent shadows, the high-resolution DEM is generated by LOLA DEM. The LOLA DEM is generated by interpolation between measured data point strips, the actual scene of the permanent shadows. Using the sensor like DIVINER, the Imaginary scene generation via a trained network between the sunlight sensor and other kinds of a sensor is suggested.

Moon, Sunghyun