mist: Multispectral Image Similarity Transformation
This document describes work intended to aid in the problem of automatically registering two images of dissimilar type.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This document describes work intended to aid in the problem of automatically registering two images of dissimilar type.
A method for registering a first image to a second image using a similarity transformation. The each image includes a plurality of pixels. The first image pixels are mapped to a set of first image coordinates and the second image pixels are mapped to a set of second image coordinates. The first image coordinates of two reference points in the first image are determined. The second image coordinates of these reference points in the second image are determined. A Cartesian translation of the set of second image coordinates is performed such that the second image coordinates of the first reference point match its first image coordinates. A similarity transformation of the translated set of second image coordinates is performed. This transformation scales and rotates the second image coordinates about the first reference point such that the second image coordinates of the second reference point match its first image coordinates.
An experimental comparison of several similarity measures and preprocessing techniques used for the registration of temporally differing images is carried out. It is found that preprocessing of the images via a gradient operator improves the registration performance. This is in agreement with a derived optimal processor based upon image and temporal difference characteristics.
This research aimed in creating new compression methods based on the central idea of Set Redundancy Compression (SRC). Set Redundancy refers to the common information that exists in a set of similar images. SRC compression methods take advantage of this common information and can achieve improved compression of similar images by reducing their Set Redundancy. The current research resulted in the development of three new lossless SRC compression methods: MARS (Median-Aided Region Sorting), MAZE (Max-Aided Zero Elimination) and MaxGBA (Max-Guided Bit Allocation).
One criterion of image quality is its geometric similarity to the control test. The ability of television, phototelevision, phototelegraphic, and other systems to transmit geometrically similar images is characterized by the geometric distortion coefficient. Linear distortions result from the inaccuracy of scanning mechanism element assembly, and distortions can be minimized during adjustment operations or may be easily compensated during image reception. Brief descriptions are given of the possible sources of nonlinear distortions which arise in these devices due to the scanning mechanism, objective distortion, or the nodding mirror.
Simulation studies of selected aircraft and spacecraft acquired images were initiated in response to anticipated desires of the user community for simulated imagery prior to launch of ERTS-A. Principal modes of simulation included: (1) areas of coverage comparable to ERTS; (2) spatial resolutions within these images similar to ERTS; (3) spectral responses analogous to that expected from each channel on both the return beam vidicon and multispectral scanner, leading to production of photographic images that should appear similar to those representing each band in the two sensors; and (4) runthroughs of several analytical techniques, such as color density slicing, color additive viewing, and computer-generated reflectance and surface temperature maps, by which ERTS data can be analyzed, interpreted, and applied. The two areas involved in the simulation study were Wyoming and the Chesapeake Bay region.
The spatial and temporal stability of the distributions of satellite-measured visible and infrared radiances, caused by variations in clouds and surfaces, are investigated using bidimensional and monodimensional histograms and time-composite images. Similar analysis of the histograms of the original and time-composite images provides separation of the contributions of the space and time variations to the total variations. The variability of both the surfaces and clouds is found to be larger at scales much larger than the minimum resolved by satellite imagery. This study shows that the shapes of these histograms are distinctive characteristics of the different climate regimes and that particular attributes of these histograms can be related to several general, though not universal, properties of clouds and surface variations at regional and synoptic scales. There are also significant exceptions to these relationships in particular climate regimes. The characteristics of these radiance histograms provide a stable well defined descriptor of the cloud and surface properties.
New wide bandgap semiconductor materials are being developed to meet the diverse high temperature, -power, and -frequency demands of the aerospace industry. Two of the most promising emerging materials are silicon carbide (SiC) for high-temperature and high power applications and gallium nitride (GaN) for high-frequency and optical (blue-light-emitting diodes and lasers) applications. This past year Glenn scientists implemented a NASA-patented crystal growth process for producing arrays of device-size mesas whose tops are atomically flat (i.e., step-free). It is expected that these mesas can be used for fabricating SiC and GaN devices with major improvements in performance and lifetime. The promising new SiC and GaN devices are fabricated in thin-crystal films (known as epi films) that are grown on commercial single-crystal SiC wafers. At this time, no commercial GaN wafers exist. Crystal defects, known as screw defects and micropipes, that are present in the commercial SiC wafers propagate into the epi films and degrade the performance and lifetime of subsequently fabricated devices. The new technology isolates the screw defects in a small percentage of small device-size mesas on the surface of commercial SiC wafers. This enables atomically flat surfaces to be grown on the remaining defect-free mesas. We believe that the atomically flat mesas can also be used to grow GaN epi films with a much lower defect density than in the GaN epi films currently being grown. Much improved devices are expected from these improved low-defect epi films. Surface-sensitive SiC devices such as Schottky diodes and field effect transistors should benefit from atomically flat substrates. Also, we believe that the atomically flat SiC surface will be an ideal surface on which to fabricate nanoscale sensors and devices. The process for achieving atomically flat surfaces is illustrated. The surface steps present on the "as-received" commercial SiC wafer is also illustrated. because of the small tilt angle between the crystal "basal" plane and the polished wafer surface. These steps are used in normal SiC epi film growth in a process known as stepflow growth to produce material for device fabrication. In the new process, the first step is to etch an array of mesas on the SiC wafer top surface. Then, epi film growth is carried out in the step flow fashion until all steps have grown themselves out of existence on each defect-free mesa. If the size of the mesas is sufficiently small (about 0.1 by 0.1 mm), then only a small percentage of the mesas will contain an undesired screw defect. Mesas with screw defects supply steps during the growth process, allowing a rough surface with unwanted hillocks to form on the mesa. The improvement in SiC epi surface morphology achievable with the new technology is shown. An atomic force microscope image of a typical SiC commercial epilayer surface is also shown. A similar image of an SiC atomically flat epi surface grown in a Glenn laboratory is given. With the current screw defect density of commercial wafers (about 5000 defects/cm2), the yield of atomically free 0.1 by 0.l mm mesas is expected to be about 90 percent. This is large enough for many types of electronic and optical devices. The implementation of this new technology was recently published in Applied Physics Letters. This work was initially carried out in-house under a Director's Discretionary Fund project and is currently being further developed under the Information Technology Base Program.
One of the most intriguing scientific questions about Mercury is whether the planet possesses a liquid core. One way that this can be ascertained is through the measurement of the longitudinal libration of Mercury about its rotation axis. The MESSENGER (Mercury Surface, Space, Environment, Geochemistry, and Ranging) mission to Mercury will attempt this measurement by deriving the rotation of the planet from remotely sensed observations of the Mercury gravity field and the planet's shape. For a fully fluid core the libration is expected to be an approximately 350-m-amplitude oscillation (at the equator) about the mean rotation of the planet. Thus, the shape of the planet undergoes a librational oscillation in the same way that features on the surface participate in the motion. In this sense altimetric topography can be considered analogous to imaging, with the important exception that for altimetry, the long wavelengths corresponding to low degrees and orders in a spherical harmonic expansion, can be precisely determined from orbital measurements. The rotation of the planet thus introduces a time dependence of the topographic image in an inertial (i.e. fixed) reference frame and the libration is a variation in the planetary rotation rate, manifest as an oscillation of the topographic image. Similarly, gravity measures the distribution of mass within a planet and as such can be viewed as providing a vertically integrated 'image' of the internal density structure. For a librating planet the gravitational field will also reveal a variation in the rotation rate, manifest as an oscillation of the field with respect to an inertial reference frame. While the long-wavelength gravity field contains contributions from the radial distribution of mass with depth, the long wavelength terms are most sensitive to the mass distribution of the deep interior. Thus, both the topography and the gravity independently can be used to determine the (irregular) rotation of a planet, although the topographical method measures the rotation of the crust while the gravity measures the rotation of the distributed mass, and these are not necessarily identical. For example, for a planet that contains a fluid outer core that is effectively decoupled from the mantle the gravity field will not librate in the manner of a solid body. The libration obtained from the variable rotation of the gravity field will represent a combination of contributions due to a librating mantle and a differentially rotating fluid core. Differential rotation of the Earth's inner core had been theoretically predicted from three dimensional geodynamical models and subsequently reported from seismic observations. A difference between the libration of the lithosphere as determined from altimetry and the deep interior as determined from gravity, if it could be detected, might provide further insight into the nature of core-mantle coupling. Additional information is contained in the original extended abstract.
Many papers have been published that further elucidate the structure of coronas in cool stars as determined from EUVE, HST, FUSE, Chandra, and XMM-Newton observations. In addition we are exploring the effects of coronas on the He I 1083081 transition that is observed in the infrared. Highlights of these are summarized below including publications during this reporting period and presentations. Ground-based magnetic Doppler imaging of cool stars suggests that active stars have active regions located at high latitudes on their surface. We have performed similar imaging in X-ray to locate the sites of enhanced activity using Chandra spectra. Chandra HETG observations of the bright eclipsing contact binary 44i Boo and Chandra LETG observations for the eclipsing binary VW Cep show X-ray line profiles that are Doppler-shifted by orbital motion. After careful analysis of the spectrum of each binary, a composite line-profile is constructed by adding the individual spectral lines. This high signal-to-noise ratio composite line-profile yields orbital velocities for these binaries that are accurate to 30 km/sec and allows their orbital motion to be studied at higher time resolutions. In conjunction with X-ray lightcurves, the phase-binned composite line-profiles constrain coronal structures to be small and located at high latitudes. These observations and techniques show the power of the Doppler Imaging Technique applied to X-ray line emission.
Examination of fluorinated ethylene propylene (FEP) copolymer specimens recovered from the Long Duration Exposure Facility (LDEF) provides evidence for degradation attributed to extended solar vacuum ultraviolet (VUV) irradiation. Scanning electron microscope (SEM) images of sheared FEP film edges reveal the presence of a highly embrittled layer on the exposed surface of specimens obtained from the trailing edge of the LDEF. Similar images obtained for leading edge and control FEP films do not exhibit evidence for such an embrittled layer. Laboratory VUV irradiation of FEP films is found to produce a damage layer similar to that witnessed in the LDEF trailing edge films. Spectroscopic analyses of irradiated films provide data to advance a photochemical mechanism for degradation.
Introduction The Porous Microstructure Analysis (PuMA) software is an open source framework for image-based simulation, primarily used to determine effective properties based on material microstructure. PuMA was originally developed for the study of NASA thermal protection materials; however, many of the solvers in PuMA have applicability to a broad range of materials science applications. PuMA version 3.2 computes material surface area, pore diameters, effective thermal conductivity, continuum and rarefied tortuosity, and permeability. For anisotropic materials, PuMA can estimate material orientation and compute anisotropic thermal conductivity and elasticity. In this talk, a brief overview of the PuMA software and underlying methods will be presented, as well as some recent and ongoing developments, including the use of immersed boundary methods for image-based simulation and the development of a new weave segmentation tool, called TomoSAM. Cut-Cell method for heat and mass transfer For simulations on complex microstructures, traditional unstructured meshing techniques often prove to be difficult and time-intensive. Voxel-based solvers, which represent the surface as a staircase structure, are relatively simple to implement but can lose accuracy when feature resolution is poor. In this work, we present a novel 3D cut-cell method for solving the variable coefficient Poisson equation on complex microstructures, suitable for the determination of effective thermal conductivity or tortuosity of a material. The method uses a Marching Cubes/Marching Squares surface reconstruction to create cut-cells and determine geometric quantities. A flux-correction method is extended to 3D, with least squares gradient reconstruction, to solve for the boundary fluxes in the cut-cells. Verification cases show the solver achieves globally 2nd order accuracy on complex microstructures. TomoSAM TomoSAM, a module of the PuMA software, has been developed as a plugin for 3D Slicer, a software platform used for 3D image processing and visualization. It utilizes the Segment Anything Model (SAM), a deep learning model capable of identifying objects and generating image masks based on minimal user input. This feature enables efficient segmentation of complex 3D datasets, particularly of woven materials, from tomography or similar imaging methods, reducing the need for manual segmentation.
The Porous Microstructure Analysis (PuMA) software is an open source framework for image-based simulation, primarily used to determine effective properties based on material microstructure. PuMA was originally developed for the study of NASA thermal protection materials; however, many of the solvers in PuMA have applicability to a broad range of materials science applications. PuMA version 3.2 computes material surface area, pore diameters, effective thermal conductivity, continuum and rarefied tortuosity, and permeability. For anisotropic materials, PuMA can estimate material orientation and compute anisotropic thermal conductivity and elasticity. In this talk, a brief overview of the PuMA software and underlying methods will be presented, as well as some recent and ongoing developments, including the use of immersed boundary methods for image-based simulation and the development of a new weave segmentation tool, called TomoSAM. Cut-Cell method for heat and mass transfer For simulations on complex microstructures, traditional unstructured meshing techniques often prove to be difficult and time-intensive. Voxel-based solvers, which represent the surface as a staircase structure, are relatively simple to implement but can lose accuracy when feature resolution is poor. In this work, we present a novel 3D cut-cell method for solving the variable coefficient Poisson equation on complex microstructures, suitable for the determination of effective thermal conductivity or tortuosity of a material. The method uses a Marching Cubes/Marching Squares surface reconstruction to create cut-cells and determine geometric quantities. A flux-correction method is extended to 3D, with least squares gradient reconstruction, to solve for the boundary fluxes in the cut-cells. Verification cases show the solver achieves globally 2nd order accuracy on complex microstructures. TomoSAM TomoSAM, a module of the PuMA software, has been developed as a plugin for 3D Slicer, a software platform used for 3D image processing and visualization. It utilizes the Segment Anything Model (SAM), a deep learning model capable of identifying objects and generating image masks based on minimal user input. This feature enables efficient segmentation of complex 3D datasets, particularly of woven materials, from tomography or similar imaging methods, reducing the need for manual segmentation.
Holographic microscopy has emerged as a tool for in situ imaging of microscopic organisms and other particles in the marine environment: appealing because of relatively larger sampling volumes and simpler optical configurations compared to similar imaging systems. However, its quantitative capabilities have remained uncertain, in part because hologram reconstruction and image recognition have required manual operation. Here we assess the quantitative skill of our automated hologram processing pipeline, the CCV Pipeline, to evaluate the size and concentration measurements of environmental and cultured assemblages of marine plankton particles, and microspheres. Over one-million particles, ranging from 10-200 microns equivalent spherical diameter (ESD), imaged by the 4-Deep HoloSea digital inline holographic microscope (DIHM) are analyzed. These measurements were collected in parallel with FlowCam, Imaging FlowCytobot, and manual microscope identification. Once corrections for particle location and nonuniform illumination were developed and applied, the DIHM showed an underestimate in ESD of about 3-10%, but successfully reproduced the size-spectral-slope from environmental samples, and the size distribution of monocultures and microspheres. DIHM concentrations (order 1-1000 particles~ml-1) showed linear agreement (r^2=0.73) with the other instruments, but individual comparisons at times had large uncertainty.
This paper describes the collection, reduction, and analysis of 0.4-1.0-micron Mars imaging spectroscopy data obtained during the 1988 and 1990 oppositions from Mauna Kea Observatory and provides a general outline for the acquisition and analysis of similar imaging spectroscopy data sets. The U.H. 2.24-m Wide Field Grism CCD Spectrograph was used to collect 13 3D image cubes covering 90 percent of the planet south of 50 deg N in the 0.4-0.8 micron region and covering 55 percent of the planet south of 50 deg N in the 0.5-1.0 micron region. Spectra extracted from these image cubes reveal the detailed character of the Martian near-UV to visible spectrum. Images at red wavelengths reveal the 'classical' albedo markings at 100-500 km spatial resolution while images at blue wavelengths show little surface feature contrast and are dominated by condensate clouds/hazes and polar ice.
We report lensing magnifications, extinction, and time-delay estimates for the first resolved, multiply imaged Type Ia supernova iPTF16geu, at z = 0.409, using Hubble Space Telescope (HST) observations in combination with supporting ground-based data. Multiband photometry of the resolved images provides unique information about the differential dimming due to dust in the lensing galaxy. Using HST and Keck AO reference images taken after the SN faded, we obtain a total lensing magnification for iPTF16geu of μ = 67.8(+2.6−2.9), accounting for extinction in the host and lensing galaxy. As expected from the symmetry of the system, we measure very short time-delays for the three fainter images with respect to the brightest one: −0.23 ± 0.99, −1.43 ± 0.74, and 1.36 ± 1.07 d. Interestingly, we find large differences between the magnifications of the four supernova images, even after accounting for uncertainties in the extinction corrections: ∆m(1) = −3.88(+0.07−0.06), ∆m(2) = −2.99(+0.09−0.08), ∆m(3) = −2.19(+0.14−0.15),and ∆m(4) = −2.40(+0.14−0.12) mag, discrepant with model predictions suggesting similar image brightnesses. A possible explanation for the large differences is gravitational lensing by substructures, micro- or millilensing, in addition to the large-scale lens causing the image separations. We find that the inferred magnification is insensitive to the assumptions about the dust properties in the host and lens galaxy.
The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) measures reflected light in 224 contiguous spectra bands in the 0.4 to 2.45 micron region of the electromagnetic spectrum. Numerous studies have used these data for mineralogic identification and mapping based on the presence of diagnostic spectral features. Quantitative mapping requires conversion of the AVIRIS data to physical units (usually reflectance) so that analysis results can be compared and validated with field and laboratory measurements. This study evaluated two different AVIRIS calibration techniques to ground reflectance: an empirically-based method and an atmospheric model based method to determine their effects on quantitative scientific analyses. Expert system analysis and linear spectral unmixing were applied to both calibrated data sets to determine the effect of the calibration on the mineral identification and quantitative mapping results. Comparison of the image-map results and image reflectance spectra indicate that the model-based calibrated data can be used with automated mapping techniques to produce accurate maps showing the spatial distribution and abundance of surface mineralogy. This has positive implications for future operational mapping using AVIRIS or similar imaging spectrometer data sets without requiring a priori knowledge.
Foam loss on the External Tank (ET) during launch can be caused by a number of factors. Voids are the best understood mechanism of foam loss, although it is known that delaminations, cracks and crushed foam can also lead to liberation of foam. Shortly after the Columbia accident, work began on non-destructive evaluation of foam targeted at finding voids and delaminations. After several months of searching for candidate methods capable of inspecting ET foam, the five most promising techniques were taken through a blind test and narrowed down to two methods to develop and use for inspection of the ET. These methods were backscatter radiography and terahertz imaging. The backscatter radiography system measures a test part by detecting Compton backscattered x-ray energy generated by a collimated beam of x-rays directed at the test subject. This collimated beam is scanned across the subject, recording scatter intensity data one pixel at a time until the area of interest is covered. The resulting data can be used to generate an image similar to a radiograph. Some depth information can be gathered utilizing apertures or collimation on the detectors. The detectors are located around the collimated source, making this a single sided inspection. The void detection limit with the currently utilized system is around 0.5 inches in diameter by 0.2 inches high. The terahertz imaging system inspects a test part by utilizing a transceiver to emit a pulse focused at the aluminum skin of the ET, which reflects it back to the transceiver where it is analyzed. The transceiver is scanned across the area of interest until a measurement has been taken at every location. Amplitude, time delay and frequency content are examined to note any discontinuities which may be the result of a void or other type of defect. The pulse currently utilized is in the millimeter wave regime. The void detection limit with this system is around 0.5 inches in diameter by 0.2 inches high. With increased interest in other causes of foam loss following the flight of Discovery in July 2005, laser shearography was added to the techniques used for inspecting ET foam. The shearography method records a sheared image of a laser speckle pattern projected on a test part before And after some sort of excitation. The resultant fringe pattern allows the slope of the out of plane displacement to be measured. For crushed and delaminated foam applications, a non-contact air coupled acoustic force is used to excite the surface of the foam. Regions without defects tend to respond differently to the sound energy than do regions with defects, generating a map of the foam integrity. Foam crushed to a depth of about 0.1 inches is detectable with shearography even after it has relaxed to its original shape.