Search NASA⌕ Search

SEARCH · Search NASA

Results for “stereo correlation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Optical stereo video signal processor

An otpical video signal processor is described which produces a two-dimensional cross-correlation in real time of images received by a stereo camera system. The optical image of each camera is projected on respective liquid crystal light valves. The images on the liquid crystal valves modulate light produced by an extended light source. This modulated light output becomes the two-dimensional cross-correlation when focused onto a video detector and is a function of the range of a target with respect to the stereo camera. Alternate embodiments utilize the two-dimensional cross-correlation to determine target movement and target identification.

Craig, G. D.↗

Investigating Photogrammetric Accuracy of a Lunar-lander-induced Crater Measurement System

Laboratory measurements have been made to validate the performance of the Stereo CAmeras for Lunar Plume-Surface Studies (SCALPSS) stereo photogrammetry systems which will be flying to the moon on two of NASA’s upcoming Commercial Lunar Payload Services (CLPS) missions. Until recently, the system’s accuracy had only been studied using idealized geometric shapes as measurement targets. A realistic crater model of representative scale and an idealized ‘staircase’ target have been used to compare measurement accuracy of ideal versus lunar-like objects, with the commercial V-STARS® system being used to provide the known reference values for comparison. In a parametric study, altitude, lens focal length, and camera separation are varied to assess each parameter’s impact on photogrammetric accuracy in relation to the scaling law prediction developed previously. The SCALPSS 1.0 and 1.1 configurations have been validated on the crater model within acceptable accuracy for the missions, performing significantly better than the scaling law prediction in some cases. A semi-automated post-processing routine was developed in MATLAB® and proved successful for the cross-correlation of features between two stereo images. For some cases of extreme convergence angles between a camera pair, manual feature detection and matching was required. By using this manual process, the crater depth map was reconstructed but with worse accuracy than the idealized staircase measurements; refinements to the processing algorithm are expected to improve future results. Also examined in this work is the impact of illumination environments, both natural (e.g., Sun angles) and artificial (diffuse or structured illumination sources), on the camera system’s ability to measure the erosion of the lunar terrain.

Plume-surface interaction↗

Investigating Photogrammetric Accuracy of a Lunar-lander-induced Crater Measurement System

Laboratory measurements have been made to validate the performance of the Stereo CAmeras for Lunar Plume-Surface Studies (SCALPSS) stereo photogrammetry systems which will be flying to the moon on two of NASA’s upcoming Commercial Lunar Payload Services (CLPS) missions. Until recently, the system’s accuracy had only been studied using idealized geometric shapes as measurement targets. A realistic crater model of representative scale and an idealized ‘staircase’ target have been used to compare measurement accuracy of ideal versus lunar-like objects, with the commercial V-STARS® system being used to provide the known reference values for comparison. In a parametric study, altitude, lens focal length, and camera separation are varied to assess each parameter’s impact on photogrammetric accuracy in relation to the scaling law prediction developed previously. The SCALPSS 1.0 and 1.1 configurations have been validated on the crater model within acceptable accuracy for the missions, performing significantly better than the scaling law prediction in some cases. A semi-automated post-processing routine was developed in MATLAB® and proved successful for the cross-correlation of features between two stereo images. For some cases of extreme convergence angles between a camera pair, manual feature detection and matching was required. By using this manual process, the crater depth map was reconstructed but with worse accuracy than the idealized staircase measurements; refinements to the processing algorithm are expected to improve future results. Also examined in this work is the impact of illumination environments, both natural (e.g., Sun angles) and artificial (diffuse or structured illumination sources), on the camera system’s ability to measure the erosion of the lunar terrain.

Plume-surface interaction↗

Stereo and IMU-Assisted Visual Odometry for Small Robots

This software performs two functions: (1) taking stereo image pairs as input, it computes stereo disparity maps from them by cross-correlation to achieve 3D (three-dimensional) perception; (2) taking a sequence of stereo image pairs as input, it tracks features in the image sequence to estimate the motion of the cameras between successive image pairs. A real-time stereo vision system with IMU (inertial measurement unit)-assisted visual odometry was implemented on a single 750 MHz/520 MHz OMAP3530 SoC (system on chip) from TI (Texas Instruments). Frame rates of 46 fps (frames per second) were achieved at QVGA (Quarter Video Graphics Array i.e. 320 240), or 8 fps at VGA (Video Graphics Array 640 480) resolutions, while simultaneously tracking up to 200 features, taking full advantage of the OMAP3530's integer DSP (digital signal processor) and floating point ARM processors. This is a substantial advancement over previous work as the stereo implementation produces 146 Mde/s (millions of disparities evaluated per second) in 2.5W, yielding a stereo energy efficiency of 58.8 Mde/J, which is 3.75 better than prior DSP stereo while providing more functionality.

Source record↗

Remotely-Sensed Geology from Lander-Based to Orbital Perspectives: Results for FIDO Rover Field Tests

Tests of the FIDO (Field Integration Design and Operations) rover and Athena-like operational scenarios were conducted May 7-16, 2000. A group located at the Jet Propulsion Lab, Pasadena, CA, formed the Core Operations Team (COT) that designed experiments and command sequences while another team tracked, maintained, and secured the rover in the field. The COT had no knowledge of the specific field location, thus the tests were done "blind." In addition to FIDO rover instrumentation, the COT had access to LANDSAT 7, TIMS, and AVIRIS regional coverage and color descent images. Using data from the FIDO instruments, primarily a color microscopic imager (CMI), infrared point spectrometer (IPS; 1.5-2.4 microns), and a three-color stereo panoramic camera (Pancam), the COT correlated lithologic features (mineralogy, rock types) from the simulated landing site to a regional scale. The May test results provide an example of how to relate site geology from landed rover investigations to the regional geology using remote sensing. The capability to relate mineralogic signatures using the point IR spectrometer to remotely sensed, multispectral or hyperspectral data proved to be key to integration of the in-situ and remote data. This exercise demonstrated the potential synergy between lander-based and orbital data, and highlighted the need to investigate a landing site in detail and at multiple scales.

Jolliff, B.↗

A Multi‐Probe Automated Classification of Ice Crystal Habits During the IMPACTS Campaign

Although all ice crystals are unique, many can be grouped together by shape or habit, with members of a habit class sharing similar representations of properties such as fall velocity and growth rate. A decision tree algorithm designed to be adaptable to any particle imaging probe, thus enabling the creation of habit size distributions over a size range larger than that of any probe on its own, is used to classify ice crystals imaged by three airborne cloud probes in mid-latitude winter cyclones during the Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS) field campaign. Crystals are sorted into seven habit classes based on their morphological properties: sphere, column/needle, plate, graupel, dendrite, aggregate, and irregular. Although adaptability was its primary goal, the algorithm was found to be moderately skillful for identifying idealized habit images. Quantitative tests of the algorithm’s adaptability displayed mixed results, as Two-Dimensional Stereo Probe (2DS) classifications showed moderate correlation with Particle Habit Imaging and Polar Scattering Probe (PHIPS) classifications, but only weak correlation with High Volume Precipitation Spectrometer (HVPS) classifications. The algorithm was applied to random sets of images from each probe in a case study of a mesoscale snow band sampled on 7 February 2020. In the case study, qualitative analysis of particle images revealed general agreement on classifications among the probes, supporting the algorithm’s applicability to multiple cloud probes. Most classifications appeared correct upon manual inspection, suggesting that in practical use, the algorithm is reasonably able to classify non-idealized images.

Julian Schima↗

Moments applied in the manual assembly of space structures - Ease biomechanics results from STS-61B

Measurements of the level and pattern of moments applied in the manual assembly of a space structure were made in extravehicular activity (EVA) and neutral buoyancy simulation (NBS). The Experimental Assembly of Structures in EVA program included the repeated assembly of a 3.6 m tetrahedral truss structure in EVA on STS-61B after extensive neutral buoyancy crew training. The flight and training structures were of equivalent mass and geometry to allow a direct correlation between EVA and NBS performance. A stereo photographic motion camera system was used to reconstruct in three dimensions rotational movements of structural beams during assembly. Moments applied in these manual handling tasks were calculated on the basis of the reconstructed movements taking into account effects of inertia, drag and virtual mass. Applied moments of 2.0 Nm were typical for beam rotations in EVA. Corresponding applied moments in NBS were typically up to five times greater. Moments were applied as impulses separated by several seconds of coasting in both EVA and NBS. Decelerating impulses were only infrequently observed in NBS.

Cousins, D.↗

Regional Rates of Young US Forest Growth Estimated From Annual Landsat Disturbance History and IKONOS Stereo Imagery

Forests of the Contiguous United States (CONUS) have been found to be a large contributor to the global atmospheric carbon sink. The magnitude and nature of this sink is still uncertain and recent studies have sought to define the dynamics that control its strength and longevity. The Landsat series of satellites has been a vital resource to understand the long-term changes in land cover that can impact ecosystem function and terrestrial carbonstock. We combine annual Landsat forest disturbance history from 1985 to 2011 with single date IKONOS stereoimagery to estimate the change in young forest canopy height and above ground live dry biomass accumulation for selected sites in the CONUS. Our approach follows an approximately linear growth rate following clearing over short intervals and does not estimate the distinct non-linear growth rate over longer intervals.We produced canopy height models by differencing digital surface models estimated from IKONOS stereo pairs with national elevation data (NED). Correlations between height and biomass were established independently using airborne LiDAR, and then applied to the IKONOS-estimated canopy height models. Graphing current biomass against time since disturbance provided biomass accumulation rates. For 20 study sites distributed across five regions of the CONUS, 19 showed statistically significant recovery trends (p is less than 0.001) with canopy growth from 0.26 m yr-1to 0.73 m yr-1. Above ground live dry biomass (AGB) density accumulation ranged from 1.31 t/ha yr-1 to 12.47 t/ha yr-1. Mean forest AGB accumulationwas 6.31 t/ha yr-1 among all sites with significant growth trends. We evaluated the accuracy of our estimates by comparing to field estimated site index curves of growth, airborne LiDAR data, and independent model predictions of C accumulation. Growth estimates found with this approach are consistent with site index curves and total biomass estimates fall within the range of field estimates. This is aviable approach to estimate forest biomass accumulation in regions with clear-cut harvest disturbances.

Neigh, Christopher S. R.↗

Near real-time stereo vision system

The apparatus for a near real-time stereo vision system for use with a robotic vehicle is described. The system is comprised of two cameras mounted on three-axis rotation platforms, image-processing boards, a CPU, and specialized stereo vision algorithms. Bandpass-filtered image pyramids are computed, stereo matching is performed by least-squares correlation, and confidence ranges are estimated by means of Bayes' theorem. In particular, Laplacian image pyramids are built and disparity maps are produced from the 60 x 64 level of the pyramids at rates of up to 2 seconds per image pair. The first autonomous cross-country robotic traverses (of up to 100 meters) have been achieved using the stereo vision system of the present invention with all computing done onboard the vehicle. The overall approach disclosed herein provides a unifying paradigm for practical domain-independent stereo ranging.

Anderson, Charles H.↗

Local parallel models for integration of stereo matching constraints and intrinsic image combination

Parallel relaxation computations such as those of connectionist networks offer a useful model for constraint integration and intrinsic image combination in developing a general-purpose stereo matching algorithm. This paper describes such a stereo algorithm that incorporates hierarchical, surface-structure, and edge-appearance constraints that are redefined and integrated at the level of individual candidate matches. The algorithm produces a high percentage of correct decisions on a wide variety of stereo pairs. Its few errors arise when the correlation measures defined by the constraints are either weakened or ambiguous, as in the case of periodic patterns in the images. Two additional mechanisms are discussed for overcoming the remaining errors.

Stewart, Charles V.↗

Stanford automatic photogrammetry research

A feasibility study on the problem of computer automated aerial/orbital photogrammetry is documented. The techniques investigated were based on correlation matching of small areas in digitized pairs of stereo images taken from high altitude or planetary orbit, with the objective of deriving a 3-dimensional model for the surface of a planet.

Quam, L. H.↗

Stereo Imaging Tactical Helper

The Stereo Imaging Tactical Helper (SITH) program displays left and right images in stereo using the display technology made available by the JADIS framework. An overlay of the surface described by the disparity map (generated from the left and right images) allows the map to be compared to the actual images. In addition, an interactive cursor, whose visual depth is controlled by the disparity map, is used to ensure the correlated surface matches the real surface. This enhances the ability of operations personnel to provide quality control for correlation results, as well as to greatly assist developers working on correlation improvements. While its primary purpose is as a quality control tool for inspecting correlation results, SITH is also straightforward for use as a basic stereo image viewer

Toole, Nicholas T.↗

Extraction of topography from side-looking satellite systems A case study with SPOT simulation data

Techniques for reconstructing topographic data from side-looking satellite systems have been developed whereby nadir and off-nadir passes are coaligned to calculate the stereo displacement for each pixel in the nadir view by correlating a small subarea to a corresponding subarea in the off-nadir pass. The correlation algorithm was tested on two pairs of data sets consisting of patterns of bars and boxes and then applied to the SPOT simulation data set. The correlation was a maximum in areas where the relief was changing gradually, while in areas of constantly changing topography, the correlation decreased.

Ungar, S. G.↗

Information extraction from digital images of the earth and the planets

An overview is presented of recent developments at the JPL Image Processing Laboratory which emphasize the utilization of a digital computer to automate the process of information extraction from digital imagery. Consideration is given to: (1) the analysis of Viking Orbiter stereo imagery to determine elevation profiles of the Mars surface, (2) the use of Viking Lander stereo imagery to determine nonhazardous surface sample acquisition strategies, (3) the correlation of Landsat imagery with geographically referenced cultural data to determine land use trends, and (4) the generation of mosaics using digital computer techniques.

Green, W. B.↗

Analytical ice shape predictions for flight in natural icing conditions

LEWICE is an analytical ice prediction code that has been evaluated against icing tunnel data, but on a more limited basis against flight data. Ice shapes predicted by LEWICE is compared with experimental ice shapes accreted on the NASA Lewis Icing Research Aircraft. The flight data selected for comparison includes liquid water content recorded using a hot wire device and droplet distribution data from a laser spectrometer; the ice shape is recorded using stereo photography. The main findings are as follows: (1) An equivalent sand grain roughness correlation different from that used for LEWICE tunnel comparisons must be employed to obtain satisfactory results for flight; (2) Using this correlation and making no other changes in the code, the comparisons to ice shapes accreted in flight are in general as good as the comparisons to ice shapes accreted in the tunnel (as in the case of tunnel ice shapes, agreement is least reliable for large glaze ice shapes at high angles of attack); (3) In some cases comparisons can be somewhat improved by utilizing the code so as to take account of the variation of parameters such as liquid water content, which may vary significantly in flight.

Berkowitz, Brian M.↗

Observations by the Mars 1994 orbiter and possible correlations with Mars Pathfinder

The Mars '94 spacecraft will still be operational when Mars Pathfinder begins its observations. While it will probably not be possible to detect the lander directly, the terrain, including the landing error ellipse, can be covered in high resolution (10 m) in various color bands. The stereo capability of the high resolution camera will provide a three-dimensional terrain map. The landing site of Pathfinder could possibly be chosen so that correlated observations of IMP and the remote sensing instruments onboard Mars '94 may be possible. We will discuss this scenario based on the presently adopted Mars '94 orbit and resulting enhancements stemming from correlations of data obtained by both spacecraft.

Keller, H. Uwe↗

Radar systems for a polar mission, volume 3, appendices A-D, S, T

Success is reported in the radar monitoring of such features of sea ice as concentration, floe size, leads and other water openings, drift, topographic features such as pressure ridges and hummocks, fractures, and a qualitative indication of age and thickness. Scatterometer measurements made north of Alaska show a good correlation with a scattering coefficient with apparent thickness as deduced from ice type analysis of stereo aerial photography. Indications are that frequencies from 9 GHz upward seem to be better for sea ice radar purposes than the information gathered at 0.4 GHz by a scatterometer. Some information indicates that 1 GHz is useful, but not as useful as higher frequencies. Either form of like-polarization can be used and it appears that cross-polarization may be more useful for thickness measurement. Resolution requirements have not been fully established, but most of the systems in use have had poorer resolution than 20 meters. The radar return from sea ice is found to be much different than that from lake ice. Methods to decrease side lobe levels of the Fresnel zone-plate processor and to decrease the memory requirements of a synthetic radar processor are discussed.

Moore, R. K.↗