Search NASASearch

Engineering topics

Monroe, Stanley E., Jr.

Publications and source records attributed to Monroe, Stanley E., Jr..

Correlation Techniques as Applied to Pose Estimation in Space Station Docking

The telerobotic assembly of space-station components has become the method of choice for the International Space Station (ISS) because it offers a safe alternative to the more hazardous option of space walks. The disadvantage of telerobotic assembly is that it does not provide for direct arbitrary views of mating interfaces for the teleoperator. Unless cameras are present very close to the interface positions, such views must be generated graphically, based on calculated pose relationships derived from images. To assist in this photogrammetric pose estimation, circular targets, or spots, of high contrast have been affixed on each connecting module at carefully surveyed positions. The appearance of a subset of spots essentially must form a constellation of specific relative positions in the incoming digital image stream in order for the docking to proceed. Spot positions are expressed in terms of their apparent centroids in an image. The precision of centroid estimation is required to be as fine as 1I20th pixel, in some cases. This paper presents an approach to spot centroid estimation using cross correlation between spot images and synthetic spot models of precise centration. Techniques for obtaining sub-pixel accuracy and for shadow, obscuration and lighting irregularity compensation are discussed.

Rollins, J. Michael

Advances in Full-Face, Full-Complex SLM Characterization

If an optical correlator is to perform at full potential, the filtersrnith must know what complex action will result from the control he applies to the filter Spatial Light Modulator (SLM). If the SLM is spatially variant (and all are, to some degree or other), the behavior may be different at every frequency plane pixel. We have previously reported characterization of the full-complex behavior at every pixel of an SLM. We have refined the method in two distinct ways: we are doing multi-step interferometry (rather than only phase quadrature), and we have significantly improved the isolation of an individual pixel's complex action. We show the methods and results.

Juday, Richard D.

A hybrid six degree-of-freedom tracking system

An optical/digital/mechanical six degree of freedom tracking system using an optical correlator for image processing is being constructed at NASA's Johnson Space Center. The degrees of freedom are expressed in sensor coordinates as azimuth, elevation, range, line-of-sight rotation, and the two out-of-plane object rotation angles. Hardware for an initial configuration has been assembled and various tracking algorithms and filtering techniques are being implemented and evaluated. The current correlator hardware is based on LCTV SLMs from a commercial television projector. Correlation peak detection and measurement are made using commercially available digital image processing boards. Out-of-plane object rotation, range, and line-of-sight rotation are tracked by various correlation filter techniques. Performance of the current system is presented, as are plans for future configurations.

Monroe, Stanley E., Jr.

Autonomous planetary landing guidance by optical correlation

We describe our planned use of optical correlation in landmark navigation associated with planetary landing. Standard correlation provides 'pointing-to' information, giving the vector to the landmark from the spacecraft in the spacecraft frame. The synthetic estimation filter (SEF) provides 'pointing-from' information, estimating the vector from the landmark to the spacecraft. Digital and optical SEFs were constructed and compared using a Martian-like 3D modelboard to provide test images. The digital SEF worked reasonably well, but the optical SEF did not perform as expected. The optical SEF was implemented with a liquid crystal television (LCTV) correlator that had been used successfully in previous SEF experiments using a spacecraft model. The results suggest the SLM model for the LCTV needs further refinements. Both the digital and optical filter provided good pointing-to results. We did not plot the correlation surface for the digital SEF response, and though it is less sharp than the POF, it had only a one-pixel variation in the peak location. Surface plots for the conventional optical phase-only filter produced a correlation peak that was sharp enough to be located within two pixels.

Knopp, Jerome

Joint transform correlation with the synthetic estimation filter

The synthetic estimation filter (SEF) combines a set of input images into a much smaller set of filters. Those input images correspond to views of a known object taken with a variety of values of the pose parameter to be estimated. The response of the filter to variations in the pose parameter is tailored so that estimation can be done to a precision considerably finer than the intervals between filters in the pose space. The technique is extended to the joint transform correlator; as a reference, the composite image from which the SEF is conventionally calculated is used. Precautions are necessary for practical reasons. For example, the SEF algorithm may call for negative values in the image, an unrealizable condition with amplitude encoding, whereas with phase-mostly filtering in the SEF, negative image values are easily accommodated.

Monroe, Stanley E., Jr.

Optical calculation of correlation filters

A method is presented for designing optical correlation filters based on measuring intensity patterns in the Fourier plane. The method can be used in general to design any type of frequency plane filter but is especially attractive in the case of a binary phase only filter (BPOF). The method can produce a filter that is well matched to both the object, its transforming optical system and the spatial light modulator used in the correlator input plane. A working filter was produced using the technique, but the filter response was weak. The suspected causes of the weak output are imprecise Fourier plane positioning, nonlinearities in the recording process, and/or aliasing effects.

Knopp, Jerome

'Backscratching' alternative to PRSI pattern recognition

The Backscratching optical correlation algorithm has been proposed for four degree of freedom tracking. In an alternating Cartesian and log-polar implementation, the tracked parameters are scale, rotation, and two-dimenisonal translation. The algorithm has a finite capture radius in the four-dimensional tracking space. The capture radius is dependent on the tracked object, the correlator architecture, and the method of filter computation. Some methods of extending the capture radius are discussed. One is a modification of matched filters, another is a careful consideration of log-polar transform center, and another is an operational method. Some simulations of the filter construction method, in which a larger capture radius is gained at the expense of precision in determining the four parameters are presented.

Monroe, Stanley E., Jr.

Multidimensional synthetic estimation filter

The synthetic estimation filter (SEF) crafts an affine variation into its response to a changing parameter (e.g. scale or rotation). Sets of such filters are used in an estimation correlator to reduce the number of filters required for a given tracking accuracy. By overspecifying the system (one more SEF than parameters to be tracked), the ratio of correlation responses between filters forms a robust estimator into the spanned domain of the parameters. Previous results dealt with a laboratory correlator which could track a single parameter. This paper explores the SEF and the estimator's extension to more dimensions. A 2D example is given in which a reduction of filters from 25 to 3 is demonstrated to span a 4-degree square portion of pose space.

Monroe, Stanley E., Jr.

Synthetic Estimation Filters For Determination Of Position

Concept of synthetic estimation filter (SEF) proposed to extend concept of matched filter from mere recognition of object to recognition of position and orientation relative to observing apparatus. Optical filter of this general type correlated with input image to obtain signal indicative of match between input and filter images.

Juday, Richard D.

Laboratory comparison of continuous vs. binary phase-mostly filters

Recent developments in spatial light modulators have led to devices which are capable of continuous phase modulation, even if only over a limited range. One of these devices, the deformable mirror device is used, to compare the relative merits of binary and partially-continuous phase filters in a specific problem of pattern recognition by optical correlation. Each filter was physically limited to only about a radiation of modulation. Researchers have predicted that for low input noise levels, continuous phase-only filters should have a higher absolute correlator peak output than the corresponding binary filters, as well as having a larger SNR. When continuous and binary filters were implemented on the DMD and they exhibited the same performance; an ad hoc filter optimization procedure was developed for use in the laboratory. The optimized continuous filter gave higher correlation peaks than did an independently optimized binary filter. Background behavior in the correlation plane was similar for the two filters, and thus the SNR showed the same improvement for the continuous filter. A phasor diagram analysis and computer simulation have explained part of the optimization procedure's success.

Monroe, Stanley E., Jr.

Laboratory results using the synthetic estimation filter

The synthetic estimation filter (SEF) was previously designed for implementation in an optical correlator. The intent was to find a simple method that would reduce the number of reference images necessary to track six degrees of freedom of an object, while avoiding the more complicated computations necessary in other methods of similar intent. Initial laboratory results are shown for estimating in-plane rotation with a minimal number of filters.

Monroe, Stanley E., Jr.

Optical correlation with phase encoding and phase filtering

The image-encoding optical activity of a deformable-mirror device (DMD) has been investigated by means of numerical simulations in the Fourier plane. Simulation results are presented which reveal the sensitivity of phase-encoded/phase-filtered systems to noise, in-plane rotation, and magnification. The present simulations are based on phase-only modulation in the input and filter planes, and do not illustrate the 'phase-mostly' nature of the devices. A procedure to achieve a filter for a real system is proposed based on a simplistic model of a DMD pixel and preliminary device data.

Juday, Richard D.

Extension of synthetic estimation filters for relative position measurements

The construction of synthetic estimation filters (SEF) for out-of-plane rotation is reported. When images corresponding to rotations between the angles which were used to construct the estimator were input to the simulator, the yaw measurement accuracy was a little better than one-half of a degree over the five degree range. If individual phase-only filters were used and the only criteria for yaw angle was 'best correlation', 11 filter would be required for the same range and accuracy. The technique proposed here is invariant to translation.

Monroe, Stanley E., Jr.

Synthetic estimation filters for a control system

Hybrid optical correlators, which use spatial light modulators and solid state imagers to interface computers and optical Fourier correlators, will allow the rapid changing of filters and digital pre- or post-correlation processing in vision systems. However, optical correlation (particulary with phase-only filtration) is notoriously sensitive to mismatches of rotation and magnification between the reference image and the input image. Such sharpness is not always desirable if the correlation pattern is to be used in a control system. Two methods of conforming the response of an inherently sharp-response optical correlation to an in plane rotation between reference and object images are discussed. The objective is to condition the correlation for better suitability to a vision-controlled system. The first method is controlled convolutional blurring of a reference image followed by construction of a matched filter (perhaps implemented as a phase-only filter). An alternative is discussed in more detail: it is a synthesis from sharp filters, so weighted as to produce a specified off-center behavior.

Juday, Richard D.