Surface Landmark Matching and Selection in Natural Terrain
In this paper we present an algorithm for robust absolute position estimation in natural terrain based on landmarks extracted from dense 3-D surfaces.
ICP↗
SEARCH · Search NASA
Results for “landmark matching”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Mapped Landmark Algorithm for Precision Landing
A report discusses a computer vision algorithm for position estimation to enable precision landing during planetary descent. The Descent Image Motion Estimation System for the Mars Exploration Rovers has been used as a starting point for creating code for precision, terrain-relative navigation during planetary landing. The algorithm is designed to be general because it handles images taken at different scales and resolutions relative to the map, and can produce mapped landmark matches for any planetary terrain of sufficient texture. These matches provide a measurement of horizontal position relative to a known landing site specified on the surface map. Multiple mapped landmarks generated per image allow for automatic detection and elimination of bad matches. Attitude and position can be generated from each image; this image-based attitude measurement can be used by the onboard navigation filter to improve the attitude estimate, which will improve the position estimates. The algorithm uses normalized correlation of grayscale images, producing precise, sub-pixel images. The algorithm has been broken into two sub-algorithms: (1) FFT Map Matching (see figure), which matches a single large template by correlation in the frequency domain, and (2) Mapped Landmark Refinement, which matches many small templates by correlation in the spatial domain. Each relies on feature selection, the homography transform, and 3D image correlation. The algorithm is implemented in C++ and is rated at Technology Readiness Level (TRL) 4.
Johnson, Andrew↗
Design and Analysis of Map Relative Localization for Access to Hazardous Landing Sites on Mars
Human and robotic planetary lander missions require accurate surface relative position knowledge to land near science targets or next to pre-deployed assets. In the absence of GPS, accurate position estimates can be obtained by automatically matching sensor data collected during descent to an on-board map. The Lander Vision System (LVS) that is being developed for Mars landing applications generates landmark matches in descent imagery and combines these with inertial data to estimate vehicle position, velocity and attitude. This paper describes recent LVS design work focused on making the map relative localization algorithms robust to challenging environmental conditions like bland terrain, appearance differences between the map and image and initial input state errors. Improved results are shown using data from a recent LVS field test campaign. This paper also fills a gap in analysis to date by assessing the performance of the LVS with data sets containing significant vertical motion including a complete data set from the Mars Science Laboratory mission, a Mars landing simulation, and field test data taken over multiple altitudes above the same scene. Accurate and robust performance is achieved for all data sets indicating that vertical motion does not play a significant role in position estimation performance.
Lander Vision System↗
A Fourier approach to cloud motion estimation
A Fourier phase-difference technique for cloud motion estimation from pairs of pictures is described, and results obtained using this technique are compared with the results of a Fourier-domain cross-correlation scheme. The phase-difference technique makes use of the phase of the cross-spectral density and allows motion estimates to be made for individual spatial frequencies, which are related to cloud pattern dimensions. When objects being tracked do not change their shape, size, and orientation to more than a limited degree, both techniques are effective. The phase difference technique is relatively sensitive to the presence of mixtures of motions, changes in cloud shape, and edge effects; in these circumstances, the cross-correlation scheme is preferable. It is suggested that the Fourier transform phase difference estimation methods can be applied in problems such as landmark matching.
Arking, A.↗
Precision Instrument Targeting via Image Registration for the Mars 2020 Rover
A key component of Mars exploration is the operation of robotic instruments on the surface, such as those on board the Mars Exploration Rovers, the Mars Science Laboratory (MSL), and the planned Mars 2020 Rover. As the instruments carried by these rovers have become more advanced, the area targeted by some instruments becomes smaller, revealing more fine-grained details about the geology and chemistry of rocks on the surface. However, thermal fluctuations, rover settling or slipping, and inherent inaccuracies in pointing mechanisms all lead to pointing error that is on the order of the target size (several millimeters) or larger. We show that given a target located on a previously acquired image, the rover can align this with a new image to visually locate the target and refine the current pointing. Due to round-trip communication constraints, this visual targeting must be done efficiently on board the rover using relatively limited computing hardware. We employ existing ORB features for landmark-based image registration, describe and theoretically justify a novel approach to filtering false landmark matches, and employ a random forest classifier to automatically reject failed alignments. We demonstrate the efficacy of our approach using over 3,800 images acquired by Remote Micro-Imager on board the “Curiosity” rover.
Doran, Gary↗
Mars 2020 Lander Vision System Flight Performance 1
The Mars 2020 Entry Descent and Landing (EDL) system delivered the Perseverance rover to the surface of Mars on February 18th, 2021. A large fraction of the Jezero Crater landing site was covered with landing hazards including cliffs, inescapable dune fields and rocks. These hazards were identified or inferred using orbital imagery before launch so that they could be avoided using Terrain Relative Navigation (TRN) which was composed of two parts: the Lander Vision System (LVS) and Safe Target Selection (STS). During EDL, the LVS successfully estimated map relative position by fusing landmarks matched between descent imagery and a map of the landing site with Inertial Measurement Unit (IMU) data. This position estimate was used by STS to identify the safest target for landing that was also reachable given fuel and other constraints. The EDL system then used the powered descent phase to retarget to this location and land safely. The overall error between the targeted location and actual landing location was 5m which was an order of magnitude less than the 60m touchdown error requirement. This paper will describe the final tests of the LVS before launch, the checkout of the LVS during operations and the LVS performance during EDL.
Zheng, Jason↗
Landmark Selection for Terrain Matching
We describe techniques to optimally select landmarks in order to perform mobile robot localization in matching terrain maps.
mobile↗
A Landmark Based Position Estimation for Pinpoint Landing on Mars
Real-time position estimation for a descent lander is a critical technological need for many of NASA's planned in situ missions including landing on a number of bodies at locations of greatest scientific interest and sample return. In particular, it enables the capability to land precisely and safely in a scientifically promising but hazardous site and is a key technology to be demonstrated by NASA in the next decade. The key challenge of pinpoint landing (PPL) is how to localize the lander by recognizing the landmarks (craters) in the landing area and match them positively to a preexisting landmark database while the spacecraft is descending. In this paper, a real-time landmark based position estimation technique for pinpoint landing is suggested. This system includes three crucial components: (1) real time landmark detection, (2) real-time landmark matching and (3) state (both position and velocity) estimation. We discuss the performance analysis of this system. Finally, we show that the suggested technology is able to deliver a spacecraft to less than 100 m from a pre-selected landing site on Mars.
Pinpoint landing↗
Interpretation of satellite-measured bidirectional reflectance from Cirrus cloudy atmospheres
The interpretation of the observed bidirectional reflectance from cirrus cloudy atmospheres is presented. A theoretical model was developed for the computation of the transfer of solar radiation in an anisotropic medium with particular applications to oriented ice crystals in cirrus clouds. In this model, the adding principle for radiative transfer was used with modifications to account for the anisotropy of scattering particles and the associated scattering phase matrix. The single-scattering properties, including the phase function, single-scattering albedo, and extinction cross sections, were used for randomly and horizontally oriented hexagonal ice crystals in radiative transfer computations. The radiative transfer model developed for the cirrus clouds was modified to account for the scattering contributions from the atmosphere and the surface. In order to test the relevance and significance of the ice crystal model for the interpretation of observed bidirectional reflectance from satellites, visible radiances collected on the half hour by the GOES series were selected. The data are calibrated and corrected with the proper filter functions, then navigated to match selected landmark data. A number of clear and cloudy cases during the cirrus IFO of the Fire experiment were chosen for theoretical analyses. The cloud particle shape and size distributions that were taken during satellite overpasses are used in radiative transfer calculations. The sensitivities of the shape, orientation, and size distribution of ice crystals on the reflected intensities at the top of the atmosphere are investigated. Finally, the relative importance of these cloud microphysical properties in the interpretation of satellite bidirectional reflectance are assessed and presented.
Takano, Y.↗
Autonomous landmark based spacecraft navigation system
An autonomous landmark based spacecraft navigation scheme is presented. This new schme involves the following data processing steps: image selection and planning; landmark detection; preliminary image matching; crater matching; database management; and finally landmark based orbit determination.
autonomous↗
Browsing schematics: Query-filtered graphs with context nodes
The early results of a research project to create tools for building interfaces to intelligent systems on the NASA Space Station are reported. One such tool is the Schematic Browser which helps users engaged in engineering problem solving find and select schematics from among a large set. Users query for schematics with certain components, and the Schematic Browser presents a graph whose nodes represent the schematics with those components. The query greatly reduces the number of choices presented to the user, filtering the graph to a manageable size. Users can reformulate and refine the query serially until they locate the schematics of interest. To help users maintain orientation as they navigate a large body of data, the graph also includes nodes that are not matches but provide global and local context for the matching nodes. Context nodes include landmarks, ancestors, siblings, children and previous matches.
Ciccarelli, Eugene C.↗
Trajectory Reconstruction of the ST-9 Sounding Rocket Experiment Using IMU and Landmark Data
This paper presents trajectory reconstruction of the ST-9 sounding rocket experiment using the onboard IMU data and descent imagery. The raw IMU accelerometer measurements are first converted into inertial acceleration and then used in trajectory integration. The descent images are pre-processed using a map-matching algorithm and unique landmarks for each image are created. Using the converted IMU data and descent images, the result from dead-reckoning and the kinematic-fix approaches are first compared with the GPS measurements. Then, both the IMU data and landmarks are processed together using a batch least-squares filter and the position, velocity, stochastic acceleration, and camera orientation of each image are estimated. The reconstructed trajectory is compared with the GPS data and the corresponding formal uncertainties are presented. The result shows that IMU data and descent images processed with a batch filter algorithm provide the trajectory accuracy required for pin-point landing.
Park, Ryan S.↗
Constructing a Database from Multiple 2D Images for Camera Pose Estimation and Robot Localization
The LMDB (Landmark Database) Builder software identifies persistent image features (landmarks) in a scene viewed multiple times and precisely estimates the landmarks 3D world positions. The software receives as input multiple 2D images of approximately the same scene, along with an initial guess of the camera poses for each image, and a table of features matched pair-wise in each frame. LMDB Builder aggregates landmarks across an arbitrarily large collection of frames with matched features. Range data from stereo vision processing can also be passed to improve the initial guess of the 3D point estimates. The LMDB Builder aggregates feature lists across all frames, manages the process to promote selected features to landmarks, and iteratively calculates the 3D landmark positions using the current camera pose estimations (via an optimal ray projection method), and then improves the camera pose estimates using the 3D landmark positions. Finally, it extracts image patches for each landmark from auto-selected key frames and constructs the landmark database. The landmark database can then be used to estimate future camera poses (and therefore localize a robotic vehicle that may be carrying the cameras) by matching current imagery to landmark database image patches and using the known 3D landmark positions to estimate the current pose.
Wolf, Michael↗
Satellite-map position estimation for the Mars rover
A method for locating the Mars rover using an elevation map generated from satellite data is described. In exploring its environment, the rover is assumed to generate a local rover-centered elevation map that can be used to extract information about the relative position and orientation of landmarks corresponding to local maxima. These landmarks are integrated into a stochastic map which is then matched with the satellite map to obtain an estimate of the robot's current location. The landmarks are not explicitly represented in the satellite map. The results of the matching algorithm correspond to a probabilistic assessment of whether or not the robot is located within a given region of the satellite map. By assigning a probabilistic interpretation to the information stored in the satellite map, researchers are able to provide a precise characterization of the results computed by the matching algorithm.
Hayashi, Akira↗
Automated Image Registration Using Morphological Region of Interest Feature Extraction
With the recent explosion in the amount of remotely sensed imagery and the corresponding interest in temporal change detection and modeling, image registration has become increasingly important as a necessary first step in the integration of multi-temporal and multi-sensor data for applications such as the analysis of seasonal and annual global climate changes, as well as land use/cover changes. The task of image registration can be divided into two major components: (1) the extraction of control points or features from images; and (2) the search among the extracted features for the matching pairs that represent the same feature in the images to be matched. Manual control feature extraction can be subjective and extremely time consuming, and often results in few usable points. Automated feature extraction is a solution to this problem, where desired target features are invariant, and represent evenly distributed landmarks such as edges, corners and line intersections. In this paper, we develop a novel automated registration approach based on the following steps. First, a mathematical morphology (MM)-based method is used to obtain a scale-orientation morphological profile at each image pixel. Next, a spectral dissimilarity metric such as the spectral information divergence is applied for automated extraction of landmark chips, followed by an initial approximate matching. This initial condition is then refined using a hierarchical robust feature matching (RFM) procedure. Experimental results reveal that the proposed registration technique offers a robust solution in the presence of seasonal changes and other interfering factors. Keywords-Automated image registration, multi-temporal imagery, mathematical morphology, robust feature matching.
Plaza, Antonio↗
The application of image processing to satellite navigation
Given the locations of several landmarks on a satellite acquired image and their true geographic coordinates, the position and orientation of the satellite can be determined. Two methods for automatically locating the image coordinates of specified landmarks are described. The first, a particularly fast sequential similarity detection algorithm for template matching was originally described by Nagel and Rosenfeld. The second method involves iteratively resampling the picture function in the vicinity of the anticipated landmark. A variety of other speedup methods is also described. An application to SMS imagery is envisioned.
Hord, R. M.↗
A landmark recognition and tracking experiment for flight on the Shuttle/Advanced Technology Laboratory (ATL)
The preliminary design of an experiment for landmark recognition and tracking from the Shuttle/Advanced Technology Laboratory is described. It makes use of parallel coherent optical processing to perform correlation tests between landmarks observed passively with a telescope and previously made holographic matched filters. The experimental equipment including the optics, the low power laser, the random access file of matched filters and the electro-optical readout device are described. A real time optically excited liquid crystal device is recommended for performing the input non-coherent optical to coherent optical interface function. A development program leading to a flight experiment in 1981 is outlined.
Welch, J. D.↗
A landmark based pinpoint landing simulator
Real-time position estimation for a descent lander is a critical technological need for many planned NASA missions.
landmark detection pinpoint landing crater matchin↗