Search NASA⌕ Search

Engineering topics

Ansar, Adnan I.

Publications and source records attributed to Ansar, Adnan I..

17 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Performance Analysis of Terrain Relative Navigation Using Blue Origin New Shepard Suborbital Flight Telemetry

As part of a NASA Tipping Point Partnership with Blue Origin to mature precision lunar landing technologies, two test flights of the Blue Origin New Shepard vehicle carrying a NASA-developed sensor suite were conducted on 10/13/2020 and 08/26/2021 at the West Texas Launch Site (LS-1). Part of the acquired datasets, comprising data from an inertial measurement unit and a downward facing camera, was postprocessed through a JPL-developed prototype Visual Odometry and Map Relative Localization software (TRNVOSIM), and compared against ground truth acquired by the host vehicle navigation system. In this paper, we provide a description of the algorithms, the test setup, and the processed results.

Pedrotty, Samuel M.↗
NASA NTRS2022

Building Lunar Maps for Terrain Relative Navigation and Hazard Detection Applications

Terrain Relative Navigation (TRN) systems that localize a spacecraft with respect to a map of the surface by comparing descent imagery to that reference map can only be as accurate as the reference map itself. Accurate map products that are based on orbital reconnaissance data must be validated for navigation applications to ensure that all relevant error sources are minimized. Currently available map products have been generated for scientific applications, so the need for accurate TRN maps remains a gap to be filled for upcoming lunar lander missions, in particular missions to the South Pole region. Additionally, representative high-resolution maps that contain lander-scale features are needed for successful development and testing of Hazard Detection (HD) systems. This paper describes one of NASA’s current efforts to develop benchmark data sets that can be used for developing and testing TRN and HD algorithms as well as suggested processes and metrics for generating and validating lunar maps that can be used for navigation and hazard detection.

Beyer, Ross A.↗
NASA NTRS2019

Demonstration of Stereo Vision for Deorbit Descent and Landing

Planetary landers need to reduce velocity at low altitude for soft landing. Traditionally, estimating velocity and altitude has been performed with radar sensors whose performance meets the specific mission needs. There are not very many options for these sensors and they are difficult to include in a flight system either due to obsolescence, prohibitive cost or difficulty in accommodation. Recently, alternative sensing modalities are being pursued including Doppler LiDAR and vision. This paper describes results from a recent helicopter field test of a binocular stereo vision system for deorbit descent and landing applications. The system consisted of two 18.6 ̊ field of view cameras mounted 1.7m apart. Post processing of the images showed ranging accuracy better than 1% up to 500mand 17 cm/s velocimetry accuracy at 37m. For a flight system these images could be input into an FPGA-based processor which processes dense stereo and visual odometry in less than 1 second to achieve the stereo ranging frame rates required for soft landing. When coupled with vision based Terrain Relative Navigation this stereo system enables landing accuracies on the order of 10m.

Sternberg, David C.↗
NASA NTRS2019

Demonstration of stereo vision for deorbit descent and landing

This paper describes results from a recent helicopter field test of a binocular stereo vision system for deorbit descent and landing applications. The system consisted of two 18.6˚ field of view cameras mounted 1.7m apart. Post processing of the images showed ranging accuracy better than 1% up to 500m and 17 cm/s velocimetry accuracy at 37m. For a flight system these images could be input into an FPGA-based processor which processes dense stereo and visual odometry in less than 1 second to achieve the stereo ranging frame rates required for soft landing. When coupled with vision based Terrain Relative Navigation this stereo system enables landing accuracies on the order of 10m.

Johnson, Andrew E.↗
NASA NTRS2013

Automatic Calibration of an Airborne Imaging System to an Inertial Navigation Unit

This software automatically calibrates a camera or an imaging array to an inertial navigation system (INS) that is rigidly mounted to the array or imager. In effect, it recovers the coordinate frame transformation between the reference frame of the imager and the reference frame of the INS. This innovation can automatically derive the camera-to-INS alignment using image data only. The assumption is that the camera fixates on an area while the aircraft flies on orbit. The system then, fully automatically, solves for the camera orientation in the INS frame. No manual intervention or ground tie point data is required.

Ansar, Adnan I.↗
NASA NTRS2013

Building a 2.5D Digital Elevation Model from 2D Imagery

When projecting imagery into a georeferenced coordinate frame, one needs to have some model of the geographical region that is being projected to. This model can sometimes be a simple geometrical curve, such as an ellipse or even a plane. However, to obtain accurate projections, one needs to have a more sophisticated model that encodes the undulations in the terrain including things like mountains, valleys, and even manmade structures. The product that is often used for this purpose is a Digital Elevation Model (DEM). The technology presented here generates a high-quality DEM from a collection of 2D images taken from multiple viewpoints, plus pose data for each of the images and a camera model for the sensor. The technology assumes that the images are all of the same region of the environment. The pose data for each image is used as an initial estimate of the geometric relationship between the images, but the pose data is often noisy and not of sufficient quality to build a high-quality DEM. Therefore, the source imagery is passed through a feature-tracking algorithm and multi-plane-homography algorithm, which refine the geometric transforms between images. The images and their refined poses are then passed to a stereo algorithm, which generates dense 3D data for each image in the sequence. The 3D data from each image is then placed into a consistent coordinate frame and passed to a routine that divides the coordinate frame into a number of cells. The 3D points that fall into each cell are collected, and basic statistics are applied to determine the elevation of that cell. The result of this step is a DEM that is in an arbitrary coordinate frame. This DEM is then filtered and smoothed in order to remove small artifacts. The final step in the algorithm is to take the initial DEM and rotate and translate it to be in the world coordinate frame [such as UTM (Universal Transverse Mercator), MGRS (Military Grid Reference System), or geodetic] such that it can be saved in a standard DEM format and used for projection.

Padgett, Curtis W.↗
NASA NTRS2012

Projection of Stabilized Aerial Imagery Onto Digital Elevation Maps for Geo-Rectified and Jitter-Free Viewing

As imagery is collected from an airborne platform, an individual viewing the images wants to know from where on the Earth the images were collected. To do this, some information about the camera needs to be known, such as its position and orientation relative to the Earth. This can be provided by common inertial navigation systems (INS). Once the location of the camera is known, it is useful to project an image onto some representation of the Earth. Due to the non-smooth terrain of the Earth (mountains, valleys, etc.), this projection is highly non-linear. Thus, to ensure accurate projection, one needs to project onto a digital elevation map (DEM). This allows one to view the images overlaid onto a representation of the Earth. A code has been developed that takes an image, a model of the camera used to acquire that image, the pose of the camera during acquisition (as provided by an INS), and a DEM, and outputs an image that has been geo-rectified. The world coordinate of the bounds of the image are provided for viewing purposes. The code finds a mapping from points on the ground (DEM) to pixels in the image. By performing this process for all points on the ground, one can "paint" the ground with the image, effectively performing a projection of the image onto the ground. In order to make this process efficient, a method was developed for finding a region of interest (ROI) on the ground to where the image will project. This code is useful in any scenario involving an aerial imaging platform that moves and rotates over time. Many other applications are possible in processing aerial and satellite imagery.

Ansar, Adnan I.↗
NASA NTRS2012

Constructing a Database from Multiple 2D Images for Camera Pose Estimation and Robot Localization

The LMDB (Landmark Database) Builder software identifies persistent image features (landmarks) in a scene viewed multiple times and precisely estimates the landmarks 3D world positions. The software receives as input multiple 2D images of approximately the same scene, along with an initial guess of the camera poses for each image, and a table of features matched pair-wise in each frame. LMDB Builder aggregates landmarks across an arbitrarily large collection of frames with matched features. Range data from stereo vision processing can also be passed to improve the initial guess of the 3D point estimates. The LMDB Builder aggregates feature lists across all frames, manages the process to promote selected features to landmarks, and iteratively calculates the 3D landmark positions using the current camera pose estimations (via an optimal ray projection method), and then improves the camera pose estimates using the 3D landmark positions. Finally, it extracts image patches for each landmark from auto-selected key frames and constructs the landmark database. The landmark database can then be used to estimate future camera poses (and therefore localize a robotic vehicle that may be carrying the cameras) by matching current imagery to landmark database image patches and using the known 3D landmark positions to estimate the current pose.

Wolf, Michael↗
NASA NTRS2011

MatchGUI: A Graphical MATLAB-Based Tool for Automatic Image Co-Registration

MatchGUI software, based on MATLAB, automatically matches two images and displays the match result by superimposing one image on the other. A slider bar allows focus to shift between the two images. There are tools for zoom, auto-crop to overlap region, and basic image markup. Given a pair of ortho-rectified images (focused primarily on Mars orbital imagery for now), this software automatically co-registers the imagery so that corresponding image pixels are aligned. MatchGUI requires minimal user input, and performs a registration over scale and inplane rotation fully automatically

Ansar, Adnan I.↗
NASA NTRS2011

Multi-Modal Image Registration and Matching for Localization of a Balloon on Titan

A solution was developed that matches visible/IR imagery aboard a balloon in Saturn's moon Titan's atmosphere to SAR (synthetic aperture radar) and visible/IR data acquired from orbit. A balloon in Titan's atmosphere must be able to localize itself autonomously both globally and with respect to local terrain. The orbital data is used to provide the balloon imagery with global context. The work is novel in applying mutual information (MI) to orbital vs. aerial data. There are unique challenges in this setting. Image offsets are much higher than in medical imaging, there is local distortion due to 3D terrain relief, and the fields of regard from orbit and from the air are quite different.

Ansar, Adnan I.↗
NASA NTRS2010

Real-Time Feature Tracking Using Homography

This software finds feature point correspondences in sequences of images. It is designed for feature matching in aerial imagery. Feature matching is a fundamental step in a number of important image processing operations: calibrating the cameras in a camera array, stabilizing images in aerial movies, geo-registration of images, and generating high-fidelity surface maps from aerial movies. The method uses a Shi-Tomasi corner detector and normalized cross-correlation. This process is likely to result in the production of some mismatches. The feature set is cleaned up using the assumption that there is a large planar patch visible in both images. At high altitude, this assumption is often reasonable. A mathematical transformation, called an homography, is developed that allows us to predict the position in image 2 of any point on the plane in image 1. Any feature pair that is inconsistent with the homography is thrown out. The output of the process is a set of feature pairs, and the homography. The algorithms in this innovation are well known, but the new implementation improves the process in several ways. It runs in real-time at 2 Hz on 64-megapixel imagery. The new Shi-Tomasi corner detector tries to produce the requested number of features by automatically adjusting the minimum distance between found features. The homography-finding code now uses an implementation of the RANSAC algorithm that adjusts the number of iterations automatically to achieve a pre-set probability of missing a set of inliers. The new interface allows the caller to pass in a set of predetermined points in one of the images. This allows the ability to track the same set of points through multiple frames.

Clouse, Daniel S.↗
NASA NTRS2009

Robot Vision Library

The JPL Robot Vision Library (JPLV) provides real-time robot vision algorithms for developers who are not vision specialists. The package includes algorithms for stereo ranging, visual odometry and unsurveyed camera calibration, and has unique support for very wideangle lenses

Howard, Andrew B.↗
NASA NTRS2009

Aerobot Autonomy Architecture

An architecture for autonomous operation of an aerobot (i.e., a robotic blimp) to be used in scientific exploration of planets and moons in the Solar system with an atmosphere (such as Titan and Venus) is undergoing development. This architecture is also applicable to autonomous airships that could be flown in the terrestrial atmosphere for scientific exploration, military reconnaissance and surveillance, and as radio-communication relay stations in disaster areas. The architecture was conceived to satisfy requirements to perform the following functions: a) Vehicle safing, that is, ensuring the integrity of the aerobot during its entire mission, including during extended communication blackouts. b) Accurate and robust autonomous flight control during operation in diverse modes, including launch, deployment of scientific instruments, long traverses, hovering or station-keeping, and maneuvers for touch-and-go surface sampling. c) Mapping and self-localization in the absence of a global positioning system. d) Advanced recognition of hazards and targets in conjunction with tracking of, and visual servoing toward, targets, all to enable the aerobot to detect and avoid atmospheric and topographic hazards and to identify, home in on, and hover over predefined terrain features or other targets of scientific interest. The architecture is an integrated combination of systems for accurate and robust vehicle and flight trajectory control; estimation of the state of the aerobot; perception-based detection and avoidance of hazards; monitoring of the integrity and functionality ("health") of the aerobot; reflexive safing actions; multi-modal localization and mapping; autonomous planning and execution of scientific observations; and long-range planning and monitoring of the mission of the aerobot. The prototype JPL aerobot (see figure) has been tested extensively in various areas in the California Mojave desert.

Elfes, Alberto↗
NASA NTRS2005

Rover mast calibration, exact camera pointing, and camara handoff for visual target tracking

This paper presents three technical elements that we have developed to improve the accuracy of the visual target tracking for single-sol approach-and-instrument placement in future Mars rover missions. An accurate, straightforward method of rover mast calibration is achieved by using a total station, a camera calibration target, and four prism targets mounted on the rover. The method was applied to Rocky8 rover mast calibration and yielded a 1.1-pixel rms residual error. Camera pointing requires inverse kinematic solutions for mast pan and tilt angles such that the target image appears right at the center of the camera image. Two issues were raised. Mast camera frames are in general not parallel to the masthead base frame. Further, the optical axis of the camera model in general does not pass through the center of the image. Despite these issues, we managed to derive non-iterative closed-form exact solutions, which were verified with Matlab routines. Actual camera pointing experiments aver 50 random target image paints yielded less than 1.3-pixel rms pointing error. Finally, a purely geometric method for camera handoff using stereo views of the target has been developed. Experimental test runs show less than 2.5 pixels error on high-resolution Navcam for Pancam-to-Navcam handoff, and less than 4 pixels error on lower-resolution Hazcam for Navcam-to-Hazcam handoff.

camera handoff↗