Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Navigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Unmanned Vehicle Guidance Using Video Camera/Vehicle Model

A video guidance sensor (VGS) system has flown on both STS-87 and STS-95 to validate a single camera/target concept for vehicle navigation. The main part of the image algorithm was the subtraction of two consecutive images using software. For a nominal size image of 256 x 256 pixels this subtraction can take a large portion of the time between successive frames in standard rate video leaving very little time for other computations. The purpose of this project was to integrate the software subtraction into hardware to speed up the subtraction process and allow for more complex algorithms to be performed, both in hardware and software.

Sutherland, T.↗
NASA NTRS2007

Learning and Prediction of Slip from Visual Information

This paper presents an approach for slip prediction from a distance for wheeled ground robots using visual information as input. Large amounts of slippage which can occur on certain surfaces, such as sandy slopes, will negatively affect rover mobility. Therefore, obtaining information about slip before entering such terrain can be very useful for better planning and avoiding these areas. To address this problem, terrain appearance and geometry information about map cells are correlated to the slip measured by the rover while traversing each cell. This relationship is learned from previous experience, so slip can be predicted remotely from visual information only. The proposed method consists of terrain type recognition and nonlinear regression modeling. The method has been implemented and tested offline on several off-road terrains including: soil, sand, gravel, and woodchips. The final slip prediction error is about 20%. The system is intended for improved navigation on steep slopes and rough terrain for Mars rovers.

rover↗
NASA NTRS1994

Using Virtual Reality for Science Mission Planning: A Mars Pathfinder Case

The Mars Pathfinder Project GDS Team has designed software that integrates virtual reality technology with existing JPL Navigational Ancillary Information Facilities (NAIF) and image processing capabilities. The result is an interactive, workstation-based application software that provides a high resolution 3-dimensional stereo display of Mars as if it were viewed through the lander camera. This paper describes the architecture and characteristics of this science mission planning software and discusses possible uses of this software by other planetary missions.

virtual↗
NASA NTRSDate not supplied

Building Maps for Terrain Relative Navigation Using Blender: An Open-Source Approach

A persistent challenge for vision-based navigation systems that compare imagery to a reference map is generating high quality maps with similar lighting conditions. Image rendering software can be used to apply variable lighting to reference maps or to generate synthetic imagery for test trajectories. While many image rendering software packages are available, with several developed specifically for spaceflight applications, there are often limitations due to cost, image fidelity, or flexibility. In this paper, we demonstrate the use of an open-source image rendering software, Blender, for use in Terrain Relative Navigation (TRN) applications. A scene in Blender was generated based on elevation data and satellite imagery of the region of West Texas used by Blue Origin for the operation of their New Shepard suborbital rocket. The Blender scene was validated by reproducing imagery collected during a flight of New Shepard in October 2020 and was further used to generate reference maps for use by a TRN algorithm on a subsequent New Shepard flight in August 2021. The work was performed under the NASA Safe and Precise Landing Integrated Capabilities Evolution (SPLICE) project, which is focused on technology advancement for precision landing and hazard avoidance. This work aims to lower the cost of entry and generally promote the adoption and advancement of vision-based navigation technologies.

Kyle W Smith↗
NASA NTRSDate not supplied

Astrobee's Multi-year Activities at the International Space Station's Japanese Experimental Module

The Astrobee free-flying robots recently completed their third successful year of operations, housed in the Japanese Experimental Module (JEM) on the International Space Station. We summarize the three years of operation, giving special attention to JAXA's 1st and 2nd Kibo Robot Programming Challenge (RPC) and the mapping processes and tools that make Astrobees' autonomous operation possible. The JEM is an ever changing, dynamic environment where light settings, cargo, payloads, and crew members constantly move and interact with one another. The 1st JAXA Kibo RPC event, a collaboration between JAXA and NASA, was held in 2020. Students from several countries in the Asia-Pacific region competed in programming challenges with a simulated Astrobee. The finalists were then invited to run their code on an actual Astrobee in the JEM. For the final round, students programmed Astrobee to visit three different locations to obtain data that would instruct the robot to complete a final task with the participation of ISS crew. The first competition was a tremendous success, leading to an equally successful 2nd JAXA Kibo RPC in 2021 with even larger participation. The 3rd JAXA Kibo RPC will occur in 2022 expanding further to incorporate US participants. These activities led to several firsts in Astrobee’s history: operation of an Astrobee free-flying robot without crew supervision in preparation for on-orbit operations, autonomous image acquisition towards updates of the navigation map, non-NASA code running on the robot (both from JAXA and participating students), two heterogeneous free-flying robots from two different space agencies working together (Int-Ball and Astrobee) during the final event in 2020, the first payload using Astrobee, and having Astrobee controlled from a non-NASA location (Tsukuba Space Center). The preparation towards these activities involved constant evaluation of the different components of Astrobee's systems, specially mapping and localization. The paper describes the evolution of these systems such as the improvements made in localization to reduce localization drift by using graph-based optimization instead of the extended Kalman Filter localizer. Additionally, it reports on the mapping process and analysis tools created to validate map consistency across different activities in the constantly changing JEM environment. These enhancements have enabled the Astrobee facility to successfully execute over 100 ISS activities supporting over a dozen researchers and partners around the world.

Astrobee↗
NASA NTRS2023

Dust Lifting Observations with the Mars Science Laboratory Navigation Cameras

Martian dust lifting is believed to occur through two primary mechanisms: dust devils and wind stress forced dust lifting. Gale Crater's varied terrain and meteorology provide a unique in situ perspective on Martian dust lifting, with the Mars Science Laboratory Curiosity rover passing through both conditions and locations detrimental to dust lifting (e.g., the crater floor) and those with active sand motion and frequent dust lifting (e.g., the Bagnold Dunes). Between L s = 248° in Mars Year 33 and L s = 51° in Mars Year 37, over ∼3.5 Mars years and 2,300 sols, the rover's Navigation Cameras took 1,260 dedicated image sequences to search for dust lifting. Approximately 42.7% of all sequences, and 9.5% of the total images have shown active dust lifting, both dust devils and linear/straight-line wind stress dust lifting. 79% of dust lifting events are classified as dust devils, while ∼16% are linear wind stress dust lifting and the remainder are of an indeterminate type. We analyze this large catalog of dust lifting events to provide ground truth on theoretical and model expectations of dust lifting and show that dust lifting in Gale Crater occurs throughout the Martian year, is strongly peaked in frequency near solar noon (even after accounting for observational biases), and that dust lifting shows an affinity for sand-covered surfaces which highlights the importance of saltating sand grains for Martian dust lifting in both dust devils and wind stress forced lifting.

Scott D. Guzewich↗
NASA NTRS2022

Terrain Relative Navigation in a Lunar Landing Scenario Using autoNGC

NASA Goddard Space Flight Center is developing Autonomous Navigation Guidance and Control (autoNGC) as a flight software system for future onboard use for missions in a variety of orbital regimes, including cislunar space and beyond. This paper describes processor-in-the-loop (PIL) testing using a lunar landing scenario with terrain relative navigation (TRN) and weak-signal GPS. We give an overview of the autoNGC project and describe preliminary navigation simulation results. We also describe the TRN PIL tests on a flight-like development board, using simulated images rendered from Lunar Reconnaissance Orbit high-resolution digital terrain models. The navigation simulations show that weak-signal GPS combined with TRN during a descent from a low lunar parking orbit results in sufficiently low navigation uncertainties to support such a mission profile independent of ground-based navigation. The PIL tests show that onboard image processing and landmark correlation is achievable at a sufficiently high measurement rate.

Michael A Shoemaker↗
NASA NTRSDate not supplied

Low SWaP Onboard Satellite Navigation, Guidance, and Control Technology

Onboard autonomy is a necessity for responsive space operations. Autonomous navigation, guidance, and control (NGC) enables space missions to reduce their dependence on high demand ground assets and costly ground personnel. It also allows for in-situ decision making and higher return on mission data. A flight software and hardware system providing this capability, called “autoNGC,” is currently being developed at NASA Goddard Space Flight Center for infusion into multiple future missions. The first build of autoNGC, providing autonomous navigation for lunar orbiting spacecraft, is targeted for completion by Fall 2024. It provides sensor fusion of multiple measurement types including pseudo-range from a weak signal Global Navigation Satellite Service (GNSS) receiver, 1-way and 2-way direct to Earth (DTE) range and Doppler, bearing and range from optical camera sensed images, and an accelerometer. AutoNGC is also being targeted for future missions that involve small body proximity operations, Sun Earth Libration point orbits, and distributed systems missions (DSMs) including those at outer planets. AutoNGC flight software is being built upon the plug-and-play architecture of the core Flight System (cFS) [Ref. 1]. Figure (Slide 7) shows the message-based software bus layout of various software applications (“apps”) consisting of the standard cFS apps and autoNGC interface apps and libraries. Accurate onboard navigation and timing is obtained through the Goddard Enhanced Onboard Navigation System (GEONS) software library [Ref. 2], which fuses different measurement types through an extended Kalman filter (EKF) framework. Optical measurements that are ingested in GEONS are provided by the cFS Goddard Image Analysis and Navigation Tool (cGIANT) app [Ref. 3]. This app processes optical images to extract the bearing angles of the centroid of the imaged body (near or far), the range to the imaged body, and/or of the features on the surface of a body to perform terrain relative navigation (TRN). Measurement of range to the body’s center of mass can also be derived from the detection of the limb. The first build of autoNGC for a lunar orbiting spacecraft is a minimal size, weight, and power (SWaP) hardware design allowing for inclusion into CubeSats and SmallSat-size class buses. Advancements in miniaturized space processors, such as the SpaceCube 3.0 Mini and the SpaceCube Mini-Z [Ref. 4] are utilized for low SWaP while maintaining a high level of performance. Figure (Slide 11) shows the composition of the first autoNGC build. The current enclosure design has dimensions 12 cm x 17 cm x 13.5 cm. The box mass is expected to be less than 2 kg, and the nominal power is 21 W. The hardware interfaces are designed for flexibility with a variety of sensor inputs. The achievable navigation performance depends on the sensors utilized, including the onboard clock for 1-way pseudo-range measurements. Analysis using a configuration that consists of weak signal GPS, TRN, and 1-way DTE has shown position and velocity accuracies of 10 meters and 2 cm/s (3-σ ) RSS, respectively, with onboard time knowledge estimated to better than 13 ns (3-σ ), for a spacecraft in a representative 12-hour eccentric lunar orbit. Other measurement types such as x-rays from known pulsars (called XNAV) and cross-links can also be processed in GEONS. With the plug-and-play architecture of autoNGC, cFS apps can easily be added and replaced, even after launch. Goddard is actively seeking partners to collaborate in the development of additional capabilities for autoNGC, including industry, academia, and others across the US Government. Plans are being formulated to make the autoNGC software platform available for use by any US government organization to leverage the non-recurring engineering associated with the development of onboard autonomous NGC 3 capabilities. As advancements in space qualified sensors, microprocessors, and algorithms are made, the autoNGC platform provides a ready starting point for inclusion of these technologies.

C. J. Gramling↗
NASA NTRS1994

Model Based Vision for Aircraft Position Determination

This paper investigates the use of imaging sensors to estimate the position of an aircraft with respect to the runway during landing. Passive vision techniques to estimate aircraft position during landing rely on the known runway model, images acquired by onboard imaging sensor, orientation information provided by the inertial navigation system and the position estimate provided by devices such as the global positioning system. Point features in the runway model are compared with the onboard sensor images of the features and the difference between the two is used to correct the aircraft position and orientation. In this paper the sensitivity of point features is examined as a means of determining the accuracy of such position estimation techniques. Expressions are derived for the sensitivity of image point to errors in the position and orientation of the sensor. Using these, the sensitivity of the image to aircraft position and orientation errors along a typical landing glide path is studied. A least squares technique based on this sensitivity analysis is described for the correction of position and orientation estimates. The final version of the paper will include results from the application of this analysis to real image sequences collected in flight.

Sridhar, Banavar↗
NASA NTRS2017

A Consistent EPIC Visible Channel Calibration using VIIRS and MODIS as a Reference

The Earth Polychromatic Imaging Camera (EPIC) aboard the Deep Space Climate Observatory (DSCOVR) satellite constantly images the sunlit disk of Earth from the Lagrange-1 (L1) point in 10 spectral channels spanning the UV, VIS, and NIR spectrums. Recently, the DSCOVR EPIC team has publicly released version 2 dataset, which has implemented improved navigation, stray-light correction, and flat-fielding of the CCD array. The EPIC 2-year data record must be well-calibrated for consistent cloud, aerosol, trace gas, land use and other retrievals. Because EPIC lacks onboard calibrators, the observations made by EPIC channels must be calibrated vicariously using the coincident measurements from radiometrically stable instruments that have onboard calibration systems. MODIS and VIIRS are best-suited instruments for this task as they contain similar spectral bands that are well-calibrated onboard using solar diffusers and lunar tracking. We have previously calibrated the EPIC version 1 dataset by using EPIC and VIIRS angularly matched radiance pairs over both all-sky ocean and deep convective clouds (DCC). We noted that the EPIC image required navigations adjustments, and that the EPIC stray-light correction provided an offset term closer to zero based on the linear regression of the EPIC and VIIRS ray-matched radiance pairs. We will evaluate the EPIC version 2 navigation and stray-light improvements using the same techniques. In addition, we will monitor the EPIC channel calibration over the two years for any temporal degradation or anomalous behavior. These two calibration methods will be further validated using desert and DCC invariant Earth targets. The radiometric characterization of the selected invariant targets is performed using multiple years of MODIS and VIIRS measurements. Results of these studies will be shown at the conference.

Haney, C. O.↗
NASA NTRS2005

Single-Command Approach and Instrument Placement by a Robot on a Target

AUTOAPPROACH is a computer program that enables a mobile robot to approach a target autonomously, starting from a distance of as much as 10 m, in response to a single command. AUTOAPPROACH is used in conjunction with (1) software that analyzes images acquired by stereoscopic cameras aboard the robot and (2) navigation and path-planning software that utilizes odometer readings along with the output of the image-analysis software. Intended originally for application to an instrumented, wheeled robot (rover) in scientific exploration of Mars, AUTOAPPROACH could be adapted to terrestrial applications, notably including the robotic removal of land mines and other unexploded ordnance. A human operator generates the approach command by selecting the target in images acquired by the robot cameras. The approach path consists of multiple legs. Feature points are derived from images that contain the target and are thereafter tracked to correct odometric errors and iteratively refine estimates of the position and orientation of the robot relative to the target on successive legs. The approach is terminated when the robot attains the position and orientation required for placing a scientific instrument at the target. The workspace of the robot arm is then autonomously checked for self/terrain collisions prior to the deployment of the scientific instrument onto the target.

Huntsberger, Terrance↗
NASA NTRS2019

Thermal testing of a Mars 2020 enhanced engineering camera

The upcoming Mars 2020 rover mission is introducing a new generation of engineering cameras (ECAMs) called the enhanced engineering cameras (EECAMs), which have advanced imaging capability over the previous ECAMs used on the Spirit, Opportunity, and Curiosity rovers. The Mars 2020 rover will have nine EECAMs – six upgraded HazCams used for hazard avoidance, two upgraded NavCams used for navigation, and a single CacheCam used to take images of samples obtained by the rover’s Sampling and Caching Subsystem (SCS). The detailed EECAM design was completed in April 2017, and since then the EECAM Subsystem has been in the process of fabrication, integration, and testing. This paper describes two thermal tests that were done for thermal model correlation and validation of the EECAM thermal design during Mars surface operations.

Novak, Keith S.↗
NASA NTRSDate not supplied

The LuNaMaps Project: Advancing Capabilities for Developing and Validating Digital Elevation Models of Rocky Surfaces from Orbital Data

Both navigation and surface science can benefit from the ability to generate high resolution and accurate maps of the surface of the Moon and other solar system bodies. The primary way these maps are generated is through the use of orbital imagery and ranging data. Traditionally, the process of using orbital imagery and ranging data is tedious and labor-intensive. Additionally, once maps have been built, there has generally been limited effort in developing standards by which to verify the accuracy and quality of the generated maps. The Lunar Navigation Maps (LuNaMaps) project is a NASA Game Changing Development (GCD) project which over the last 4 years has aimed to address these issues both for the Moon and for other rocky solar system bodies. This has been accomplished through development of new and existing capabilities including: a suite of methods and tools to combine all sources of orbital imagery; a benchmark data set as well as basic requirements for high-fidelity simulations of precision landing functions; tools to synthetically enhance map products with lander-scale features for use in the development and testing of hazard detection systems; methods and tools to evaluate the accuracy of developed digital elevation maps (DEMs) and their quality for use in terrain relative navigation scenarios; and tools to realistically render image and lidar data. In this work, we provide an overview of the capabilities developed through LuNaMaps, demonstrating its use for processing existing lunar data, and describing how it can be applied to other use cases. We additionally provide preliminary results showing the application of the developed tools and processes to the generation of elevation maps of the Lunar Surface Proving Grounds (LSPG) lunar analog at Astrobotic’s Mojave testing facility using “orbital imagery” captured by a drone. In this terrestrial demonstration, we have the benefit of being able to compare the results to a ground truth model of the LSPG. We finally describe plans to use the newly created maps in a terrestrial terrain relative navigation demonstration over the LSPG in early 2025.

optical navigation↗