Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Navigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Improving Sim-to-Real Transfer in Vision-Based Robot Navigation Via Instance-Level GAN-Based Data Augmentation

Achieving robust vision-based robotic tasks requires large amounts of data, which are often difficult to obtain in real-world scenarios. Simulators and synthetic data offer a cost-effective alternative, but the visual gap between simulation and reality hinders the performance of models when deployed in real-world environments. In this paper, we present a data augmentation pipeline that integrates a foundation model (Segment Anything Model) with an unsupervised image-to-image translation model (CycleGAN) for instance-level domain transfer from simulation to reality. This pipeline enables the generation of realistic labeled data from synthetic images for training supervised machine learning models in vision-based navigation tasks. We evaluate our approach on real-world data for ego-vehicle pose estimation, a critical autonomous navigation task involving the prediction of cross-track position and heading angle relative to road center line markings. The results of our tests show that our GAN-based data augmentation pipeline significantly outperforms models trained solely on simulation data or on data processed with standard image augmentation methods for sim-to-real transfer, enhancing model robustness and generalizability in real-world scenarios. Our method provides a scalable and flexible data augmentation tool for leveraging large synthetic datasets to enhance vision-based robotic navigation tasks.

artificial intelligence↗

Ephemerides of the major Neptunian satellites determined from earth-based astrometric and Voyager imaging observations

The Voyager project used Neptunian satellite ephemerides to support both navigation and acquisition of scientific data. The development of postencounter ephemerides for the satellites Triton, Nereid, and 1989N1 is discussed. Primary results are the final set of model parameters which generate orbits that best fit both the earth-based satellite observations and data acquired by Voyager. The ephemerides are compared with those generated preencounter, and the accuracy of the final ephemerides is assessed. Mean orbital elements are also provided as a geometrical representation for the satellite orbits.

Jacobson, R. A.↗

Optical-Based Kinematic Positioning for Deep-Space Navigation

NASA’s Deep Space 1 mission demonstrated that a spacecraft can be navigated autonomously during deep-space cruise operations using only images of distant asteroids as measurements. This paper derives an approximation of the position estimate accuracy that can be achieved with this technique based on the assumption of multiple, simultaneous line-of-sight measurements. This achievable accuracy is computed for locations across the solar system, which can be used to estimate cruise navigation performance as a function of spacecraft trajectory. It is shown that a on-board optical navigation system can achieve kinematic position estimate accuracies of better than 100 km throughout the inner solar system with a highperformance camera and from many hundred to several thousand kilometers with a low-end camera. Beyond the main-asteroid belt, the feasibilty of this approach suffers due to lack of targets. A case-study implementation of this approach for the upcoming InSight mission to Mars is also presented.

Bhaskaran, Shyam↗

High-Fidelity Flash Lidar Model Development

NASA's Autonomous Landing and Hazard Avoidance Technologies (ALHAT) project is currently developing the critical technologies to safely and precisely navigate and land crew, cargo and robotic spacecraft vehicles on and around planetary bodies. One key element of this project is a high-fidelity Flash Lidar sensor that can generate three-dimensional (3-D) images of the planetary surface. These images are processed with hazard detection and avoidance and hazard relative navigation algorithms, and then are subsequently used by the Guidance, Navigation and Control subsystem to generate an optimal navigation solution. A complex, high-fidelity model of the Flash Lidar was developed in order to evaluate the performance of the sensor and its interaction with the interfacing ALHAT components on vehicles with different configurations and under different flight trajectories. The model contains a parameterized, general approach to Flash Lidar detection and reflects physical attributes such as range and electronic noise sources, and laser pulse temporal and spatial profiles. It also provides the realistic interaction of the laser pulse with terrain features that include varying albedo, boulders, craters slopes and shadows. This paper gives a description of the Flash Lidar model and presents results from the Lidar operating under different scenarios.

Hines, Glenn D.↗

Knowledge based imaging for terrain analysis

A planetary rover will have various vision based requirements for navigation, terrain characterization, and geological sample analysis. In this paper we describe a knowledge-based controller and sensor development system for terrain analysis. The sensor system consists of a laser ranger and a CCD camera. The controller, under the input of high-level commands, performs such functions as multisensor data gathering, data quality monitoring, and automatic extraction of sample images meeting various criteria. In addition to large scale terrain analysis, the system's ability to extract useful geological information from rock samples is illustrated. Image and data compression strategies are also discussed in light of the requirements of earth bound investigators.

Holben, Rick↗

Virtual Sensors Determined Through Machine Learning

We propose a method that increases the capability of a conventional sensor/instrument, transforming it into an enhanced virtual sensor/instrument. This paper focuses on a virtual thermal IR sensor based on a conventional visual (RGB) sensor. The estimation of thermal IR images can enhance the ability of terrain classification, which is crucial for autonomous navigation of rovers. The estimate in IR from visual band has inherent limitations, as these are different bands, yet correlations between visual/RGB and thermal IR images exist, as different terrains, which visually may appear different, also have different thermal inertia. We developed a deep learning-based algorithm that estimates thermal IR images from RGB images of terrains, providing the feasibility of the idea with average 1.21 error [degree].

Kurazume, Ryo↗

Geometric rectification and geocoding of JPL's AIRSAR data over hilly terrain

A post-processing system was developed to georeference and geocode airborne synthetic aperture radar (SAR) data collected by the JPL-Airborne SAR (AIRSAR) System over hilly terrain during the 1990 MAESTRO1 campaign. Georectification relates image coordinates and object coordinates while the geocoding involves resampling. The georectification method uses a hybrid method based upon a number of navigational parameters and minimal two ground-control points which are referenced in both image and map space. The calculation of the intersection of the SAR signal wavefront and a digital elevation model allowed, within certain error bounds, acquisition of the object-to-image and image-to-object relationships.

Degroof, H.↗

Virtual Sensors Determined Through Machine Learning

We propose a method that increases the capability of a conventional sensor, transforming it into an enhanced virtual sensor. This paper focuses on a virtual thermal Infrared Radiation (IR) sensor based on a conventional visual (RGB) sensor. The estimation of thermal IR images can enhance the ability of terrain classification, which is crucial for autonomous navigation of rovers. The estimate in IR from visual band has inherent limitations, as these are different bands, yet correlations between visual RGB and thermal IR images exist, as different terrains, which visually may appear different, also have different thermal inertia. This paper describes the developed deep learning-based algorithm that estimates thermal IR images from RGB images of terrains, providing the feasibility of the idea with average 1.21 error [degree Celsius].

Torresen, Jim↗

Magellan radar to reveal secrets of enshrouded Venus

Imaging Venus with a synthetic aperture radar (SAR) with 70 percent global coverage at 1-km optical line-pair resolution to provide a detailed global characterization of the volcanic land-forms on Venus by an integration of image data with altimetry is discussed. The Magellan radar system uses navigation predictions to preset the radar data collection parameters. The data are collected in such a way as to preserve the Doppler signature of surface elements and later they are transmitted to the earth for processing into high-resolution radar images. To maintain high accuracy, a complex on-board filter algorithm allows the altitude control logic to respond only to a narrow range of expected photon intensity levels and only to signals that occur within a small predicted interval of time. Each mapping pass images a swath of the planet that varies in width from 20 to 25 km. Since the orbital plane of the spacecraft remains fixed in the inertial space, the slow rotation of Venus continually brings new areas into view of the spacecraft.

Saunders, R. Stephen↗

A land-surface Testbed for EOSDIS

The main objective of the Testbed project was to deliver satellite images via the Internet to scientific and educational users free of charge. The main method of operations was to store satellite images on a low cost tape library system, visually browse the raw satellite data, access the raw data filed, navigate the imagery through 'C' programming and X-Windows interface software, and deliver the finished image to the end user over the Internet by means of file transfer protocol methods. The conclusion is that the distribution of satellite imagery by means of the Internet is feasible, and the archiving of large data sets can be accomplished with low cost storage systems allowing multiple users.

Emery, William↗

The role of autonomous satellite navigation in the NEEDS program

A number of applications of autonomous satellite navigation are discussed. They include the onboard annotation of all experimental data and the onboard correction of imaging data. The accuracy levels required for each function are presented. Two alternative techniques for achieving autonomous satellite navigation are considered. One technique utilizes data from the Global Positioning System (GPS). The other approach utilizes data from a geosynchronous relay satellite system such as the Tracking and Data Relay Satellite System (TDRSS). The TDRSS approach makes use of one-way range and Doppler data along with a time transfer mechanism. Comparative accuracy levels for the onboard determination of position, velocity, and time based upon the GPS and TDRSS approaches are presented.

Fuchs, A. J.↗

Simultaneous dual-band radar development

Efforts to design and construct an airborne imaging radar operating simultaneously at L band and X band with an all-inertial navigation system in order to form a dual-band radar system are described. The areas of development include duplex transmitters, receivers, and recorders, a control module, motion compensation for both bands, and adaptation of a commercial inertial navigation system. Installation of the system in the aircraft and flight tests are described. Circuit diagrams, performance figures, and some radar images are presented.

Liskow, C. L.↗

Systems and Methods for Automated Vessel Navigation Using Sea State Prediction

Systems and methods for sea state prediction and autonomous navigation in accordance with embodiments of the invention are disclosed. One embodiment of the invention includes a method of predicting a future sea state including generating a sequence of at least two 3D images of a sea surface using at least two image sensors, detecting peaks and troughs in the 3D images using a processor, identifying at least one wavefront in each 3D image based upon the detected peaks and troughs using the processor, characterizing at least one propagating wave based upon the propagation of wavefronts detected in the sequence of 3D images using the processor, and predicting a future sea state using at least one propagating wave characterizing the propagation of wavefronts in the sequence of 3D images using the processor. Another embodiment includes a method of autonomous vessel navigation based upon a predicted sea state and target location.

Huntsberger, Terrance L.↗

Systems and Methods for Automated Vessel Navigation Using Sea State Prediction

Systems and methods for sea state prediction and autonomous navigation in accordance with embodiments of the invention are disclosed. One embodiment of the invention includes a method of predicting a future sea state including generating a sequence of at least two 3D images of a sea surface using at least two image sensors, detecting peaks and troughs in the 3D images using a processor, identifying at least one wavefront in each 3D image based upon the detected peaks and troughs using the processor, characterizing at least one propagating wave based upon the propagation of wavefronts detected in the sequence of 3D images using the processor, and predicting a future sea state using at least one propagating wave characterizing the propagation of wavefronts in the sequence of 3D images using the processor. Another embodiment includes a method of autonomous vessel navigation based upon a predicted sea state and target location.

Huntsberger, Terrance L.↗

Thomas Leps Internship Abstract

An optical navigation system is being flown as the backup system to the primary Deep Space Network telemetry for navigation and guidance purposes on Orion. This is required to ensure Orion can recover from a loss of communication, which would simultaneously cause a loss of DSN telemetry. Images taken of the Moon and Earth are used to give range and position information to the navigation computer for trajectory calculations and maneuver execution. To get telemetry data from these images, the size and location of the moon need to be calculated with high accuracy and precision. The reentry envelope for the Orion EM-1 mission requires the centroid and radius of the moon images to be determined within 1/3 of a pixel 3 sigma. In order to ensure this accuracy and precision can be attained, I was tasked with building precise dot grid images for camera calibration as well as building a hardware in the loop test stand for flight software and hardware proofing. To calibrate the Op-Nav camera a dot grid is imaged with the camera, the error between the image dot location and the actual dot location can be used to build a distortion map of the camera and lens system so that images can be fixed to display truth locations. To build the dot grid images I used the Electro Optics Lab optical bench Bright Object Simulator System, and gimbal. The gimbal was slewed to a series of elevations and azimuths. An image of the collimated single point light source was then taken at each position. After a series of 99 images were taken at different locations the single light spots were extracted from each image and added to a composite image containing all 99 points. During the development of these grids it was noticed that an intermittent error in the artificial "star" locations occurred. Prior to the summer this error was attributed to the gimbal having glitches in it's pointing direction and was going to be replaced, however after further examining the issue I determined it to be a software issue. I have since narrowed the likely source of the error down to a Software Development Kit released by the camera supplier PixeLink. I have since developed a workaround in order to build star grids for calibration until the software bug can be isolated and fixed. I was also tasked with building a Hardware in the Loop test stand in order to test the full Op-Nav system. A 4k screen displays simulated Lunar and Terrestrial images from a possible Orion trajectory. These images are then projected through a collimator and then captured with an Op-Nav camera controlled by an Intel NUC computer running flight software. The flight software then analyzes the images to determine attitude and position, this data is then reconstructed into a trajectory and matched to the simulated trajectory in order to determine the accuracy of the attitude and position estimates. In order for the system to work it needs to be precisely and accurately aligned. I developed an alignment procedure that allows the screen, collimator and camera to be squared, centered and collinear with each other within a micron spatially and 5 arcseconds in rotation. I also designed a rigid mount for the screen that was machined on site in Building 10 by another intern. While I was working in the EOL we received a $500k Orion startracker for alignment procedure testing. Due to my prior experience in electronics development, as an ancillary duty, I was tasked with building the cables required to operate and power the startracker. If any errors are made building these cables the startracker would be destroyed, I was honored that the director of the lab entrusted such a critical component with me. This internship has cemented my view on public space exploration. I always preferred public sector to privatization because, as a scientist, the most interesting aspects of space for me are not necessarily the most profitable. I was concerned that the public sector was faltering however, and that in order to improve human space exploration I would be forced into private sector. I now know that, at least at JSC, human spaceflight is still progressing, and exciting work is still being done. I am now actively seeking employment at JSC after I complete my Ph.D and have met with my branch chiefs and mentor to discuss transitioning to a grad Co-op position.

Leps, Thomas↗

Insect-Inspired Optical-Flow Navigation Sensors

Integrated circuits that exploit optical flow to sense motions of computer mice on or near surfaces ( optical mouse chips ) are used as navigation sensors in a class of small flying robots now undergoing development for potential use in such applications as exploration, search, and surveillance. The basic principles of these robots were described briefly in Insect-Inspired Flight Control for Small Flying Robots (NPO-30545), NASA Tech Briefs, Vol. 29, No. 1 (January 2005), page 61. To recapitulate from the cited prior article: The concept of optical flow can be defined, loosely, as the use of texture in images as a source of motion cues. The flight-control and navigation systems of these robots are inspired largely by the designs and functions of the vision systems and brains of insects, which have been demonstrated to utilize optical flow (as detected by their eyes and brains) resulting from their own motions in the environment. Optical flow has been shown to be very effective as a means of avoiding obstacles and controlling speeds and altitudes in robotic navigation. Prior systems used in experiments on navigating by means of optical flow have involved the use of panoramic optics, high-resolution image sensors, and programmable imagedata- processing computers.

Thakoor, Sarita↗

Millimeter wavelength communications applications for the SEI

The potentially complex missions of the Space Exploration Initiative (SEI) require advanced lunar communications, navigation, and information systems to provide voice, data, and image transmissions. The objectives here are to determine which SEI telecommunications applications will benefit from millimeter wave technology, assess the state of the art in millimeter wave technology, and describe the technology development shortfalls with respect to potential mission time frames. The assumptions for the analysis as well as other non-performance related issues are also presented.

Ponchak, Denise S.↗

Precision Landing and Hazard Avoidance Doman

The Precision Landing and Hazard Avoidance (PL&HA) domain addresses the development, integration, testing, and spaceflight infusion of sensing, processing, and GN&C functions critical to the success and safety of future human and robotic exploration missions. PL&HA sensors also have applications to other mission events, such as rendezvous and docking. Autonomous PL&HA builds upon the core GN&C capabilities developed to enable soft, controlled landings on the Moon, Mars, and other solar system bodies. Through the addition of a Terrain Relative Navigation (TRN) function, precision landing within tens of meters of a map-based target is possible. The addition of a 3-D terrain mapping lidar sensor improves the probability of a safe landing via autonomous, real-time Hazard Detection and Avoidance (HDA). PL&HA significantly improves the probability of mission success and enhances access to sites of scientific interest located in challenging terrain. PL&HA can also utilize external navigation aids, such as navigation satellites and surface beacons. Advanced Lidar Sensors High precision ranging, velocimetry, and 3-D terrain mapping Terrain Relative Navigation (TRN) TRN compares onboard reconnaissance data with real-time terrain imaging data to update the S/C position estimate Hazard Detection and Avoidance (HDA) Generates a high-resolution, 3-D terrain map in real-time during the approach trajectory to identify safe landing targets Inertial Navigation During Terminal Descent High precision surface relative sensors enable accurate inertial navigation during terminal descent and a tightly controlled touchdown within meters of the selected safe landing target.

Robertson, Edward A.↗