Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual stereo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Deciphering the Precision of Stereo IKONOS Canopy Height Models for U.S. Forests with G-LiHT Airborne LiDAR

Few studies have evaluated the precision of IKONOS stereo data for measuring forest canopy height. The high cost of airborne light detection and ranging (LiDAR) data collection for large area studies and the present lack of a spaceborne instrument lead to the need to explore other low cost options. The US Government currently has access to a large archive of commercial high-resolution imagery, which could be quite valuable to forest structure studies. At 1 m resolution, we here compared canopy height models (CHMs) and height data derived from Goddard's airborne LiDAR Hyper-spectral and Thermal Imager (G-LiHT) with three types of IKONOS stereo derived digital surface models (DSMs) that estimate CHMs by subtracting National Elevation Data (NED) digital terrain models (DTMs). We found the following in three different forested regions of the US after excluding heterogeneous and disturbed forest samples: (1) G-LiHT DTMs were highly correlated with NED DTMs with R (sup 2) greater than 0.98 and root mean square errors (RMSEs) less than 2.96 m; (2) when using one visually identifiable ground control point (GCP) from NED, G-LiHT DSMs and IKONOS DSMs had R (sup 2) greater than 0.84 and RMSEs of 2.7 to 4.1 m; and (3) one GCP CHMs for two study sites had R (sup 2) greater than 0.7 and RMSEs of 2.6 to 3 m where data were collected less than four years apart. Our results suggest that IKONOS stereo data are a useful LiDAR alternative where high-quality DTMs are available.

IKONOS↗

SU-E-T-154: Establishment and Implement of 3D Image Guided Brachytherapy Planning System

Purpose: Cannot observe the dose intuitionally is a limitation of the existing 2D pre-implantation dose planning. Meanwhile, a navigation module is essential to improve the accuracy and efficiency of the implantation. Hence a 3D Image Guided Brachytherapy Planning System conducting dose planning and intra-operative navigation based on 3D multi-organs reconstruction is developed. Methods: Multi-organs including the tumor are reconstructed in one sweep of all the segmented images using the multiorgans reconstruction method. The reconstructed organs group establishs a three-dimensional visualized operative environment. The 3D dose maps of the three-dimentional conformal localized dose planning are calculated with Monte Carlo method while the corresponding isodose lines and isodose surfaces are displayed in a stereo view. The real-time intra-operative navigation is based on an electromagnetic tracking system (ETS) and the fusion between MRI and ultrasound images. Applying Least Square Method, the coordinate registration between 3D models and patient is realized by the ETS which is calibrated by a laser tracker. The system is validated by working on eight patients with prostate cancer. The navigation has passed the precision measurement in the laboratory. Results: The traditional marching cubes (MC) method reconstructs one organ at one time and assembles them together. Compared to MC, presented multi-organs reconstruction method has superiorities in reserving the integrality and connectivity of reconstructed organs. The 3D conformal localized dose planning, realizing the 'exfoliation display' of different isodose surfaces, helps make sure the dose distribution has encompassed the nidus and avoid the injury of healthy tissues. During the navigation, surgeons could observe the coordinate of instruments real-timely employing the ETS. After the calibration, accuracy error of the needle position is less than 2.5mm according to the experiments. Conclusion: The speed and quality of 3D reconstruction, the efficiency in dose planning and accuracy in navigation all can be improved simultaneously.

60 APPLIED LIFE SCIENCES↗

A computational model for dynamic vision

This paper describes a novel computational model for dynamic vision which promises to be both powerful and robust. Furthermore the paradigm is ideal for an active vision system where camera vergence changes dynamically. Its basis is the retinotopically indexed object-centered encoding of the early visual information. Specifically, the relative distances of objects to a set of referents is encoded in image registered maps. To illustrate the efficacy of the method, it is applied to the problem of dynamic stereo vision. Integration of depth information over multiple frames obtained by a moving robot generally requires precise information about the relative camera position from frame to frame. Usually, this information can only be approximated. The method facilitates the integration of depth information without direct use or knowledge of camera motion.

Moezzi, Saied↗

Vision Based Localization in Urban Environments

As part of DARPA's MARS2020 program, the Jet Propulsion Laboratory developed a vision-based system for localization in urban environments that requires neither GPS nor active sensors. System hardware consists of a pair of small FireWire cameras and a standard Pentium-based computer. The inputs to the software system consist of: 1) a crude grid-based map describing the positions of buildings, 2) an initial estimate of robot location and 3) the video streams produced by each camera. At each step during the traverse the system: captures new image data, finds image features hypothesized to lie on the outside of a building, computes the range to those features, determines an estimate of the robot's motion since the previous step and combines that data with the map to update a probabilistic representation of the robot's location. This probabilistic representation allows the system to simultaneously represent multiple possible locations, For our testing, we have derived the a priori map manually using non-orthorectified overhead imagery, although this process could be automated. The software system consists of two primary components. The first is the vision system which uses binocular stereo ranging together with a set of heuristics to identify features likely to be part of building exteriors and to compute an estimate of the robot's motion since the previous step. The resulting visual features and the associated range measurements are software component, a particle-filter based localization system. This system uses the map and the then fed to the second primary most recent results from the vision system to update the estimate of the robot's location. This report summarizes the design of both the hardware and software and will include the results of applying the system to the global localization of a robot over an approximately half-kilometer traverse across JPL'S Pasadena campus.

unmanned-ground vehicles↗

Topography from shading and stereo

Methods exploiting photometric information in images that have been developed in machine vision can be applied to planetary imagery. Integrating shape from shading, binocular stereo, and photometric stereo yields a robust system for recovering detailed surface shape and surface reflectance information. Such a system is useful in producing quantitative information from the vast volume of imagery being received, as well as in helping visualize the underlying surface.

Horn, Berthold K. P.↗

A virtual reality browser for Space Station models

The Graphics Analysis Facility at NASA/JSC has created a visualization and learning tool by merging its database of detailed geometric models with a virtual reality system. The system allows an interactive walk-through of models of the Space Station and other structures, providing detailed realistic stereo images. The user can activate audio messages describing the function and connectivity of selected components within his field of view. This paper presents the issues and trade-offs involved in the implementation of the VR system and discusses its suitability for its intended purposes.

Goldsby, Michael↗

Rover Slip Validation and Prediction Algorithm

A physical-based simulation has been developed for the Mars Exploration Rover (MER) mission that applies a slope-induced wheel-slippage to the rover location estimator. Using the digital elevation map from the stereo images, the computational method resolves the quasi-dynamic equations of motion that incorporate the actual wheel-terrain speed to estimate the gross velocity of the vehicle. Based on the empirical slippage measured by the Visual Odometry software of the rover, this algorithm computes two factors for the slip model by minimizing the distance of the predicted and actual vehicle location, and then uses the model to predict the next drives. This technique, which has been deployed to operate the MER rovers in the extended mission periods, can accurately predict the rover position and attitude, mitigating the risk and uncertainties in the path planning on high-slope areas.

Yen, Jeng↗

3D Stereo Immersive Environment Utilizing Mobile Devices / Peripherals

This project expands upon some of the FY23 IRAD funded "Full Lunar Surface Simulation Platform" (FLS-SP) derived technologies. The results have demonstrated a low-cost, compact, immersive technology that supports training, interaction, mission planning, and other man-in-loop activities in simulated environments called “3D Stereo Immersion Environment Utilizing Mobile Devices” (3D SIEUMD). These activities will become crucial for safety and mission, planning, and assurance in the Artemis program, as well as future commercial crew programs. The FLS-SP enabled the visualization of simulated lunar surface operations for rovers, landers, habitation, and EVA. The 3D SIEUMD technology allows for NASA S&MA experts, tasked with defining safety protocols and procedures, to interact in an immersive environment without expensive immersion gear. Reduction of the overall safety risk by immersing safety concepts into the design and engineering phase for very small cost is accomplished even before hardware is deployed to the lunar surface.

Scott Johnson↗

The CAVE (TM) automatic virtual environment: Characteristics and applications

Virtual reality may best be defined as the wide-field presentation of computer-generated, multi-sensory information that tracks a user in real time. In addition to the more well-known modes of virtual reality -- head-mounted displays and boom-mounted displays -- the Electronic Visualization Laboratory at the University of Illinois at Chicago recently introduced a third mode: a room constructed from large screens on which the graphics are projected on to three walls and the floor. The CAVE is a multi-person, room sized, high resolution, 3D video and audio environment. Graphics are rear projected in stereo onto three walls and the floor, and viewed with stereo glasses. As a viewer wearing a location sensor moves within its display boundaries, the correct perspective and stereo projections of the environment are updated, and the image moves with and surrounds the viewer. The other viewers in the CAVE are like passengers in a bus, along for the ride. 'CAVE,' the name selected for the virtual reality theater, is both a recursive acronym (Cave Automatic Virtual Environment) and a reference to 'The Simile of the Cave' found in Plato's 'Republic,' in which the philosopher explores the ideas of perception, reality, and illusion. Plato used the analogy of a person facing the back of a cave alive with shadows that are his/her only basis for ideas of what real objects are. Rather than having evolved from video games or flight simulation, the CAVE has its motivation rooted in scientific visualization and the SIGGRAPH 92 Showcase effort. The CAVE was designed to be a useful tool for scientific visualization. The Showcase event was an experiment; the Showcase chair and committee advocated an environment for computational scientists to interactively present their research at a major professional conference in a one-to-many format on high-end workstations attached to large projection screens. The CAVE was developed as a 'virtual reality theater' with scientific content and projection that met the criteria of Showcase.

Kenyon, Robert V.↗

In-simulator assessment of trade-offs arising from mixture of color cuing and monocular, binoptic, and stereopsis cuing information

The use of monochrome Helmet Mounted Display (HMD) systems is becoming prevalent in today's complex flight mission environment. These HMD systems can provide stereopsis cueing as an almost natural byproduct for binocular helmet systems of an additional image generation source is provided. The addition of color cueing capability is much more difficult. The application of stereopsis cueing to advanced HMD and heads-down flight display concepts has demonstrated gains in pilot situation awareness and improved task performance. To provide stereopsis, binocular HMD systems must trade some of the total field-of-view (FOV) available from their two monocular fields to obtain a partial overlap region. The visual field then provides a mixture of cues, with monocular regions on both peripheries, and, in the overlapped center, a binoptic (the same image to both eyes) or, if lateral disparity is introduced to produce two images, a stereo region. The goal of this research was to assess the trade-offs arising from the mixture of color cueing and monocular, biocular, and stereopsis cueing information in peripheral monitoring displays as encountered in HMD systems. The accompanying effect of stereopsis cueing in the foveal display of tracking information was also assessed.

Williams, Steven P.↗

Evaluating the Usability of Pinchigator, a system for Navigating Virtual Worlds using Pinch Gloves

Appropriate design of two dimensional user interfaces (2D U/I) utilizing the well known WIMP (Window, Icon, Menu, Pointing device) environment for computer software is well studied and guidance can be found in several standards. Three-dimensional U/I design is not nearly so mature as 2D U/I, and standards bodies have not reached consensus on what makes a usable interface. This is especially true when the tools for interacting with the virtual environment may include stereo viewing, real time trackers and pinch gloves instead of just a mouse & keyboard. Over the last several years the authors have created a 3D U/I system dubbed Pinchigator for navigating virtual worlds based on the dVise dV/Mockup visualization software, Fakespace Pinch Gloves and Pohlemus trackers. The current work is to test the usability of the system on several virtual worlds, suggest improvements to increase Pinchigator s usability, and then to generalize about what was learned and how those lessons might be applied to improve other 3D U/I systems.

Hamilton, George S.↗

Photo-realistic Terrain Modeling and Visualization for Mars Exploration Rover Science Operations

Modern NASA planetary exploration missions employ complex systems of hardware and software managed by large teams of. engineers and scientists in order to study remote environments. The most complex and successful of these recent projects is the Mars Exploration Rover mission. The Computational Sciences Division at NASA Ames Research Center delivered a 30 visualization program, Viz, to the MER mission that provides an immersive, interactive environment for science analysis of the remote planetary surface. In addition, Ames provided the Athena Science Team with high-quality terrain reconstructions generated with the Ames Stereo-pipeline. The on-site support team for these software systems responded to unanticipated opportunities to generate 30 terrain models during the primary MER mission. This paper describes Viz, the Stereo-pipeline, and the experiences of the on-site team supporting the scientists at JPL during the primary MER mission.

Edwards, Laurence↗

Robot Sequencing and Visualization Program (RSVP)

The Robot Sequencing and Visualization Program (RSVP) is being used in the Mars Science Laboratory (MSL) mission for downlink data visualization and command sequence generation. RSVP reads and writes downlink data products from the operations data server (ODS) and writes uplink data products to the ODS. The primary users of RSVP are members of the Rover Planner team (part of the Integrated Planning and Execution Team (IPE)), who use it to perform traversability/articulation analyses, take activity plan input from the Science and Mission Planning teams, and create a set of rover sequences to be sent to the rover every sol. The primary inputs to RSVP are downlink data products and activity plans in the ODS database. The primary outputs are command sequences to be placed in the ODS for further processing prior to uplink to each rover. RSVP is composed of two main subsystems. The first, called the Robot Sequence Editor (RoSE), understands the MSL activity and command dictionaries and takes care of converting incoming activity level inputs into command sequences. The Rover Planners use the RoSE component of RSVP to put together command sequences and to view and manage command level resources like time, power, temperature, etc. (via a transparent realtime connection to SEQGEN). The second component of RSVP is called HyperDrive, a set of high-fidelity computer graphics displays of the Martian surface in 3D and in stereo. The Rover Planners can explore the environment around the rover, create commands related to motion of all kinds, and see the simulated result of those commands via its underlying tight coupling with flight navigation, motor, and arm software. This software is the evolutionary replacement for the Rover Sequencing and Visualization software used to create command sequences (and visualize the Martian surface) for the Mars Exploration Rover mission.

Cooper, Brian K.↗

Localized Imaging and Mapping for Underwater Fuel Storage Basins - 18364

Current methods for inspection of spent nuclear fuel storage basins involve lowering a single camera for visual inspection of walls and other structures. We present a localized inspection solution where the images are automatically annotated by localization information and a 3D model of the inspected area is generated. The system consists of an underwater sensor pod containing a stereo pair of cameras, light source, inertial measurement unit, and a pressure sensor. The sensors are time synchronized to provide precise measurements. We describe both the sensor pod and the algorithms that keep the pod localized. Preliminary results from in-air testing of a prototype are presented. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Recent developments at JPL in the application of image processing to astronomy

Four applications of image processing to astronomy, automated location and analysis of star and galaxy images, geometric and radiometric decalibration of vidicon spectra, display of multiband radio images, and generation of high resolution polarization direction and magnitude maps from images are presented with illustrative examples. The technique by which a digital image can be analyzed automatically to locate and segregate between stars and galaxies and the steps performed by the classifier to determine the nature of each object are outlined. The classification program executed on a 48 inch Schmidt plate of the cluster of galaxies 655 is described. The calibration and decalibration steps to remove geometric and radiometric distortions from a silicon vidicon camera digital spectra are discussed. Three methods of displaying multispectral radio data, generating a mosaic of each image, producing a color coded image to depict radio velocity, and producing a stereo pair with radial velocity as depth are described. The generation of polarization information from images obtained through linear polarizing filters is illustrated, and it is concluded that in each case information was displayed using digital techniques which could not readily have been provided visually.

Lorre, J. J.↗

The 3-D Moons: The Voyager stereo atlas of the outer solar system

Comprehension and analysis of geologic features on any planet is enhanced manyfold by a clear perception between albedo and topography. On many of the icy satellites significant albedo contrasts due to mixtures of dark rocky and bright icy materials can be associated with topographic features. Subtle topographic features can be masked by albedo variation and under high solar illumination albedo and topography can be difficult to separate. To this end we are compiling an atlas of stereo image pairs of the outer solar system based on Voyager imaging for the investigation of various geologic problems and for general use. For the icy satellites, general perceptions of topography are usually gleaned from shape-from-shading information in the images processed by the human brain (i.e. visual inspection). With few exceptions, actual topography has been measured on a spot-by-spot basis using shadow heights or photoclinometry, or along limb profiles (where geographic context may be unavailable). Shadow heights are limited to regions within approximately 10 deg of the terminator and images with resolution better than approximately 1 km/pixel. Photoclinometric scans can be used more widely but are subject to a variety of errors, primarily uncertain assumptions of uniform scene albedo or poorly understood photometry. Stereoscopic analysis, where available, has the potential for greatly expanding topographic perception.

Schenk, P.↗

Contour completion through depth interferes with stereoacuity

Local disparity signals must interact in visual cortex to represent boundaries and surfaces of three-dimensional (3D) objects. We investigated how disparity signals interact in 3D contours and in 3D surfaces generated from the contours. We compared flat (single disparity) stimuli with curved (multi-disparity) stimuli. We found no consistent differences in sensitivity to contours vs. surfaces; for equivalent amounts of disparity, however, observers were more sensitive to flat stimuli than curved stimuli. Poor depth sensitivity for curved stimuli cannot be explained by the larger range of disparities present in the curved surface, nor by disparity averaging, nor by poor sensitivity to the largest disparity in the stimulus. Surprisingly, sensitivity to surfaces curved in depth was improved by removing portions of the surface and thus removing disparity information. Stimulus configuration had a profound effect on stereo thresholds that cannot be accounted for by disparity-energy models of V1 processing. We suggest that higher-level 3D contour or 3D shape mechanisms are involved.

Non-NASA Center↗

Use of 3D vision for fine robot motion

An integration of 3-D vision systems with robot manipulators will allow robots to operate in a poorly structured environment by visually locating targets and obstacles. However, by using computer vision for objects acquisition makes the problem of overall system calibration even more difficult. Indeed, in a CAD based manipulation a control architecture has to find an accurate mapping between the 3-D Euclidean work space and a robot configuration space (joint angles). If a stereo vision is involved, then one needs to map a pair of 2-D video images directly into the robot configuration space. Neural Network approach aside, a common solution to this problem is to calibrate vision and manipulator independently, and then tie them via common mapping into the task space. In other words, both vision and robot refer to some common Absolute Euclidean Coordinate Frame via their individual mappings. This approach has two major difficulties. First a vision system has to be calibrated over the total work space. And second, the absolute frame, which is usually quite arbitrary, has to be the same with a high degree of precision for both robot and vision subsystem calibrations. The use of computer vision to allow robust fine motion manipulation in a poorly structured world which is currently in progress is described along with the preliminary results and encountered problems.

Lokshin, Anatole↗