Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual stereo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Graphics for Stereo Visualization Theater for Supercomputing 1998

The Stereo Visualization Theater is a high-resolution graphics demonstration that prides a review of current research being performed at NASA. Using a stereoscopic projection, multiple participants can explore scientific data in new ways. The pre-processed audio and video are being played in real-time off of a workstation. A stereo graphics filter for the projector and passive polarized glasses worn by audience members are used to create the stereo effect.

Antipuesto, Joel↗

Stereo image visualization of numerically simulated turbulence

Stereo imaging techniques are used in the current study to analyze the results of a direct Navier-Stokes simulation of a turbulent boundary layer. Coherent structures embedded within the unsteady, highly three-dimensional turbulent flow fields are significantly enhanced through the use of stereo computer graphic renderings. In the paper, the geometrical foundations of two different methods for generating stereo images are reviewed. Sufficient detail is provided to enable readers to code stereo display algorithms from scratch. The effects of varying the geometric parameters of the stereo algorithm are demonstrated. Sample image pairs from animations of the turbulence numerical simulation are presented in color. Stereo imagery, especially when used with time-evolving data, provides new insight into the physical processes responsible for the generation an maintenance of turbulence within boundary layers.

Robinson, Stephen K.↗

Initial results from the Magellan stereo experiment

The second global radar image coverage of Venus by Magellan included a 1 day experiment to produce a set of eight images along orbits that combined with the original nominal imagery into stereo image pairs suited for visual stereo interpretation and mapping of topographic elevations. Initial analysis shows excellent stereo radar data with good vertical exaggeration of six and more, parallax accuracies of +/- 0.6 pixels or +/- 45 m and a surface definition with +/- 30 m. The topographic relief can be very accentuated, with local elevation differences of 2.5 km and terrain slopes often in excess of 25 deg. This data set has proven the usefulness of global stereo coverage and marks the beginning of significant planetary stereo radargrammetric developments. Extensive mapping with this same stereo geometry is being carried out in cycle 3, and preparations are underway to develop a detailed stereo radargrammetric topographic model of the planet.

Leberl, Franz W.↗

The Evolution of Three Dimensional Visualization for Commanding the Mars Rovers

NASA's Jet Propulsion Laboratory has built and operated four rovers on the surface of Mars. Two and three dimensional visualization has been extensively employed to command both the mobility and robotic arm operations of these rovers. Stereo visualization has been an important component in this set of visualization techniques. This paper discusses the progression of the implementation and use of visualization techniques for in-situ operations of these robotic missions. Illustrative examples will be drawn from the results of using these techniques over more than ten years of surface operations on Mars.

stereo visualization↗

Visualization of electronic density

An atom’s volume depends on its electronic density. Although this density can only be evaluated exactly for hydrogen-like atoms, there are many excellent numerical algorithms and packages to calculate it for other materials. 3D visualization of charge density is challenging, especially when several molecular/atomic levels are intertwined in space. We explore several approaches to 3D charge density visualization, including the extension of an anaglyphic stereo visualization application based on the AViz package to larger structures such as nanotubes. We will describe motivations and potential applications of these tools for answering interesting questions about nanotube properties.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Visual tracking in stereo

A method is described for visual object tracking by a computer vision system using TV cameras and special low-level image processing hardware. The tracker maintains an internal model of the location, orientation, and velocity of the object in three-dimensional space. This model is used to predict where features of the object will lie on the two-dimensional images produced by stereo TV cameras. The differences in the locations of features in the two-dimensional images as predicted by the internal model and as actually seen create an error signal in the two-dimensional representation. This is multiplied by a generalized inverse Jacobian matrix to deduce the error in the internal model. The procedure repeats to update the internal model of the object's location, orientation and velocity continuously.

Saund, E.↗

Exploratory Climate Data Visualization and Analysis Using DV3D and UVCDAT

Earth system scientists are being inundated by an explosion of data generated by ever-increasing resolution in both global models and remote sensors. Advanced tools for accessing, analyzing, and visualizing very large and complex climate data are required to maintain rapid progress in Earth system research. To meet this need, NASA, in collaboration with the Ultra-scale Visualization Climate Data Analysis Tools (UVCOAT) consortium, is developing exploratory climate data analysis and visualization tools which provide data analysis capabilities for the Earth System Grid (ESG). This paper describes DV3D, a UV-COAT package that enables exploratory analysis of climate simulation and observation datasets. OV3D provides user-friendly interfaces for visualization and analysis of climate data at a level appropriate for scientists. It features workflow inte rfaces, interactive 40 data exploration, hyperwall and stereo visualization, automated provenance generation, and parallel task execution. DV30's integration with CDAT's climate data management system (COMS) and other climate data analysis tools provides a wide range of high performance climate data analysis operations. DV3D expands the scientists' toolbox by incorporating a suite of rich new exploratory visualization and analysis methods for addressing the complexity of climate datasets.

Maxwell, Thomas↗

NASA Tech Briefs, March 2014

Topics include: Data Fusion for Global Estimation of Forest Characteristics From Sparse Lidar Data; Debris and Ice Mapping Analysis Tool - Database; Data Acquisition and Processing Software - DAPS; Metal-Assisted Fabrication of Biodegradable Porous Silicon Nanostructures; Post-Growth, In Situ Adhesion of Carbon Nanotubes to a Substrate for Robust CNT Cathodes; Integrated PEMFC Flow Field Design for Gravity-Independent Passive Water Removal; Thermal Mechanical Preparation of Glass Spheres; Mechanistic-Based Multiaxial-Stochastic-Strength Model for Transversely-Isotropic Brittle Materials; Methods for Mitigating Space Radiation Effects, Fault Detection and Correction, and Processing Sensor Data; Compact Ka-Band Antenna Feed with Double Circularly Polarized Capability; Dual-Leadframe Transient Liquid Phase Bonded Power Semiconductor Module Assembly and Bonding Process; Quad First Stage Processor: A Four-Channel Digitizer and Digital Beam-Forming Processor; Protective Sleeve for a Pyrotechnic Reefing Line Cutter; Metabolic Heat Regenerated Temperature Swing Adsorption; CubeSat Deployable Log Periodic Dipole Array; Re-entry Vehicle Shape for Enhanced Performance; NanoRacks-Scale MEMS Gas Chromatograph System; Variable Camber Aerodynamic Control Surfaces and Active Wing Shaping Control; Spacecraft Line-of-Sight Stabilization Using LWIR Earth Signature; Technique for Finding Retro-Reflectors in Flash LIDAR Imagery; Novel Hemispherical Dynamic Camera for EVAs; 360 deg Visual Detection and Object Tracking on an Autonomous Surface Vehicle; Simulation of Charge Carrier Mobility in Conducting Polymers; Observational Data Formatter Using CMOR for CMIP5; Propellant Loading Physics Model for Fault Detection Isolation and Recovery; Probabilistic Guidance for Swarms of Autonomous Agents; Reducing Drift in Stereo Visual Odometry; Future Air-Traffic Management Concepts Evaluation Tool; Examination and A Priori Analysis of a Direct Numerical Simulation Database for High-Pressure Turbulent Flows; and Resource-Constrained Application of Support Vector Machines to Imagery.

Source record↗

A Synchronized Sensor Array for Remote Monitoring of Avian and Bat Interactions with Offshore Renewable Energy Facilities

Wind energy production in the U.S. is projected to increase to 35% of our nation’s energy by 2050. This substantial increase in the U.S. is only a portion of the global wind industry growth, as many countries strive to reduce greenhouse gas emissions. A major environmental concern and potential market barrier for expansion of wind energy is bird and bat mortality from impacts with turbine blades, towers, and nacelles. Carcass surveys are the standard protocol for quantifying mortality at onshore sites. This method is imperfect, however, due to survey frequency at remote sites, removal of carcasses by scavengers between surveys, searcher efficiency, and other biases as well as delays of days to weeks or more in obtaining information on collision events. Furthermore, carcass surveys are not feasible at offshore wind energy sites. Near-real-time detection and quantification of interaction rates is possible at both onshore and offshore wind facilities using an onboard, integrated sensor package with data transmitted to central processing centers. We developed and experimentally tested an array of sensors that continuously monitors for interactions (including impacts) of birds and bats with wind turbines. The synchronized array includes three sensor nodes: (1) vibration (accelerometers and contact microphones), (2) optical (visual and infrared spectrum cameras), and (3) bioacoustics (acoustic and ultrasonic microphones). Accelerometers and contact acoustic microphones are placed at the root of each blade to detect impact vibrations and sound waves propagating through the structure. On-board data processing algorithms using wavelet analysis detect impact signals exceeding background vibration. Stereo-visual and infrared cameras were placed on the nacelle to allow target tracking, distance, and size calculations. On-board image processing and target detection algorithms identify moving targets within the camera field of view. Bioacoustic recorders monitor vocalizations and echolocations to aid in identifying organisms involved in interactions. Data from all sensors are temporarily stored in ring (i.e., circular) buffers with a duration varying by sensor type. Detection of target presence or impact by any of the sensors can trigger the archiving of data from all buffers for transmission to a central data processing center for evaluation and post-processing. This mitigates the risk of “data mortgages” posed by continual recording and minimizes personnel time required to manually review event data. We first conducted individual component tests at laboratories and field sites in Corvallis and Newport, Oregon, and Seattle and Sequim, Washington. We conducted additional component tests on research wind turbines at the North American Wind Research and Training Center, Mesalands Community College (MCC; General Electric 1.5 MW turbine), New Mexico, and the National Wind Technology Center, National Renewable Energy Laboratory (NREL; Controls Advanced Research Turbines 3 [CART 3] 600 kW Westinghouse turbine), Colorado. We conducted fully integrated system tests at NREL in October 2014 and April 2015. We used only research wind turbines so that we could conduct controlled, experimentally generated impacts using empty and water-filled tennis balls shot from a compressed air cannon on the ground. The approx. 57-140 g tennis balls (depending on water content) were at the upper mass range for bats, but lower mass range for marine birds. Therefore, the ability to detect collisions of most seabirds is likely greater than our experiments demonstrate, but possibly lower for some bats depending on the background signal of a given turbine. Vibration data demonstrated that background signals of operating turbines varied markedly among the CART 3 under normal operation (greatest), GE (moderate), and CART 3 during idle rotation (generator not engaged; least). In total, we measured 63 experimental blade impacts on the two research turbines. Impaction detection was dependent on background signals, position of impact on the blade (a tip strike resulted in the strongest impact signal), and impact kinetics (velocity of ball and whether the ball struck the surface of the blade or the leading edge of the blade struck the ball). Overall detection percentage ranged from 100% for the “quietest” conditions (CART 3 idle rotation), down to 35% for the noisiest (CART 3 normal operation). Impact signals were detected from sensors on more than one blade (i.e., blades other than the blade struck) 50% - 75% of the time. Stereo imaging provided valuable metrics, but increased data processing and equipment cost. Given the cost of cameras with sufficient resolution for target identification, we suggest mounting cameras directly on the blades to continuously view the entire rotor swept area with the fewest number of cameras. Bioacoustic microphones provide taxonomic identification, as well as information on ambient noise levels. They also assist in identifying environmental conditions such as hail storms, high winds, thunder, lightning, etc., that may contribute to a collision or a false positive detection. We demonstrated a proof of concept for an integrated sensor array to detect and identify bird and bat collisions with wind turbines. The next phase of research and development for this system will miniaturize and integrate sensors from all three nodes into a single wireless package that can be attached directly to the blade. This next generation system would use all “smart” sensors capable of onboard data processing to drastically reduce data streams and processing time on a central computer. A provisional patent for the blade mounted system was submitted by Oregon State University and recorded by the U.S. Patent and Trademark Office (application no. 62313028). Eventually, technology and industry advances will allow this low cost monitoring system to be designed into materials during manufacturing so that all turbines could be monitored with either a subset or full suite of sensors. As standard equipment on all commercial turbines, the sensor suite would allow the industry to effectively monitor whether individual turbines were causing mortalities or not and under what circumstances. It would also provide real-time evaluation of mechanical and structural integrity of a turbine via vibration, image, and acoustic data streams, thereby permitting modifications in operation to limit environmental or mechanical damage.

17 WIND ENERGY↗

Virtual Reality Used to Serve the Glenn Engineering Community

There are a variety of innovative new visualization tools available to scientists and engineers for the display and analysis of their models. At the NASA Glenn Research Center, we have an ImmersaDesk, a large, single-panel, semi-immersive display device. This versatile unit can interactively display three-dimensional images in visual stereo. Our challenge is to make this virtual reality platform accessible and useful to researchers. An example of a successful application of this computer technology is the display of blade out simulations. NASA Glenn structural dynamicists, Dr. Kelly Carney and Dr. Charles Lawrence, funded by the Ultra Safe Propulsion Project under Base R&T, are researching blade outs, when turbine engines lose a fan blade during operation. Key objectives of this research include minimizing danger to the aircraft via effective blade containment, predicting destructive loads due to the imbalance following a blade loss, and identifying safe, cost-effective designs and materials for future engines.

Carney, Dorothy V.↗

Real-time tracking using stereo and motion: Visual perception for space robotics

The state-of-the-art in computing technology is rapidly attaining the performance necessary to implement many early vision algorithms at real-time rates. This new capability is helping to accelerate progress in vision research by improving our ability to evaluate the performance of algorithms in dynamic environments. In particular, we are becoming much more aware of the relative stability of various visual measurements in the presence of camera motion and system noise. This new processing speed is also allowing us to raise our sights toward accomplishing much higher-level processing tasks, such as figure-ground separation and active object tracking, in real-time. This paper describes a methodology for using early visual measurements to accomplish higher-level tasks; it then presents an overview of the high-speed accelerators developed at Teleos to support early visual measurements. The final section describes the successful deployment of a real-time vision system to provide visual perception for the Extravehicular Activity Helper/Retriever robotic system in tests aboard NASA's KC135 reduced gravity aircraft.

Nishihara, H. Keith↗

Accuracy aspects of stereo side-looking radar

The geometry of the radar stereo model and factors affecting visual radar stereo perception are reviewed. Limits to the vertical exaggeration factor of stereo radar are defined. Radar stereo model accuracies are analyzed with respect to coordinate errors caused by errors of radar sensor position and of range, and with respect to errors of coordinate differences, i.e., cross-track distances and height differences.

Leberl, F. W.↗

Stereo and IMU-Assisted Visual Odometry for Small Robots

This software performs two functions: (1) taking stereo image pairs as input, it computes stereo disparity maps from them by cross-correlation to achieve 3D (three-dimensional) perception; (2) taking a sequence of stereo image pairs as input, it tracks features in the image sequence to estimate the motion of the cameras between successive image pairs. A real-time stereo vision system with IMU (inertial measurement unit)-assisted visual odometry was implemented on a single 750 MHz/520 MHz OMAP3530 SoC (system on chip) from TI (Texas Instruments). Frame rates of 46 fps (frames per second) were achieved at QVGA (Quarter Video Graphics Array i.e. 320 240), or 8 fps at VGA (Video Graphics Array 640 480) resolutions, while simultaneously tracking up to 200 features, taking full advantage of the OMAP3530's integer DSP (digital signal processor) and floating point ARM processors. This is a substantial advancement over previous work as the stereo implementation produces 146 Mde/s (millions of disparities evaluated per second) in 2.5W, yielding a stereo energy efficiency of 58.8 Mde/J, which is 3.75 better than prior DSP stereo while providing more functionality.

Source record↗

Demonstration of Stereo Vision for Deorbit Descent and Landing

Planetary landers need to reduce velocity at low altitude for soft landing. Traditionally, estimating velocity and altitude has been performed with radar sensors whose performance meets the specific mission needs. There are not very many options for these sensors and they are difficult to include in a flight system either due to obsolescence, prohibitive cost or difficulty in accommodation. Recently, alternative sensing modalities are being pursued including Doppler LiDAR and vision. This paper describes results from a recent helicopter field test of a binocular stereo vision system for deorbit descent and landing applications. The system consisted of two 18.6 ̊ field of view cameras mounted 1.7m apart. Post processing of the images showed ranging accuracy better than 1% up to 500mand 17 cm/s velocimetry accuracy at 37m. For a flight system these images could be input into an FPGA-based processor which processes dense stereo and visual odometry in less than 1 second to achieve the stereo ranging frame rates required for soft landing. When coupled with vision based Terrain Relative Navigation this stereo system enables landing accuracies on the order of 10m.

Sternberg, David C.↗

Demonstration of stereo vision for deorbit descent and landing

This paper describes results from a recent helicopter field test of a binocular stereo vision system for deorbit descent and landing applications. The system consisted of two 18.6˚ field of view cameras mounted 1.7m apart. Post processing of the images showed ranging accuracy better than 1% up to 500m and 17 cm/s velocimetry accuracy at 37m. For a flight system these images could be input into an FPGA-based processor which processes dense stereo and visual odometry in less than 1 second to achieve the stereo ranging frame rates required for soft landing. When coupled with vision based Terrain Relative Navigation this stereo system enables landing accuracies on the order of 10m.

Johnson, Andrew E.↗

Hand-Eye Calibration Using Active Vision

The project described in this paper designed and implemented a hand-eye calibration method for manipulators under observation by stereo cameras. This method has been utilized on Johnson Space Center's Robonaut, and on a planetary manipulator mock-up at the Jet Propulsion Laboratory. The intent of this calibration is to improve the manipulator's hand-eye coordination.

manipulation↗

Robot Vision Library

The JPL Robot Vision Library (JPLV) provides real-time robot vision algorithms for developers who are not vision specialists. The package includes algorithms for stereo ranging, visual odometry and unsurveyed camera calibration, and has unique support for very wideangle lenses

Howard, Andrew B.↗