Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual stereo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Quantitatively Monitoring Bubble-Flow at a Seep Site Offshore Oregon: Field Trials and Methodological Advances for Parallel Optical and Hydroacoustical Measurements

Two lander-based devices, the Bubble-Box and GasQuant-II, were used to investigate the spatial and temporal variability and total gas flow rates of a seep area offshore Oregon, United States. The Bubble-Box is a stereo camera–equipped lander that records bubbles inside a rising corridor with 80 Hz, allowing for automated image analyses of bubble size distributions and rising speeds. GasQuant is a hydroacoustic lander using a horizontally oriented multibeam swath to record the backscatter intensity of bubble streams passing the swath plain. The experimental set up at the Astoria Canyon site at a water depth of about 500 m aimed at calibrating the hydroacoustic GasQuant data with the visual Bubble-Box data for a spatial and temporal flow rate quantification of the site. For about 90 h in total, both systems were deployed simultaneously and pressure and temperature data were recorded using a CTD as well. Detailed image analyses show a Gaussian-like bubble size distribution of bubbles with a radius of 0.6–6 mm (mean 2.5 mm, std. dev. 0.25 mm); this is very similar to other measurements reported in the literature. Rising speeds ranged from 15 to 37 cm/s between 1- and 5-mm bubble sizes and are thus, in parts, slightly faster than reported elsewhere. Bubble sizes and calculated flow rates are rather constant over time at the two monitored bubble streams. Flow rates of these individual bubble streams are in the range of 544–1,278 mm 3 /s. One Bubble-Box data set was used to calibrate the acoustic backscatter response of the GasQuant data, enabling us to calculate a flow rate of the ensonified seep area (~1,700 m 2 ) that ranged from 4.98 to 8.33 L/min (5.38 × 10 6 to 9.01 × 10 6 CH 4 mol/year). Such flow rates are common for seep areas of similar size, and as such, this location is classified as a normally active seep area. For deriving these acoustically based flow rates, the detailed data pre-processing considered echogram gridding methods of the swath data and bubble responses at the respective water depth. The described method uses the inverse gas flow quantification approach and gives an in-depth example of the benefits of using acoustic and optical methods in tandem.

54 ENVIRONMENTAL SCIENCES↗

Visual observations from space

Visual observations from space reveal a number of fascinating natural phenomena of interest to meteorologists and aeronomists, such as aurorae, airglow, aerosol layers, lightning, and atmospheric refraction effects. Other man-made radiation, including city lights and laser beacons, are also of considerable interest. Of course, the most widely used space observations are of the large-scale weather systems viewed each day by millions of people on their local television. From lower altitudes than the geostationary meteorological satellite orbits, obliques and overlapping stereo views are possible, allow height information to be obtained directly, often a key element in the use of the photographs for research purposes. However, this note will discuss only the less common observations mentioned at the beginning of this paragraph.

Garriott, O. K.↗

Evaluation system and web infrastructure for the second cryo-EM model challenge

An evaluation system and a web infrastructure were developed for the second cryo-EM model challenge. The evaluation system includes tools to validate stereo-chemical plausibility of submitted models, check their fit to the corresponding density maps, estimate their overall and per-residue accuracy, and assess their similarity to reference cryo-EM or X-ray structures as well as other models submitted in this challenge. The web infrastructure provides a convenient interface for analyzing models at different levels of detail. As a result, it includes interactively sortable tables of evaluation scores for different subsets of models and different sublevels of structure organization, and a suite of visualization tools facilitating model analysis.

59 BASIC BIOLOGICAL SCIENCES↗

A helmet mounted display to adapt the telerobotic environment to human vision

A Helmet Mounted Display system has been developed. It provides the capability to display stereo images with the viewpoint tied to subjects' head orientation. The type of display might be useful in a telerobotic environment provided the correct operating parameters are known. The effects of update frequency were tested using a 3D tracking task. The effects of blur were tested using both tracking and pick-and-place tasks. For both, researchers found that operator performance can be degraded if the correct parameters are not used. Researchers are also using the display to explore the use of head movements as part of gaze as subjects search their visual field for target objects.

Tharp, Gregory↗

Creating a NASA-Wide Museum Alliance

NASA's Museum Alliance is a nationwide network of informal educators at museums, science centers, and planetariums that present NASA information to their local audiences. Begun in 2002 as the Mars Museum Visualization Alliance with advisors from a dozen museums, the network has grown to over 300 people from 200 organizations, including a dozen or so international partners. The network has become a community of practice among these informal educators who work with students, educators, and the general public on a daily basis, presenting information and fielding questions about space exploration. Communications are primarily through an active listserve, regular telecons, and a pass word protected website. Professional development is delivered via telecons and downloadable presentations. Current content offerings include Mars exploration, Cassini, Stardust, Genesis, Deep Impact, Earth observations, STEREO, and missions to explore beyond our solar system.

planetary sciences↗

Bioinspired engineering of exploration systems for NASA and DoD

A new approach called bioinspired engineering of exploration systems (BEES) and its value for solving pressing NASA and DoD needs are described. Insects (for example honeybees and dragonflies) cope remarkably well with their world, despite possessing a brain containing less than 0.01% as many neurons as the human brain. Although most insects have immobile eyes with fixed focus optics and lack stereo vision, they use a number of ingenious, computationally simple strategies for perceiving their world in three dimensions and navigating successfully within it. We are distilling selected insect-inspired strategies to obtain novel solutions for navigation, hazard avoidance, altitude hold, stable flight, terrain following, and gentle deployment of payload. Such functionality provides potential solutions for future autonomous robotic space and planetary explorers. A BEES approach to developing lightweight low-power autonomous flight systems should be useful for flight control of such biomorphic flyers for both NASA and DoD needs. Recent biological studies of mammalian retinas confirm that representations of multiple features of the visual world are systematically parsed and processed in parallel. Features are mapped to a stack of cellular strata within the retina. Each of these representations can be efficiently modeled in semiconductor cellular nonlinear network (CNN) chips. We describe recent breakthroughs in exploring the feasibility of the unique blending of insect strategies of navigation with mammalian visual search, pattern recognition, and image understanding into hybrid biomorphic flyers for future planetary and terrestrial applications. We describe a few future mission scenarios for Mars exploration, uniquely enabled by these newly developed biomorphic flyers.

Space Flight↗

MISR Instrument Data Visualization

The MISR Interactive eXplorer (MINX) software functions both as a general-purpose tool to visualize Multiangle Imaging SpectroRadiometer (MISR) instrument data, and as a specialized tool to analyze properties of smoke, dust, and volcanic plumes. It includes high-level options to create map views of MISR orbit locations; scrollable, single-camera RGB (red-greenblue) images of MISR level 1B2 (L1B2) radiance data; and animations of the nine MISR camera images that provide a 3D perspective of the scenes that MISR has acquired. NASA Tech Briefs, September 2008 55 The plume height capability provides an accurate estimate of the injection height of plumes that is needed by air quality and climate modelers. MISR provides global high-quality stereo height information, and this program uses that information to perform detailed height retrievals of aerosol plumes. Users can interactively digitize smoke, dust, or volcanic plumes and automatically retrieve heights and winds, and can also archive MISR albedos and aerosol properties, as well as fire power and brightness temperatures associated with smoke plumes derived from Moderate Resolution Imaging Spectroradiometer (MODIS) data. Some of the specialized options in MINX enable the user to do other tasks. Users can display plots of top-of-atmosphere bidirectional reflectance factors (BRFs) versus camera-angle for selected pixels. Images and animations can be saved to disk in various formats. Also, users can apply a geometric registration correction to warp camera images when the standard processing correction is inadequate. It is possible to difference the images of two MISR orbits that share a path (identical ground track), as well as to construct pseudo-color images by assigning different combinations of MISR channels (angle or spectral band) to the RGB display channels. This software is an interactive application written in IDL and compiled into an IDL Virtual Machine (VM) ".sav" file.

Nelson, David↗

FY19 Status of the Full Circumference Examination of the Inner Container Closure Weld Region for Selected 3013 DE Containers

One of the main focus areas of the 3013 Surveillance Program is a thorough evaluation of the inner container closure weld region (ICCWR) opened for destructive examination (DE). As part of the protocol to investigate the corrosion in the ICCWR a laser confocal microscope (LCM) is used to perform close visual examination of the surface and measurements of corrosion features on the surface. In FY17, DE containers from FY13 through FY16 were evaluated to select candidates for a full circumference analysis of the ICCWR. In FY18, the selected DE containers for full circumference evaluation (FCE) were processed according to the ICCWR protocol and LCM data collection was completed for the full circumference only for FY15 DE07. In FY19 the remaining DE containers were completed. The ICCWR protocol was completed as follows: (1) the FCE containers were sectioned into quarters and the weld removed to access the ICCWR; (2) a series of images of the ICCWR full circumference were taken using a stereo microscope and assembled into panoramic views; (3) SEM/EDS analysis performed on selected sections showed what is most likely corrosion products on the surface and chlorides randomly dispersed; (4) the presence of chlorides was also confirmed with ion chromatography of citric acid washes, in which FY15 DE07 and FY16 DE05 showed a significant amount of chlorides with FY15 DE08 showing the less amount of chlorides; (5) dye penetrant examination was performed on the interior and exterior surfaces of all the sidewall sections but reveled no relevant indication of surface-breaking defects, (6) finally, as described above, the full circumference examination of the ICCWR by LCM was completed. The three ICCWRs show general and localized corrosion on the surface. However, FY15 DE08 show more areas with agglomerated pits in Zones 2 and 3 than the other two DEs. The major suspect corrosion events were observed for FY15 DE07 on Sections C1 and C2 and for FY15 DE08 on Section C2. These events correspond to suspect cracks or crack-like features identified with a unique name to easily refer to each feature. FY15 DE07 shows a crack-like feature, identified as Acrux, in Section C1 and three features in Section C2 identified as Bellatrix, Cursa Minor and Cursa Major. Acrux and Bellatrix are located at the boundary of Zone 2 and Zone 3. Cursa Minor and Cursa Major are in Zone 2. FY15 DE08 shows two crack-like features, identified as Denebola and Draco, in Section C2. Both features are located at the boundary of Zone 2 and Zone 3. However, gas analysis and statistical evaluation of the gas compositions and pressures via GEST analyses suggest that leakage between the OI and IC volumes was unlikely. Additional characterization and analysis will be performed on the locations where the cracks were found.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of visual 3D virtual environment for control software

Virtual environments for software visualization may enable complex programs to be created and maintained. A typical application might be for control of regional electric power systems. As these encompass broader computer networks than ever, construction of such systems becomes very difficult. Conventional text-oriented environments are useful in programming individual processors. However, they are obviously insufficient to program a large and complicated system, that includes large numbers of computers connected to each other; such programming is called 'programming in the large.' As a solution for this problem, the authors are developing a graphic programming environment wherein one can visualize complicated software in virtual 3D world. One of the major features of the environment is the 3D representation of concurrent process. 3D representation is used to supply both network-wide interprocess programming capability (capability for 'programming in the large') and real-time programming capability. The authors' idea is to fuse both the block diagram (which is useful to check relationship among large number of processes or processors) and the time chart (which is useful to check precise timing for synchronization) into a single 3D space. The 3D representation gives us a capability for direct and intuitive planning or understanding of complicated relationship among many concurrent processes. To realize the 3D representation, a technology to enable easy handling of virtual 3D object is a definite necessity. Using a stereo display system and a gesture input device (VPL DataGlove), our prototype of the virtual workstation has been implemented. The workstation can supply the 'sensation' of the virtual 3D space to a programmer. Software for the 3D programming environment is implemented on the workstation. According to preliminary assessments, a 50 percent reduction of programming effort is achieved by using the virtual 3D environment. The authors expect that the 3D environment has considerable potential in the field of software engineering.

Hirose, Michitaka↗

TEAMER - Field Demonstration of MarineSitu’s Marine Energy Monitoring Tools - CRADA 664 (Abstract)

In order to effectively monitor for marine life around marine energy devices and thus minimize the risk of collision, multiple sensors working in coordination and augmented with around-the-clock automated monitoring algorithms need to be installed in challenging high-energy tidal and wave environments. Such systems are often too expensive for widespread adoption, or lack sufficient sensors or smarts to enable around-the-clock, real-time monitoring without human involvement. MarineSitu has been working to tackle this problem by developing a low-cost, combined sonar and stereo camera sensor array with connected real-time AI-based algorithms for automatically detecting marine life in these marine energy suitable environments. In this TEAMER project with Pacific Northwest National Lab (PNNL), MarineSitu will be testing this novel sensor system for the first time in the high-energy tidal channel environment at PNNL’s Marine and Coastal Research Lab. Throughout this deployment, MarineSitu will be monitoring their system and running analytics on the sensor’s data in real-time. Meanwhile, PNNL Data Scientists and Ocean Engineers, will be evaluating the system’s effectiveness and ease of use both as a tool for plug-and-play environmental monitoring and novel environmental monitoring research. In doing so, the team will improve MarineSitu’s system and software, produce insightful data products, and develop novel visualizations and AI algorithms for combining and analyzing the data produced by systems like MarineSitu’s.

16 TIDAL AND WAVE POWER↗

TEAMER – Field Demonstration of MarineSitu’s Marine Energy Monitoring (Abstract)

In order to effectively monitor for marine life around marine energy devices and thus minimize the risk of collision, multiple sensors working in coordination and augmented with around-the-clock automated monitoring algorithms need to be installed in challenging high-energy tidal and wave environments. Such systems are often too expensive for widespread adoption, or lack sufficient sensors or smarts to enable around-the-clock, real-time monitoring without human involvement. MarineSitu has been working to tackle this problem by developing a low-cost, combined sonar and stereo camera sensor array with connected real-time AI-based algorithms for automatically detecting marine life in these marine energy suitable environments. In this TEAMER project with Pacific Northwest National Lab (PNNL), MarineSitu will be testing this novel sensor system for the first time in the high-energy tidal channel environment at PNNL’s Marine and Coastal Research Lab. Throughout this deployment, MarineSitu will be monitoring their system and running analytics on the sensor’s data in real-time. Meanwhile, PNNL Data Scientists and Ocean Engineers, will be evaluating the system’s effectiveness and ease of use both as a tool for plug-and-play environmental monitoring and novel environmental monitoring research. In doing so, the team will improve MarineSitu’s system and software, produce insightful data products, and develop novel visualizations and AI algorithms for combining and analyzing the data produced by systems like MarineSitu’s.

16 TIDAL AND WAVE POWER↗

Hand-Eye Calibration of Robonaut

NASA's Human Space Flight program depends heavily on Extra-Vehicular Activities (EVA's) performed by human astronauts. EVA is a high risk environment that requires extensive training and ground support. In collaboration with the Defense Advanced Research Projects Agency (DARPA), NASA is conducting a ground development project to produce a robotic astronaut's assistant, called Robonaut, that could help reduce human EVA time and workload. The project described in this paper designed and implemented a hand-eye calibration scheme for Robonaut, Unit A. The intent of this calibration scheme is to improve hand-eye coordination of the robot. The basic approach is to use kinematic and stereo vision measurements, namely the joint angles self-reported by the right arm and 3-D positions of a calibration fixture as measured by vision, to estimate the transformation from Robonaut's base coordinate system to its hand coordinate system and to its vision coordinate system. Two methods of gathering data sets have been developed, along with software to support each. In the first, the system observes the robotic arm and neck angles as the robot is operated under external control, and measures the 3-D position of a calibration fixture using Robonaut's stereo cameras, and logs these data. In the second, the system drives the arm and neck through a set of pre-recorded configurations, and data are again logged. Two variants of the calibration scheme have been developed. The full calibration scheme is a batch procedure that estimates all relevant kinematic parameters of the arm and neck of the robot The daily calibration scheme estimates only joint offsets for each rotational joint on the arm and neck, which are assumed to change from day to day. The schemes have been designed to be automatic and easy to use so that the robot can be fully recalibrated when needed such as after repair, upgrade, etc, and can be partially recalibrated after each power cycle. The scheme has been implemented on Robonaut Unit A and has been shown to reduce mismatch between kinematically derived positions and visually derived positions from a mean of 13.75cm using the previous calibration to means of 1.85cm using a full calibration and 2.02cm using a suboptimal but faster daily calibration. This improved calibration has already enabled the robot to more accurately reach for and grasp objects that it sees within its workspace. The system has been used to support an autonomous wrench-grasping experiment and significantly improved the workspace positioning of the hand based on visually derived wrench position. estimates.

Nickels, Kevin↗

Celestial Mapping System

Celestial Mapping System (CMS) is a desktop application that provides a toolkit of features for visualization and analysis of celestial bodies, beginning with a 3D lunar globe. Although there are lunar mapping products publicly available, they use old data from lunar missions, have no native desktop version, and they are mostly 2D. CMS addresses this by providing high-resolution datasets from recent lunar missions, accurate elevation data to display and read 3D terrain, and is built on top of World Wind Java library which provides a rich set of functionality and the ability to easily expand to other celestial bodies. CMS is also looking at implementing features to support situational awareness, path optimization and resource assessment, which will be of use in upcoming missions to the lunar surface. CMS utilizes geospatial tools such as QGIS and GDAL to test and modify planetary data. Other features include the ability to enable specific place names, a measurement toolbox, terrain profiler, the ability to view the moon in stereo, navigation capabilities, and an interactive visit to the Apollo landing sites which showcase 3D objects of the astronauts and lunar landers. In the world of planetary mapping, CMS aims to significantly improve upon existing functionalities, and bring new tools, that will be useful to the planetary science community and mission planners.

Kaitlyn Dickinson↗

Real-time detection of moving objects from moving vehicles using dense stereo and optical flow

Dynamic scene perception is very important for autonomous vehicles operating around other moving vehicles and humans. Most work on real-time object tracking from moving platforms has used sparse features or assumed flat scene structures. We have recently extended a real-time, dense stereo system to include realtime, dense optical flow, enabling more comprehensive dynamic scene analysis. We describe algorithms to robustly estimate 6-DOF robot egomotion in the presence of moving objects using dense flow and dense stereo. We then use dense stereo and egomotion estimates to identify & other moving objects while the robot itself is moving. We present results showing accurate egomotion estimation and detection of moving people and vehicles under general 6-DOF motion of the robot and independently moving objects. The system runs at 18.3 Hz on a 1.4 GHz Pentium M laptop, computing 160x120 disparity maps and optical flow fields, egomotion, and moving object segmentation. We believe this is a significant step toward general unconstrained dynamic scene analysis for mobile robots, as well as for improved position estimation where GPS is unavailable.

egomotion↗

A strongly goal-directed close-range vision system for spacecraft docking

In this presentation, we will propose a strongly goal-oriented stereo vision system to establish proper docking approach motions for automated rendezvous and capture (AR&C). From an input sequence of stereo video image pairs, the system produces a current best estimate of: contact position; contact vector; contact velocity; and contact orientation. The processing demands imposed by this particular problem and its environment dictate a special case solution; such a system should necessarily be, in some sense, minimalist. By this we mean the system should construct a scene description just sufficiently rich to solve the problem at hand and should do no more processing than is absolutely necessary. In addition, the imaging resolution should be just sufficient. Extracting additional information and constructing higher level scene representations wastes energy and computational resources and injects an unnecessary degree of complexity, increasing the likelihood of malfunction. We therefore take a departure from most prior stereopsis work, including our own, and propose a system based on associative memory. The purpose of the memory is to immediately associate a set of motor commands with a set of input visual patterns in the two cameras. That is, rather than explicitly computing point correspondences and object positions in world coordinates and trying to reason forward from this information to a plan of action, we are trying to capture the essence of reflex behavior through the action of associative memory. The explicit construction of point correspondences and 3D scene descriptions, followed by online velocity and point of impact calculations, is prohibitively expensive from a computational point of view for the problem at hand. Learned patterns on the four image planes, left and right at two discrete but closely spaced instants in time, will be bused directly to infer the spacecraft reaction. This will be a continuing online process as the docking collar approaches.

Boyer, Kim L.↗

Real-time detection of moving objects from moving vehicles using dense stereo and optical flow

Dynamic scene perception is very important for autonomous vehicles operating around other moving vehicles and humans. Most work on real-time object tracking from moving platforms has used sparse features or assumed flat scene structures. We have recently extended a real-time, dense stereo system to include real-time, dense optical flow, enabling more comprehensive dynamic scene analysis. We describe algorithms to robustly estimate 6-DOF robot egomotion in the presence of moving objects using dense flow and dense stereo. We then use dense stereo and egomotion estimates to identity other moving objects while the robot itself is moving. We present results showing accurate egomotion estimation and detection of moving people and vehicles under general 6-DOF motion of the robot and independently moving objects. The system runs at 18.3 Hz on a 1.4 GHz Pentium M laptop, computing 160x120 disparity maps and optical flow fields, egomotion, and moving object segmentation. We believe this is a significant step toward general unconstrained dynamic scene analysis for mobile robots, as well as for improved position estimation where GPS is unavailable.

egomotion↗

R and DE Robotic Sensor Intern Team: Remote 3D Mapping Sensor Suite

The primary goal of the sensor suite is to provide an internal 3D map of the HCAEX tunnel. When looking for a sensor that would provide XYZ point cloud data for mapping the decision was between a stereo camera, a 3D Lidar, or a 2D Lidar that would need to be spun around. The issues with the stereo camera were that it does not have a large field-of-view and that its depth information was not nearly as accurate as even the baseline Lidars. The selection between Lidars is detailed. The Hokuyo UTM-30LX-EW shown provides a 270 deg. FOV with high accuracy and resolution while the largest FOV on a 3D Lidar is 40 deg.. This was the reason a 2D Lidar was chosen over the 3D Lidar. Even though the 2D Lidar requires additional components and software to generate a 3D map, its FOV advantage is too great given that the HCAEX tunnel is a relatively confined space. The rotating planar scan from the 2D Lidar can be stitched into a 3D scan as shown in the graphic below. Along with XYZ data, the Lidar provides return intensity data in color which can be used to distinguish between different materials within the tunnel. To provide visual feedback a camera system needed to be identified. The common solution for this is a high resolution camera with a small FOV mounted on a pan-tilt system. But, given the critical nature of the visual feedback we looked into solutions without the need for moving parts. Two panospheric cameras give a FOV large enough to get a full 360 deg. view.. Camera color data (RGB) can also be combined with the 3D mapping data from the Lidar and overlaid on the map to give the user the ability to see inside the entire length of the tunnel as if they were inside. Situational awareness is required for the crawler in the tunnel in order for it to be able to register the 3D scans to create a final map. For this we procured a Microstrain 3DM-GX5-25 Inertial Measurement Unit (IMU). To perform the Lidar rotation we have two servos driving the pan and tilt. The servo controls and most data processing will be performed via an onboard computer. The sensor components are to be packaged together using 3D printed mounts into a standalone unit.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Real-time Detection of Moving Objects from Moving Vehicles Using Dense Stereo and Optical Flow

Dynamic scene perception is very important for autonomous vehicles operating around other moving vehicles and humans. Most work on real-time object tracking from moving platforms has used sparse features or assumed flat scene structures. We have recently extended a real-time. dense stereo system to include realtime. dense optical flow, enabling more comprehensive dynamic scene analysis. We describe algorithms to robustly estimate 6-DOF robot egomotion in the presence of moving objects using dense flow and dense stereo. We then use dense stereo and egomotion estimates to identify other moving objects while the robot itself is moving. We present results showing accurate egomotion estimation and detection of moving people and vehicles under general 6DOF motion of the robot and independently moving objects. The system runs at 18.3 Hz on a 1.4 GHz Pentium M laptop. computing 160x120 disparity maps and optical flow fields, egomotion, and moving object segmentation. We believe this is a significant step toward general unconstrained dynamic scene analysis for mobile robots, as well as for improved position estimation where GPS is unavailable.

moving object detection↗