Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual stereo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

AUTOMATIC DETECTION AND TRACKING OF CORONAL MASS EJECTIONS. II. MULTISCALE FILTERING OF CORONAGRAPH IMAGES

Studying coronal mass ejections (CMEs) in coronagraph data can be challenging due to their diffuse structure and transient nature, and user-specific biases may be introduced through visual inspection of the images. The large amount of data available from the Solar and Heliospheric Observatory (SOHO), Solar TErrestrial RElations Observatory (STEREO), and future coronagraph missions also makes manual cataloging of CMEs tedious, and so a robust method of detection and analysis is required. This has led to the development of automated CME detection and cataloging packages such as CACTus, SEEDS, and ARTEMIS. Here, we present the development of a new CORIMP (coronal image processing) CME detection and tracking technique that overcomes many of the drawbacks of current catalogs. It works by first employing the dynamic CME separation technique outlined in a companion paper, and then characterizing CME structure via a multiscale edge-detection algorithm. The detections are chained through time to determine the CME kinematics and morphological changes as it propagates across the plane of sky. The effectiveness of the method is demonstrated by its application to a selection of SOHO/LASCO and STEREO/SECCHI images, as well as to synthetic coronagraph images created from a model corona with a variety of CMEs. The algorithms described in this article are being applied to the whole LASCO and SECCHI data sets, and a catalog of results will soon be available to the public.

79 ASTRONOMY AND ASTROPHYSICS↗

Earth orbital teleoperator visual system evaluation program

Visual system parameters and stereoptic television component geometries were evaluated for optimum viewing. The accuracy of operator range estimation using a Fresnell stereo television system with a three dimensional cursor was examined. An operator's ability to align three dimensional targets using vidicon tube and solid state television cameras as part of a Fresnell stereoptic system was evaluated. An operator's ability to discriminate between varied color samples viewed with a color television system was determined.

Frederick, P. N.↗

Pseudo-automatic Determination of Coronal Mass Ejections’ Kinematics in 3D

Coronal mass ejection (CME) events are among the main drivers of geomagnetic disturbances, and hence play a central role in the Sun–Earth system. Their monitoring and, in particular, the determination of their speed and direction of propagation are key issues for the forecasting of space weather near to Earth. We have implemented a method to track CME events in three dimensions by combining triangulation and tie-pointing analysis with a supervised computer vision algorithm. This novel approach does not rely on any geometric constraint, and eliminates the need for visual identification of the CME boundaries. We applied our method to 17 CME events observed simultaneously by the twin Solar Terrestrial Relations Observatory ( STEREO ) COR2 coronagraph imagers from 2008 December to 2011 November in order to obtain their 3D kinematical characterization (i.e., the velocity vector) along with their morphological properties. About ten of these events have already been analyzed using other methodologies. In these cases, we carried out a thorough comparison with our results and found that, in spite of the different nature and spatial coverage range of the other methods with respect to CORSET3D, the majority of the results agree. We found, however, that three events exhibited discrepancies in the magnitude of the velocity vector, four in the longitudinal direction of propagation, and in only one case was there a discrepancy in latitude. The discrepancies appeared in those cases where quasi-simultaneous, quasi-co-located events were observed in the coronagraphs’ fields of view.

79 ASTRONOMY AND ASTROPHYSICS↗

SU-E-J-128: 3D Surface Reconstruction of a Patient Using Epipolar Geometry

Purpose: To obtain a 3D surface data of a patient in a non-invasive way can substantially reduce the effort for the registration of patient in radiation therapy. To achieve this goal, we introduced the multiple view stereo technique, which is known to be used in a 'photo tourism' on the internet. Methods: 70 Images were taken with a digital single-lens reflex camera from different angles and positions. The camera positions and angles were inferred later in the reconstruction step. A sparse 3D reconstruction model was locating by SIFT features, which is robust for rotation and shift variance, in each image. We then found a set of correspondences between pairs of images by computing the fundamental matrix using the eight-point algorithm with RANSAC. After the pair matching, we optimized the parameter including camera positions to minimize the reprojection error by use of bundle adjustment technique (non-linear optimization). As a final step, we performed dense reconstruction and associate a color with each point using the library of PMVS. Results: Surface data were reconstructed well by visual inspection. The human skin is reconstructed well, althogh the reconstruction was time-consuming for direct use in daily clinical practice. Conclusion: 3D reconstruction using multi view stereo geometry is a promising tool for reducing the effort of patient setup. This work was supported by JSPS KAKENHI(25861128)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Dense 3D-Reconstruction from Monocular Image Sequences for Computationally Constrained UAS

The ability to find safe landing sites over complex 3D terrain is an essential safety feature for fully autonomous small unmanned aerial systems (UAS), which requires on-board perception for 3D reconstruction and terrain analysis if the overflown terrain is unknown. This is a challenge for UAS that are limited in size, weight and computational power, such as small rotorcrafts executing autonomous missions on Earth, or in planetary applications such as the Mars Helicopter. For such a computationally constraint system, we propose a structure from motion approach that uses inputs from a single downward facing camera to produce dense point clouds of the overflown terrain in real time. In contrast to existing approaches, our method uses metric pose information from a visual-inertial odometry algorithm as camera pose priors, which allows deploying a fast pose refinement step to align camera frames such that a conventional stereo algorithm can be used for dense 3D reconstruction. We validate the performance of our approach with extensive evaluations in simulation, and demonstrate the feasibility with data from UAS flights.

Brockers, Roland↗

Experimenter's Laboratory for Visualized Interactive Science

ELVIS (Experimenter's Laboratory for Visualized Interactive Science) is an interactive visualization environment that enables scientists, students, and educators to visualize and analyze large, complex, and diverse sets of scientific data. It accomplishes this by presenting the data sets as 2-D, 3-D, color, stereo, and graphic images with movable and multiple light sources combined with displays of solid-surface, contours, wire-frame, and transparency. By simultaneously rendering diverse data sets acquired from multiple sources, formats, and resolutions and by interacting with the data through an intuitive, direct-manipulation interface, ELVIS provides an interactive and responsive environment for exploratory data analysis.

Hansen, Elaine R.↗

Johns Hopkins University Stereoscopic Particle Image Velocimetry (SPIV) Test Results

Professor J. Katz at the Johns Hopkins University conducted an experimental investigation of the effect of varying the clearance over the tip of a compressor rotor in an embedded stage through a NASA funded award. The activity provided very detailed stereo Particle Image Velocimetry (PIV) measurements of the tip flow field in their optically index-matched facility. The researchers were able to measure and visualize the unsteady velocity and pressure field in the tip gap area for the first time from which they have published more than 10 Journal papers. The dataset has been used widely within NASA for internal program development. The compressor geometry is part of the NASA Low-Speed Axial Compressor (LSAC) compressor stage geometry which is publicly available. All the casing treatment geometries were published by the researchers at JHU. The PIV data has also been published in several ASME papers and presented at recent TurboExpo Conferences. Many research groups at universities and US industry would like access to this data; therefore, we would like to prepare the data package and release it to public. The data package will be announced on data.nasa.gov.

Compressor↗

Stereo-Video Data Reduction of Wake Vortices and Trailing Aircrafts

This report presents stereo image theory and the corresponding image processing software developed to analyze stereo imaging data acquired for the wake-vortex hazard flight experiment conducted at NASA Langley Research Center. In this experiment, a leading Lockheed C-130 was equipped with wing-tip smokers to visualize its wing vortices, while a trailing Boeing 737 flew into the wake vortices of the leading airplane. A Rockwell OV-10A airplane, fitted with video cameras under its wings, flew at 400 to 1000 feet above and parallel to the wakes, and photographed the wake interception process for the purpose of determining the three-dimensional location of the trailing aircraft relative to the wake. The report establishes the image-processing tools developed to analyze the video flight-test data, identifies sources of potential inaccuracies, and assesses the quality of the resultant set of stereo data reduction.

Alter-Gartenberg, Rachel↗

Project Report: Reducing Color Rivalry in Imagery for Conjugated Multiple Bandpass Filter Based Stereo Endoscopy

A pair of conjugated multiple bandpass filters (CMBF) can be used to create spatially separated pupils in a traditional lens and imaging sensor system allowing for the passive capture of stereo video. This method is especially useful for surgical endoscopy where smaller cameras are needed to provide ample room for manipulating tools while also granting improved visualizations of scene depth. The significant issue in this process is that, due to the complimentary nature of the filters, the colors seen through each filter do not match each other, and also differ from colors as seen under a white illumination source. A color correction model was implemented that included optimized filter selection, such that the degree of necessary post-processing correction was minimized, and a chromatic adaptation transformation that attempted to fix the imaged colors tristimulus indices based on the principle of color constancy. Due to fabrication constraints, only dual bandpass filters were feasible. The theoretical average color error after correction between these filters was still above the fusion limit meaning that rivalry conditions are possible during viewing. This error can be minimized further by designing the filters for a subset of colors corresponding to specific working environments.

conjugated multiple bandpass filters (CMBF)↗

Stereo Imaging Tactical Helper

The Stereo Imaging Tactical Helper (SITH) program displays left and right images in stereo using the display technology made available by the JADIS framework. An overlay of the surface described by the disparity map (generated from the left and right images) allows the map to be compared to the actual images. In addition, an interactive cursor, whose visual depth is controlled by the disparity map, is used to ensure the correlated surface matches the real surface. This enhances the ability of operations personnel to provide quality control for correlation results, as well as to greatly assist developers working on correlation improvements. While its primary purpose is as a quality control tool for inspecting correlation results, SITH is also straightforward for use as a basic stereo image viewer

Toole, Nicholas T.↗

COMPOSITION STRUCTURE OF INTERPLANETARY CORONAL MASS EJECTIONS FROM MULTISPACECRAFT OBSERVATIONS, MODELING, AND COMPARISON WITH NUMERICAL SIMULATIONS

We present an analysis of the ionic composition of iron for two interplanetary coronal mass ejections (ICMEs) observed on 2007 May 21-23 by the ACE and STEREO spacecraft in the context of the magnetic structure of the ejecta flux rope, sheath region, and surrounding solar wind flow. This analysis is made possible due to recent advances in multispacecraft data interpolation, reconstruction, and visualization as well as results from recent modeling of ionic charge states in MHD simulations of magnetic breakout and flux cancellation coronal mass ejection (CME) initiation. We use these advances to interpret specific features of the ICME plasma composition resulting from the magnetic topology and evolution of the CME. We find that, in both the data and our MHD simulations, the flux ropes centers are relatively cool, while charge state enhancements surround and trail the flux ropes. The magnetic orientations of the ICMEs are suggestive of magnetic breakout-like reconnection during the eruption process, which could explain the spatial location of the observed iron enhancements just outside the traditional flux rope magnetic signatures and between the two ICMEs. Detailed comparisons between the simulations and data were more complicated, but a sharp increase in high iron charge states in the ACE and STEREO-A data during the second flux rope corresponds well to similar features in the flux cancellation results. We discuss the prospects of this integrated in situ data analysis and modeling approach to advancing our understanding of the unified CME-to-ICME evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

Positional estimation techniques for an autonomous mobile robot

Techniques for positional estimation of a mobile robot navigation in an indoor environment are described. A comprehensive review of the various positional estimation techniques studied in the literature is first presented. The techniques are divided into four different types and each of them is discussed briefly. Two different kinds of environments are considered for positional estimation; mountainous natural terrain and an urban, man-made environment with polyhedral buildings. In both cases, the robot is assumed to be equipped with single visual camera that can be panned and tilted and also a 3-D description (world model) of the environment is given. Such a description could be obtained from a stereo pair of aerial images or from the architectural plans of the buildings. Techniques for positional estimation using the camera input and the world model are presented.

Nandhakumar, N.↗

Current and future use of TOPSAR digital topographic data for volcanological research

In several investigations of volcanoes, high quality digital elevation models (DEM's) are required to study either the geometry of the volcano or to investigate temporal changes in relief due to eruptions. Examples include the analysis of volume changes of a volcanic dome, the prediction of flow paths for pyroclastic flows, and the quantitative investigation of the geometry of valleys carved by volcanic mudflows. Additionally, to provide input data for models of lava flow emplacement, accurate measurements are needed of the thickness of lava flows as a function of distance from the vent and local slope. Visualization of volcano morphology is also aided by the ability to view a DEM from oblique perspectives. Until recently, the generation of these DEM's has required either high resolution stereo air photographs or extensive field surveying using the Global Positioning System (GPS) and other field techniques. Through the use of data collected by the NASA/JPL TOPSAR system, it is now possible to remotely measure the topography of volcanoes using airborne radar interferometry. TOPSAR data can be collected day or night under any weather conditions, thereby avoiding the problems associated with the derivation of DEM's from air photographs that may often contain clouds. Here we describe some of our initial work on volcanoes using TOPSAR data for Mt. Hekla (Iceland) and Vesuvius (Italy). We also outline various TOPSAR topographic studies of volcanoes in the Galapagos and Hawaii that will be conducted in the near future, describe how TOPSAR complements the volcanology investigations to be conducted with orbital radars (SIR-C/X-SAR, JERS-1 and ERS-1), and place these studies into the broader context of NASA's Global Change Program.

Mouginis-Mark, Peter J.↗

Solar System Visualizations

Solar System Visualization products enable scientists to compare models and measurements in new ways that enhance the scientific discovery process, enhance the information content and understanding of the science results for both science colleagues and the public, and create.visually appealing and intellectually stimulating visualization products. Missions supported include MER, MRO, and Cassini. Image products produced include pan and zoom animations of large mosaics to reveal the details of surface features and topography, animations into registered multi-resolution mosaics to provide context for microscopic images, 3D anaglyphs from left and right stereo pairs, and screen captures from video footage. Specific products include a three-part context animation of the Cassini Enceladus encounter highlighting images from 350 to 4 meter per pixel resolution; Mars Reconnaissance Orbiter screen captures illustrating various instruments during assembly and testing at the Payload Hazardous Servicing Facility at Kennedy Space Center; and an animation of Mars Exploration Rover Opportunity's 'Rub al Khali' panorama where the rover was stuck in the deep fine sand for more than a month. This task creates new visualization products that enable new science results and enhance the public's understanding of the Solar System and NASA's missions of exploration.

Brown, Alison M.↗

The New Realm of 3-D Vision

Dimension Technologies Inc., developed a line of 2-D/3-D Liquid Crystal Display (LCD) screens, including a 15-inch model priced at consumer levels. DTI's family of flat panel LCD displays, called the Virtual Window(TM), provide real-time 3-D images without the use of glasses, head trackers, helmets, or other viewing aids. Most of the company initial 3-D display research was funded through NASA's Small Business Innovation Research (SBIR) program. The images on DTI's displays appear to leap off the screen and hang in space. The display accepts input from computers or stereo video sources, and can be switched from 3-D to full-resolution 2-D viewing with the push of a button. The Virtual Window displays have applications in data visualization, medicine, architecture, business, real estate, entertainment, and other research, design, military, and consumer applications. Displays are currently used for computer games, protein analysis, and surgical imaging. The technology greatly benefits the medical field, as surgical simulators are helping to increase the skills of surgical residents. Virtual Window(TM) is a trademark of Dimension Technologies Inc.

Source record↗

Machine Vision for Autonomous Small Body Navigation

This paper describes machine vision algorithms that enable precision guidance and hazard avoidance during small body exploration through onboard visual feature tracking and landmark recognition.

Estimation Landmark Recognition↗

Autonomous Ocean World Exploration: Advancement of a Virtual Testbed

The search for life (extinct or extant) and potentially habitable bodies in our solar system and beyond is one of the 12 priority science questions outlined in the National Acadamies’ 2022 decadal survey [5]. Extraterrestrial destinations containing liquid water present an opportunity to search for life as we know it, and in recent years an increasing number of such locations have been discovered within our solar system. Several Jovian moons—Europa, Ganymede, and Callisto [10]—and the Saturnian moons Enceladus [8] and Titan [9] are known or suspected to harbor massive subsurface oceans. Of these "ocean worlds", Europa is the focus of at least one planned NASA orbiter mission, Europa Clipper [4], and an early lander mission concept, the Europa Lander [2, 3]. Whereas most robotic missions to the Moon and Mars (e.g. orbiters, rovers, landers) to date have had ground controllers on Earth tightly involved in mission operations, missions to more distant worlds will require a high degree of onboard autonomy due to long communication lags and blackouts, harsh environments (radiation, cold), and more limited battery and hardware life. The past decade has seen great advances in both AI technologies and computing scalability and performance that offer promising solutions for spacecraft autonomy and motivate the software system and research programs described in this paper. The Ocean Worlds Autonomy Testbed for Exploration, Research, and Simulation (OceanWATERS) [1], which has been in development at the NASA Ames Research Center since 2018, is a virtual environment for testing lander autonomy solutions. It is built on the Robot Operating System (ROS), runs on consumer-grade Linux workstations, and was released as open source in 2020. OceanWATERS provides a physical and visual simulation of a prototypical lander in a Europa-like environment (Figure 1). The lander was modeled after requirements and specifications made in JPL’s Europa Lander Study of 2016 [3]. Simulated lander systems include stereo cameras and spotlights mounted on an antenna mast that pans and tilts, a 6 degrees of freedom (DoF) robotic arm with a force-torque sensor and two interchangeable end effectors, and a battery pack power system. The environment consists of multiple terrain models including a highly detailed model sourced from the FROST dataset [11], simulation of surrounding planetary bodies based on an ephemeris model, and lighting from the sun with associated surface illumination, reflectance, and shadows. Operations supported by OceanWATERS include panoramic and directed imaging of the environment and lander workspace, Cartesian and joint-level arm commanding, grinding of the terrain surface (e.g. digging a trench), and scooping of ground material (Figure 2) which can be discarded or collected as science samples in a receptacle that can be emptied (science operations themselves are not simulated). These operations are realized as ROS Actions and are complimented by a wide selection of telemetry that is continually produced by each lander subsystem. The power system model is driven by the open-source Generic Software Architecture for Prognostics (GSAP) [11] that predicts the battery’s remaining useful life and other characteristics. As a testbed for high-level autonomy, OceanWATERS provides an execution framework based on PLEXIL [12], an open-source plan specification language and execution engine developed largely at Ames. NASA's initial development of OceanWATERS, as well the Ocean Worlds Lander Autonomy Testbed (OWLAT) [6], a complimentary physical testbed developed at JPL, was the first step in a plan for realizing candidate onboard autonomy solutions for such planetary landers. In 2020 NASA solicited applications for its Autonomous Robotics Research for Ocean Worlds (ARROW) program, and in 2021 the similar Concepts for Ocean worlds Life Detection Technology (COLDTech) program. Collectively six research teams, based in universities and companies across the United States, were awarded grants to develop and demonstrate autonomy solutions on OceanWATERS and OWLAT. These 1–2-year projects have now finished or are nearing completion, and a wide variety of autonomy challenges in ocean world surface missions were addressed. Prototyped and demonstrated solutions have included autonomous discovery, response and adaptation to system faults and unexpected environmental events, world model synthesis through perception, plan synthesis using learned models, methods to optimize sample target selection and prioritize science data transmission, extension of PLEXIL for stochastic decision-making, and an integration of a model of JPL’s mission-ready COLDArm [7]. Technologies used in these projects include many forms of machine learning, causal reasoning, automated planning, Markov decision processes, formal methods, and other advanced techniques. A more detailed summary of the ARROW and COLDTech projects is given herein. OceanWATERS has had significant enhancements since its open-source release in 2020. Many of its new features were driven or shaped by feedback from the ARROW and COLDTech teams and requirements of their projects. In support of enabling autonomous adaptation to spacecraft faults (a specific capability solicited by both programs), a fault injection and detection framework was developed that supports a wide and growing range of fault types such as locked joints, image loss, and battery failures. The power system model was completed and integrated into the simulator, starting as a single-cell battery model and later upgraded to a multi-cell model with associated faults such as cell disconnection. Arm/terrain interaction was improved by adding a force-torque sensor and associated faults, and an analytic dig force model based on the Balovnev bucket force equations. Environment fidelity was increased by modeling terrain deformation resulting from digging and scooping; visual improvements were made in textures, lighting, and shadows. To facilitate interoperation with OWLAT, a unified command and telemetry interface between the testbeds was developed at the ROS level, along with a PLEXIL interface. The number of lander operations was greatly expanded (e.g. with Cartesian-based arm and antenna movement), and a framework was designed for users to build their own lander actions. A GUI for PLEXIL plan selection was created (Figure 3), and an expansive set of plans were added, such as those that illustrate patterns for fault handling. This paper provides a self-contained high-level description of OceanWATERS, focusing on more detailed coverage of the aforementioned enhancements. It provides a high-level summary of the projects undertaken by participants in the ARROW and COLDTech programs and how these efforts have helped shape OceanWATERS. Finally, potential future work and directions for the testbed are listed, as likely informed by the recent planetary science decadal survey [5].

K Michael Dalal↗

Deciphering the Precision of Stereo IKONOS Canopy Height Models for U.S. Forests with G-LiHT Airborne LiDAR

Few studies have evaluated the precision of IKONOS stereo data for measuring forest canopy height. The high cost of airborne light detection and ranging (LiDAR) data collection for large area studies and the present lack of a spaceborne instrument lead to the need to explore other low cost options. The US Government currently has access to a large archive of commercial high-resolution imagery, which could be quite valuable to forest structure studies. At 1 m resolution, we here compared canopy height models (CHMs) and height data derived from Goddard's airborne LiDAR Hyper-spectral and Thermal Imager (G-LiHT) with three types of IKONOS stereo derived digital surface models (DSMs) that estimate CHMs by subtracting National Elevation Data (NED) digital terrain models (DTMs). We found the following in three different forested regions of the US after excluding heterogeneous and disturbed forest samples: (1) G-LiHT DTMs were highly correlated with NED DTMs with R (sup 2) greater than 0.98 and root mean square errors (RMSEs) less than 2.96 m; (2) when using one visually identifiable ground control point (GCP) from NED, G-LiHT DSMs and IKONOS DSMs had R (sup 2) greater than 0.84 and RMSEs of 2.7 to 4.1 m; and (3) one GCP CHMs for two study sites had R (sup 2) greater than 0.7 and RMSEs of 2.6 to 3 m where data were collected less than four years apart. Our results suggest that IKONOS stereo data are a useful LiDAR alternative where high-quality DTMs are available.

IKONOS↗