Search NASA⌕ Search

SEARCH · Search NASA

Results for “Stereo cameras”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Advances in Stereo Photogrammetry Capabilities for in-Situ Ejecta Measurements in Lunar Plume-Surface Interactions

Plume-surface interaction is a critical topic of interest as human spaceflight programs establish a renewed presence on the Moon and push onwards to Mars. The erosion of regolith and high-speed ejection of soil and rocks which occurs during a powered spacecraft landing on lunar or terrestrial bodies can pose serious risks to the vehicle during landing and to existing ground assets. Ground testing campaigns have provided data sets in relevant environments (e.g., low pressure) in tandem with predictive computational model validation. To-date, limited in-situ flight data exists to inform the study of the key phenomena of plume-surface interaction: plume-flow physics, soil erosion, and ejecta dynamics. In two upcoming lunar missions, erosion of the lunar regolith will be measured in-situ using the stereo photogrammetry technique as part of NASA’s Commercial Lunar Payload Services (CLPS) Program. The Stereo Cameras for Lunar Plume Surface Studies (SCALPSS) will use a multiple-camera system to measure the erosion of the lunar regolith due to the vehicles’ rocket engine plumes during descent and after landing. The application of stereo photogrammetry to accurately measure a realistic eroded shape has been validated in laboratory work ahead of the scheduled flights. In preparation for future CLPS, Artemis, or other lunar science missions, recent advancements have been made to measure the ejecta structure and particle dynamics in addition to the erosion of regolith using a SCALPSS-like photogrammetry system. The thickness and ejection angle of entrained soil and dust produced during plume-induced erosion can be used to determine how far debris will travel, and thus how it may impact nearby infrastructure or the landing vehicle itself. The present work highlights the development of this new flight instrumentation capability and its value to advancements in the plume-surface interaction measurement topic for lunar or planetary landings.

Olivia K. Tyrrell↗
NASA NTRS2017

Depth from Stereo and Polarization of Opaque Non-Lambertian Surfaces

This paper presents a new approach to depth from stereo in scenes with non-Lambertian surfaces. While these surfaces usually prove to be hard to incorporate in photo-consistency energy minimization, we retrieve additional information about their surface normals from applying a polarization-based approach that computes the degree and angle of polarization at each pixel. Therefore, we set up a stereo camera rig that captures four different rotations of a linear polarizer simultaneously for each camera. While most existing polarization-based approaches to shape reconstruction require a setup with known lighting, our approach uses arbitrary unpolarized illumination. We describe a regularization-based stereo approach that constrains specular surface normals in the scene to lie in the plane of their observed angle of polarization. We derive the mathematical foundations of this approach and present results on virtually generated stereo and real-world stereo imagery.

Berger, Kai↗
NASA NTRS2019

Astrobiology Survey of a Lava Cave at Lava Beds National Monument by a Rover Carrying a Remote Sensing Instrument Payload

We report here on a survey of a lava tube cave by a rover that is instrumented for astrobiology missions. The NASA Ames testbed rover, CaveR, was deployed in Valentine Cave in Lava Beds National Monument (N. CA, USA) during August of 2018. The rover carried an instrument package consisting of Near Infrared and Visible Spectrometer System (NIRVSS) a point spectrometer operating in 1590-3400 nm range, sensitive to H2O and -OH bearing minerals, pyroxenes, and carbonates (Roush, et al 2018); the bore sighted Drill Operations Camera (DOC), a monochrome imager illuminated by LEDs at 410, 540, 640, 740, 905 and 940 nm; a Realsense ™ depth sensor system for 3D model generation; and a high resolution DSLR stereo camera. The payload was mounted on a tiltable instrument platform attached to the left side of the rover. The rover was driven manually in the cave by field operators, following instructions from a remote science operations team, and simulating a mission concept with science-guided autonomy. A simulated mission took place for 3 days with a team of 3 scientists selecting targets and interpreting data from the payload. To begin the mission, the rover drove along one wall of the cave imaging continuously with the Realsense in 20 m cave segments, three total. At the start of each day, the images from a 20m segment and a panorama stitched from them were provided to the science team to examine. The science team used these data to prioritize specific points along the cave wall for the collection of NIRVSS, DOC, and DSLR data. The objective of the data collection was to identify and study putative biological and mineralogical features in the cave. The data were delivered in xGDS, a customized mapping, planning, and data base management software developed at NASA Ames (Lee, et al 2013). Once the targets for further observations were selected, a plan for collecting the observations (positions in the cave and pointing for each requested observation) was constructed using xGDS and delivered to a rover team to execute the science data collection plan. Acquired data were delivered back to the science team for analysis. Preliminary results from the experiment illustrate the utility of the system (rover plus payload) to study the cave geology and mineralogy and its potential for identifying biomineral features.

Wong, Uland↗
NASA NTRSDate not supplied

Development of a Terrain Mapping/Crater Evolution Measurement using Diffractive Optical Elements

When landing on the moon, understanding the interaction of the engine exhaust plume with the lunar surface is critical for the success of the descent and landing flight phases. Two evaluation tools currently used are computational simulations and ground test measurements. Computational simulations require experimental measurements for comparison/validation, but ground test measurements cannot accurately emulate all aspects of an actual lunar landing; flight tests remain the only method of obtaining fully representative data. A terrain mapping/crater evolution measurement system was developed for potential inclusion on a future lander mission. This system uses two stereo cameras viewing a laser dot grid pattern projected on the ground, where the grid is created by shining a laser through one or two diffractive optical elements. CAD simulations of the stereo imaging system are first used to validate the proposed design. Laboratory testing of the system using both a large-scale fixed-geometry crater and a small-scale evolving-geometry crater validate the use of the system for terrain mapping measurements, and for its potential inclusion on a future lander mission.

Joshua M Weisberger↗
NASA NTRSDate not supplied

Development of a Terrain Mapping/Crater Evolution Measurement using Diffractive Optical Elements

When landing on the moon, understanding the interaction of the engine exhaust plume with the lunar surface is critical for the success of the descent and landing flight phases. Two evaluation tools currently used are computational simulations and ground test measurements. Computational simulations require experimental measurements for comparison/validation, but ground test measurements cannot accurately emulate all aspects of an actual lunar landing; flight tests remain the only method of obtaining fully representative data. A terrain mapping/crater evolution measurement system was developed for potential inclusion on a future lander mission. This system uses two stereo cameras viewing a laser dot grid pattern projected on the ground, where the grid is created by shining a laser through one or two diffractive optical elements. CAD simulations of the stereo imaging system are first used to validate the proposed design. Laboratory testing of the system using both a large-scale fixed-geometry crater and a small-scale evolving-geometry crater validate the use of the system for terrain mapping measurements. High-speed, front-illumination shadow particle tracking of particles ejected from the evolving geometry crater is also performed, demonstrating another diagnostic that can be used to further the understanding of plume-surface interactions.

Joshua M Weisberger↗
NASA NTRSDate not supplied

Applications and Development Work for Digital Image Correlation Using High Speed Cameras

NASA, Army, and industry partners are working to advance optical measurement techniques used in highly dynamic rocket engine and missile test environments. This allows for direct component data collection during test and flight environments, significantly reduced analysis time, and associated cost savings. Digital Image Correlation (DIC) uses calibrated stereo cameras to collect three-dimensional (3-D) displacements, strains, and acceleration data by referencing a stochastic speckle pattern applied to the test object. These optical measurement techniques provide significantly improved data resulting in better performance predictions, model validation, and information about components during hot-fire tests and test flights.

Rachel Paden↗
NASA NTRS2005

Bias Reduction and Filter Convergence for Long Range Stereo

We are concerned here with improving long range stereo by filtering image sequences. Traditionally, measurement errors from stereo camera systems have been approximated as 3-D Gaussians, where the mean is derived by triangulation and the covariance by linearized error propagation. However, there are two problems that arise when filtering such 3-D measurements. First, stereo triangulation suffers from a range dependent statistical bias; when filtering this leads to over-estimating the true range. Second, filtering 3-D measurements derived via linearized error propagation leads to apparent filter divergence; the estimator is biased to under-estimate range. To address the first issue, we examine the statistical behavior of stereo triangulation and show how to remove the bias by series expansion. The solution to the second problem is to filter with image coordinates as measurements instead of triangulated 3-D coordinates.

robotics↗
NASA NTRS1991

VERDEX: A virtual environment demonstrator for remote driving applications

One of the key areas of the National Advanced Robotics Centre's enabling technologies research program is that of the human system interface, phase 1 of which started in July 1989 and is currently addressing the potential of virtual environments to permit intuitive and natural interactions between a human operator and a remote robotic vehicle. The aim of the first 12 months of this program (to September, 1990) is to develop a virtual human-interface demonstrator for use later as a test bed for human factors experimentation. This presentation will describe the current state of development of the test bed, and will outline some human factors issues and problems for more general discussion. In brief, the virtual telepresence system for remote driving has been designed to take the following form. The human operator will be provided with a helmet-mounted stereo display assembly, facilities for speech recognition and synthesis (using the Marconi Macrospeak system), and a VPL DataGlove Model 2 unit. The vehicle to be used for the purposes of remote driving is a Cybermotion Navmaster K2A system, which will be equipped with a stereo camera and microphone pair, mounted on a motorized high-speed pan-and-tilt head incorporating a closed-loop laser ranging sensor for camera convergence control (currently under contractual development). It will be possible to relay information to and from the vehicle and sensory system via an umbilical or RF link. The aim is to develop an interactive audio-visual display system capable of presenting combined stereo TV pictures and virtual graphics windows, the latter featuring control representations appropriate for vehicle driving and interaction using a graphical 'hand,' slaved to the flex and tracking sensors of the DataGlove and an additional helmet-mounted Polhemus IsoTrack sensor. Developments planned for the virtual environment test bed include transfer of operator control between remote driving and remote manipulation, dexterous end effector integration, virtual force and tactile sensing (also the focus of a current ARRL contract, initially employing a 14-pneumatic bladder glove attachment), and sensor-driven world modeling for total virtual environment generation and operator-assistance in remote scene interrogation.

Stone, Robert J.↗
NASA NTRSDate not supplied

SCALPSS Project Overview

An 8-minute presentation on the Stereo CAmeras for Lunar Plume Surface Studies (SCALPSS) project, to the Lunar Surface Science Dust and Regolith Workshop on Aug. 20, 2020

plume surface interaction↗
NASA NTRS1987

Robotic mobile servicing platform for space station

The semi-autonomous inspection and servicing of the Space Station's major thermal, electrical, mechanical subsystems are critical needs for the safe and reliable operation of the station. A conceptual design is presented of a self-intelligent, small and highly mobile robotic platform. Equipped with suitable inspection sensors (cameras, ammonia detectors, etc.), this system's primary mission is to perform routine, autonomous inspection of the Station's primary subsystems. Typical tasks include detection of leaks from thermal fluid or refueling lines, as well as detection of micro-meteroid damage to the primary structure. Equipped with stereo cameras and a dexterous manipulator, simple teleoperator repairs and small On-orbit Replacement Unit (ORU) changeout can also be accomplished. More difficult robotic repairs would be left to the larger, more sophisticated Mobile Remote Manipulator System (MRMS). An ancillary function is to ferry crew members and equipment around the station. The primary design objectives were to provide a flexible, but uncomplicated robotic platform, one which caused minimal impact to the design of the Station's primary structure but could accept more advanced telerobotic technology as it evolves.

Lowenthal, S. H.↗
NASA NTRS1990

Space environment robot vision system

A prototype twin-camera stereo vision system for autonomous robots has been developed at Goddard Space Flight Center. Standard charge coupled device (CCD) imagers are interfaced with commercial frame buffers and direct memory access to a computer. The overlapping portions of the images are analyzed using photogrammetric techniques to obtain information about the position and orientation of objects in the scene. The camera head consists of two 510 x 492 x 8-bit CCD cameras mounted on individually adjustable mounts. The 16 mm efl lenses are designed for minimum geometric distortion. The cameras can be rotated in the pitch, roll, and yaw (pan angle) directions with respect to their optical axes. Calibration routines have been developed which automatically determine the lens focal lengths and pan angle between the two cameras. The calibration utilizes observations of a calibration structure with known geometry. Test results show the precision attainable is plus or minus 0.8 mm in range at 2 m distance using a camera separation of 171 mm. To demonstrate a task needed on Space Station Freedom, a target structure with a movable I beam was built. The camera head can autonomously direct actuators to dock the I-beam to another one so that they could be bolted together.

Wood, H. John↗
NASA NTRS2018

Onboard Stereo Vision for Drone Pursuit or Sense and Avoid

Wedescribeanew,on-board,shortrangeperceptionsystem that enables micro aerial vehicles (MAVs) to detect, track, and follow or avoid nearby drones (within 2-20 meters) in GPS-denied environments. Each vehicle is able to sense its neighborhood and adapt its motion accordingly without use of centralized reasoning or inter-vehicle communication. To enable a lightweight, low power solution, on-board stereo cameras are used for detection and tracking with depth images, while a downward-looking camera and an inertial measurement unit are used to estimate the position of the observer without use of GPS. We illustrate the robustness and accuracy of this approach through real-time, outdoor leader-follower experiments with three quadrotors. Our experiments show that state-of-art trackers are far less robust in detection against cluttered background. This demonstrates that stereo vision is a highly effective approach to perception for safe navigation of multiple MAVs in close proximity.

Matthies, Larry↗
NASA NTRS2003

Optical Depth Retrievals from HRSC Stereo Images

Mars Express is due to arrive in orbit around Mars during the last days of 2003. A primary task of its mission is to map Mars in stereo with the High Resolution Stereo Camera (HRSC) at a spatial resolution of up to 12 m. The Martian atmosphere contains large amounts of dust and other aerosols that scatter light and influence the images. Therefore, image analysis requires careful consideration of these atmospheric effects. An essential parameter to consider is the optical depth. It will be possible to map the optical depth of the Martian atmosphere from HRSC stereo images by analyzing contrast differences. Software to this purpose has been developed at the Max-Planck Institute for Aeronomy in Lindau Germany. We present examples of optical depth-retrievals from airborne HRSC-A images of a region in the French Alps.

N M Hoekzema↗
NASA NTRS2012

Dig Hazard Assessment Using a Stereo Pair of Cameras

This software evaluates the terrain within reach of a lander s robotic arm for dig hazards using a stereo pair of cameras that are part of the lander s sensor system. A relative level of risk is calculated for a set of dig sectors. There are two versions of this software; one is designed to run onboard a lander as part of the flight software, and the other runs on a PC under Linux as a ground tool that produces the same results generated on the lander, given stereo images acquired by the lander and downlinked to Earth. Onboard dig hazard assessment is accomplished by executing a workspace panorama command sequence. This sequence acquires a set of stereo pairs of images of the terrain the arm can reach, generates a set of candidate dig sectors, and assesses the dig hazard of each candidate dig sector. The 3D perimeter points of candidate dig sectors are generated using configurable parameters. A 3D reconstruction of the terrain in front of the lander is generated using a set of stereo images acquired from the mast cameras. The 3D reconstruction is used to evaluate the dig goodness of each candidate dig sector based on a set of eight metrics. The eight metrics are: 1. The maximum change in elevation in each sector, 2. The elevation standard deviation in each sector, 3. The forward tilt of each sector with respect to the payload frame, 4. The side tilt of each sector with respect to the payload frame, 5. The maximum size of missing data regions in each sector, 6. The percentage of a sector that has missing data, 7. The roughness of each sector, and 8. Monochrome intensity standard deviation of each sector. Each of the eight metrics forms a goodness image layer where the goodness value of each sector ranges from 0 to 1. Goodness values of 0 and 1 correspond to high and low risk, respectively. For each dig sector, the eight goodness values are merged by selecting the lowest one. Including the merged goodness image layer, there are nine goodness image layers for each stereo pair of mast images.

Rankin, Arturo L.↗
NASA NTRS1985

Icing flight research: Aerodynamic effects of ice and ice shape documentation with stereo photography

Aircraft icing flight research was performed in natural icing conditions. A data base consisting of icing cloud measurements, ice shapes, and aerodynamic measurements is being developed. During research icing encounters the icing cloud was continuously measured. After the encounter, the ice accretion shapes on the wing were documented with a stereo camera system. The increase in wing section drag was measured with a wake survey probe. The overall aircraft performance loss in terms of lift and drag coefficient changes was obtained by steady level speed/power measurements. Selective deicing of the airframe components was performed to determine their contributions to the total drag increase. Engine out capability in terms of power available was analyzed for the iced aircraft. It was shown that the stereo photography system can be used to document ice shapes in flight and that the wake survey probe can measure increases in wing section drag caused by ice. On one flight, the wing section drag coefficient (c sub d) increased approximately 120 percent over the uniced baseline at an aircraft angle of attack of 6 deg. On another flight, the aircraft darg coefficient (c sub d) increased by 75 percent over the uniced baseline at an aircraft lift coefficient (C sub d) of 0.5.

Mikkelsen, K. L.↗
NASA NTRS1985

Icing flight research - Aerodynamic effects of ice and ice shape documentation with stereo photography

Aircraft icing flight research was performed in natural icing conditions. A data base consisting of icing cloud measurements, ice shapes, and aerodynamic measurements is being developed. During research icing encounters the icing cloud was continuously measured. After the encounter, the ice accretion shapes on the wing were documented with a stereo camera system. The increase in wing section drag was measured with a wake survey probe. The overall aircraft performance loss in terms of lift and drag coefficient changes were obtained by steady level speed/power measurements. Selective deicing of the airframe components was performed to determine their contributions to the total drag increase. Engine out capability in terms of power available was analyzed for the iced aircraft. It was shown that the stereo photography system can be used to document ice shapes in flight and that the wake survey probe can measure increases in wing section drag caused by ice. On one flight, the wing section drag coefficient (c sub d) increased approximately 120 percent over the uniced baseline at an aircraft angle of attack of 6 deg. On another flight, the aircraft drag coefficient (c sub d) increased by 75 percent over the uniced baseline at an aircraft lift coefficient (c sub d) of 0.5.

Mikkelsen, K. L.↗
NASA NTRS2007

Hand-Eye Calibration Using Active Vision

The project described in this paper designed and implemented a hand-eye calibration method for manipulators under observation by stereo cameras. This method has been utilized on Johnson Space Center's Robonaut, and on a planetary manipulator mock-up at the Jet Propulsion Laboratory. The intent of this calibration is to improve the manipulator's hand-eye coordination.

manipulation↗
NASA NTRS2000

Planar Particle Imaging Doppler Velocimetry Developed

Two current techniques exist for the measurement of planar, three-component velocity fields. Both techniques require multiple views of the illumination plane in order to extract all three velocity components. Particle image velocimetry (PIV) is a high-resolution, high accuracy, planar velocimetry technique that provides valuable instantaneous velocity information in aeropropulsion test facilities. PIV can provide three-component flow-field measurements using a two-camera, stereo viewing configuration. Doppler global velocimetry (DGV) is another planar velocimetry technique that can provide three component flow-field measurements; however, it requires three detector systems that must be located at oblique angles from the measurement plane. The three-dimensional configurations of either technique require multiple (DGV) or at least large (stereo PIV) optical access ports in the facility in which the measurements are being conducted. Optical access is extremely limited in aeropropulsion test facilities. In many cases, only one optical access port is available. A hybrid measurement technique has been developed at the NASA Glenn Research Center, planar particle image and Doppler velocimetry (PPIDV), which combines elements from both the PIV and DGV techniques into a single detection system that can measure all three components of velocity across a planar region of a flow field through a single optical access port. In the standard PIV technique, a pulsed laser is used to illuminate the flow field at two closely spaced instances in time, which are recorded on a "frame-straddling" camera, yielding a pair of single-exposure image frames. The PIV camera is oriented perpendicular to the light sheet, and the processed PIV data yield the two-component velocity field in the plane of the light sheet. In the standard DGV technique, an injection-seeded Nd:YAG pulsed laser light sheet illuminates the seeded flow field, and three receiver systems are used to measure three components of velocity. The receiver systems are oriented at oblique angles to the light sheet in order to accurately resolve the three-component velocity. Each DGV receiver system contains two cameras, which share a common view of the illuminated flow through a beam-splitting cube. One camera views the illuminated flow directly (reference camera) and the second camera images the illuminated flow through an iodine vapor cell (signal camera). The laser frequency (wavelength) is adjusted so that the Doppler-shifted light from particles in the flow falls on an iodine absorption feature, see the following graph. The iodine vapor cell acts as a frequency-to-velocity filter by modulating the intensity of the transmitted light as a function of the flow velocity (Doppler shift). The ratio of the signal and reference images yields the component of the flow velocity along the bisector of the laser sheet propagation direction and the receiver system observation direction. The hybrid system employs a single-component DGV receiver system configured to simultaneously acquire PIV image data, as shown in the following diagram. The cameras used in the DGV receiver are replaced with PIV frame-straddling cameras, and the receiver system views the illuminated light sheet plane at 90 (as in the standard PIV configuration).

Wernet, Mark P.↗