Search NASA⌕ Search

SEARCH · Search NASA

Results for “depth imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Analysis of airborne imaging spectrometer data for the Ruby Mountains, Montana, by use of absorption-band-depth images

Airborne Imaging Spectrometer-1 (AIS-1) data were obtained for an area of amphibolite grade metamorphic rocks that have moderate rangeland vegetation cover. Although rock exposures are sparse and patchy at this site, soils are visible through the vegetation and typically comprise 20 to 30 percent of the surface area. Channel averaged low band depth images for diagnostic soil rock absorption bands. Sets of three such images were combined to produce color composite band depth images. This relative simple approach did not require extensive calibration efforts and was effective for discerning a number of spectrally distinctive rocks and soils, including soils having high talc concentrations. The results show that the high spectral and spatial resolution of AIS-1 and future sensors hold considerable promise for mapping mineral variations in soil, even in moderately vegetated areas.

Brickey, David W.↗

Model based estimation of image depth and displacement

Passive depth and displacement map determinations have become an important part of computer vision processing. Applications that make use of this type of information include autonomous navigation, robotic assembly, image sequence compression, structure identification, and 3-D motion estimation. With the reliance of such systems on visual image characteristics, a need to overcome image degradations, such as random image-capture noise, motion, and quantization effects, is clearly necessary. Many depth and displacement estimation algorithms also introduce additional distortions due to the gradient operations performed on the noisy intensity images. These degradations can limit the accuracy and reliability of the displacement or depth information extracted from such sequences. Recognizing the previously stated conditions, a new method to model and estimate a restored depth or displacement field is presented. Once a model has been established, the field can be filtered using currently established multidimensional algorithms. In particular, the reduced order model Kalman filter (ROMKF), which has been shown to be an effective tool in the reduction of image intensity distortions, was applied to the computed displacement fields. Results of the application of this model show significant improvements on the restored field. Previous attempts at restoring the depth or displacement fields assumed homogeneous characteristics which resulted in the smoothing of discontinuities. In these situations, edges were lost. An adaptive model parameter selection method is provided that maintains sharp edge boundaries in the restored field. This has been successfully applied to images representative of robotic scenarios. In order to accommodate image sequences, the standard 2-D ROMKF model is extended into 3-D by the incorporation of a deterministic component based on previously restored fields. The inclusion of past depth and displacement fields allows a means of incorporating the temporal information into the restoration process. A summary on the conditions that indicate which type of filtering should be applied to a field is provided.

Damour, Kevin T.↗

Delamination Depth Imaging for Quasi-Static and Fatigue Load Testing Using Passive Thermography

Passive thermography is used to monitor small increases in temperature resulting from delamination damage formation in composite hat-stiffened panels during both quasi-static and fatigue loading. It has been observed that rapid damage formation produces heating. This is composed of two heat generation components. The first component is an instantaneous response due to an irreversible thermoelastic strain release. The second component is mechanical heating, at the interface of failure, due to fracture damage. This produces a transient rise in temperature as the heat diffuses to the surface. The first component defines the thermal start time for the transient response. A one-dimensional thermal model is fitted to the data pixel by pixel, to produce imagery of the damage depth. The results are compared to ultrasonic and X-ray CT data.

Passive thermography↗

New Insights on Subsurface Imaging of Carbon Nanotubes in Polymer Composites via Scanning Electron Microscopy

Despite many studies of subsurface imaging of carbon nanotube (CNT)-polymer composites via scanning electron microscopy (SEM), significant controversy exists concerning the imaging depth and contrast mechanisms. We studied CNT-polyimide composites and, by threedimensional reconstructions of captured stereo-pair images, determined that the maximum SEM imaging depth was typically hundreds of nanometers. The contrast mechanisms were investigated over a broad range of beam accelerating voltages from 0.3 to 30 kV, and ascribed to modulation by embedded CNTs of the effective secondary electron (SE) emission yield at the polymer surface. This modulation of the SE yield is due to non-uniform surface potential distribution resulting from current flows due to leakage and electron beam induced current. The importance of an external electric field on SEM subsurface imaging was also demonstrated. The insights gained from this study can be generally applied to SEM nondestructive subsurface imaging of conducting nanostructures embedded in dielectric matrices such as graphene-polymer composites, silicon-based single electron transistors, high resolution SEM overlay metrology or e-beam lithography, and have significant implications in nanotechnology.

Zhao, Minhua↗

Estimating Lunar Pyroclastic Deposit Depth from Imaging Radar Data: Applications to Lunar Resource Assessment

Lunar pyroclastic deposits represent one of the primary anticipated sources of raw materials for future human settlements. These deposits are fine-grained volcanic debris layers produced by explosive volcanism contemporaneous with the early stage of mare infilling. There are several large regional pyroclastic units on the Moon (for example, the Aristarchus Plateau, Rima Bode, and Sulpicius Gallus formations), and numerous localized examples, which often occur as dark-halo deposits around endogenic craters (such as in the floor of Alphonsus Crater). Several regional pyroclastic deposits were studied with spectral reflectance techniques: the Aristarchus Plateau materials were found to be a relatively homogeneous blanket of iron-rich glasses. One such deposit was sampled at the Apollo 17 landing site, and was found to have ferrous oxide and titanium dioxide contents of 12 percent and 5 percent, respectively. While the areal extent of these deposits is relatively well defined from orbital photographs, their depths have been constrained only by a few studies of partially filled impact craters and by imaging radar data. A model for radar backscatter from mantled units applicable to both 70-cm and 12.6-cm wavelength radar data is presented. Depth estimates from such radar observations may be useful in planning future utilization of lunar pyroclastic deposits.

Campbell, B. A.↗

Extended depth of field imaging for high speed object analysis

A high speed, high-resolution flow imaging system is modified to achieve extended depth of field imaging. An optical distortion element is introduced into the flow imaging system. Light from an object, such as a cell, is distorted by the distortion element, such that a point spread function (PSF) of the imaging system is invariant across an extended depth of field. The distorted light is spectrally dispersed, and the dispersed light is used to simultaneously generate a plurality of images. The images are detected, and image processing is used to enhance the detected images by compensating for the distortion, to achieve extended depth of field images of the object. The post image processing preferably involves de-convolution, and requires knowledge of the PSF of the imaging system, as modified by the optical distortion element.

Ortyn, William↗

Extended depth of field imaging for high speed object analysis

A high speed, high-resolution flow imaging system is modified to achieve extended depth of field imaging. An optical distortion element is introduced into the flow imaging system. Light from an object, such as a cell, is distorted by the distortion element, such that a point spread function (PSF) of the imaging system is invariant across an extended depth of field. The distorted light is spectrally dispersed, and the dispersed light is used to simultaneously generate a plurality of images. The images are detected, and image processing is used to enhance the detected images by compensating for the distortion, to achieve extended depth of field images of the object. The post image processing preferably involves de-convolution, and requires knowledge of the PSF of the imaging system, as modified by the optical distortion element.

Ortyn, William↗

Television monitor field shifter and an opto-electronic method for obtaining a stereo image of optimal depth resolution and reduced depth distortion on a single screen

A method and apparatus for obtaining a stereo image with reduced depth distortion and optimum depth resolution. Static and dynamic depth distortion and depth resolution trade-off is provided. Cameras obtaining the images for a stereo view are converged at a convergence point behind the object to be presented in the image, and (a) the collection-surface-to-object distance, (b) the camera separation distance, and (c) the focal lengths of zoom lenses for the camera are all increased. Doubling the distances cuts the static depth distortion in half while maintaining image size and depth resolution. Dynamic depth distortion is minimized by panning a stereo view-collecting camera system about a circle which passes through the convergence point and the cameras' first nodal points. Horizontal field shifting of the television fields on a television monitor brings both the monitor and the stereo views within the viewer's limit of binocular fusion.

Daniel B Diner↗

A Tool for the Automated Collection of Space Utilization Data: Three Dimensional Space Utilization Monitor

Space Human Factors and Habitability (SHFH) Element within the Human Research Program (HRP), in collaboration with the Behavioral Health and Performance (BHP) Element, is conducting research regarding Net Habitable Volume (NHV), the internal volume within a spacecraft or habitat that is available to crew for required activities, as well as layout and accommodations within that volume. NASA is looking for innovative methods to unobtrusively collect NHV data without impacting crew time. Data required includes metrics such as location and orientation of crew, volume used to complete tasks, internal translation paths, flow of work, and task completion times. In less constrained environments methods for collecting such data exist yet many are obtrusive and require significant post‐processing. Example technologies used in terrestrial settings include infrared (IR) retro‐reflective marker based motion capture, GPS sensor tracking, inertial tracking, and multiple camera filmography. However due to constraints of space operations many such methods are infeasible, such as inertial tracking systems which typically rely upon a gravity vector to normalize sensor readings, and traditional IR systems which are large and require extensive calibration. However multiple technologies have not yet been applied to space operations for these explicit purposes. Two of these include 3‐Dimensional Radio Frequency Identification Real‐Time Localization Systems (3D RFID‐RTLS) and depth imaging systems which allow for 3D motion capture and volumetric scanning (such as those using IR‐depth cameras like the Microsoft Kinect or Light Detection and Ranging / Light‐Radar systems, referred to as LIDAR).

Vos, Gordon A.↗

A Tool for the Automated Collection of Space Utilization Data: Three Dimensional Space Utilization Monitor

Space Human Factors and Habitability (SHFH) Element within the Human Research Program (HRP) and the Behavioral Health and Performance (BHP) Element are conducting research regarding Net Habitable Volume (NHV), the internal volume within a spacecraft or habitat that is available to crew for required activities, as well as layout and accommodations within the volume. NASA needs methods to unobtrusively collect NHV data without impacting crew time. Data required includes metrics such as location and orientation of crew, volume used to complete tasks, internal translation paths, flow of work, and task completion times. In less constrained environments methods exist yet many are obtrusive and require significant post-processing. Examplesused in terrestrial settings include infrared (IR) retro-reflective marker based motion capture, GPS sensor tracking, inertial tracking, and multi-camera methods Due to constraints of space operations many such methods are infeasible. Inertial tracking systems typically rely upon a gravity vector to normalize sensor readings,and traditional IR systems are large and require extensive calibration. However, multiple technologies have not been applied to space operations for these purposes. Two of these include: 3D Radio Frequency Identification Real-Time Localization Systems (3D RFID-RTLS) Depth imaging systems which allow for 3D motion capture and volumetric scanning (such as those using IR-depth cameras like the Microsoft Kinect or Light Detection and Ranging / Light-Radar systems, referred to as LIDAR)

Vos, Gordon A.↗

Ruggedizing a Commercial Depth Camera for Novel Lunar Exploration.

The novel contribution of this instrument is to take the first depth images on the moon. A commercial Kinect camera from Microsoft has been ruggedized for a CLPS mission to the Lunar South Pole. The 12-megapixel color camera is combined with a 1-megapixel color time-of-flight (ToF) depth sensor. The solid-state depth sensor/LIDAR provides greater resolution, a wider field of view, pixel binning, and reduced power consumption. The high-resolution data collected from the mission can be used to construct a near-field virtual environment of the lunar surface for scientific applications. The depth camera can provide a 360-degree view of the target area by combining ToF data with RGB imagery and rover turning. The unit was evaluated for space flight compliant materials and parts at NASA Ames. The microphone array, RF shield, front face, and outer body parts were removed to reduce mass. Plastic parts were replaced with vacuum-compatible materials; manufactured cables were added to properly interface with the host rover, built by Lunar Outpost. The environmental testing was performed on the Kinect with Random Vibration/Sine Testing (Fig 1a), per GEVS (NASA’s General Environmental Verification Standard for spaceflight launch survival). Thermal Vacuum testing cycled the instrument between expected hot (+ 85 C) and cold survival temperatures, as well as +50 C and -25 C operational temps (Fig 1b). The instrument functioned nominally at the conclusion of vibration and thermal cycling tests. The Azure Kinect is manifested on the Nova-C lander which flies on the Intuitive Machines mission IM-2, landing at the lunar south pole for a mission duration of 14 days (one lunar daylight cycle). The unit will be integrated to the MAPP (Mobile Autonomous Prospecting Platform) rover at Lunar Outpost. The Azure Kinect with ToF feature will improve the resolution of lunar geology data near the south pole and enable ground-based VR experience of details of the lunar surface (Fig 1c).

V. Jha↗

Unsupervised Change Detection for Space Habitats Using 3D Point Clouds

This work presents an algorithm for scene change detection from point clouds to enable autonomous robotic caretaking in future space habitats. Autonomous robotic systems will help maintain future deep-space habitats, such as the Gateway space station, which will be uncrewed for extended periods. Existing scene analysis software used on the International Space Station (ISS) relies on manually-labeled images for detecting changes. In contrast, the algorithm presented in this work uses raw, unlabeled point clouds as inputs. The algorithm first applies modified Expectation-Maximization Gaussian Mixture Model (GMM) clustering to two input point clouds. It then performs change detection by comparing the GMMs using the Earth Mover’s Distance. The algorithm is validated quantitatively and qualitatively using a test dataset collected by an Astrobee robot in the NASA Ames Granite Lab comprising single frame depth images taken directly by Astrobee and full-scene reconstructed maps built with RGB-D and pose data from Astrobee. The runtimes of the approach are also analyzed in depth. The source code is publicly released to promote further development.

robotics↗

Time-Distance Helioseismology with the HMI Instrument

We expect considerable improvement of time-distance results from the Helioseismic and Magnetic Imager (HMI) instrument as opposed to the earlier MDI and GONG data. The higher data rate makes possible several improvements, including faster temporal sampling (45 sec), smaller spatial pixels (0.5 arc sec), better wavelength coverage (6 samples across the line all transmitted to the ground), and year-round coverage of the full disk. The higher spatial resolution makes possible better longitude coverage of active regions and supergranulation and also better latitude coverage. Doppler, continuum, and line depth images have a strong granulation signal. Line core images show little granulation. Analyses to test the limits of these new capabilities will be presented.

Duvall, Thomas L., Jr.↗

Onboard Stereo Vision for Drone Pursuit or Sense and Avoid

Wedescribeanew,on-board,shortrangeperceptionsystem that enables micro aerial vehicles (MAVs) to detect, track, and follow or avoid nearby drones (within 2-20 meters) in GPS-denied environments. Each vehicle is able to sense its neighborhood and adapt its motion accordingly without use of centralized reasoning or inter-vehicle communication. To enable a lightweight, low power solution, on-board stereo cameras are used for detection and tracking with depth images, while a downward-looking camera and an inertial measurement unit are used to estimate the position of the observer without use of GPS. We illustrate the robustness and accuracy of this approach through real-time, outdoor leader-follower experiments with three quadrotors. Our experiments show that state-of-art trackers are far less robust in detection against cluttered background. This demonstrates that stereo vision is a highly effective approach to perception for safe navigation of multiple MAVs in close proximity.

Matthies, Larry↗

Data Compression Algorithm Architecture for Large Depth-of-Field Particle Image Velocimeters

A large depth-of-field particle image velocimeter (PIV) is designed to characterize dynamic dust environments on planetary surfaces. This instrument detects lofted dust particles, and senses the number of particles per unit volume, measuring their sizes, velocities (both speed and direction), and shape factors when the particles are large. To measure these particle characteristics in-flight, the instrument gathers two-dimensional image data at a high frame rate, typically >4,000 Hz, generating large amounts of data for every second of operation, approximately 6 GB/s. To characterize a planetary dust environment that is dynamic, the instrument would have to operate for at least several minutes during an observation period, easily producing more than a terabyte of data per observation. Given current technology, this amount of data would be very difficult to store onboard a spacecraft, and downlink to Earth. Since 2007, innovators have been developing an autonomous image analysis algorithm architecture for the PIV instrument to greatly reduce the amount of data that it has to store and downlink. The algorithm analyzes PIV images and automatically reduces the image information down to only the particle measurement data that is of interest, reducing the amount of data that is handled by more than 10(exp 3). The state of development for this innovation is now fairly mature, with a functional algorithm architecture, along with several key pieces of algorithm logic, that has been proven through field test data acquired with a proof-of-concept PIV instrument.

Bos, Brent↗

Self-Motion and Depth Estimation from Image Sequences

An image-based version of a computational model of human self-motion perception (developed in collaboration with Dr. Leland S. Stone at NASA Ames Research Center) has been generated and tested. The research included in the grant proposal sought to extend the utility of the self-motion model so that it could be used for explaining and predicting human performance in a greater variety of aerospace applications. The model can now be tested with video input sequences (including computer generated imagery) which enables simulation of human self-motion estimation in a variety of applied settings.

Perrone, John↗