Search NASA⌕ Search

SEARCH · Search NASA

Results for “point cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Three-dimensional estimation of deciduous forest canopy structure and leaf area using multi-directional, leaf-on and leaf-off airborne lidar data

Airborne laser scanning (ALS) has been widely used to map gap probability and leaf area index (LAI) distribution at plot and landscape scales. As an indirect measurement, most ALS methods to estimate LAI combine waveform or point density information with supporting field measurements such as the leaf angle distribution, gap probability, or direct LAI measures. The development of a more independent estimation approach would facilitate more widespread use of existing ALS data to investigate patterns of forest structure and build realistic 3-D vegetation scenes to simulate remote sensing imagery and energy balance. Here, we develop a data processing workflow (named PVlad) using ALS point cloud apparent reflectance to estimate LAI and voxel-based leaf area density (LAD), aiming to reduce the need for associated field measurements such as the gap probability. The adaptation of the path volume (PV) concept derived from apparent reflectance integrates information from multi-directional ALS pulses, and quantifies the percentage exploration of each voxel for classification and occlusion correction, such that rigorous volumetric sampling approaches can be developed to derive LAI and LAD. The PVlad workflow was applied to discrete-return lidar data (Riegl VQ480i) acquired by NASA Goddard's LiDAR, Hyperspectral and Thermal Imager (G-LiHT) Airborne Imager during leaf-on (summer) and leaf-off (spring) conditions at the Smithsonian Environmental Research Center (SERC). The estimates of LAI and LAD captured structural differences between mature, logged, and intermediate-aged stands over eight deciduous forest plots. The derived LAI values were compared to field litter collection measurements, and the derived LAD vertical distribution was compared to the output of the VoxLAD model using terrestrial laser scan (TLS) field survey data. Using voxel sizes ranging from 0.5 m to 5 m, overall LAI estimation showed linear fitting coefficient bias and for 1 and 2 m voxel sizes, and vertical LAD distribution showed strong correlation with and for 0.5 and 1m voxel sizes. For every forest stand, upper-canopy LAD had a low variance for voxel sizes of ≤ . Application of PVlad to the G-LiHT and other similar ALS data archives enables the development of fine-resolution LAI map products, including voxelization of LAD for ecosystem science and radiative transfer simulations of remote sensing imagery or surface energy balance.

Tiangang Yin↗

Synthesizing Disparate LiDAR and Satellite Datasets through Deep Learning to Generate Wall-to-Wall Regional Inventories for the Complex, Mixed-Species Forests of the Eastern United States

Light detection and ranging (LiDAR) has become a commonly-used tool for generating remotely-sensed forest inventories. However, LiDAR-derived forest inventories have remained uncommon at a regional scale due to varying parameters among LiDAR data acquisitions and the availability of sufficient calibration data. Here, we present a model using a 3-D convolutional neural network (CNN), a form of deep learning capable of scanning a LiDAR point cloud, combined with coincident satellite data (spectral, phenology, and disturbance history). We compared this approach to traditional modeling used for making forest predictions from LiDAR data (height metrics and random forest) and found that the CNN had consistently lower uncertainty. We then applied the CNN to public data over six New England states in the USA, generating maps of 14 forest attributes at a 10 m resolution over 85% of the region. Aboveground biomass estimates produced a root mean square error of 36 Mg ha−1 (44%) and were within the 97.5% confidence of independent county-level estimates for 33 of 38 or 86.8% of the counties examined. CNN predictions for stem density and percentage of conifer attributes were moderately successful, while predictions for detailed species groupings were less successful. The approach shows promise for improving the prediction of forest attributes from regional LiDAR data and for combining disparate LiDAR datasets into a common framework for large-scale estimation.

Elias Ayrey↗

Estimating Bare Earth in Sparse Boreal Forests With WorldView Stereo Imagery

Circumboreal forests are currently experiencing rapid climate warming which is altering their structure, productivity, and status as a carbon sink. Very-high resolution (VHR, <2 m) stereo derived digital surface models are available to monitor these forests, but, a similar resolution digital terrain model (DTM) is required to extract information about tree height, which is often used to estimate carbon content. To our knowledge, no openly available VHR DTM currently exists. To address this need, we developed approaches to extract DTMs by filtering VHR stereo point clouds (PCs) in sparse canopies of Alaska. Our evaluation consisted of two stereo processing methods with three PC search radii, at six different tree canopy cover (TCC) intervals. We found VHR DTMs were robust for estimating bare ground at TCC intervals less than 40% with vertical errors <1.6 m using airborne small footprint light detection and ranging (LiDAR) as reference.

Christopher S. R. Neigh↗

Very High-Resolution Satellite-Derived Bathymetry and Habitat Mapping Using Pleiades-1 and ICESat-2

Accurate and reliable bathymetric data are needed for a wide diversity of marine research and management applications. Satellite-derived bathymetry represents a time saving method to map large shallow waters of remote regions compared to the current costly in situ measurement techniques. This study aims to create very high-resolution (VHR) bathymetry and habitat mapping in Mayotte island waters (Indian Ocean) by fusing 0.5 m Pleiades-1 passive multispectral imagery and active ICESat-2 LiDAR bathymetry. ICESat-2 georeferenced photons were filtered to remove noise and corrected for water column refraction. The bathymetric point clouds were validated using the French naval hydrographic and oceanographic service Litto3D® dataset and then used to calibrate the multispectral image to produce a digital depth model (DDM). The latter enabled the creation of a digital albedo model used to classify benthic habitats. ICESat-2 provided bathymetry down to 15 m depth with a vertical accuracy of bathymetry estimates reaching 0.89 m. The benthic habitats map produced using the maximum likelihood supervised classification provided an overall accuracy of 96.62%. This study successfully produced a VHR DDM solely from satellite data. Digital models of higher accuracy were further discussed in the light of the recent and near-future launch of higher spectral and spatial resolution satellites.

Bathymetry↗

Cockpit Interface for Locomotion and Manipulation Control of the NASA Valkyrie Humanoid in Virtual Reality (VR)

A virtual reality (VR) interface is presented for controlling NASA’s Valkyrie humanoid robot with flexible locomotion control options and intuitive teleoperation. Locomotion modes include navigating to a specified waypoint, sending desired velocities with a joystick, or manually placing a sequence of footsteps. On the other hand, teleoperation modes include voice commands to toggle relative whole-body tracking or high-level commandeering, and key bindings for common stored poses such as power grasps. The primary novelties of the interface are in the implementation of the cockpit mode and a floating augmented reality (AR) screen fixed with respect to the robot. The former enables embodied teleoperation and increased awareness during navigation in a mixed-reality setting. The latter preserves depth perception without the disparity clutter from a stereo point cloud. The interface is demonstrated on two real humanoids performing common explosive ordnance disposal (EOD) tasks such as door opening, vehicle inspection, and disruptor placement. Notably, the interface enables a single operator to control multiple humanoids. While the interface is motivated by EOD missions, the presented ideas are usable for other robots employing VR-based control.

Virtual-reality↗

Quantifying Mangrove Canopy Regrowth and Recovery After Hurricane Irma With Large-Scale Repeat Airborne Lidar in the Florida Everglades

Hurricane Irma caused significant damages to mangrove forested wetlands in south Florida, including defoliation, tree snapping, and uprooting. Previous studies have used optical satellite imagery to estimate large-scale forest disturbance and resilience patterns. However, satellite images alone cannot provide measurements of vertical mangrove structure. In this study, we used dense point cloud data collected by NASA Goddard’s LiDAR, Hyperspectral, and Thermal (G-LiHT) airborne imager before (March 2017) and after (December 2017 and March 2020) Hurricane Irma to quantify the recovery, or lack thereof, of the three-dimensional (3D) mangrove forest structure. Recent resilience and vulnerability models developed from Landsat time series following the storm were used to group the lidar data into distinct disturbance-recovery classes. We then analyzed lidar-based forest canopy within each of the recovery classes to test a suite of forest structural characteristics. Our results indicate that 77.0 % of the survey area experienced canopy height loss three months after Hurricane Irma, whereby the majority of canopy height loss occurred in areas with the tallest mangrove forests (i.e., 15–25 m tall). Our analysis shows that the mangrove canopy height in South Florida increased by an average 0.26 m from December 2017 to March 2020, with most of the forest (84.7 % of the survey area) experiencing canopy height regrowth. However, only 38.1 % of the survey area has recovered to pre-storm canopy height. The distribution of canopy height was significantly altered by Hurricane Irma in the low and intermediate resilience classes, but were not significantly different 2.5 years later. Indeed, in areas of low resilience, little to no vertical change has occurred suggesting the absence of canopy regrowth and natural regeneration. Conversely, mangroves in high resilience class, which are dominated by shorter canopies (<5 m), were not heavily damaged by the storm and have maintained the same structural attributes as those before Hurricane Irma. Our findings highlight that hurricane disturbances significantly alter mangrove forest canopy structure, but recovery of vertical structure varies by resilience classes, species composition, and canopy height.

Lidar↗

Lunar Rover Localization Using Craters as Landmarks

Onboard localization capabilities for planetary rovers to date have used relative navigation, by integrating combinations of wheel odometry, visual odometry, and inertial measurements during each drive to track position relative to the start of each drive. At the end of each drive, a “ground-in-the-loop” (GITL) interaction is used to get a position update from human operators in a more global reference frame, such as a map frame defined by orbital reconnaissance imaging of a large region around the rover’s current position. For Mars rovers, this typically has involved downlinking imagery from the rover mast cameras and using interactive visualization tools on Earth to register such images to the orbital reconnaissance images. For safety purposes, rover mission operations typically specify “keep out zones”, which human operators recognize as being unsafe in the orbital images. Autonomous rover drives are limited in distance so that accumulated relative navigation error does not risk the possibility of the rover driving into a keep out zone. The allowable autonomous drive distance in this mode of operation depends on the distribution of keep out zones and the accuracy of relative navigation; in practice, drive limits of a few hundred meters between GITL cycles are to be expected. Several rover mission concepts have recently been studied that require much longer drives between GITL cycles, particularly for the Moon. This includes lunar rover mission concepts that involve (1) driving mostly in sunlight at low latitudes, (2) driving in permanently shadowed regions near the south pole, and (3) a mixture of day and night driving in mid-latitudes. These concepts include total traverse distance requirements of up to 1,800 km in 4 Earth years, with individual drives of several kilometers between stops for downlink. These concepts require greater autonomy to minimize GITL cycles to enable such large range; onboard global localization is a key element of such autonomy. Multiple techniques have been studied in the past for onboard rover global localization, including radio navigation aiding from an orbiter, recognizing horizon landmarks that are known in a regional elevation map, and correlating a local elevation map created onboard the rover with a regional elevation map. These techniques all have drawbacks, including requiring an expensive extra mission element (navigation orbiter), unavailability of sufficient regional elevation map data, or limited accuracy in resulting position estimates (e.g. a few hundred meters with horizon landmarks). For the Moon, the ubiquitous craters offer another possibility, which involves mapping craters from orbit, then recognizing crater landmarks with cameras and/or a lidar onboard the rover. This approach is applicable everywhere on the Moon, does not require high resolution stereo imaging from orbit as some other approaches do, and has potential to enable position knowledge with order of 10 m accuracy at all times. This paper will provide more detail on our technical approach to crater-based lunar rover localization and will present initial results on crater detection using 3-D point cloud data from onboard lidar or stereo cameras and using shading cues in monocular onboard imagery.

Ono, M.↗

Modeling Deformable Linear Objects for Autonomous Robotic Outfitting of Lunar Surface Systems

This paper presents structural models of deformable linear objects (DLOs). DLOs are a subclass of deformable objects that encompasses common outfitting elements such as cables and ropes. Models are validated through hardware experiments, and integration in a robotic autonomy architecture for space environments is discussed. A persistent human presence on the lunar surface is one of the next major milestones in space exploration. This requires the development of robust extraplanetary construction technologies including structures and materials modeling and robotic systems. Previous robotic construction technology development has primarily focused on structural assembly, with significantly less focus on robotically performed outfitting tasks to instantiate subsystems providing power, data, life support, etc. These tasks involve manipulation of highly flexible elements, which are difficult to model, such as cable harnesses, ropes, and hoses. Robotic manipulation of DLOs, especially cable harnesses, is an active area of research as cable harnesses are essential for providing power and data to space assets. DLO models that can be used for robot manipulator trajectory generation are necessary for autonomous operation of lunar infrastructure. There are many proposed methods for modeling DLOs, and they primarily fall into three types: 1) discrete model-based, 2) continuum model-based, and 3) Neural Network-based. These types each have pros and cons, and the tradeoff between model accuracy and computational speed informs which type should be used. An understanding of this trade-off is imperative for real-time control of autonomous systems. High computational requirements reduce the speed of the model, making real-time control difficult, while accuracy is critical to preventing collisions. Discrete models, such as a mass-spring multibody representation, require relatively few calculations, and accuracy is directly tied to the step size of the discretization. Continuum models, such as a B-spline representation or a Cosserat rod model (a mix of continuous and discrete), are more informed of the structural properties of the cable and are much more accurate than a rigid body mass-spring model, but at significant computational cost. A Neural Network approach can provide an online solution with very few computational steps, but properly generating training data can be difficult and validation for an in-space application is not trivial. This paper explores the trade-off between different modeling approaches and compares accuracy and computational speed/complexity of the three types mentioned above. Model accuracy is evaluated using a cable in a static configuration. True cable shape is obtained using a depth camera for RGB images and point-cloud segmentation. The purpose of this experiment is to evaluate the trade-offs of different approaches to the DLO modeling problem. Understanding the tradeoffs between different cable modeling techniques paves the way for developing robotic control and planning architectures necessary for real-time manipulation of DLOs for lunar infrastructure outfitting. Real-time control is required for robotic systems to be able to actively manipulate a cable in a harsh environment where model and sensor errors compound, and environmental conditions can cause significant disturbances. Cable routing must be performed in areas with high density of objects/obstacles: through truss structures, near solar panels or mirror arrays, next to bundles of electrical equipment. Understanding the best way to plan and manipulate a cable without disrupting the environment or damaging the cable is imperative to robotic outfitting operations on the lunar surface.

Amy M Quartaro↗

Standalone Hazard Evaluation and Refinement From Instrument Findings (S.H.E.R.I.F.)

The Standalone Hazard Evaluation From Instrument Findings or SHERIF is a set of novel algorithms and associated framework designed to support the generation of Digital Elevation Maps (DEMs) from multiple LiDAR scans and perform Hazard Detection (HD) and Safe Site Selection with minimal input from other onboard systems. SHERIF can employ several techniques to perform Point Cloud registration(PCR) on disparate LiDAR scans of a planetary surface to generate a DEM which evolves over the course of a trajectory, with a flow designed to enable robustness. The framework also supports a variety of Hazard Detection and Safe Site Selection algorithms which can be run on the evolving DEM being produced. SHERIF features a robust and modular construction, allowing the user a high degree of flexibility in selecting and implementing whichever PCR and HD/SSL algorithms they may prefer, while maintaining the data products and sensor independence of the core SHERIF framework. SHERIF was recently tested in a hardware in the loop simulation at NASA JSC.

Entry Descent and Landing Guidance Navigation Cont↗

Standalone Hazard Evaluation and Refinement From Instrument Findings (S.H.E.R.I.F.)

The Standalone Hazard Evaluation From Instrument Findings (SHERIF) system is a set of novel algorithms and associated framework designed to support the generation of Digital Elevation Maps (DEMs) from multiple LiDAR scans and perform Hazard Detection (HD) and Safe Site Identification (SSI) with no dependencies on other onboard systems. SHERIF can employ several techniques to perform robust 3D keypoint extraction and Point Cloud registration (PCR) on disparate LiDAR scans of a planetary surface to generate a DEM which evolves over the course of a trajectory. The framework also supports a variety of Hazard Detection and Safe Site Identification algorithms which can be applied to the evolving DEM being produced. SHERIF features a robust and modular construction, allowing the user a high degree of flexibility in selecting and implementing whichever keypoint identificaiton, PCR and HD/SSI algorithms they may prefer, while maintaining the data products and sensor independence of the core SHERIF framework. SHERIF was recently evaluated via simulation and hardware-in-the-loop experimental testing at NASA Johnson Space Center.

hazard detection↗

Standalone Hazard Evaluation and Refinement From Instrument Findings (S.H.E.R.I.F.)

The Standalone Hazard Evaluation From Instrument Findings (SHERIF) system is a set of novel algorithms and associated framework designed to support the generation of Digital Elevation Maps (DEMs) from multiple LiDAR scans and perform Hazard Detection (HD) and Safe Site Identification (SSI) with no dependencies on other onboard systems. SHERIF can employ several techniques to perform robust 3D keypoint extraction and Point Cloud registration (PCR) on disparate LiDAR scans of a planetary surface to generate a DEM which evolves over the course of a trajectory. The framework also supports a variety of Hazard Detection and Safe Site Identification algorithms which can be applied to the evolving DEM being produced. SHERIF features a robust and modular construction, allowing the user a high degree of flexibility in selecting and implementing whichever keypoint identificaiton, PCR and HD/SSI algorithms they may prefer, while maintaining the data products and sensor independence of the core SHERIF framework. SHERIF was recently evaluated via simulation and hardware-in-the-loop experimental testing at NASA Johnson Space Center.

hazard detection↗

Two-stage Framework for a Topology-Based Projection and Visualization of Classified Document Collections

During the last decades, electronic textual information has become the world's largest and most important information source available. People have added a variety of daily newspapers, books, scientific and governmental publications, blogs and private messages to this wellspring of endless information and knowledge. Since neither the existing nor the new information can be read in its entirety, computers are used to extract and visualize meaningful or interesting topics and documents from this huge information clutter. In this paper, we extend, improve and combine existing individual approaches into an overall framework that supports topological analysis of high dimensional document point clouds given by the well-known tf-idf document-term weighting method. We show that traditional distance-based approaches fail in very high dimensional spaces, and we describe an improved two-stage method for topology-based projections from the original high dimensional information space to both two dimensional (2-D) and three dimensional (3-D) visualizations. To show the accuracy and usability of this framework, we compare it to methods introduced recently and apply it to complex document and patent collections.

97 MATHEMATICS AND COMPUTING↗

Small-Footprint Lidar Estimations of Sagebrush Canopy Characteristics

Separating lidar returns for use in determining canopy height and shape in low-height vegetation is difficult because the vegetation canopy return is often close to the ground return in time and space. In addition, height underestimation is likely exacerbated in sparsely vegetated shrub ecosystems. This study compares lidar point-cloud data to sagebrush canopy characteristics measured in the field. It was determined that cumulative prediction error could account for as much as 35.6% of the average height and 37.4% of the average canopy area of shrubs sampled. When scaling from the individual shrub scale to coarser scales, prediction error averaged over a number of shrubs decreases as observation numbers increase. High density (in this case an average of 9.46 returns per m2), small footprint lidar (in this case a footprint diameter of 18 cm at nadir) may provide sufficient accuracy for characterizing sagebrush structure and cover and estimating biomass across landscapes.

54 ENVIRONMENTAL SCIENCES↗

Linking Advanced Visualization and MATLAB for the Analysis of 3D Gene Expression Data

Three-dimensional gene expression PointCloud data generated by the Berkeley Drosophila Transcription Network Project (BDTNP) provides quantitative information about the spatial and temporal expression of genes in early Drosophila embryos at cellular resolution. The BDTNP team visualizes and analyzes Point-Cloud data using the software application PointCloudXplore (PCX). To maximize the impact of novel, complex data sets, such as PointClouds, the data needs to be accessible to biologists and comprehensible to developers of analysis functions. We address this challenge by linking PCX and Matlab via a dedicated interface, thereby providing biologists seamless access to advanced data analysis functions and giving bioinformatics researchers the opportunity to integrate their analysis directly into the visualization application. To demonstrate the usefulness of this approach, we computationally model parts of the expression pattern of the gene even skipped using a genetic algorithm implemented in Matlab and integrated into PCX via our Matlab interface.

59 BASIC BIOLOGICAL SCIENCES↗

Characterization and classification of vegetation canopy structure and distribution within the Great Smoky Mountains National Park using LiDAR

Vegetation canopy structure is a critically important habit characteristic for many threatened and endangered birds and other animal species, and it is key information needed by forest and wildlife managers for monitoring and managing forest resources, conservation planning and fostering biodiversity. Advances in Light Detection and Ranging (LiDAR) technologies have enabled remote sensing-based studies of vegetation canopies by capturing three-dimensional structures, yielding information not available in two-dimensional images of the landscape pro- vided by traditional multi-spectral remote sensing platforms. However, the large volume data sets produced by airborne LiDAR instruments pose a significant computational challenge, requiring algorithms to identify and analyze patterns of interest buried within LiDAR point clouds in a computationally efficient manner, utilizing state-of-art computing infrastructure. We developed and applied a computationally efficient approach to analyze a large volume of LiDAR data and to characterize and map the vegetation canopy structures for 139,859 hectares (540 sq. miles) in the Great Smoky Mountains National Park. This study helps improve our understanding of the distribution of vegetation and animal habitats in this extremely diverse ecosystem.

Clustering↗

SWinzip v. 1.0

SWinzip is a Matlab and C++ library for scientific lossy data compression and reconstruction using compressed sensing and tree-wavelets transforms. These methods are known for their large compression and usefulness in data analytics such as features extraction. Compressed sensing and wavelets methods rely heavily on sparse and dense linear algebra operations implemented through the Boost codes in our library. SWinzip accommodates data represented on both regular grids (e.g. image data) and point-clouds (e.g. unstructured meshes).

Salloum, Maher↗

Crop Stem Width Estimation in Highly Cluttered Field Environment

We present two methods for estimation of crop stem width on small mobile robots. Stem width is an important phenotype needed by breeders and plant-biologists to measure plant growth, however, its manual measurement is cumbersome, in-accurate, and inefficient. The presented methods use a common image processing core that is designed to extract the foreground in the presence of significant leaf and stem clutter, view of other rows, and varying lighting, from a side-facing USB camera mounted on a small mobile robot. Using the extracted foreground, one approach uses estimates of robot velocity from wheel encoders and dense optical flow to estimate depth, while the other employs filtering of the LIDAR 2-D point cloud to estimate the depth. Both methods have been exhaustively validated against available hand-measurements on biomass sorghum (Sorghum bicolor) in real experimental fields. Experiments indicate that both methods are also applicable to other crops with cylindrical stems without significant modifications. The width estimation match on sorghum is 92.5% (using vision) and 98.2% (using vision and LIDAR) when compared against manual measurements by trained agronomists. Thus, our results clearly establish the feasibility of using small robots for stem-width estimation in realistic field settings. Furthermore, the techniques presented here can be utilized for automating other phenotypic measurements.

Choudhuri, Anwesa↗

GMLS-Nets: Scientific Machine Learning Methods for Unstructured Data

Data fields sampled on irregularly spaced points arise in many applications in the sciences and engineering. For regular grids, Convolutional Neural Networks (CNNs) have been successfully used to gaining benefits from weight sharing and invariances. We generalize CNNs by introducing methods for data on unstructured point clouds based on Generalized Moving Least Squares (GMLS). GMLS is a nonparametric technique for estimating linear bounded functionals from scattered data, and has recently been used in the literature for solving partial differential equations. By parameterizing the GMLS estimator, we obtain learning methods for operators with unstructured stencils. In GMLS-Nets the necessary calculations are local, readily parallelizable, and the estimator is supported by a rigorous approximation theory. We show how the framework may be used for unstructured physical data sets to perform functional regression to identify associated differential operators and to regress quantities of interest. The results suggest the architectures to be an attractive foundation for data-driven model development in scientific machine learning applications

97 MATHEMATICS AND COMPUTING↗