Mixing characteristics of a West Coast stratocumulus cloud deck as inferred from cloud top lidar observations and boundary layer saturation point analysis
Explore the source record for details and available documents.
Boers, R.↗
SEARCH · Search NASA
Results for “point cloud analysis”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Easy, Scalable Subsetting of GEDI Point Clouds
The GEDI Subsetter, a Python tool developed for NASA’s Multi-mission Algorithm and Analysis Platform (MAAP), optimizes the accessibility and visualization of GEDI point clouds by enabling users to efficiently subset data in a convenient, scalable manner. Complex science data often requires users to learn new software skills and handle many large files. Handling and cleaning large data sets is tedious and error-prone. These challenges significantly impede analysis. One of the goals of NASA's MAAP is to provide a platform that lowers the barrier to conducting research and analysis at scale. When a group of MAAP users wanted to conduct above-ground biomass estimation using GEDI data, we found that their existing workflow for leveraging GEDI data suffered from the barriers mentioned above. Furthermore, their workflow did not scale easily beyond a small number of granules. We found that existing tools related to GEDI data retrieval and subsetting were too limiting, so the GEDI Subsetter was written to support MAAP users’ needs. Being able to run many subsetting jobs simultaneously in the MAAP, and parallelizing the code itself, has led to significant speed improvements in obtaining relevant data, reducing subsetting time from hours to minutes. MAAP users can now more quickly and easily obtain only the data relevant to their research, by choosing which GEDI collection they want to work with (L1A, L2A, L2B, or L4A), and how they want to subset it, by specifying an area of interest, a temporal range, and relevant attributes. This has significantly reduced the feedback loop for users, allowing them to much more quickly subset GEDI data and begin their analysis. Although the GEDI Subsetter originally targeted users of the MAAP, it is generalized such that it can also be used outside of the MAAP and includes a command-line interface for convenience. Furthermore, with minor modifications, it should be possible to use it with non-GEDI data as the general pattern should be applicable to other sparse/track-based sensors.
Charles Daniels↗
Cultivating an Emergent Earth Observation Analytics Ecosystem in the Cloud
A diverse set of data analytics systems for Earth Observations are sprouting up in the Earth Science community, with a wealth of processing algorithms and analysis methods. There is a similar wealth of data resources available via myriad data providers and clearinghouses, including large institutional systems like the Earth Observing System Data and Information System, Comprehensive Large Scale Array-data Stewardship System, and Federated Earth Observation Missions gateway. With Earth system science driving a need to work with more datasets together, and the community developing more analysis tools (some of them dataset-specific), how can we develop analysis workflows that incorporate far-flung datasets and leverage analysis resources from multiple organizations? Cloud computing points the way toward a solution in two different respects. Firstly, the access to and abstraction of virtually unlimited storage and computing power provides an environment that enables more straightforward means of pulling datasets and analysis resources together. Just as importantly, however, cloud computing serves as an example of an "ecosystem" of interoperating services, since the essence of cloud computing is the presentation of all resources as a service, from hardware to infrastructure to platform to software. This enables the combination of off-the-shelf, diverse services to construct entire systems that emerge out of an equally diverse community of architects and developers. This approach can be similarly applied to the data and analysis resources in the Earth Observation community. By exposing these resources via well understood services, and consuming resources in the same way, different organizations can construct bespoke analysis workflows and systems for their own purposes. The key leap the community needs to make is to develop analysis systems in components that interact with other components via services. The result would be a rich ecosystem of analytics components that can be combined to analyze datasets at scale and in conjunction with other datasets from other sources.
chaos↗
ICESAT Laser Altimeter Pointing, Ranging and Timing Calibration from Integrated Residual Analysis
On January 12, 2003 the Ice, Cloud and land Elevation Satellite (ICESat) was successfully placed into orbit. The ICESat mission carries the Geoscience Laser Altimeter System (GLAS), which has a primary measurement of short-pulse laser- ranging to the Earth s surface at 1064nm wavelength at a rate of 40 pulses per second. The instrument has collected precise elevation measurements of the ice sheets, sea ice roughness and thickness, ocean and land surface elevations and surface reflectivity. The accurate geolocation of GLAS s surface returns, the spots from which the laser energy reflects on the Earth s surface, is a critical issue in the scientific application of these data. Pointing, ranging, timing and orbit errors must be compensated to accurately geolocate the laser altimeter surface returns. Towards this end, the laser range observations can be fully exploited in an integrated residual analysis to accurately calibrate these geolocation/instrument parameters. ICESat laser altimeter data have been simultaneously processed as direct altimetry from ocean sweeps along with dynamic crossovers in order to calibrate pointing, ranging and timing. The calibration methodology and current calibration results are discussed along with future efforts.
Luthcke, Scott B.↗
Magnetospheric multiprobes: Investigations and instrumentation
The multiprobe scientific objectives are to: (1) determine the spatial structure of plasma phenomena such as the aurora, convection reversals, and ion troughs; (2) separate spatial and temporal variations in these phenomena; (3) determine field aligned current densities; (4) perform multiple point analysis of particle beams, wave fields, and plasma clouds that are injected into the ionosphere and magnetosphere by Spacelab active experiment facilities. Trade studies described include: instrument accommodations, power, attitude determination, electric field antennas, storage and ejection, thermal control, tracking communications, command and data management, payload and mission specialist support, functional objectives, and orbital analysis.
Burch, J. L.↗
Variation of cloud emissivity in the infrared.
The spectral radiative properties of solid and liquid H2O particles in the thermal infrared are examined. The study of these properties is aimed at an explanation of the spectral features associated with certain clouds pointed out by Hanel et al. (1972) in an analysis of the results of the Nimbus 4 infrared spectroscopy experiment.
Curran, R. J.↗
Pattern recognition of clouds and ice in polar regions
The study is based on AVHRR imagery and results from Landsat high-spatial-resolution scenes. Among the textual features investigated are the gray level difference vector (GLDV), and sum and difference histogram (SADH) approaches as well as gray level run length, spatial-coherence, and spectral-histogram measures. The traditional stepwise discriminant analysis and neural-network analysis are used for the identification of 20 Arctic surface and cloud classes. A principal-component analysis and hybrid architecture employing a modularized competitive learning layer are utilized. It is pointed out that the cloud-classification accuracy comparable to that of back-propagation could be achieved with a training time two orders of magnitude faster.
Welch, R. M.↗
ICESat Laser Altimeter Pointing, Ranging and Timing Calibration from Integrated Residual Analysis: A Summary of Early Mission Results
On January 12, 2003 the Ice, Cloud and land Elevation Satellite (ICESat) was successfully placed into orbit. The ICESat mission carries the Geoscience Laser Altimeter System (GLAS), which consists of three near-infrared lasers that operate at 40 short pulses per second. The instrument has collected precise elevation measurements of the ice sheets, sea ice roughness and thickness, ocean and land surface elevations and surface reflectivity. The accurate geolocation of GLAS's surface returns, the spots from which the laser energy reflects on the Earth's surface, is a critical issue in the scientific application of these data Pointing, ranging, timing and orbit errors must be compensated to accurately geolocate the laser altimeter surface returns. Towards this end, the laser range observations can be fully exploited in an integrated residual analysis to accurately calibrate these geolocation/instrument parameters. Early mission ICESat data have been simultaneously processed as direct altimetry from ocean sweeps along with dynamic crossovers resulting in a preliminary calibration of laser pointing, ranging and timing. The calibration methodology and early mission analysis results are summarized in this paper along with future calibration activities.
Scott B Luthcke↗
Sampling analysis for the Earth Radiation Budget Satellite System mission based on orbital coverage and cloud variability
It is pointed out that accurate computation of the earth's radiation budget from satellite measurements requires spatial and temporal sampling which accounts for variations in cloud and surface conditions. It is in this connection important that cloud radiative properties and areal cloud cover be accurately determined for the desired time period. The reported investigation represents an extension of a study by Harrison et al. (1976). The time and space coverage capabilities of various sampling schemes are analyzed for the proposed Earth Radiation Budget Satellite System. The effects of cloud cover variability on the measured monthly mean reflected shortwave (0.2-5.0 micrometers) irradiance are also analyzed for several spatial scales.
Harrison, E. F.↗
Star formation via the phase transition of an adiabatic gas
An analytic model based on a second-order accurate global virial analysis is used to describe two stable equilibrium states for rotating gas clouds: a pressure-supported, diffuse state and a rotationally supported, compact state. Diffuse and compact equilibrium sequences are identified along which slow, secular evolution of a gas cloud can occur. A virial analysis provides analytic expressions for the limiting masses of gas clouds at points of dynamical instability. The minimum mass below which external triggers of any amplitude cannot effectively induce star formation is identified for adiabatic gas clouds. It is suggested that fluctuations in the ISM of some galaxies may actually cause star formation to proceed primarily via a phase transition, rather than via the classical Jeans instability.
Tohline, Joel E.↗
Saturation point representation of cloud-top entrainment instability
Cloud-top entrainment instability was investigated using a mixing line analysis. Mixing time scales are closely related to the actual size of the parcel, so that local instabilities are largely dependent on the scales of mixing near the cloud top. Given a fixed transport velocity, variation over a small range of parcel length scales (parcel mixing velocities) turns an energy-producing mixing process into an energy-consuming mixing process. It is suggested that a single criterion for cloud-top entrainment instability will not be found due to the role of at least three factors operating more or less independently; the stability of the mixing line, the entrainment speed, and the strength of the internal boundary-layer circulation.
Boers, Reinout↗
Integration of the Total Lightning Jump Algorithm into Current Operational Warning Environment Conceptual Models
Key points this analysis will address: 1) What physically is going on in the cloud when there is a jump in lightning? -- Updraft variations, Ice fluxes 2) How do these processes fit in with severe storm conceptual models? 3) What would this information provide an end user? --Relate LJA to radar observations, like changes in reflectivity, MESH, VIL, etc. based multi -Doppler derived physical relationships
Schultz, Chris↗
Cross-Calibration of GNC and OLA LIDAR Systems Onboard OSIRIS-REx
The Origins, Spectral Interpretation, Resource Identification, and Security–Regolith Explorer (OSIRIS-REx) mission carried two distinct light detection and ranging (LIDAR) systems: A scanning LIDAR called OSIRIS-REx Laser Altimeter (OLA) as part of the science payload, and a flash LIDAR system has part of the Guidance, Navigation, & Control (GNC) subsystem to serve as a navigation sensor during TAG. This presents a unique opportunity to compare the performance of the two LIDAR systems in close proximity to a small asteroid body. During the Orbital B mission phase, between June to August 2019, the OSIRIS-REx spacecraft orbited Bennu in a near-circular terminator orbit during which the altitude above the surface varied between 645 m to 740 m. Over five-week period observations were recorded with the OLA instrument that were subsequently used to construct a global digital terrain map (DTM) with a resolution of 5 cm and accuracy of ±20 cm. This model provides an excellent reference for assessing the performance of the GNC LIDAR system. Two different GNC LIDAR checkout activities were also conducted during the Orbital B phase: A limb-crossing check-out featured a series of slews to collect GNC LIDAR data across varying ranges and phase angles and operate the automatic gain control modes of the device; An OLA-GNC LIDAR cross calibration was designed to collect data from both the OLA and GNC LIDAR devices with overlapping footprints while the spacecraft was pointed nadir. This paper compares the on-orbit performance observed during the cross-calibration activity. The OLA-based global DTM and point clouds are used to evaluate the GNC LIDAR not available during previous analysis. The GNC LIDAR measurements were found to be well within accuracy and precision specified for the instrument, but much noisier than the measurements from OLA within this operating regime.
Jason M Leonard↗
Algorithm for Detection of Ground and Canopy Cover in Micropulse Photon-Counting Lidar Altimeter Data in Preparation for the ICESat-2 Mission
NASA's Ice, Cloud and Land Elevation Satellite-II (ICESat-2) mission is a decadal survey mission (2016 launch). The mission objectives are to measure land ice elevation, sea ice freeboard, and changes in these variables, as well as to collect measurements over vegetation to facilitate canopy height determination. Two innovative components will characterize the ICESat-2 lidar: 1) collection of elevation data by a multibeam system and 2) application of micropulse lidar (photon-counting) technology. A photon-counting altimeter yields clouds of discrete points, resulting from returns of individual photons, and hence new data analysis techniques are required for elevation determination and association of the returned points to reflectors of interest. The objective of this paper is to derive an algorithm that allows detection of ground under dense canopy and identification of ground and canopy levels in simulated ICESat-2 data, based on airborne observations with a Sigma Space micropulse lidar. The mathematical algorithm uses spatial statistical and discrete mathematical concepts, including radial basis functions, density measures, geometrical anisotropy, eigenvectors, and geostatistical classification parameters and hyperparameters. Validation shows that ground and canopy elevation, and hence canopy height, can be expected to be observable with high accuracy by ICESat-2 for all expected beam energies considered for instrument design (93.01%-99.57% correctly selected points for a beam with expected return of 0.93 mean signals per shot (msp), and 72.85%-98.68% for 0.48 msp). The algorithm derived here is generally applicable for elevation determination from photoncounting lidar altimeter data collected over forested areas, land ice, sea ice, and land surfaces, as well as for cloud detection.
Algorithms↗
Unsupervised Change Detection for Space Habitats Using 3D Point Clouds
This work presents an algorithm for scene change detection from point clouds to enable autonomous robotic caretaking in future space habitats. Autonomous robotic systems will help maintain future deep-space habitats, such as the Gateway space station, which will be uncrewed for extended periods. Existing scene analysis software used on the International Space Station (ISS) relies on manually-labeled images for detecting changes. In contrast, the algorithm presented in this work uses raw, unlabeled point clouds as inputs. The algorithm first applies modified Expectation-Maximization Gaussian Mixture Model (GMM) clustering to two input point clouds. It then performs change detection by comparing the GMMs using the Earth Mover’s Distance. The algorithm is validated quantitatively and qualitatively using a test dataset collected by an Astrobee robot in the NASA Ames Granite Lab comprising single frame depth images taken directly by Astrobee and full-scene reconstructed maps built with RGB-D and pose data from Astrobee. The runtimes of the approach are also analyzed in depth. The source code is publicly released to promote further development.
robotics↗
Tuning the Performance of a Computational Persistent Homology Package
In recent years, persistent homology has become an attractive method for data analysis. It captures topological features, such as connected components, holes, and voids from point cloud data and summarizes the way in which these features appear and disappear in a filtration sequence. In this project, we focus on improving the performanceof Eirene, a computational package for persistent homology. Eirene is a 5000-line open-source software library implemented in the dynamic programming language Julia. We use the Julia profiling tools to identify performance bottlenecks and develop novel methods to manage them, including the parallelization of some time-consuming functions on multicore/manycore hardware. Empirical results show that performance can be greatly improved.
Persistent Homology↗
An Algorithm for Detection of Ground and Canopy Cover in Micropulse Photon-Counting Lidar Altimeter Data in Preparation of the ICESat-2 Mission
The Ice, Cloud and Land Elevation Satellite-II (ICESat-2) mission has been selected by NASA as a Decadal Survey mission, to be launched in 2016. Mission objectives are to measure land ice elevation, sea ice freeboard/ thickness and changes in these variables and to collect measurements over vegetation that will facilitate determination of canopy height, with an accuracy that will allow prediction of future environmental changes and estimation of sea-level rise. The importance of the ICESat-2 project in estimation of biomass and carbon levels has increased substantially, following the recent cancellation of all other planned NASA missions with vegetation-surveying lidars. Two innovative components will characterize the ICESat-2 lidar: (1) Collection of elevation data by a multi-beam system and (2) application of micropulse lidar (photon counting) technology. A micropulse photon-counting altimeter yields clouds of discrete points, which result from returns of individual photons, and hence new data analysis techniques are required for elevation determination and association of returned points to reflectors of interest including canopy and ground in forested areas. The objective of this paper is to derive and validate an algorithm that allows detection of ground under dense canopy and identification of ground and canopy levels in simulated ICESat-2-type data. Data are based on airborne observations with a Sigma Space micropulse lidar and vary with respect to signal strength, noise levels, photon sampling options and other properties. A mathematical algorithm is developed, using spatial statistical and discrete mathematical concepts, including radial basis functions, density measures, geometrical anisotropy, eigenvectors and geostatistical classification parameters and hyperparameters. Validation shows that the algorithm works very well and that ground and canopy elevation, and hence canopy height, can be expected to be observable with a high accuracy during the ICESat-2 mission. A result relevant for instrument design is that even the two weaker beam classes considered can be expected to yield useful results for vegetation measurements (93.01-99.57% correctly selected points for a beam with expected return of 0.93 mean signals per shot (msp9) and 72.85% - 98.68% for 0.48 msp (msp4)). Resampling options affect results more than noise levels. The algorithm derived here is generally applicable for analysis of micropulse lidar altimeter data collected over forested areas as well as other surfaces, including land ice, sea ice and land surfaces.
Herzfeld, Ute C.↗
Performance Enhancement of a Computational Persistent Homology Package
In recent years, persistent homology has become an attractive method for data analysis. It captures topological features, such as connected components, holes, voids, etc., from a point cloud by finding out when these features appear and disappear in the filtration sequence. In this project, we focus on improving the performance of Eirene, a fancy computational persistent homology package. Eirene is a 5000-line opensource software implemented by using the dynamic programming language Julia. We use the Julia profiling tools to identify the performance bottlenecks and develop different methods to manage the bottlenecks, including the parallelization of some time-consuming functions on the multicore/manycore hardware. The empirical results show that the performance can be greatly improved.
Profiling↗