Compressing massive geophysical data sets using vector quantization
This talk discusses a method for creating low-volume versions of massive geophysical data sets that approximately retain high-resolution data structure.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This talk discusses a method for creating low-volume versions of massive geophysical data sets that approximately retain high-resolution data structure.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
We are in the early stages of work on EPA task to investigate the effects of fires on air quality in North America, led by Jennifer Logan of Harvard University. JPL's contribution to this study is to find thousands of smoke plumes in satellite images of North America, and derive statistics about their geographic distribution, extent, orientation, and injection height.
Explore the source record for details and available documents.
Support Vector Machines (SVMs) are a type of supervised learning algorith,, other examples of which are Artificial Neural Networks (ANNs), Decision Trees, and Naive Bayesian Classifiers. Supervised learning algorithms are used to classify objects labled by a 'supervisor' - typically a human 'expert.'.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Techniques for passive remote sensing of aerosol optical and microphysical properties from space include visible, near and shortwave-infrared imaging (e.g., from MODIS), multiangle intensity imaging (e.g., ATSR-2, AATSR, MISR), near-ultraviolet mapping (e.g., TOMSIOMI), and polarimetry (e.g., POLDER, APS). Each of these methods has unique strengths. In this paper, we present a concept for integrating these approaches into a unified sensor. Design goals include spectral coverage from the near-UV to the shortwave infrared; intensity and polarimetric imaging simultaneously at multiple view angles; global coverage within a few days; kilometer to sub-kilometer spatial resolution; and measurement of the degree of linear polarization (DOLP) for a subset of the spectral complement with an uncertainty of 0.5% or less.
The MISR instrument consists of nine pushbroom cameras which measure radiance in four spectral bands. Global coverage is achieved in nine days. The cameras are arranged with one camera pointing toward the nadir, four cameras pointing forward and four cameras pointing aftward. It takes 7 minutes for all nine cameras to view the same surface location. The view angles relative to the surface reference ellipsoid, are 0, 26.1, 45.6, 60.0, and 70.5 degrees. The spectral band shapes are nominally gaussian, centered at 443, 555, 670, and 865 nm. The Terrain data are re-projected to the terrain altitude. In this product, surface data from all cameras will appear in the same geographic location. Thus, this product is the primary input to Level 2 aerosol/surface processing, which requires co-registration of the L1B2 imagery at the surface. Clouds will still be displaced due to their elevation above the surface, but this time with respect to the terrain rather than the ellipsoid. (The mountain location T is now assigned the geographic location at T, and the Cloud at F appears at the geographic location T.) In Level 2 aerosol/surface processing, algorithms are applied to screen out the clouds. Terrain data only exist for MISR blocks containing some land. [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=563.2 km (cross-track); Longitude_Resolution=140.8 km (along-track).; Temporal_Resolution=about 15 orbits/day; Temporal_Resolution_Range=about 15 orbits/day].
The CGM dataset is used to describe pointing geometry of the nine MISR cameras. It consists of a set of parameters used in a mathematical expression that gives the pointing direction of an arbitrary pixel in the spacecraft attitude frame of reference. These parameters represent the geometry of the camera system and account for distortions from an ideal optical system..
In addition to the Level 1B2 Global Mode imagery, MISR can be configured to disable the on-board data averaging and provide high resolution images in all 36 channels for selected targets and observation times. This capability is referred to as Local Mode (LM). [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=275 m x 360 km (cross-track); Longitude_Resolution=275 m x 300 km (along-track)].
In addition to the Level 1B2 Global Mode imagery, MISR can be configured to disable the on-board data averaging and provide high resolution images in all 36 channels for selected targets and observation times. This capability is referred to as Local Mode (LM). [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=275 m x 360 km (cross-track); Longitude_Resolution=275 m x 300 km (along-track)].
The results of two types of processing are included in this product. First, the Radiance Scaling operation converts the camera's digital number output to a measure of energy incident on the front optical surface. The measurement is expressed in units called radiance (energy per unit area, wavelength, and solid angle) as defined by the International Standard (SI). Second, Radiance Conditioning modifies the radiances to remove instrument-dependent effects. Specifically, image sharpening is applied, and focal-plane scattering is removed. Additionally, all radiances are adjusted to remove slight spectral sensitivity differences among the 1504 detector elements of each spectral band and each camera. The Radiometric Product contains spectral radiances for all MISR channels (four spectral bands and nine cameras). Each radiance value represents the incident radiance averaged over the sensor's total band response. Processing includes both radiance scaling and conditioning steps. Radiance scaling converts the Level 1A data from digital counts to radiances using coefficients derived in combination with the On-Board Calibrator (OBC) and vicarious calibrations. The OBC contains Spectralon calibration panels which are deployed monthly and reflect sunlight into the cameras. The OBC detector standards then measure this reflected light to provide the calibration. Vicarious field campaigns are conducted less frequently but provide an independent methodology useful for reducing systematic errors. Radiance conditioning removes undesirable instrument effects. Image enhancement is provided by deconvolving the scene with the sensor's point-spread-function. Additionally, in-band scaling adjusts the reported radiances to correspond to a nominal band response profile. This frees the Level 2 software from the need to correct for detector element non-uniformities. No out-of-band correction is done for this product, nor are the data geometrically corrected or resampled at this point. In summary, the Level 1B1 Product contains the Data Numbers (DNs) radiometrically-scaled to radiances with no geometric resampling. [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1.1 km; Longitude_Resolution=1.1 km; Temporal_Resolution=about 15 orbits/day; Temporal_Resolution_Range=about 15 orbits/day].
The results of two types of processing are included in this product. First, the Radiance Scaling operation converts the camera's digital number output to a measure of energy incident on the front optical surface. The measurement is expressed in units called radiance (energy per unit area, wavelength, and solid angle) as defined by the International Standard (SI). Second, Radiance Conditioning modifies the radiances to remove instrument-dependent effects. Specifically, image sharpening is applied, and focal-plane scattering is removed. Additionally, all radiances are adjusted to remove slight spectral sensitivity differences among the 1504 detector elements of each spectral band and each camera. In addition to the Level 1B1 radiometric product for MISR's Global Mode imagery, there is a separate Level 1B1 product for each high-resolution Local Mode scene. The Radiometric Product contains spectral radiances for all MISR channels (four spectral bands and nine cameras). Each radiance value represents the incident radiance averaged over the sensor's total band response. Processing includes both radiance scaling and conditioning steps. Radiance scaling converts the Level 1A data from digital counts to radiances using coefficients derived in combination with the On-Board Calibrator (OBC) and vicarious calibrations. The OBC contains Spectralon calibration panels which are deployed monthly and reflect sunlight into the cameras. The OBC detector standards then measure this reflected light to provide the calibration. Vicarious field campaigns are conducted less frequently but provide an independent methodology useful for reducing systematic errors. Radiance conditioning removes undesirable instrument effects. Image enhancement is provided by deconvolving the scene with the sensor's point-spread-function. Additionally, in-band scaling adjusts the reported radiances to correspond to a nominal band response profile. This frees the Level 2 software from the need to correct for detector element non-uniformities. No out-of-band correction is done for this product, nor are the data geometrically corrected or resampled at this point. In summary, the Level 1B1 Product contains the Data Numbers (DNs) radiometrically-scaled to radiances with no geometric resampling. [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=275 m for red band only; Longitude_Resolution=275 m for red band only; Temporal_Resolution=about 15 orbits/day].
The TOA/Cloud Albedo data contain albedo values, including finely-sampled or local (2.2 km) TOA albedos registered to the RLRA, and two coarsely-sampled (35.2 km resolution) TOA albedos projected to 30-km altitude. The local (2.2 km) albedos do not take the obscuration of cloud features into account, so they should only be treated as traditional albedos when the number of obscured pixels is low. The restrictive and expansive albedos are both available at 35.2 km resolution: the restrictive albedos are only calculated using the radiation upwelling from the pixel under consideration, whereas the expansive albedos use all the radiation emanating from the surrounding area. Therefore, the expansive albedo is closer to the traditional definition of top-of-atmosphere albedos. [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1.1 km; Longitude_Resolution=1.1 km; Temporal_Resolution=about 15 orbits/day].
The MISR Top-of-Atmosphere (TOA)/Cloud Stereo geophysical parameters include stereoscopically-derived cloud motion vectors (winds), cloud-top heights, and an accompanying cloud mask. The Stereo product geophysical parameters include a stereoscopically-derived cloud mask and cloud height on a 1.1 km grid. It also includes cloud motion vectors on a 70.4 km grid. The three types of stereo heights are: the BestWind heights are only calculated for those regions where the associated wind vectors passed the quality tests. Therefore, they have sparse coverage but since the wind correction is included, these contain our 'best guess' as to what the true heights are. The WithoutWind heights are calculated assuming a constant wind vector of zero. They have almost complete coverage and therefore form a nice 'pretty picture' of the relative cloud heights over small areas. The RawWind heights are a diagnostic product as they are calculated using all available wind vectors (even the bad ones). It is therefore recommended that one only use the Best and Without wind products. It is important to remember that the stereo matchers pick up the layer of maximum contrast, which is not necessarily the same as the highest cloud so all the stereo heights are keyed to this level of maximum contrast. Therefore, higher and thinner cirrus layers may not be detected by any of the height fields. [Temporal_Coverage: Start_Date=2000-02-24; Stop_Date=] [Spatial_Coverage: Southernmost_Latitude=-90; Northernmost_Latitude=90; Westernmost_Longitude=-180; Easternmost_Longitude=180] [Data_Resolution: Latitude_Resolution=1.1 km; Longitude_Resolution=1.1 km; Temporal_Resolution=about 15 orbits/day].