Visual data mining for quantized, spatial data
Explore the source record for details and available documents.
quantized data mining MISR↗
SEARCH · Search NASA
Results for “spatial data mining”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Visual data mining for quantized spatial data
In previous papers we've shown how a well known data compression algorithm called Entropy-constrained Vector Quantization ( can be modified to reduce the size and complexity of very large, satellite data sets. In this paper, we descuss how to visualize and understand the content of such reduced data sets.
cluster analysis↗
Data Fusion and Mining Techniques to Map Water Use and Drought across Spatial and Temporal Scales
As the world’s water resources come under increasing tension due to dual stressors of climate change and population growth, accurate knowledge of water consumption through evapotranspiration (ET) over a range in spatial scales will be critical in developing adaptation strategies. Remote sensing methods for monitoring consumptive water use (e.g, ET) are becoming increasingly important, especially in areas of significant water and food insecurity. One method to estimate ET from satellite-based methods, the Atmosphere Land Exchange Inverse (ALEXI) model uses the change in mid-morning land surface temperature to estimate the partitioning of sensible and latent heat fluxes which are then used to estimate daily ET. This presentation will outline several recent enhancements to the ALEXI modeling system, with a focus on global ET and drought monitoring. Until recently, ALEXI has been limited to areas with high resolution temporal sampling of geostationary sensors. The use of geostationary sensors makes global mapping a complicated process, especially for real-time applications, as data from as many as five different sensors are required to be ingested and harmonized to create a global mosaic. However, our research team has developed a new and novel method of using twice-daily observations from polar-orbiting sensors such as MODIS and VIIRS to estimate the mid-morning rise in LST that is used to drive the energy balance estimations within ALEXI. This allows the method to be applied globally using a single sensor (in this case, initially MODIS with a planned transition to VIIRS) rather than a global compositing of all available geostationary data. Other advantages of this new method include the higher spatial resolution provided by MODIS and VIIRS and the increased sampling at high latitudes where oblique view angles limit the utility of geostationary sensors. This presentation will focus on global applications for mapping water use and drought using data mining and data fusion across spatial scales extending from 5-km to 30-m “field-scale” estimates.
Christopher Hain↗
Anthropogenic Land-use Change and the Dynamics of Amazon Forest Biomass
This project was focused on assessing the effects of prevailing land uses, such as habitat fragmentation, selective logging, and fire, on biomass and carbon storage in Amazonian forests, and on the dynamics of carbon sequestration in regenerating forests. Ancillary goals included developing GIs models to help predict the future condition of Amazonian forests, and assessing the effects of anthropogenic climate change and ENS0 droughts on intact and fragmented forests. Ground-based studies using networks of permanent plots were linked with remote-sensing data (including Landsat TM and AVHRR) at regional scales, and higher-resolution techniques (IKONOS imagery, videography, LIDAR, aerial photographs) at landscape and local scales. The project s specific goals were quite eclectic and included: Determining the effects of habitat fragmentation on forest dynamics, floristic composition, and the various components of above- and below-ground biomass. Assessing historical and physical factors that affect trajectories of forest regeneration and carbon sequestration on abandoned lands. Extrapolating results from local studies of biomass dynamics in fragmented and regenerating forests to landscape and regional scales in Amazonia, using remote sensing and GIS. Testing the hypothesis that intact Amazonian forests are functioning as a significant carbon sink. Examining destructive synergisms between forest fragmentation and fire. Assessing the short-term impacts of selective logging on aboveground biomass. Developing GIS models that integrate current spatial data on forest cover, deforestation, logging, mining, highway and roads, navigable rivers, vulnerability to wild fires, protected areas, and existing and planned infrastructure projects, in an effort to predict the future condition of Brazilian Amazonian forests over the next 20-25 years. Devising predictive spatial models to assess the influence of varied biophysical and anthropogenic predictors on Amazonian deforestation.
Laurance, William F.↗
Potential utility of the thematic mapper for surface mine monitoring
One of many potential applications of the thematic mapper (TM) is surface mine monitoring. To assess this potential, data acquired by an aircraft multispectral scanner over Pennsylvania surface mines were preprocessed to simulate the anticipated spectral, spatial, and radiometric characteristics of TM data. False color imagery and thematic maps were derived from the simulated data and compared to imagery and maps derived from LANDSAT multispectral scanner subsystems data. On the basis of this comparison, TM data should definitely increase the detail and accuracy of remotely acquired surface mine information and may enable the remote determination of compliance with reclamation regulations.
Irons, J. R.↗
Fractals and Spatial Methods for Mining Remote Sensing Imagery
The rapid increase in digital remote sensing and GIS data raises a critical problem -- how can such an enormous amount of data be handled and analyzed so that useful information can be derived quickly? Efficient handling and analysis of large spatial data sets is central to environmental research, particularly in global change studies that employ time series. Advances in large-scale environmental monitoring and modeling require not only high-quality data, but also reliable tools to analyze the various types of data. A major difficulty facing geographers and environmental scientists in environmental assessment and monitoring is that spatial analytical tools are not easily accessible. Although many spatial techniques have been described recently in the literature, they are typically presented in an analytical form and are difficult to transform to a numerical algorithm. Moreover, these spatial techniques are not necessarily designed for remote sensing and GIS applications, and research must be conducted to examine their applicability and effectiveness in different types of environmental applications. This poses a chicken-and-egg problem: on one hand we need more research to examine the usability of the newer techniques and tools, yet on the other hand, this type of research is difficult to conduct if the tools to be explored are not accessible. Another problem that is fundamental to environmental research are issues related to spatial scale. The scale issue is especially acute in the context of global change studies because of the need to integrate remote-sensing and other spatial data that are collected at different scales and resolutions. Extrapolation of results across broad spatial scales remains the most difficult problem in global environmental research. There is a need for basic characterization of the effects of scale on image data, and the techniques used to measure these effects must be developed and implemented to allow for a multiple scale assessment of the data before any useful process-oriented modeling involving scale-dependent data can be conducted. Through the support of research grants from NASA, we have developed a software module called ICAMS (Image Characterization And Modeling System) to address the need to develop innovative spatial techniques and make them available to the broader scientific communities. ICAMS provides new spatial techniques, such as fractal analysis, geostatistical functions, and multiscale analysis that are not easily available in commercial GIS/image processing software. By bundling newer spatial methods in a user-friendly software module, researchers can begin to test and experiment with the new spatial analysis methods and they can gauge scale effects using a variety of remote sensing imagery. In the following, we describe briefly the development of ICAMS and present application examples.
Lam, Nina↗
Regression methods for spatial data
The kriging approach, a parametric regression method used by hydrologists and mining engineers, among others also provides an error estimate the integral of the regression function. The kriging method is explored and some of its statistical characteristics are described. The Watson method and theory are extended so that the kriging features are displayed. Theoretical and computational comparisons of the kriging and Watson approaches are offered.
Yakowitz, S. J.↗
Comparison of techniques for discriminating hydrothermal alteration minerals with Airborne Imaging Spectrometer data
Hydrothermal alteration mineralogy in the Tybo mining district of Nevada has been mapped on the basis of high spectral and spatial resolution Airborne Imaging Spectrometer (AIS) data, using band ratios, principal component analysis, and a signature-matching algorithm to delineate the alteration zones and limestone foundations. The signature-matching algorithm is found to be the most effective method of discriminating alteration minerals, and is noted to be able to identify mineralogy by matching AIS image spectra with library reference spectra. AIS bands in the 2048-2337-nm portion of the spectrum accounted for the greatest amount of variance.
Feldman, Sandra C.↗
Mineral mapping at Cuprite, Nevada with a 63-channel imaging spectrometer
Geophysical and Environmental Research Imaging Spectrometer (GERIS) 63-channel scanner data covering the spectral region 0.4 to 2.5 microns were analyzed for the Cuprite mining district, Esmeralda and Nye Counties, Nevada. Individual and spatially averaged spectra extracted from the GERIS data were used to identify the minerals alunite, kaolinite, buddingtonite, and hematite by their spectral characteristics. The images were classified in the spectral domain to produce color-coded image maps of mineral distribution that clearly show the zoned nature of the hydrothermal system. Comparison of the thematic mineral maps with existing geologic and alteration maps demonstrates the utility of imaging spectrometers for producing detailed maps for mineral exploration.
Kruse, F. A.↗
The utility of Thematic Mapper sensor characteristics for surface mine monitoring
The employment of Landsat Multispectral Scanner (MSS) data for surface coal mine inventory and inspection applications has been extensively investigated. However, in spite of encouraging research results, MSS data have not gained wide acceptance for surface mine monitoring operations. This situation is partly related to MSS spatial resolution (80 m), which is considered insufficient for detailed surface mine inspection. The Thematic Mapper (TM) employed on the Landsat-4 and 5 satellites provides an improved resolution (30 m) and other refinements which are expected to enhance the usefulness of TM data relative to MSS data. The present paper reports research which was conducted to assess the usefulness of actual TM data and to quantitatively evaluate the contribution of individual sensor characteristics to data utility for surface mine monitoring. The obtained results demonstrate that the TM spatial resolution can be of immediate benefit for certain applications such as surface mine monitoring.
Irons, J. R.↗
Application of a data-mining method based on Bayesian networks to lesion-deficit analysis
Although lesion-deficit analysis (LDA) has provided extensive information about structure-function associations in the human brain, LDA has suffered from the difficulties inherent to the analysis of spatial data, i.e., there are many more variables than subjects, and data may be difficult to model using standard distributions, such as the normal distribution. We herein describe a Bayesian method for LDA; this method is based on data-mining techniques that employ Bayesian networks to represent structure-function associations. These methods are computationally tractable, and can represent complex, nonlinear structure-function associations. When applied to the evaluation of data obtained from a study of the psychiatric sequelae of traumatic brain injury in children, this method generates a Bayesian network that demonstrates complex, nonlinear associations among lesions in the left caudate, right globus pallidus, right side of the corpus callosum, right caudate, and left thalamus, and subsequent development of attention-deficit hyperactivity disorder, confirming and extending our previous statistical analysis of these data. Furthermore, analysis of simulated data indicates that methods based on Bayesian networks may be more sensitive and specific for detecting associations among categorical variables than methods based on chi-square and Fisher exact statistics.
NASA Discipline Neuroscience↗
Enhanced Product Generation at NASA Data Centers Through Grid Technology
This paper describes how grid technology can support the ability of NASA data centers to provide customized data products. A combination of grid technology and commodity processors are proposed to provide the bandwidth necessary to perform customized processing of data, with customized data subsetting providing the initial example. This customized subsetting engine can be used to support a new type of subsetting, called phenomena-based subsetting, where data is subsetted based on its association with some phenomena, such as mesoscale convective systems or hurricanes. This concept is expanded to allow the phenomena to be detected in one type of data, with the subsetting requirements transmitted to the subsetting engine to subset a different type of data. The subsetting requirements are generated by a data mining system and transmitted to the subsetter in the form of an XML feature index that describes the spatial and temporal extent of the phenomena. For this work, a grid-based mining system called the Grid Miner is used to identify the phenomena and generate the feature index. This paper discusses the value of grid technology in facilitating the development of a high performance customized product processing and the coupling of a grid mining system to support phenomena-based subsetting.
Barkstrom, Bruce R.↗
The 1999 (Mw 7.1) Hector Mine, California, Earthquake: Near-Field Postseismic Deformation from ERS Interferometry
Interferometric synthetic aperture radar (InSAR) data over the area of the Hector Mine earthquake (Mw 7.1, 16 October 1999) reveal postseismic deformation of several centimeters over a spatial scale of 0.5 to 50 km. We analyzed seven SAR acquisitions to form interferograms over four time periods after the event. The main deformations seen in the line-of-sight (LOS) displacement maps are a region of subsidence (60 mm LOS increase) on the northern end of the fault, a region of uplift (45 mm LOS decrease) located to the northeast of the primary fault bend, and a linear trough running along the main rupture having a depth of up to 15 mm and a width of about 2 km. We correlate these features with a double left-bending, rightlateral, strike-slip fault that exhibits contraction on the restraining side and extension along the releasing side of the fault bends. The temporal variations in the near-fault postseismic deformation are consistent with a characteristic time scale of 135 + 42 or - 25 days, which is similar to the relaxation times following the 1992 Landers earthquake. High gradients in the LOS displacements occur on the fault trace, consistent with afterslip on the earthquake rupture. We derive an afterslip model by inverting the LOS data from both the ascending and descending orbits. Our model indicates that much of the afterslip occurs at depths of less than 3 to 4 km.
Jacobs, Allison↗
Efficient Implementation of an Optimal Interpolator for Large Spatial Data Sets
Scattered data interpolation is a problem of interest in numerous areas such as electronic imaging, smooth surface modeling, and computational geometry. Our motivation arises from applications in geology and mining, which often involve large scattered data sets and a demand for high accuracy. The method of choice is ordinary kriging. This is because it is a best unbiased estimator. Unfortunately, this interpolant is computationally very expensive to compute exactly. For n scattered data points, computing the value of a single interpolant involves solving a dense linear system of size roughly n x n. This is infeasible for large n. In practice, kriging is solved approximately by local approaches that are based on considering only a relatively small'number of points that lie close to the query point. There are many problems with this local approach, however. The first is that determining the proper neighborhood size is tricky, and is usually solved by ad hoc methods such as selecting a fixed number of nearest neighbors or all the points lying within a fixed radius. Such fixed neighborhood sizes may not work well for all query points, depending on local density of the point distribution. Local methods also suffer from the problem that the resulting interpolant is not continuous. Meyer showed that while kriging produces smooth continues surfaces, it has zero order continuity along its borders. Thus, at interface boundaries where the neighborhood changes, the interpolant behaves discontinuously. Therefore, it is important to consider and solve the global system for each interpolant. However, solving such large dense systems for each query point is impractical. Recently a more principled approach to approximating kriging has been proposed based on a technique called covariance tapering. The problems arise from the fact that the covariance functions that are used in kriging have global support. Our implementations combine, utilize, and enhance a number of different approaches that have been introduced in literature for solving large linear systems for interpolation of scattered data points. For very large systems, exact methods such as Gaussian elimination are impractical since they require 0(n(exp 3)) time and 0(n(exp 2)) storage. As Billings et al. suggested, we use an iterative approach. In particular, we use the SYMMLQ method, for solving the large but sparse ordinary kriging systems that result from tapering. The main technical issue that need to be overcome in our algorithmic solution is that the points' covariance matrix for kriging should be symmetric positive definite. The goal of tapering is to obtain a sparse approximate representation of the covariance matrix while maintaining its positive definiteness. Furrer et al. used tapering to obtain a sparse linear system of the form Ax = b, where A is the tapered symmetric positive definite covariance matrix. Thus, Cholesky factorization could be used to solve their linear systems. They implemented an efficient sparse Cholesky decomposition method. They also showed if these tapers are used for a limited class of covariance models, the solution of the system converges to the solution of the original system. Matrix A in the ordinary kriging system, while symmetric, is not positive definite. Thus, their approach is not applicable to the ordinary kriging system. Therefore, we use tapering only to obtain a sparse linear system. Then, we use SYMMLQ to solve the ordinary kriging system. We show that solving large kriging systems becomes practical via tapering and iterative methods, and results in lower estimation errors compared to traditional local approaches, and significant memory savings compared to the original global system. We also developed a more efficient variant of the sparse SYMMLQ method for large ordinary kriging systems. This approach adaptively finds the correct local neighborhood for each query point in the interpolation process.
Memarsadeghi, Nargess↗
The application of satellite data in monitoring strip mines
Strip mines in the New River Drainage Basin of Tennessee were studied through use of Landsat-1 imagery and aircraft photography. A multilevel analysis, involving conventional photo interpretation techniques, densitometric methods, multispectral analysis and statistical testing was applied to the data. The Landsat imagery proved adequate for monitoring large-scale change resulting from active mining and land-reclamation projects. However, the spatial resolution of the satellite imagery rendered it inadequate for assessment of many smaller strip mines, in the region which may be as small as a few hectares.
Sharber, L. A.↗
Mapping Weathering and Alteration Minerals in the Comstock and Geiger Grade Areas using Visible to Thermal Infrared Airborne Remote Sensing Data
To support research into both precious metal exploration and environmental site characterization a combination of high spatial/spectral resolution airborne visible, near infrared, short wave infrared (VNIR/SWIR) and thermal infrared (TIR) image data were acquired to remotely map hydrothermal alteration minerals around the Geiger Grade and Comstock alteration regions, and map the mineral by-products of weathered mine dumps in Virginia City. Remote sensing data from the Airborne Visible Infrared Imaging Spectrometer (AVIRIS), SpecTIR Corporation's airborne hyperspectral imager (HyperSpecTIR), the MODIS-ASTER airborne simulator (MASTER), and the Spatially Enhanced Broadband Array Spectrograph System (SEBASS) were acquired and processed into mineral maps based on the unique spectral signatures of image pixels. VNIR/SWIR and TIR field spectrometer data were collected for both calibration and validation of the remote data sets, and field sampling, laboratory spectral analyses and XRD analyses were made to corroborate the surface mineralogy identified by spectroscopy. The resulting mineral maps show the spatial distribution of several important alteration minerals around each study area including alunite, quartz, pyrophyllite, kaolinite, montmorillonite/muscovite, and chlorite. In the Comstock region the mineral maps show acid-sulfate alteration, widespread propylitic alteration and extensive faulting that offsets the acid-sulfate areas, in contrast to the larger, dominantly acid-sulfate alteration exposed along Geiger Grade. Also, different mineral zones within the intense acid-sulfate areas were mapped. In the Virginia City historic mining district the important weathering minerals mapped include hematite, goethite, jarosite and hydrous sulfate minerals (hexahydrite, alunogen and gypsum) located on mine dumps. Sulfate minerals indicate acidic water forming in the mine dump environment. While there is not an immediate threat to the community, there are clearly sources of acidic drainage that were identified remotely.
imaging spectroscopy↗
NASA Remote Sensing Data in Earth Sciences: Processing, Archiving, Distribution, Applications at the GES DISC
The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is one of the major Distributed Active Archive Centers (DAACs) archiving and distributing remote sensing data from the NASA's Earth Observing System. In addition to providing just data, the GES DISC/DAAC has developed various value-adding processing services. A particularly useful service is data processing a t the DISC (i.e., close to the input data) with the users' algorithms. This can take a number of different forms: as a configuration-managed algorithm within the main processing stream; as a stand-alone program next to the on-line data storage; as build-it-yourself code within the Near-Archive Data Mining (NADM) system; or as an on-the-fly analysis with simple algorithms embedded into the web-based tools (to avoid downloading unnecessary all the data). The existing data management infrastructure at the GES DISC supports a wide spectrum of options: from data subsetting data spatially and/or by parameter to sophisticated on-line analysis tools, producing economies of scale and rapid time-to-deploy. Shifting processing and data management burden from users to the GES DISC, allows scientists to concentrate on science, while the GES DISC handles the data management and data processing at a lower cost. Several examples of successful partnerships with scientists in the area of data processing and mining are presented.
Leptoukh, Gregory G.↗
Utilizing Skylab data in on-going resources management programs in the state of Ohio
The author has identified the following significant results. The use of Skylab imagery for total area woodland surveys was found to be more accurate and cheaper than conventional surveys using aerial photo-plot techniques. Machine-aided (primarily density slicing) analyses of Skylab 190A and 190B color and infrared color photography demonstrated the feasibility of using such data for differentiating major timber classes including pines, hardwoods, mixed, cut, and brushland providing such analyses are made at scales of 1:24,000 and larger. Manual and machine-assisted image analysis indicated that spectral and spatial capabilities of Skylab EREP photography are adequate to distinguish most parameters of current, coal surface mining concern associated with: (1) active mining, (2) orphan lands, (3) reclaimed lands, and (4) active reclamation. Excellent results were achieved when comparing Skylab and aerial photographic interpretations of detailed surface mining features. Skylab photographs when combined with other data bases (e.g., census, agricultural land productivity, and transportation networks), provide a comprehensive, meaningful, and integrated view of major elements involved in the urbanization/encroachment process.
Baldridge, P. E.↗