Search NASASearch

NASA NTRS · 20170003162

An Active Learning Framework for Hyperspectral Image Classification Using Hierarchical Segmentation

Abstract

Augmenting spectral data with spatial information for image classification has recently gained significant attention, as classification accuracy can often be improved by extracting spatial information from neighboring pixels. In this paper, we propose a new framework in which active learning (AL) and hierarchical segmentation (HSeg) are combined for spectral-spatial classification of hyperspectral images. The spatial information is extracted from a best segmentation obtained by pruning the HSeg tree using a new supervised strategy. The best segmentation is updated at each iteration of the AL process, thus taking advantage of informative labeled samples provided by the user. The proposed strategy incorporates spatial information in two ways: 1) concatenating the extracted spatial features and the original spectral features into a stacked vector and 2) extending the training set using a self-learning-based semi-supervised learning (SSL) approach. Finally, the two strategies are combined within an AL framework. The proposed framework is validated with two benchmark hyperspectral datasets. Higher classification accuracies are obtained by the proposed framework with respect to five other state-of-the-art spectral-spatial classification approaches. Moreover, the effectiveness of the proposed pruning strategy is also demonstrated relative to the approaches based on a fixed segmentation.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Zhang, Zhou, Pasolli, Edoardo, Crawford, Melba M., Tilton, James C.. 2015-12-01. An Active Learning Framework for Hyperspectral Image Classification Using Hierarchical Segmentation. https://ntrs.nasa.gov/citations/20170003162

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

Clarifying the trophic state concept to advance macroscale freshwater science and management

For over a century, ecologists have used the concept of trophic state (TS) to characterize an aquatic ecosystem's biological productivity. However, multiple TS classification schemes, each relying on a variety of measurable parameters as proxies for productivity, have emerged to meet use‐specific needs. Frequently, chlorophyll a, phosphorus, and Secchi depth are used to classify TS based on autotrophic production, whereas phosphorus, dissolved organic carbon, and true color are used to classify TS based on both autotrophic and heterotrophic production. Both classification approaches aim to characterize an ecosystem's function broadly, but with varying degrees of autotrophic and heterotrophic processes considered in those characterizations. Moreover, differing classification schemes can create inconsistent interpretations of ecosystem integrity. For example, the US Clean Water Act focuses exclusively on algal threats to water quality, framed in terms of eutrophication in response to nutrient loading. This usage lacks information about non‐algal threats to water quality, such as dystrophication in response to dissolved organic carbon loading. Consequently, the TS classification schemes used to identify eutrophication and dystrophication may refer to ecosystems similarly (e.g., oligotrophic and eutrophic), yet these categories are derived from different proxies. These inconsistencies in TS classification schemes may be compounded when interdisciplinary projects employ varied TS frameworks. Even with these shortcomings, TS can still be used to distill information on complex aquatic ecosystem function into a set of generalizable expectations. The usefulness of distilling complex information into a TS index is substantial such that usage inconsistencies should be explicitly addressed and resolved. To emphasize the consequences of diverging TS classification schemes, we present three case studies for which an improved understanding of the TS concept advances freshwater research, management efforts, and interdisciplinary collaboration. To increase clarity in TS, the aquatic sciences could benefit from including information about the proxy variables, ecosystem type, as well as the spatiotemporal domains used to classify TS. As the field of aquatic sciences expands and climatic irregularity increases, we highlight the importance of re‐evaluating fundamental concepts, such as TS, to ensure their compatibility with evolving science.

classification

Towards an Automated Classification of Transient Events in Synoptic Sky Surveys

We describe the development of a system for an automated, iterative, real-time classification of transient events discovered in synoptic sky surveys. The system under development incorporates a number of Machine Learning techniques, mostly using Bayesian approaches, due to the sparse nature, heterogeneity, and variable incompleteness of the available data. The classifications are improved iteratively as the new measurements are obtained. One novel featrue is the development of an automated follow-up recommendation engine, that suggest those measruements that would be the most advantageous in terms of resolving classification ambiguities and/or characterization of the astrophysically most interesting objects, given a set of available follow-up assets and their cost funcations. This illustrates the symbiotic relationship of astronomy and applied computer science through the emerging disciplne of AstroInformatics.

classification

Onboard Classifiers for Science Event Detection on a Remote Sensing Spacecraft

Typically, data collected by a spacecraft is downlinked to Earth and pre-processed before any analysis is performed. We have developed classifiers that can be used onboard a spacecraft to identify high priority data for downlink to Earth, providing a method for maximizing the use of a potentially bandwidth limited downlink channel. Onboard analysis can also enable rapid reaction to dynamic events, such as flooding, volcanic eruptions or sea ice break-up. Four classifiers were developed to identify cryosphere events using hyperspectral images. These classifiers include a manually constructed classifier, a Support Vector Machine (SVM), a Decision Tree and a classifier derived by searching over combinations of thresholded band ratios. Each of the classifiers was designed to run in the computationally constrained operating environment of the spacecraft. A set of scenes was hand-labeled to provide training and testing data. Performance results on the test data indicate that the SVM and manual classifiers outperformed the Decision Tree and band-ratio classifiers with the SVM yielding slightly better classifications than the manual classifier.

classification