Search NASA⌕ Search

SEARCH · Search NASA

Results for “Hyperspectral imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Surface Biology and Geology (SBG) Thermal Infrared (TIR) Free -Flyer Concept

Scientists and engineers from the United States and Italy are developing a thermal infrared (TIR) free-flyer concept that forms an essential element of the NASA Surface Biology & Geology (SBG) designated observable and the greater NASA Earth System Observatory (ESO), which also includes observations of aerosols, clouds, convection, and precipitation; mass change; and surface deformation & change.In response to the recommendations from the 2017 National Academies decadal survey for Earth science, NASA initiated the SBG designated observable with five key research and applications focus areas: ecosystems and natural resources, hydrology, weather, climate, and solid Earth. SBG includes spaceborne measurements of hyperspectral imagery in the visible to shortwave infrared (0.4-2.5 um) and multispectral imagery in the mid and thermal infrared (3-12 um) that provide the remote sensing data needed to inform each research and applications area. High-level TIR data products include Earth surface temperature & emissivity, evapotranspiration, substrate composition, volcanic plumes, and high-temperature features. While the science, applications, and technology build on prior mission studies conducted for more than a decade, it has only been recently that a joint team of scientists and engineers from the NASA Jet Propulsion Laboratory (JPL), Agenzia Spaziale Italiana (ASI), Istituto Nazionale Geofisica e Volcanologia (INGV), and the Istituto Nazionale Astrofisica (INAF) have developed a compelling concept for a TIR free-flyer. In this concept, the TIR instrument is an eight-band radiometer. Seven of the bands are between 3 and 12 um with an additional band at 1.65 um. The instrument’s 68.8 deg total viewing angle and the free-flyer’s 665 km operational altitude results in a ground sampling distance (GSD) of <60 m at nadir, produces a swath width of 935 km, and allows for a 2-3-day revisit time. A two-band visible and near infrared (VNIR) camera, with <30 m GSD at nadir and 935 km swath width, will complement the TIR instrument. VNIR high-level data products include top & bottom of atmosphere reflectance and normalized difference vegetation indices (NDVI). The TIR instrument and VNIR camera will be mounted on a PLATiNO+ spacecraft, a multi-application, reconfigurable, and scalable platform. The launcher selected for the TIR free-flyer is the VEGA-C. To maximize the science and applications benefits the SBG-TIR free-flyer team are collaborating with personnel from the ESA Land Surface Temperature Monitoring mission (LSTM) as well individuals from the Thermal Infrared Imaging Satellite for High-resolution Natural resource Assessment (TRISHNA), a joint mission by CNES and ISRO. Pre-Phase A concept studies for the SBG-TIR free-flyer commenced in the spring 2021. This allows for the concept to be refined; for technical risks to be identified and mitigated, as necessary; and strategies for reducing the development schedule to be defined and assessed before conducting a NASA-ASI Mission Concept Review (MCR) in the spring of 2022 and a NASA Key Decision Point-A (KDP-A) as early as the summer of 2022. These are key milestones in being able to launch and begin operating the SBG-TIR free-flyer in the second half of the decade, so that many of the questions posed by the National Academies in the 2017 decadal survey can be answered.

Fabrizia-Buongiorno, Maria↗
NASA NTRS2015

Mapping Species Composition of Forests and Tree Plantations in Northeastern Costa Rica with an Integration of Hyperspectral and Multitemporal Landsat Imagery

An efficient means to map tree plantations is needed to detect tropical land use change and evaluate reforestation projects. To analyze recent tree plantation expansion in northeastern Costa Rica, we examined the potential of combining moderate-resolution hyperspectral imagery (2005 HyMap mosaic) with multitemporal, multispectral data (Landsat) to accurately classify (1) general forest types and (2) tree plantations by species composition. Following a linear discriminant analysis to reduce data dimensionality, we compared four Random Forest classification models: hyperspectral data (HD) alone; HD plus interannual spectral metrics; HD plus a multitemporal forest regrowth classification; and all three models combined. The fourth, combined model achieved overall accuracy of 88.5%. Adding multitemporal data significantly improved classification accuracy (p less than 0.0001) of all forest types, although the effect on tree plantation accuracy was modest. The hyperspectral data alone classified six species of tree plantations with 75% to 93% producer's accuracy; adding multitemporal spectral data increased accuracy only for two species with dense canopies. Non-native tree species had higher classification accuracy overall and made up the majority of tree plantations in this landscape. Our results indicate that combining occasionally acquired hyperspectral data with widely available multitemporal satellite imagery enhances mapping and monitoring of reforestation in tropical landscapes.

hyperspectral fusion↗
NASA NTRS1993

The HYDICE instrument design and its application to planetary instruments

The Hyperspectral Digital Imagery Collection Experiment (HYDICE) instrument represents a significant advance in the state of the art in hyperspectral sensors. It combines a higher signal-to-noise ratio (SNR) and significantly better spatial and spectral resolution and radio metric accuracy than systems flying on aircraft today. The need for 'clean' data, i.e., data free of sampling artifacts and excessive spatial or spectral noise, is a key driver behind the difficult combination of performance requirements laid out for HYDICE. Most of these involve the sensor optics and detector. This paper presents an optimized approach to those requirements, one that comprises push broom scanning, a single, mechanically cooled focal plane, a double-pass prism spectrometer, and an easily fabricated yet wide-field telescope. Central to the approach is a detector array that covers the entire spectrum from 0.4 to 2.5 microns. Among the major benefits conferred by such a design are optical and mechanical simplicity, low polarization sensitivity, and coverage of the entire spectrum without suffering the spectral gaps caused by beam splitters. The overall system minimizes interfaces to the C-141 aircraft on which it will be flown, can be calibrated on the ground and in flight to accuracies better than those required, and is designed for simple, push-button operation. Only unprocessed data are recorded during flight. A ground data processing station provides quick-look, calibration correction, and archiving capabilities, with a throughput better than the requirements. Overall performance of the system is expected to provide the solid database required to evaluate the potential of hyperspectral imagery in a wide variety of applications. HYDICE can be regarded as a test bed for future planetary instruments. The ability to spectrally image a wide field of view over multiple spectral octaves offers obvious advantages and is expected to maximize science return for the required cost and weight.

Basedow, R.↗
NASA NTRS2023

A Hyperspectral Inversion Framework for Estimating Absorbing Inherent Optical Properties and Biogeochemical Parameters in Inland and Coastal Waters

The simultaneous remote estimation of biogeochemical parameters (BPs) and inherent optical properties (IOPs) from hyperspectral satellite imagery of globally distributed optically distinct inland and coastal waters is a complex, unsolved, non-unique inverse problem. To tackle this problem, we leverage a machine-learning model termed Mixture Density Networks (MDNs). MDNs outperform operational algorithms by calculating the covariance between the simultaneously estimated products. We train the MDNs on a large ( N = 8237) dataset of co-aligned, in situ measured, hyperspectral remote sensing reflectance (R rs ), BPs, and absorbing IOPs from globally representative optically distinct inland and coastal waters. The estimated IOPs include absorption due to phytoplankton (a ph ), chromophoric dissolved organic matter (a cdom ), and non-algal particles (a nap ). The estimated BPs include chlorophyll-a, total suspended solids, and phycocyanin (PC). MDNs dramatically reduce uncertainty in the retrievals, relative to operational algorithms, when using a 50/50 dataset split, where the MDNs are trained on a randomly selected half of the in situ dataset and validated on the other half. Our model is shown to have higher, or equivalent, generalization performance than the calculated operational algorithms available for all BPs and IOPs (except PC) via a leave-one-out cross-validation assessment. The MDNs are sensitive to uncertainties in the hyperspectral satellite R rs , resulting from instrument noise and atmospheric correction; there is a difference of ~37.4–62.8% (using median symmetric accuracy) between the MDNs’ estimates derived from co-located satellite-derived R rs and in situ R rs . Of the IOPs, a cdom and a nap are less sensitive to uncertainties in hyperspectral satellite imagery relative to a ph , with remote estimates of a ph exhibiting incorrect spectral shape and magnitude relative to in situ measured IOPs. Despite the uncertainties in satellite derived R rs , the spatial distributions of BPs and IOPs in MDN-derived product maps of Lake Erie and the Curonian Lagoon, based on imagery taken with the Hyperspectral Imager for the Coastal Ocean (HICO) and PRecursore Iper-Spettrale della Missione Applicativa (PRISMA), are confirmed via co-aligned in situ measurements and agree with the literature’s understanding of these well-studied regions. The consistency and accuracy of the model on HICO and PRISMA imagery, despite radiometric uncertainties, demonstrate its applicability to future hyperspectral missions, such as the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission, where the simultaneous estimation model will serve as a key part of phytoplankton community composition analysis.

Ryan E. O'Shea↗
DOE OSTI2021

Data Fusion of Very High Resolution Hyperspectral and Polarimetric SAR Imagery for Terrain Classification

Performing terrain classification with data from heterogeneous imaging modalities is a very challenging problem. The challenge is further compounded by very high spatial resolution. (In this paper we consider very high spatial resolution to be much less than a meter.) At very high resolution many additional complications arise, such as geometric differences in imaging modalities and heightened pixel-by-pixel variability due to inhomogeneity within terrain classes. In this paper we consider the fusion of very high resolution hyperspectral imaging (HSI) and polarimetric synthetic aperture radar (PolSAR) data. We introduce a framework that utilizes the probabilistic feature fusion (PFF) one-class classifier for data fusion and demonstrate the effect of making pixelwise, superpixel, and pixelwise voting (within a superpixel) terrain classification decisions. We show that fusing imaging modality data sets, combined with pixelwise voting within the spatial extent of superpixels, gives a robust terrain classification framework that gives a good balance between quantitative and qualitative results.

47 OTHER INSTRUMENTATION↗
NASA NTRS2021

Evaluation of SWIR Crop Residue Bands for the Landsat Next Mission

This research reports the findings of a Landsat Next expert review panel that evaluated the use of narrow shortwave infrared (SWIR) reflectance bands to measure ligno-cellulose absorption features centered near 2100 and 2300 nm, with the objective of measuring and mapping non-photosynthetic vegetation (NPV), crop residue cover, and the adoption of conservation tillage practices within agricultural landscapes. Results could also apply to detection of NPV in pasture, grazing lands, and non-agricultural settings. Currently, there are no satellite data sources that provide narrowband or hyperspectral SWIR imagery at sufficient volume to map NPV at a regional scale. The Landsat Next mission, currently under design and expected to launch in the late 2020’s, provides the opportunity for achieving increased SWIR sampling and spectral resolution with the adoption of new sensor technology. This study employed hyperspectral data collected from 916 agricultural field locations with varying fractional NPV, fractional green vegetation, and surface moisture contents. These spectra were processed to generate narrow bands with centers at 2040, 2100, 2210, 2260, and 2230 nm, at various bandwidths, that were subsequently used to derive 13 NPV spectral indices from each spectrum. For crop residues with minimal green vegetation cover, two-band indices derived from 2210 and 2260 nm bands were top performers for measuring NPV (R^(2) = 0.81, RMSE = 0.13) using bandwidths of 30 to 50 nm, and the addition of a third band at 2100 nm increased resistance to atmospheric correction residuals and improved mission continuity with Landsat 8 Operational Land Imager Band 7. For prediction of NPV over a full range of green vegetation cover, the Cellulose Absorption Index, derived from 2040, 2100, and 2210 nm bands, was top performer (R^(2) = 0.77, RMSE = 0.17), but required a narrow (≤20 nm) bandwidth at 2040 nm to avoid interference from atmospheric carbon dioxide absorption. In comparison, broadband NPV indices utilizing Landsat 8 bands centered at 1610 and 2200 nm performed poorly in measuring fractional NPV (R^(2) = 0.44), with significantly increased interference from green vegetation

Wells Dean Hively↗
DOE OSTI2021

Absorptive Weak Plume Detection on Gaussian and Non-Gaussian Background Clutter

For additive signals on Gaussian clutter, the optimal detector is a linear matched filter that is adapted to the known signal and the covariance of the background. This adaptive matched filter is widely used for gas-phase plume detection, even though the effect of the plume on the background is not strictly additive. Here, a derivation of the matched filter for a strictly absorptive plume produces, in the weak plume limit, a quadratic filter. This quadratic matched filter is extended in two ways: an elliptically-contoured multivariate t distribution is used to generalize the Gaussian background clutter, and a generalized likelihood ratio test detector is derived to extend applicability to stronger plumes. In addition to detectors whose purpose is to identify presence versus absence of a plume, expressions are also derived for estimating plume strength. The performance of these various detectors is evaluated by implanting simulated plume into background images that are either real hyperspectral images or simulated images based on different (Gaussian, multivariate t, and lognormal) clutter distributions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Towards mapping biodiversity from above: Can fusing lidar and hyperspectral remote sensing predict taxonomic, functional, and phylogenetic tree diversity in temperate forests?

Abstract Aim Rapid global change is impacting the diversity of tree species and essential ecosystem functions and services of forests. It is therefore critical to understand and predict how the diversity of tree species is spatially distributed within and among forest biomes. Satellite remote sensing platforms have been used for decades to map forest structure and function but are limited in their capacity to monitor change by their relatively coarse spatial resolution and the complexity of scales at which different dimensions of biodiversity are observed in the field. Recently, airborne remote sensing platforms making use of passive high spectral resolution (i.e., hyperspectral) and active lidar data have been operationalized, providing an opportunity to disentangle how biodiversity patterns vary across space and time from field observations to larger scales. Most studies to date have focused on single sites and/or one sensor type; here we ask how multiple sensor types from the National Ecological Observatory Network’s Airborne Observation Platform (NEON AOP) perform across multiple sites in a single biome at the NEON field plot scale (i.e., 40 m × 40 m). Location Eastern USA. Time period 2017–2018. Taxa studied Trees. Methods With a fusion of hyperspectral and lidar data from the NEON AOP, we assess the ability of high resolution remotely sensed metrics to measure biodiversity variation across eastern US temperate forests. We examine how taxonomic, functional, and phylogenetic measures of alpha diversity vary spatially and assess to what degree remotely sensed metrics correlate with in situ biodiversity metrics. Results Models using estimates of forest function, canopy structure, and topographic diversity performed better than models containing each category alone. Our results show that canopy structural diversity, and not just spectral reflectance, is critical to predicting biodiversity. Main conclusions We found that an approach that jointly leverages spectral properties related to leaf and canopy functional traits and forest health, lidar derived estimates of forest structure, fine‐resolution topographic diversity, and careful consideration of biogeographical differences within and among biomes is needed to accurately map biodiversity variation from above.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

More chemical detection through less sampling: amplifying chemical signals in hyperspectral data cubes through compressive sensing

Compressive sensing (CS) is a method of sampling which permits some classes of signals to be reconstructed with high accuracy even when they were sampled at sub-Nyquist rates. In this paper we explore a phenomenon in which bandwise CS sampling of a hyperspectral data cube followed by reconstruction can actually result in amplification of chemical signals contained in the cube. Perhaps most surprisingly, chemical signal amplification generally seems to increase as the level of sampling decreases. In some examples, the chemical signal is significantly stronger in a data cube reconstructed from 10% CS sampling than it is in the raw, 100% sampled data cube. We explore this phenomenon in two real-world datasets including the Physical Sciences Inc. Fabry-Perot interferometer sensor multispectral dataset and the Johns Hopkins Applied Physics Lab FTIR-based longwave infrared sensor hyperspectral dataset. Each of these datasets contains the release of a chemical simulant, such as glacial acetic acid, triethyl phospate, and sulfur hexafluoride, and in all cases we use the adaptive coherence estimator (ACE) to detect a target signal in the hyperspectral data cube. We end the paper by suggesting some theoretical justifications for why chemical signals would be amplified in CS sampled and reconstructed hyperspectral data cubes and discuss some practical implications.

Hyperspectral imagery, Compressive Sensing, single↗
NASA NTRS2000

Hyperspectral Imaging Sensors and the Marine Coastal Zone

Hyperspectral imaging sensors greatly expand the potential of remote sensing to assess, map, and monitor marine coastal zones. Each pixel in a hyperspectral image contains an entire spectrum of information. As a result, hyperspectral image data can be processed in two very different ways: by image classification techniques, to produce mapped outputs of features in the image on a regional scale; and by use of spectral analysis of the spectral data embedded within each pixel of the image. The latter is particularly useful in marine coastal zones because of the spectral complexity of suspended as well as benthic features found in these environments. Spectral-based analysis of hyperspectral (AVIRIS) imagery was carried out to investigate a marine coastal zone of South Florida, USA. Florida Bay is a phytoplankton-rich estuary characterized by taxonomically distinct phytoplankton assemblages and extensive seagrass beds. End-member spectra were extracted from AVIRIS image data corresponding to ground-truth sample stations and well-known field sites. Spectral libraries were constructed from the AVIRIS end-member spectra and used to classify images using the Spectral Angle Mapper (SAM) algorithm, a spectral-based approach that compares the spectrum, in each pixel of an image with each spectrum in a spectral library. Using this approach different phytoplankton assemblages containing diatoms, cyanobacteria, and green microalgae, as well as benthic community (seagrasses), were mapped.

Richardson, Laurie L.↗
NASA NTRS2012

Synegies Between Visible/Near-Infrared Imaging Spectrometry and the Thermal Infrared in an Urban Environment: An Evaluation of the Hyperspectral Infrared Imager (HYSPIRI) Mission

A majority of the human population lives in urban areas and as such, the quality of urban environments is becoming increasingly important to the human population. Furthermore, these areas are major sources of environmental contaminants and sinks of energy and materials. Remote sensing provides an improved understanding of urban areas and their impacts by mapping urban extent, urban composition (vegetation and impervious cover fractions), and urban radiation balance through measures of albedo, emissivity and land surface temperature (LST). Recently, the National Research Council (NRC) completed an assessment of remote sensing needs for the next decade (NRC, 2007), proposing several missions suitable for urban studies, including a visible, near-infrared and shortwave infrared (VSWIR) imaging spectrometer and a multispectral thermal infrared (TIR) instrument called the Hyperspectral Infrared Imagery (HyspIRI). In this talk, we introduce the HyspIRI mission, focusing on potential synergies between VSWIR and TIR data in an urban area. We evaluate potential synergies using an Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and MODIS-ASTER (MASTER) image pair acquired over Santa Barbara, United States. AVIRIS data were analyzed at their native spatial resolutions (7.5m VSWIR and 15m TIR), and aggregated 60 m spatial resolution similar to HyspIRI. Surface reflectance was calculated using ACORN and a ground reflectance target to remove atmospheric and sensor artifacts. MASTER data were processed to generate estimates of spectral emissivity and LST using Modtran radiative transfer code and the ASTER Temperature Emissivity Separation algorithm. A spectral library of common urban materials, including urban vegetation, roofs and roads was assembled from combined AVIRIS and field-measured reflectance spectra. LST and emissivity were also retrieved from MASTER and reflectance/emissivity spectra for a subset of urban materials were retrieved from co-located MASTER and AVIRIS pixels. Fractions of Impervious, Soil, Green Vegetation (GV) and Non-photosynthetic Vegetation (NPV), were estimated using Multiple Endmember Spectral Mixture Analysis (MESMA) applied to AVIRIS data at 7.5, 15 and 60 m spatial scales. Surface energy parameters, including albedo, vegetation cover fraction, broadband emissivity and LST were also determined for urban and natural land-cover classes in the region. Fractions were validated using 1m digital photography.

Roberts, Dar A.↗
NASA NTRS2013

A Web-Based Search Service to Support Imaging Spectrometer Instrument Operations

Imaging spectrometers yield rich and informative data products, but interpreting them demands time and expertise. There is a continual need for new algorithms and methods for rapid first-draft analyses to assist analysts during instrument opera-tions. Intelligent data analyses can summarize scenes to draft geologic maps, searching images to direct op-erator attention to key features. This validates data quality while facilitating rapid tactical decision making to select followup targets. Ideally these algorithms would operate in seconds, never grow bored, and be free from observation bias about the kinds of mineral-ogy that will be found.

hyperspectral imagery↗
DOE OSTI2020

Total variation vs L1 regularization: a comparison of compressive sensing optimization methods for chemical detection

One of the fundamental assumptions of compressive sensing (CS) is that a signal can be reconstructed from a small number of samples by solving an optimization problem with the appropriate regularization term. Two standard regularization terms are the L1 norm and the total variation (TV) norm. We present a comparison of CS reconstruction results based on these two approaches in the context of chemical detection, and we demonstrate that optimization based on the L1 norm outperforms optimization based on the TV norm. Our comparison is driven by CS sampling, reconstruction, and chemical detection in two real-world datasets: the Physical Sciences Inc. Fabry-Perot interferometer sensor multispectral dataset and the Johns Hopkins Applied Physics Lab FTIR-based longwave infrared sensor hyperspectral dataset. Both datasets contain the release of a chemical simulant such as glacial acetic acid, triethyl phosphate, and sulfur hexafluoride. For chemical detection we use the adaptive coherence estimator (ACE) and bulk coherence, and we propose algorithmic ACE thresholds to define the presence or absence of a chemical of interest in both un-compressed data cubes and reconstructed data cubes. The un-compressed data cubes provide an approximate ground truth. We demonstrate that optimization based on either the L1 norm or TV norm results in successful chemical detection at a compression rate of 90%, but we show that L1 optimization is preferable. We present quantitative comparisons of chemical detection on reconstructions from the two methods, with an emphasis on the number of pixels with an ACE value above the threshold.

Hyperspectral imagery, L1-norm, total variation, A↗
NASA NTRS2018

Advances in Hyperspectral Image Classification Methods for Vegetation and Agricultural Cropland Studies

Hyperspectral data are becoming more widely available via sensors on airborne and unmanned aerial vehicle (UAV) platforms, as well as proximal platforms. While space-based hyperspectral data continue to be limited in availability, multiple spaceborne Earth-observing missions on traditional platforms are scheduled for launch, and companies are experimenting with small satellites for constellations to observe the Earth, as well as for planetary missions. Land cover mapping via classification is one of the most important applications of hyperspectral remote sensing and will increase in significance as time series of imagery are more readily available. However, while the narrow bands of hyperspectral data provide new opportunities for chemistry-based modeling and mapping, challenges remain. Hyperspectral data are high dimensional, and many bands are highly correlated or irrelevant for a given classification problem. For supervised classification methods, the quantity of training data is typically limited relative to the dimension of the input space. The resulting Hughes phenomenon, often referred to as the curse of dimensionality, increases potential for unstable parameter estimates, overfitting, and poor generalization of classifiers. This is particularly problematic for parametric approaches such as Gaussian maximum likelihood–based classifiers that have been the backbone of pixel-based multispectral classification methods. This issue has motivated investigation of alternatives, including regularization of the class covariance matrices, ensembles of weak classifiers, development of feature selection and extraction methods, adoption of nonparametric classifiers, and exploration of methods to exploit unlabeled samples via semi-supervised and active learning. Data sets are also quite large, motivating computationally efficient algorithms and implementations. This chapter provides an overview of the recent advances in classification methods for mapping vegetation using hyperspectral data. Three data sets that are used in the hyperspectral classification literature (e.g., Botswana Hyperion satellite data and AVIRIS airborne data over both Kennedy Space Center and Indian Pines) are described in Section 3.2 and used to illustrate methods described in the chapter. An additional high-resolution hyperspectral data set acquired by a SpecTIR sensor on an airborne platform over the Indian Pines area is included to exemplify the use of new deep learning approaches, and a multiplatform example of airborne hyperspectral data is provided to demonstrate transfer learning in hyperspectral image classification. Classical approaches for supervised and unsupervised feature selection and extraction are reviewed in Section 3.3. In particular, nonlinearities exhibited in hyperspectral imagery have motivated development of nonlinear feature extraction methods in manifold learning, which are outlined in Section 3.3.1.4. Spatial context is also important in classification of both natural vegetation with complex textural patterns and large agricultural fields with significant local variability within fields. Approaches to exploit spatial features at both the pixel level (e.g., co-occurrence–based texture and extended morphological attribute profiles [EMAPs]) and integration of segmentation approaches (e.g., HSeg) are discussed in this context in Section 3.3.2. Recently, classification methods that leverage nonparametric methods originating in the machine learning community have grown in popularity. An overview of both widely used and newly emerging approaches, including support vector machines (SVMs), Gaussian mixture models, and deep learning based on convolutional neural networks is provided in Section 3.4. Strategies to exploit unlabeled samples, including active learning and metric learning, which combine feature extraction and augmentation of the pool of training samples in an active learning framework, are outlined in Section 3.5. Integration of image segmentation with classification to accommodate spatial coherence typically observed in vegetation is also explored, including as an integrated active learning system. Exploitation of multisensor strategies for augmenting the pool of training samples is investigated via a transfer learning framework in Section 3.5.1.2. Finally, we look to the future, considering opportunities soon to be provided by new paradigms, as hyperspectral sensing is becoming common at multiple scales from ground-based and airborne autonomous vehicles to manned aircraft and space-based platforms.

Pasolli, Edoardo↗
NASA NTRSDate not supplied

Satellite-Derived Imagery and Transfer Learning: A Novel Technique for Land Cover Classification

Land cover classification is a continuing research topic due to its relevance to land use and land cover changes from impacts such as climate change, agriculture, urbanization, and hazardous weather. Simple access to frequently changing land cover classifications could provide knowledge and decision support to various researchers and agencies across the globe for each of above-mentioned and related influences. This research aims to provide a novel technique for land cover classification of remote sensing imagery; harnessing Artificial Neural Networks and transfer learning (TL). Knowledge sharing techniques within machine learning are typically utilized when training datasets are sparse or transitions between data modalities is required. In this case, two data modalities, multi and hyperspectral data, are considered for knowledge transfer. The large number of continuous spectral bands available from hyperspectral sensors typically provide increased sophisticated land classification capability compared to more traditional multispectral imagery with limited discrete spectral bands. However, large-scale, frequent access to hyperspectral imagery is relatively limited. The proposed classification technique would therefore prove useful in regions in which hyperspectral data are not readily available for classification but multispectral data are. Image segmentation models are trained on each multi and hyperspectral datasets. Knowledge sharing techniques are then applied to each model to understand what knowledge, if any, is gained when moving between the data modalities. The datasets utilized for training and testing a U-Net model include the European Space Agency’s multispectral imager Sentinel-2 and the hyperspectral German Aerospace Center’s Earth Sensing Imaging Spectrometer (DESIS). Initially, only two classes, land and water, are classified for simplicity. However, more complex classes can be added if knowledge sharing is successful. The workflow for image classification through supervised image segmentation with a U-Net model will be discussed along with metrics calculated before and after TL for both Sentinel-2 and DESIS data are applied. Additionally, future steps to advance the sophistication of this technique as well as other applicable methodologies will be explored.

Emily Foshee↗