On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification

Jie Liang, Jun Zhou*, Yuntao Qian, Lian Wen, Xiao Bai, Yongsheng Gao

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

106 Citations (Scopus)

Abstract

Spectral-spatial processing has been increasingly explored in remote sensing hyperspectral image classification. While extensive studies have focused on developing methods to improve the classification accuracy, experimental setting and design for method evaluation have drawn little attention. In the scope of supervised classification, we find that traditional experimental designs for spectral processing are often improperly used in the spectral-spatial processing context, leading to unfair or biased performance evaluation. This is especially the case when training and testing samples are randomly drawn from the same image - a practice that has been commonly adopted in the experiments. Under such setting, the dependence caused by overlap between the training and testing samples may be artificially enhanced by some spatial information processing methods, such as spatial filtering and morphological operation. Such enhancement of dependence in return amplifies the classification accuracy, leading to an improper evaluation of spectral-spatial classification techniques. Therefore, the widely adopted pixel-based random sampling strategy is not always suitable to evaluate spectral-spatial classification algorithms, because it is difficult to determine whether the improvement of classification accuracy is caused by incorporating spatial information into classifier or by increasing the overlap between training and testing samples. To tackle this problem, we propose a novel controlled random sampling strategy for spectral-spatial methods. It can greatly reduce the overlap between training and testing samples and provides more objective and accurate evaluation.

Original languageEnglish
Article number7762146
Pages (from-to)862-880
Number of pages19
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume55
Issue number2
DOIs
Publication statusPublished - Feb 2017

Fingerprint

Dive into the research topics of 'On the Sampling Strategy for Evaluation of Spectral-Spatial Methods in Hyperspectral Image Classification'. Together they form a unique fingerprint.

Cite this