SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers
Danfeng Hong, Zhu Han, Jing Tao Yao, Lianru Gao, Bing Zhang, Antonio Plaza, Jocelyn Chanussot
Chinese Academy of Sciences Aerospace Information Research Institute University of Chinese Academy of Sciences Institute of Remote Sensing and Digital Earth
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Hyperspectral (HS) images are characterized by approximately contiguous spectral information, enabling the fine identification of materials by capturing subtle spectral discrepancies. Due to their excellent locally contextual modeling ability, convolutional neural networks (CNNs) have been proven to be a powerful feature extractor in HS image classification. However, CNNs fail to mine and represent the sequence attributes of spectral signatures well due to the limitations of their inherent network backbone. To solve this issue, we rethink HS image classification from a sequential perspective with transformers and propose a novel backbone network calledSpectralFormer. Beyond bandwise representations in classic transformers, SpectralFormer is capable of learning spectrally local sequence information from neighboring bands of HS images, yielding groupwise spectral embeddings. More significantly, to reduce the possibility of losing valuable information in the layerwise propagation process, we devise a cross-layer skip connection to convey memory-like components from shallow to deep layers by adaptively learning to fuse “soft” residuals across layers. It is worth noting that the proposed SpectralFormer is a highly flexible backbone network, which can be applicable to both pixelwise and patchwise inputs. We evaluate the classification performance of the proposed SpectralFormer on three HS datasets by conducting extensive experiments, showing the superiority over classic transformers and achieving a significant improvement in comparison with state-of-the-art backbone networks. The codes of this work will be available athttps://github.com/danfenghong/IEEE_TGRS_SpectralFormerfor the sake of reproducibility.
逐年被引趋势
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
计算机 / AIRemote-Sensing Image Classification
Advanced Neural Network Applications · Spectroscopy and Chemometric Analyses