Change detection in hyperspectral images based on a spatial-spectral-temporal attention network

Xijuan Zhang, Feng Gao*, Junyu Dong, Decang Bi, Hui Yu, Lin Qi

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

27 Downloads (Pure)

Abstract

Most of the existing hyperspectral image change detection methods based on deep learning utilize convolutional neural networks (CNN), recurrent neural networks (RNN), and long-short-term memory (LSTM). However, CNNs primarily focus on extracting spatial information from hyperspectral images, thereby failing to fully utilize channel and temporal information. In this paper, we propose a network called STSTNet that can jointly extract spatial, spectral, and temporal feature information. To achieve a richer feature representation space, we employ a spatial attention module to extract spatial feature information from feature maps, and a spectral transformer encoder structure to extract abundant spectral sequence information. Specifically, we design two temporal information extraction structures after each spatial information extraction structure or spectral information extraction structure to capture correlations and interactions within the hyperspectral images. Extensive experiments have been conducted on three hyperspectral datasets, and the experimental results demonstrate the network's excellent performance.

Original languageEnglish
Title of host publicationICCPR 2023 - Proceedings of the 2023 12th International Conference on Computing and Pattern Recognition
PublisherAssociation for Computing Machinery (ACM)
Pages235-240
Number of pages6
ISBN (Electronic)9798400707988
DOIs
Publication statusPublished - 27 Oct 2023
Event12th International Conference on Computing and Pattern Recognition, ICCPR 2023 - Qingdao, China
Duration: 27 Oct 202329 Oct 2023

Conference

Conference12th International Conference on Computing and Pattern Recognition, ICCPR 2023
Country/TerritoryChina
CityQingdao
Period27/10/2329/10/23

Keywords

  • change detection
  • hyperspectral image
  • self-attention
  • temporal information

Fingerprint

Dive into the research topics of 'Change detection in hyperspectral images based on a spatial-spectral-temporal attention network'. Together they form a unique fingerprint.

Cite this