Abstract
Most of the existing hyperspectral image change detection methods based on deep learning utilize convolutional neural networks (CNN), recurrent neural networks (RNN), and long-short-term memory (LSTM). However, CNNs primarily focus on extracting spatial information from hyperspectral images, thereby failing to fully utilize channel and temporal information. In this paper, we propose a network called STSTNet that can jointly extract spatial, spectral, and temporal feature information. To achieve a richer feature representation space, we employ a spatial attention module to extract spatial feature information from feature maps, and a spectral transformer encoder structure to extract abundant spectral sequence information. Specifically, we design two temporal information extraction structures after each spatial information extraction structure or spectral information extraction structure to capture correlations and interactions within the hyperspectral images. Extensive experiments have been conducted on three hyperspectral datasets, and the experimental results demonstrate the network's excellent performance.
Original language | English |
---|---|
Title of host publication | ICCPR 2023 - Proceedings of the 2023 12th International Conference on Computing and Pattern Recognition |
Publisher | Association for Computing Machinery (ACM) |
Pages | 235-240 |
Number of pages | 6 |
ISBN (Electronic) | 9798400707988 |
DOIs | |
Publication status | Published - 27 Oct 2023 |
Event | 12th International Conference on Computing and Pattern Recognition, ICCPR 2023 - Qingdao, China Duration: 27 Oct 2023 → 29 Oct 2023 |
Conference
Conference | 12th International Conference on Computing and Pattern Recognition, ICCPR 2023 |
---|---|
Country/Territory | China |
City | Qingdao |
Period | 27/10/23 → 29/10/23 |
Keywords
- change detection
- hyperspectral image
- self-attention
- temporal information