Skip to content

Zhu Han, Jin Yang, Lianru Gao, Zhiqiang Zeng, Bing Zhang, Jocelyn Chanussot. Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification, IEEE TGRS, 2024

License

Notifications You must be signed in to change notification settings

hanzhu97702/DSNet

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DSNet

Zhu Han, Jin Yang, Lianru Gao, Zhiqiang Zeng, Bing Zhang, Jocelyn Chanussot


This is a PyTorch implementation of the "Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification" in IEEE Transactions on Geoscience and Remote Sensing. More specifically, it is detailed as follow.

alt text

DSNet includes deep AE unmixing network, CNN-based classifier network and subpixel fusion module. The deep AE unmixing network is designed by considering a general mixing decoder with physically nonlinear constraints, and further extract useful subpixel-level abundance information from the HSI in an unsupervised manner. The CNN-based classifier network extracts the spectral-spatial information within the HSI to obtain pixel-level class features. The subpixel fusion module aims at integrating the abundance information and class features to ensure high-quality information fusion and enhance model representation capability.

🌞 Overview

Deep learning (DL) has been widely applied into hyperspectral image (HSI) classification owing to its promising feature learning and representation capabilities. However, limited by the spatial resolution of sensors, existing DL-based classification approaches mainly focus on pixel-level spectral and spatial information extraction through complex network architecture design, while ignoring the existence of mixed pixels in actual scenarios. To tackle this difficulty, we propose a novel dual-branch subpixel-guided network for HSI classification, called DSNet, which automatically integrates subpixel information and convolutional class features by introducing a deep autoencoder unmixing architecture to enhance classification performance. DSNet is capable of fully considering physically nonlinear properties within subpixels and adaptively generating diagnostic abundances in an unsupervised manner to achieve more reliable decision boundaries for class label distributions. The subpixel fusion module is designed to ensure high-quality information fusion across pixel and subpixel features, further promoting stable joint classification. Experimental results on three benchmark datasets demonstrate the effectiveness and superiority of DSNet compared with state-of-the-art DL-based HSI classification approaches.

🔨 Usage

Dataset

The adopted Berlin and Augsburg datasets can be downloaded in Google Drive Link.

Training

  • ./demo.py is the script for training DSNet on different hyperspectral datasets. The patch size can be changed according to input dataset.
python demo.py --dataset='Indian' --patches=7 --flag_test='train'

Testing

  • After training DSNet, the saved model is loaded to obtain final classification results.
python demo.py --dataset='Indian' --patches=7 --flag_test='test'

⭐ Citation

Please kindly cite the papers if this code is useful and helpful for your research.

Zhu Han, Jin Yang, Lianru Gao, Zhiqiang Zeng, Bing Zhang, Jocelyn Chanussot. Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification, IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1-13, 2024, Art no. 5521813, doi: 10.1109/TGRS.2024.3418583.

@ARTICLE{10570241,
  author={Han, Zhu and Yang, Jin and Gao, Lianru and Zeng, Zhiqiang and Zhang, Bing and Chanussot, Jocelyn},
  journal={IEEE Transactions on Geoscience and Remote Sensing}, 
  title={Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification}, 
  year={2024},
  volume={62},
  pages={1-13},
  doi={10.1109/TGRS.2024.3418583}
}

Licensing

Copyright (C) 2024 Zhu Han

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, version 3 of the License.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program.

Contact Information

Zhu Han: [email protected]

About

Zhu Han, Jin Yang, Lianru Gao, Zhiqiang Zeng, Bing Zhang, Jocelyn Chanussot. Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification, IEEE TGRS, 2024

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages