Unsupervised Change Detection in Multitemporal VHR Images Based on Deep Kernel PCA Convolutional Mapping Network

Code for TCYB 2022 paper: Unsupervised Change Detection in Multitemporal VHR Images Based on Deep Kernel PCA Convolutional Mapping Network.

Abstract

With the development of Earth observation technology, very-high-resolution (VHR) image has become an important data source of change detection. Nowadays, deep learning methods have achieved conspicuous performance in the change detection of VHR images. Nonetheless, most of the existing change detection models based on deep learning require annotated training samples. In this paper, a novel unsupervised model called kernel principal component analysis (KPCA) convolution is proposed for extracting representative features from multi-temporal VHR images. Based on the KPCA convolution, an unsupervised deep siamese KPCA convolutional mapping network (KPCA-MNet) is designed for binary and multi-class change detection. In the KPCA-MNet, the high-level spatial-spectral feature maps are extracted by a deep siamese network consisting of weight-shared KPCA convolutional layers. Then, the change information in the feature difference map is mapped into a 2-D polar domain. Finally, the change detection results are generated by threshold segmentation and clustering algorithms. All procedures of KPCA-MNet do not require labeled data. The theoretical analysis and experimental results in two binary change detection datasets and one multi-class change detection datasets demonstrate the validity, robustness, and potential of the proposed method.

Requirements

python==3.6.12
scikit-learn==0.19.0
imageio=2.9.0
numpy==1.13.3
gdal==2.2.2

Dataset

The datasets WH and HY used in our paper has been open-sourced! You can download them here.

Results

• The results of quantitative assessments:

• Predictions on our dataset:

Our Results	Reference Image

Citation

Please cite our paper if you use this code in your research.

@article{Wu2022Unsupervised,
  author={Wu, Chen and Chen, Hongruixuan and Du, Bo and Zhang, Liangpei},
  journal={IEEE Transactions on Cybernetics}, 
  title={Unsupervised Change Detection in Multitemporal VHR Images Based on Deep Kernel PCA Convolutional Mapping Network}, 
  year={2022},
  volume={52},
  number={11},
  pages={12084-12098},
  doi={10.1109/TCYB.2021.3086884}
}

Q & A

For any questions, please contact us.