The Study of Scene Classification in the Multisensor Remote Sensing Image Fusion

Abstract EN

We propose a scene classification method for speeding up the multisensor remote sensing image fusion by using the singular value decomposition of quaternion matrix and the kernel principal component analysis (KPCA) to extract features.

At first, images are segmented to patches by a regular grid, and for each patch, we extract color features by using quaternion singular value decomposition (QSVD) method, and the grey features are extracted by Gabor filter and then by using orientation histogram to describe the grey information.

After that, we combine the color features and the orientation histogram together with the same weight to obtain the descriptor for each patch.

All the patch descriptors are clustered to get visual words for each category.

Then we apply KPCA to the visual words to get the subspaces of the category.

The descriptors of a test image then are projected to the subspaces of all categories to get the projection length to all categories for the test image.

Finally, support vector machine (SVM) with linear kernel function is used to get the scene classification performance.

We experiment with three classification situations on OT8 dataset and compare our method with the typical scene classification method, probabilistic latent semantic analysis (pLSA), and the results confirm the feasibility of our method.