Heterogeneous Network Based Contrastive Learning Method for PolSAR Land Cover Classification

Introduction

The provided text introduces polarimetric synthetic aperture radar (PolSAR), an active remote sensing technology that can obtain more information than conventional single-polarization synthetic aperture radar (SAR). PolSAR works by using different polarimetric combinations of transmitting and receiving backscattered waves from land covers. This capability allows PolSAR to observe targets in all weather conditions and at any time.

The text highlights that PolSAR image classification, which is the most crucial task in PolSAR image interpretation, has been widely used in various fields such as geography, agriculture, and environmental monitoring.

The provided text discusses the limitations of existing PolSAR (Polarimetric Synthetic Aperture Radar) classification methods and proposes a novel approach called Heterogeneous Contrastive Learning Network (HCLNet). The key points are:

• Existing PolSAR classification methods using hand-crafted features or deep learning have limitations in fully representing the data or requiring large labeled datasets.

• Self-supervised contrastive learning (CL) methods, popular for optical images, face challenges when applied to PolSAR due to differences in data characteristics.

• The proposed HCLNet aims to overcome these challenges by effectively utilizing multi-features in PolSAR, addressing pixel similarity issues, and handling scattering confusion problems.

• HCLNet introduces a heterogeneous network with an online 2D CNN and a target 1D CNN to learn representations from different PolSAR features without labeled data.

• It employs a novel superpixel-based instance discrimination task to reduce pixel similarity and facilitate better representation learning.

• A feature filter selects complementary features and reduces redundancy among multi-features.

• Experimental results on benchmark PolSAR datasets demonstrate HCLNet's state-of-the-art performance in few-shot and full-sample scenarios.

The paper does not provide any information about the subsequent sections.

Related Work

The section discusses contrastive learning (CL) for self-supervised representation learning in polarimetric synthetic aperture radar (PolSAR) images. Key points:

• CL is a prevalent self-supervised learning method. It uses two networks - an online network to be fine-tuned for downstream tasks, and a target network to aid learning. The goal is to make representations from the same image similar, and different images dissimilar.

• The section categorizes CL approaches for optical images based on parameter updating and negative sample selection methods. Some examples are Instance Discrimination, CPC, CMC, MoCo, SimCLR, BYOL, and SimSiam.

• For PolSAR images, methods like MI-SSL, PCLNet, SSPRL, and TCSPANet tailor CL by exploiting polarimetric properties.

• The paper proposes a heterogeneous CL network using superpixel instance discrimination for negative sample selection.

• It discusses various physical and statistical features extractable from PolSAR data like target decompositions, coherency and covariance matrices.

• Proper feature selection is important, and the paper proposes a "feature filter" method to obtain a good complementary feature combination.

The section provides an overview of CL methods for representation learning, their adaptations for PolSAR data, and the use of polarimetric features, setting up the proposed approach.

Heterogeneous Network based Contrastive Learning

The section details the proposed HCLNet (Heterogeneous Contrastive Learning Network) architecture for PolSAR (Polarimetric Synthetic Aperture Radar) data representation learning. HCLNet comprises three main components:

1. Feature Filter: A 1D CNN classifier evaluates different combinations of target decomposition features to select an appropriate complementary set of features.

2. Superpixel-based Instance Discrimination: An improved approach to select positive and negative sample pixels based on superpixel segmentation for the contrastive learning task.

3. Heterogeneous Network: The core component consisting of two networks with different architectures - a 2D CNN online network for the coherency matrix input and a 1D CNN target network for the filtered target decomposition features. This heterogeneous design learns high-level representations by capturing both spatial and feature-level differences between PolSAR instances.

The feature filter performs beam search to iteratively remove feature groups that minimally impact classification accuracy, ensuring complementarity. The superpixel-based instance discrimination redefines positive and negative samples within and across superpixels for contrastive learning. The heterogeneous network learns representations by maximizing agreement between the online and target network outputs for positive sample pairs using an InfoNCE loss. After pre-training, the online network can serve as a backbone for downstream PolSAR classification tasks.

V Experimental Results and Analysis

The paper employs three standard PolSAR datasets (RADARSAT-2 Flevoland, AIRSAR Flevoland, and ESAR Oberpfaffenhofen) to verify the effectiveness of the proposed HCLNet method. Details of these datasets and the ground truth images are provided.

The experimental settings, including implementation details, multi-feature extraction, and compared methods, are described. The proposed HCLNet method is compared against several state-of-the-art semi-supervised and PolSAR classification methods (MI-SSL, CF-CSSL, PCLNet, and SSPRL) on the three datasets.

The results show that HCLNet achieves superior classification accuracy, overall accuracy (OA), average accuracy (AA), and kappa coefficient on all three datasets for both few-shot and full-sample settings. Detailed quantitative results and classification maps are provided to demonstrate HCLNet's improvement over other methods, especially in alleviating scattering confusion.

The t-SNE visualization of the learned representations further confirms HCLNet's ability to distinguish different categories well and reduce overlapping/disconnection compared to other methods.

The model complexity analysis shows that HCLNet has relatively low parameter count and floating-point operations (FLOPs) compared to other complex methods.

An ablation study validates the effectiveness of each component (heterogeneous network, superpixel-based instance discrimination, and feature filter) in HCLNet's design.

Overall, the experimental results across multiple datasets and analyses demonstrate the generalization, high classification accuracy, and effectiveness of the proposed HCLNet method for PolSAR image classification.

Conclusion

The paper proposes a self-supervised learning method called HCLNet (Heterogeneous Contrastive Learning Network) for polarimetric synthetic aperture radar (PolSAR) data classification. It introduces two plugins to enhance the learning process: a feature filter to reduce redundancy in multi-target decomposition features, and a superpixel-based instance discrimination technique to learn better representations by reducing similarity between pixels.

HCLNet leverages unsupervised pre-training to extract high-level representations from the physical and statistical features of PolSAR data. After this pre-training, the network can achieve high performance in few-shot PolSAR classification tasks through fine-tuning.

Experiments on three benchmark datasets demonstrate HCLNet's superiority over mainstream methods for both few-shot and full-sample PolSAR classification. The paper highlights that PolSAR data has more valuable features than optical images, and heterogeneous networks have a natural advantage in utilizing these features.

This work sets a precedent for future research on heterogeneous network learning for PolSAR data. The authors plan to explore positive and negative selection problems for heterogeneous networks in depth to further improve PolSAR classifier performance.