Mapping Degeneration Meets Label Evolution: Learning Infrared Small Target Detection with Single Point Supervision

Overview

• Researchers have been training convolutional neural networks (CNNs) to detect infrared small targets, but this requires a large number of detailed per-pixel annotations, which is labor-intensive.
• To address this, the researchers propose a new method called label evolution with single point supervision (LESPS) that can train CNNs using only point-level supervision rather than full pixel-level annotations.
• During training, the researchers discover that CNNs first learn to segment a cluster of pixels near the target, and then gradually converge to predict the ground truth point labels.
• Motivated by this, the LESPS framework progressively expands the point labels using the CNN's intermediate predictions, allowing the network to learn a pixel-level target mask in an end-to-end manner.

Plain English Explanation

The paper focuses on training convolutional neural networks (CNNs) to detect small infrared targets. Typically, this requires detailed annotations for every pixel in the image, which is very time-consuming and expensive.

To make this process easier, the researchers propose a new method called label evolution with single point supervision (LESPS). With LESPS, the CNN only needs to be trained on simple point-level annotations - just a dot indicating the center of each target.

Interestingly, the researchers found that during this point-level training, the CNN first learns to segment a cluster of pixels around the target, and then gradually refines this to match the exact ground truth point. Inspired by this, the LESPS framework dynamically expands the point labels using the CNN's own predictions. This allows the network to eventually learn a full pixel-level target mask, without needing the labor-intensive full pixel annotations.

Technical Explanation

The key innovation in this paper is the label evolution with single point supervision (LESPS) framework. Traditionally, training CNNs for infrared small target detection requires detailed per-pixel annotations, which is very labor-intensive.

To address this, the researchers propose using only simple point-level supervision during training. Surprisingly, they find that even with just these point labels, the CNN first learns to segment a cluster of pixels around the target, and then gradually converges to predict the exact ground truth point.

Motivated by this "mapping degeneration" phenomenon, the LESPS method dynamically expands the point labels using the CNN's own intermediate predictions. Specifically, the point labels are iteratively grown into larger regions based on the network's outputs. This allows the CNN to gradually learn a full pixel-level target mask in an end-to-end manner, without needing the costly full pixel annotations.

The researchers conduct extensive experiments to validate the effectiveness of LESPS. They show that CNNs trained with LESPS can recover the target masks from just point-level supervision, achieving over 70% of the performance of fully supervised CNNs in terms of pixel-level intersection over union (IoU), and over 95% in terms of object-level probability of detection (Pd).

Critical Analysis

The LESPS framework represents an innovative approach to reducing the annotation burden for training CNNs on infrared small target detection. By leveraging the network's own intermediate predictions to progressively expand the point-level labels, the researchers are able to avoid the need for full pixel-level annotations.

However, the paper does not fully address potential limitations or edge cases of the LESPS method. For example, it's unclear how well the approach would scale to more complex scenes with many closely-spaced targets, or how robust it would be to noisy or inaccurate point labels provided by human annotators.

Additionally, while the researchers provide strong quantitative results, more qualitative analysis or visualizations of the intermediate stages of label evolution could help readers better understand the underlying dynamics and failure modes of the approach.

Further research could also explore ways to make the label expansion process more principled or automated, rather than relying on heuristics. Incorporating uncertainty estimates or active learning strategies may be fruitful avenues to investigate.

Overall, the LESPS framework represents an important step forward in reducing annotation costs for infrared small target detection. With further refinement and analysis, it could become a valuable tool in the computer vision practitioner's toolkit.

Conclusion

This paper presents a novel label evolution with single point supervision (LESPS) framework for training convolutional neural networks (CNNs) to detect infrared small targets. By leveraging the CNN's own intermediate predictions to progressively expand simple point-level annotations, LESPS can achieve high performance without the need for labor-intensive full pixel-level annotations.

The researchers' key insight is that CNNs trained on point labels first learn to segment a cluster around the target, and then gradually converge to the exact ground truth point. Motivated by this "mapping degeneration" phenomenon, LESPS dynamically grows the point labels to allow the network to learn a full pixel-level target mask in an end-to-end manner.

Extensive experiments show that CNNs trained with LESPS can recover detailed target masks while achieving over 70% of the performance of fully supervised networks in terms of pixel-level intersection over union (IoU), and over 95% in object-level probability of detection (Pd). This represents an important step forward in reducing annotation costs for infrared small target detection, with potential applications in a variety of computer vision tasks.