A Comparative Study of CAM Variants with GrabCut Refinement for Large-Scale Pseudo-Mask Generation
Year: 2025
Type: article
Abstract: Semantic segmentation typically demands laborious pixel-level annotations, motivating cost-effective weakly supervised approaches that generate pseudo-masks from classifier signals. Weakly supervised pseudo-mask generation offers a cost-effective alternative to costly pixel-level annotation by leveraging classifier activation maps and simple refinement. In this work, we present the first large-scale, systematic comparison of six Class Activation Map (CAM) variants—CAM, Grad-CAM, Grad-CAM++, Eigen-CAM, Layer-CAM, and Ablation-CAM—within a unified GrabCut refinement pipeline. For each CAM method, we binarize heatmaps using both a fixed 0.2 threshold and Otsu’s method, then refine seeds with GrabCut to produce final masks. Evaluated on 23,151 ImageNet-LID validation images, our results show that (1) vanilla CAM yields the most precise seeds and highest final mask quality (IoU = 0.5124, Dice = 0.6219), (2) GrabCut consistently improves mask accuracy across all variants (ΔIoU≈0.10-0.17,ΔDice≈0.08-0.14), and (3) although newer CAM methods exhibit superior localization in raw heatmaps, those advantages do not translate into better thresholded pseudo‐masks after GrabCut refinement. These findings guide practitioners toward simple yet effective weakly supervised segmentation pipelines and highlight directions—such as multi‐threshold schemes or alternative refinement methods—for capturing the strengths of advanced CAM variants.
Author: Binghan Chen
Institution: University College London
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4413183407