论文标题
ClassMix:半监督学习的基于细分的数据增强
ClassMix: Segmentation-Based Data Augmentation for Semi-Supervised Learning
论文作者
论文摘要
语义细分中的最新技术的性能正在稳步提高,从而在许多不同的应用中更加精确,更可靠地分割。但是,进度受到培训标签的成本的限制,有时需要进行数小时的手动劳动才能进行单个图像。因此,半监督方法已应用于此任务,并取得了不同程度的成功。一个关键的挑战是,在半监督分类中使用的常见扩展对于语义分割效果较差。我们提出了一种称为ClassMix的新型数据增强机制,该机制通过利用网络的预测来尊重对象边界来通过混合未标记的样品来产生增强。我们对两种常见的半监督语义分割基准测试评估了这种增强技术,表明它可以达到最先进的结果。最后,我们还提供了比较不同设计决策和培训制度的广泛消融研究。
The state of the art in semantic segmentation is steadily increasing in performance, resulting in more precise and reliable segmentations in many different applications. However, progress is limited by the cost of generating labels for training, which sometimes requires hours of manual labor for a single image. Because of this, semi-supervised methods have been applied to this task, with varying degrees of success. A key challenge is that common augmentations used in semi-supervised classification are less effective for semantic segmentation. We propose a novel data augmentation mechanism called ClassMix, which generates augmentations by mixing unlabelled samples, by leveraging on the network's predictions for respecting object boundaries. We evaluate this augmentation technique on two common semi-supervised semantic segmentation benchmarks, showing that it attains state-of-the-art results. Lastly, we also provide extensive ablation studies comparing different design decisions and training regimes.