论文标题
通过公制学习进行自我训练,以适应语义分割的无源域
Self-training via Metric Learning for Source-Free Domain Adaptation of Semantic Segmentation
论文作者
论文摘要
无监督的无源域适应方法旨在训练目标域的模型,利用验证的源域模型和未标记的目标域数据,尤其是由于知识产权或隐私问题限制了源数据的可访问性时。传统方法通常将自我训练与伪标记使用,通常根据预测信心对阈值进行阈值。但是,这种阈值限制了由于监督不足而引起的自我训练的有效性。在无源环境中,此问题变得更加严重,在这种环境中,监督仅来自预先训练的源模型的预测。在这项研究中,我们提出了一种新颖的方法,通过合并均等老师模型,其中使用教师网络的所有预测对学生网络进行培训。我们没有在预测上采用阈值,而是引入了一种方法,以根据教师预测的可靠性根据伪标签计算得出的梯度。为了评估可靠性,我们使用基于代理的公制学习引入了一种新颖的方法。我们的方法在综合到现实和跨城市方案中进行了评估,与现有最新方法相比,表现出较高的性能。
Unsupervised source-free domain adaptation methods aim to train a model for the target domain utilizing a pretrained source-domain model and unlabeled target-domain data, particularly when accessibility to source data is restricted due to intellectual property or privacy concerns. Traditional methods usually use self-training with pseudo-labeling, which is often subjected to thresholding based on prediction confidence. However, such thresholding limits the effectiveness of self-training due to insufficient supervision. This issue becomes more severe in a source-free setting, where supervision comes solely from the predictions of the pre-trained source model. In this study, we propose a novel approach by incorporating a mean-teacher model, wherein the student network is trained using all predictions from the teacher network. Instead of employing thresholding on predictions, we introduce a method to weight the gradients calculated from pseudo-labels based on the reliability of the teacher's predictions. To assess reliability, we introduce a novel approach using proxy-based metric learning. Our method is evaluated in synthetic-to-real and cross-city scenarios, demonstrating superior performance compared to existing state-of-the-art methods.