论文标题

使用最佳运输自我监督学习来选择任务进行几次分类

Selecting task with optimal transport self-supervised learning for few-shot classification

论文作者

Xu, Renjie, Yang, Xinghao, Liu, Baodi, Zhang, Kai, Liu, Weifeng

论文摘要

很少有射击分类旨在解决培训过程中只有几个样本的问题。由于缺乏样本,研究人员通常采用来自其他领域的一组培训任务来协助目标任务,在这种任务中,助理任务和目标任务之间的分配通常不同。为了减少分布差距,已经提出了几行方法,例如数据增强和域的比对。但是,这些算法的一个常见缺点是它们在训练之前忽略了相似性任务选择。基本问题是将辅助任务推向目标任务。在本文中,我们提出了一项新的任务选择算法,名为“最佳传输任务选择”(OTTS),以通过选择相似的任务来构建培训设置,以进行几次学习。具体而言,OTTS通过计算最佳运输距离并通过自我监督策略来完成模型培训来衡量任务相似性。通过使用OTT利用选定的任务,几乎没有学习的培训过程变得更加稳定和有效。在此期间,可以使用其他提出的方法,包括数据增强和域对齐方式。我们在各种数据集上进行了广泛的实验,包括迷你胶原,Cifar,Cub,Cars和Place,以评估OTT的有效性。实验结果验证了我们的OTT的表现优于典型的基准,即MAML,Matchingnet,Protonet,较大的边缘(通常1.72 \%的精度提高)。

Few-Shot classification aims at solving problems that only a few samples are available in the training process. Due to the lack of samples, researchers generally employ a set of training tasks from other domains to assist the target task, where the distribution between assistant tasks and the target task is usually different. To reduce the distribution gap, several lines of methods have been proposed, such as data augmentation and domain alignment. However, one common drawback of these algorithms is that they ignore the similarity task selection before training. The fundamental problem is to push the auxiliary tasks close to the target task. In this paper, we propose a novel task selecting algorithm, named Optimal Transport Task Selecting (OTTS), to construct a training set by selecting similar tasks for Few-Shot learning. Specifically, the OTTS measures the task similarity by calculating the optimal transport distance and completes the model training via a self-supervised strategy. By utilizing the selected tasks with OTTS, the training process of Few-Shot learning become more stable and effective. Other proposed methods including data augmentation and domain alignment can be used in the meantime with OTTS. We conduct extensive experiments on a variety of datasets, including MiniImageNet, CIFAR, CUB, Cars, and Places, to evaluate the effectiveness of OTTS. Experimental results validate that our OTTS outperforms the typical baselines, i.e., MAML, matchingnet, protonet, by a large margin (averagely 1.72\% accuracy improvement).

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源