论文标题
基于语义驱动能量的分布外检测
Semantic Driven Energy based Out-of-Distribution Detection
论文作者
论文摘要
在当今部署深度学习系统中,在现实世界的视觉应用(例如分类或对象检测)(例如分类或对象检测)(例如分类或对象检测)中检测到分布(OOD)样本已成为必要的前提。已经提出了许多技术,其中已证明基于能量的OOD方法是有希望的,并且具有令人印象深刻的性能。我们提出了基于语义驱动的能量方法,这是一种端到端的可训练系统,易于优化。我们将分布样品与能量评分和表示分数结合的外部分布样本区分开。我们通过最大程度地降低分布样本的能量来实现这一目标,并同时学习各自的类表征,这些类别更接近和最大化能量以供外分配样品,并将其从已知的类表征进一步推出。此外,我们提出了一种新颖的损失功能,我们称之为集群局灶性损失(CFL),事实证明,它很简单,但在学习更好的班级聚类中心表示方面非常有效。我们发现,我们的新颖方法增强了异常检测,并以基于共同基准的能量模型实现最先进的检测。与现有基于能量的方法相比,在CIFAR-10和CIFAR-100训练有素的WIDERESNET上,我们的模型分别显着降低了相对平均误报率(以95%为95%)和57.4%。此外,我们扩展了对象检测的框架并提高了性能。
Detecting Out-of-Distribution (OOD) samples in real world visual applications like classification or object detection has become a necessary precondition in today's deployment of Deep Learning systems. Many techniques have been proposed, of which Energy based OOD methods have proved to be promising and achieved impressive performance. We propose semantic driven energy based method, which is an end-to-end trainable system and easy to optimize. We distinguish in-distribution samples from out-distribution samples with an energy score coupled with a representation score. We achieve it by minimizing the energy for in-distribution samples and simultaneously learn respective class representations that are closer and maximizing energy for out-distribution samples and pushing their representation further out from known class representation. Moreover, we propose a novel loss function which we call Cluster Focal Loss(CFL) that proved to be simple yet very effective in learning better class wise cluster center representations. We find that, our novel approach enhances outlier detection and achieve state-of-the-art as an energy-based model on common benchmarks. On CIFAR-10 and CIFAR-100 trained WideResNet, our model significantly reduces the relative average False Positive Rate(at True Positive Rate of 95%) by 67.2% and 57.4% respectively, compared to the existing energy based approaches. Further, we extend our framework for object detection and achieve improved performance.