论文标题
DEEPLSD:线段检测和深度图像梯度的改进
DeepLSD: Line Segment Detection and Refinement with Deep Image Gradients
论文作者
论文摘要
线段在我们的人类世界中无处不在,并且越来越多地用于视觉任务。由于它们的空间范围及其提供的结构信息,它们对特征点具有补充。基于图像梯度的传统线探测器非常快速,准确,但在嘈杂的图像和具有挑战性的条件下缺乏健壮性。他们所学的同行更具重复性,并且可以处理具有挑战性的图像,但以较低的精度和对线框线的偏见为代价。我们建议将传统和学识渊博的方法结合起来,以获得两全其美的最好:可以在没有地面真相的情况下在野外接受训练的准确而健壮的探测器。在将其转换为替代图像梯度幅度和角度之前,我们的新线段检测器DEEPLSD用深网处理图像以生成线路吸引力字段,然后将其馈送到任何现有的手工制作的线路检测器中。此外,我们为基于吸引力字段和消失点的线段提出了一种新的优化工具。这种改进可以通过很大的边距提高当前深探测器的准确性。我们在低级线路检测指标以及使用多个挑战性数据集的几个下游任务上演示了方法的性能。源代码和模型可在https://github.com/cvg/deeplsd上找到。
Line segments are ubiquitous in our human-made world and are increasingly used in vision tasks. They are complementary to feature points thanks to their spatial extent and the structural information they provide. Traditional line detectors based on the image gradient are extremely fast and accurate, but lack robustness in noisy images and challenging conditions. Their learned counterparts are more repeatable and can handle challenging images, but at the cost of a lower accuracy and a bias towards wireframe lines. We propose to combine traditional and learned approaches to get the best of both worlds: an accurate and robust line detector that can be trained in the wild without ground truth lines. Our new line segment detector, DeepLSD, processes images with a deep network to generate a line attraction field, before converting it to a surrogate image gradient magnitude and angle, which is then fed to any existing handcrafted line detector. Additionally, we propose a new optimization tool to refine line segments based on the attraction field and vanishing points. This refinement improves the accuracy of current deep detectors by a large margin. We demonstrate the performance of our method on low-level line detection metrics, as well as on several downstream tasks using multiple challenging datasets. The source code and models are available at https://github.com/cvg/DeepLSD.