论文标题

VID2Curve:从RGB视频中同时进行相机运动估计和薄结构重建

Vid2Curve: Simultaneous Camera Motion Estimation and Thin Structure Reconstruction from an RGB Video

论文作者

Wang, Peng, Liu, Lingjie, Chen, Nenglun, Chu, Hung-Kuo, Theobalt, Christian, Wang, Wenping

论文摘要

在现实世界中,薄的结构,例如电框雕塑,栅栏,电缆,电源线和树枝很常见。使用基于图像的传统或基于深度的重建方法获取其3D数字模型非常具有挑战性,因为薄结构通常缺乏独特的点特征并且具有严重的自我概括。我们提出了第一种同时估算摄像机运动的方法,并通过手持式相机捕获的颜色视频从高质量的高质量中重建了复杂的3D薄结构的几何形状。具体来说,我们提出了一种基于曲线的新方法,通过在连续的视频框架中建立无特征的薄对象之间的对应关系,而无需在背景场景中锁定视觉纹理。通过这种有效的基于曲线的相机姿势估计策略启用,我们开发了一种迭代优化方法,该方法具有定制的几何措施,拓扑以及用于重建3D薄结构的自我批判性处理。对各种薄结构的广泛验证表明,我们的方法实现了准确的相机姿势估计,并忠实地重建具有复杂形状和拓扑的3D薄结构,其水平尚未通过其他现有重建方法实现。

Thin structures, such as wire-frame sculptures, fences, cables, power lines, and tree branches, are common in the real world. It is extremely challenging to acquire their 3D digital models using traditional image-based or depth-based reconstruction methods because thin structures often lack distinct point features and have severe self-occlusion. We propose the first approach that simultaneously estimates camera motion and reconstructs the geometry of complex 3D thin structures in high quality from a color video captured by a handheld camera. Specifically, we present a new curve-based approach to estimate accurate camera poses by establishing correspondences between featureless thin objects in the foreground in consecutive video frames, without requiring visual texture in the background scene to lock on. Enabled by this effective curve-based camera pose estimation strategy, we develop an iterative optimization method with tailored measures on geometry, topology as well as self-occlusion handling for reconstructing 3D thin structures. Extensive validations on a variety of thin structures show that our method achieves accurate camera pose estimation and faithful reconstruction of 3D thin structures with complex shape and topology at a level that has not been attained by other existing reconstruction methods.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源