论文标题
透明对象的网格重建的可区分折射跟踪
Differentiable Refraction-Tracing for Mesh Reconstruction of Transparent Objects
论文作者
论文摘要
捕获透明物体的3D几何形状是一项具有挑战性的任务，不适合通用扫描和重建技术，因为它们无法处理镜面光传输现象。专门为此任务设计的现有最新方法涉及复杂的设置以重建完整的折射路径，或者基于合成训练数据利用数据驱动的方法。无论哪种情况，重建的3D模型都会遭受过度光滑的和细节的损失。本文介绍了一种新颖的，高精度，3D采集和重建方法，用于实心透明对象。使用带有编码图案的静态背景，我们在摄像机视图射线和背景上的位置之间建立了映射。然后，使用折射光路径的可区分跟踪来直接优化对象的3D网格近似，同时确保剪影的一致性和光滑度。广泛的实验和比较证明了我们方法的卓越精度。
Capturing the 3D geometry of transparent objects is a challenging task, ill-suited for general-purpose scanning and reconstruction techniques, since these cannot handle specular light transport phenomena. Existing state-of-the-art methods, designed specifically for this task, either involve a complex setup to reconstruct complete refractive ray paths, or leverage a data-driven approach based on synthetic training data. In either case, the reconstructed 3D models suffer from over-smoothing and loss of fine detail. This paper introduces a novel, high precision, 3D acquisition and reconstruction method for solid transparent objects. Using a static background with a coded pattern, we establish a mapping between the camera view rays and locations on the background. Differentiable tracing of refractive ray paths is then used to directly optimize a 3D mesh approximation of the object, while simultaneously ensuring silhouette consistency and smoothness. Extensive experiments and comparisons demonstrate the superior accuracy of our method.
