论文标题

对未校准图像的3D面部重建的调查

Survey on 3D face reconstruction from uncalibrated images

论文作者

Morales, Araceli, Piella, Gemma, Sukno, Federico M.

论文摘要

最近,大量关注的重点是将3D数据纳入面部分析及其应用。尽管提供了面部的更准确的表示,但3D面部图像比2D图片更复杂。结果,已经为开发未校准的2D图像重建3D面孔的系统投入了巨大的努力。但是,3D-From-2D面部重建问题是不适合的,因此需要先验知识来限制解决方案空间。在这项工作中,我们回顾了过去十年中提出的3D面对重建方法,重点是仅使用在不受控制的条件下捕获的2D图片的人。我们根据用于增加先验知识的技术进行了对拟议方法的分类,即考虑三种主要策略,即统计模型拟合,光度法和深度学习,并分别审查每个策略。此外,鉴于统计3D面部模型作为先验知识的相关性,我们解释了施工程序,并提供了最流行的公开可用3D面部模型的列表。在对3D-From-2D面对重建方法进行详尽的研究之后,我们观察到自过去几年以来,深度学习策略正在迅速增长,成为替代广泛统计模型拟合的标准选择。与其他两种策略不同,与统计模型拟合和深度学习方法相比,基于光度法的方法的数量有所减少,这些假设需要限制其重建质量的强大基础假设。该评论还确定了当前的挑战,并提出了未来研究的途径。

Recently, a lot of attention has been focused on the incorporation of 3D data into face analysis and its applications. Despite providing a more accurate representation of the face, 3D facial images are more complex to acquire than 2D pictures. As a consequence, great effort has been invested in developing systems that reconstruct 3D faces from an uncalibrated 2D image. However, the 3D-from-2D face reconstruction problem is ill-posed, thus prior knowledge is needed to restrict the solutions space. In this work, we review 3D face reconstruction methods proposed in the last decade, focusing on those that only use 2D pictures captured under uncontrolled conditions. We present a classification of the proposed methods based on the technique used to add prior knowledge, considering three main strategies, namely, statistical model fitting, photometry, and deep learning, and reviewing each of them separately. In addition, given the relevance of statistical 3D facial models as prior knowledge, we explain the construction procedure and provide a list of the most popular publicly available 3D facial models. After the exhaustive study of 3D-from-2D face reconstruction approaches, we observe that the deep learning strategy is rapidly growing since the last few years, becoming the standard choice in replacement of the widespread statistical model fitting. Unlike the other two strategies, photometry-based methods have decreased in number due to the need for strong underlying assumptions that limit the quality of their reconstructions compared to statistical model fitting and deep learning methods. The review also identifies current challenges and suggests avenues for future research.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源