论文标题

神经雅各布田:学习任意网格的内在映射

Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshes

论文作者

Aigerman, Noam, Gupta, Kunal, Kim, Vladimir G., Chaudhuri, Siddhartha, Saito, Jun, Groueix, Thibault

论文摘要

本文介绍了一个框架,旨在通过神经网络准确地预测任意网格的分段线性映射,从而实现训练和评估不共享三角剖分的异质收集的网格集合,并产生高度细节的图像,其准确的准确性超过了艺术的当前状态。该框架基于将神经方面降低到单个给定点的矩阵的预测,并以整体形状描述符为条件。然后将矩阵字段投影到给定网格的切线束上,并用作预测地图的候选雅各布人。该地图是由标准泊松求解计算的,该标准泊松求解是作为可靠的层实现的,该层具有缓存的预分离以进行有效训练。这种构建对输入的三角剖分不可知,从而在具有不同三角剖分的数据集上实现了应用程序。同时,通过在每个单独网格的固有梯度域操作,它允许框架预测高度准确的映射。我们通过在各种场景中进行实验来验证这些属性,从变形,注册和变形传递等语义的场景到基于优化的实验,例如模拟弹性变形和接触校正,以及据我们所知的第一项工作,到学习的任务来应对计算UV参数的任务。结果表现出该方法的高精度及其多功能性,因为它很容易应用于上述情况,而没有任何更改框架的情况。

This paper introduces a framework designed to accurately predict piecewise linear mappings of arbitrary meshes via a neural network, enabling training and evaluating over heterogeneous collections of meshes that do not share a triangulation, as well as producing highly detail-preserving maps whose accuracy exceeds current state of the art. The framework is based on reducing the neural aspect to a prediction of a matrix for a single given point, conditioned on a global shape descriptor. The field of matrices is then projected onto the tangent bundle of the given mesh, and used as candidate jacobians for the predicted map. The map is computed by a standard Poisson solve, implemented as a differentiable layer with cached pre-factorization for efficient training. This construction is agnostic to the triangulation of the input, thereby enabling applications on datasets with varying triangulations. At the same time, by operating in the intrinsic gradient domain of each individual mesh, it allows the framework to predict highly-accurate mappings. We validate these properties by conducting experiments over a broad range of scenarios, from semantic ones such as morphing, registration, and deformation transfer, to optimization-based ones, such as emulating elastic deformations and contact correction, as well as being the first work, to our knowledge, to tackle the task of learning to compute UV parameterizations of arbitrary meshes. The results exhibit the high accuracy of the method as well as its versatility, as it is readily applied to the above scenarios without any changes to the framework.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源