论文标题
在野外几射击
Few-Shot Head Swapping in the Wild
论文作者
论文摘要
头交换任务旨在完美地将源头放在目标主体上，这对于各种娱乐场景至关重要。尽管面部交换引起了很多关注，但很少探索头部交换的任务，尤其是在几个射击设置下。由于其在头部建模和背景融合中的独特需求，这本质上是具有挑战性的。在本文中，我们介绍了头部交换器（HES），该交换器通过两个精心设计的模块在野外几乎没有头部交换。首先，通过检查多尺度信息，设计了一个Head2head对准器将整体迁移的姿势和表达信息从目标迁移到源头。其次，为了应对交换过程中的肤色变化和后背景不匹配的挑战，引入了Head2scene Blender，以同时修改面部肤色，并填补头部周围背景的不匹配间隙。特别是，借助于语义引导的色彩参考创建程序和混合UNET实现无缝混合。广泛的实验表明，所提出的方法在各种场景中产生了出色的头部交换结果。
The head swapping task aims at flawlessly placing a source head onto a target body, which is of great importance to various entertainment scenarios. While face swapping has drawn much attention, the task of head swapping has rarely been explored, particularly under the few-shot setting. It is inherently challenging due to its unique needs in head modeling and background blending. In this paper, we present the Head Swapper (HeSer), which achieves few-shot head swapping in the wild through two delicately designed modules. Firstly, a Head2Head Aligner is devised to holistically migrate pose and expression information from the target to the source head by examining multi-scale information. Secondly, to tackle the challenges of skin color variations and head-background mismatches in the swapping procedure, a Head2Scene Blender is introduced to simultaneously modify facial skin color and fill mismatched gaps in the background around the head. Particularly, seamless blending is achieved with the help of a Semantic-Guided Color Reference Creation procedure and a Blending UNet. Extensive experiments demonstrate that the proposed method produces superior head swapping results in a variety of scenes.
