论文标题
学会将纹理显着性适应图像漫画化的注意力
Learning to Incorporate Texture Saliency Adaptive Attention to Image Cartoonization
论文作者
论文摘要
从无监督的图像到图像翻译的角度来看,图像漫画化最近由生成对抗网络(GAN)主导,其中固有的挑战是精确捕获和充分传递特征性的卡通风格(例如,清晰的边缘,光滑的色彩阴影,光滑的色彩阴影,抽象的精美结构等)。现有的高级模型试图通过学习以对抗性促进边缘,引入样式转移损失或学习从多个表示空间保持一致的样式来增强卡通化效果。本文表明,只有基本的对抗性损失,可以轻松实现更独特和生动的漫画化效果。观察到卡通风格在卡通纹理的本地图像区域中更为明显,我们与正常图像级构建了一个区域级别的对抗学习分支,该分支与正常的图像级构建,该分支限制了在卡通质量介绍的局部局部贴片上的对抗性学习,以更好地感知和传递卡通文本特征。为此,提出了一种新型的卡通纹理效果缓慢(CTSS)模块,以从训练数据中动态采样卡通纹理 - 静态贴片。通过广泛的实验,我们证明了对抗性学习中的纹理显着性适应性注意力,作为图像漫画化中相关方法的缺失成分,对于促进和增强图像卡通风格而言至关重要,特别是对于高分辨率输入图片。
Image cartoonization is recently dominated by generative adversarial networks (GANs) from the perspective of unsupervised image-to-image translation, in which an inherent challenge is to precisely capture and sufficiently transfer characteristic cartoon styles (e.g., clear edges, smooth color shading, abstract fine structures, etc.). Existing advanced models try to enhance cartoonization effect by learning to promote edges adversarially, introducing style transfer loss, or learning to align style from multiple representation space. This paper demonstrates that more distinct and vivid cartoonization effect could be easily achieved with only basic adversarial loss. Observing that cartoon style is more evident in cartoon-texture-salient local image regions, we build a region-level adversarial learning branch in parallel with the normal image-level one, which constrains adversarial learning on cartoon-texture-salient local patches for better perceiving and transferring cartoon texture features. To this end, a novel cartoon-texture-saliency-sampler (CTSS) module is proposed to dynamically sample cartoon-texture-salient patches from training data. With extensive experiments, we demonstrate that texture saliency adaptive attention in adversarial learning, as a missing ingredient of related methods in image cartoonization, is of significant importance in facilitating and enhancing image cartoon stylization, especially for high-resolution input pictures.