论文标题
从混合数据集中学习:单调图像质量评估模型
Learning from Mixed Datasets: A Monotonic Image Quality Assessment Model
论文作者
论文摘要
基于深度学习的图像质量评估(IQA)模型通常学会从单个数据集中预测图像质量,从而导致该模型过度适合特定的场景。为此,混合的数据集培训可能是增强模型概括能力的有效方法。但是,将不同的iQA数据集结合在一起是不平凡的,因为它们的质量评估标准,得分范围,视图条件以及在图像质量注释期间通常不共享主题。在本文中,我们没有对注释进行对齐,而是为IQA模型学习提供了一个单调的神经网络,其中包含不同的数据集。特别是,我们的模型由数据集共享质量回归器和几个特定于数据集的质量变压器组成。质量回归器旨在获得每个数据集的感知质量,而每个质量变压器则将感知质量映射到相应的数据集注释及其单调性。实验结果验证了提出的学习策略的有效性,我们的代码可在https://github.com/fzp0424/monotoniciqa上获得。
Deep learning based image quality assessment (IQA) models usually learn to predict image quality from a single dataset, leading the model to overfit specific scenes. To account for this, mixed datasets training can be an effective way to enhance the generalization capability of the model. However, it is nontrivial to combine different IQA datasets, as their quality evaluation criteria, score ranges, view conditions, as well as subjects are usually not shared during the image quality annotation. In this paper, instead of aligning the annotations, we propose a monotonic neural network for IQA model learning with different datasets combined. In particular, our model consists of a dataset-shared quality regressor and several dataset-specific quality transformers. The quality regressor aims to obtain the perceptual qualities of each dataset while each quality transformer maps the perceptual qualities to the corresponding dataset annotations with their monotonicity maintained. The experimental results verify the effectiveness of the proposed learning strategy and our code is available at https://github.com/fzp0424/MonotonicIQA.