从图像质量数据集学习局部失真可见性
Learning Local Distortion Visibility From Image Quality Data-sets
摘要:
在许多图像和视频处理应用中,局部失真可见性阈值的准确预测是至关重要的。现有的方法需要对人类视觉系统进行精确建模,并且是通过简单的人工刺激的物理实验得出的。然而,这些方法很难推广到具有复杂类型失真的自然图像。在本文中,我们探索了一个不同的角度,我们调查是否有可能从图像质量分数学习局部失真可见性。我们提出了一个基于卷积神经网络的优化框架,以推断局部检测阈值的失真图像。我们的模型在多个质量数据集上进行了训练,结果与最近一项研究中收集的复杂刺激的经验可见性阈值相关。我们的结果与直接在phsycovisual数据上训练的最先进的数学模型相当。这表明,它是可能的预测心理物理现象的可见性信息嵌入在图像质量分数。
英文摘要:
Accurate prediction of local distortion visibility thresholds is critical in many image and video processing applications. Existing methods require an accurate modeling of the human visual system, and are derived through pshycophysical experiments with simple, artificial stimuli. These approaches, however, are difficult to generalize to natural images with complex types of distortion. In this paper, we explore a different perspective, and we investigate whether it is possible to learn local distortion visibility from image quality scores. We propose a convolutional neural network based optimization framework to infer local detection thresholds in a distorted image. Our model is trained on multiple quality datasets, and the results are correlated with empirical visibility thresholds collected on complex stimuli in a recent study. Our results are comparable to state-of-the-art mathematical models that were trained on phsycovisual data directly. This suggests that it is possible to predict psychophysical phenomena from visibility information embedded in image quality scores.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。