arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1612.03530cs.CV
收藏

一种注意力驱动的无参考图像质量评价方法

An Attention-Driven Approach of No-Reference Image Quality Assessment

Peking University(北京大学);North Carolina State University(北卡罗来纳州立大学)

Diqi Chen, Yizhou Wang, Tianfu Wu, Wen Gao

摘要:

在本文中,我们提出了一种新的方法,无参考图像质量评估(NR-IQA),这是预测的感知质量分数的给定图像,而不使用任何参考图像。所提出的方法利用三个功能(i)视觉注意力机制,它影响视觉感知的许多方面,包括图像质量评估,然而,在NR-IQA文献中被忽视。该方法假设图像上的注视区域包含IQA过程的关键信息。(ii)鲁棒平均策略,这是一种由心理学研究支持的方法,用于整合多个/逐步证据以做出最终的感知判断。(iii)多任务学习被认为是形成表示学习的有效手段,并可能导致更普遍的模型。为了利用三者的协同作用,我们将NR-IQA视为一个动态感知过程,其中模型对一系列“信息”区域进行采样,并汇总信息以学习联合预测图像质量分数和失真类型的任务的表示。模型学习通过强化策略实现,其中两个任务的奖励引导学习最优采样策略以获取“任务信息”图像区域,从而可以准确有效地进行预测(就采样步骤而言)。强化学习通过具有策略梯度方法的深度网络实现,并通过反向传播进行训练。在实验中,该模型在TID 2008数据集上进行了测试,其性能优于几种最先进的方法。此外,该模型是非常有效的意义上说,少量的固定使用NR-IQA。

英文摘要:

In this paper, we present a novel method of no-reference image quality assessment (NR-IQA), which is to predict the perceptual quality score of a given image without using any reference image. The proposed method harnesses three functions (i) the visual attention mechanism, which affects many aspects of visual perception including image quality assessment, however, is overlooked in the NR-IQA literature. The method assumes that the fixation areas on an image contain key information to the process of IQA. (ii) the robust averaging strategy, which is a means \--- supported by psychology studies \--- to integrating multiple/step-wise evidence to make a final perceptual judgment. (iii) the multi-task learning, which is believed to be an effectual means to shape representation learning and could result in a more generalized model. To exploit the synergy of the three, we consider the NR-IQA as a dynamic perception process, in which the model samples a sequence of "informative" areas and aggregates the information to learn a representation for the tasks of jointly predicting the image quality score and the distortion type. The model learning is implemented by a reinforcement strategy, in which the rewards of both tasks guide the learning of the optimal sampling policy to acquire the "task-informative" image regions so that the predictions can be made accurately and efficiently (in terms of the sampling steps). The reinforcement learning is realized by a deep network with the policy gradient method and trained through back-propagation. In experiments, the model is tested on the TID2008 dataset and it outperforms several state-of-the-art methods. Furthermore, the model is very efficient in the sense that a small number of fixations are used in NR-IQA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑