arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2008.05396cs.CVcs.LG
收藏

融合多层次结构相似度的全参考屏内容图像质量评价

Full Reference Screen Content Image Quality Assessment by Fusing Multi-level Structure Similarity

Qingdao University(青岛大学);Stony Brook University(石溪大学)

Chenglizhao Chen, Hongmeng Zhao, Huan Yang, Chong Peng, Teng Yu

摘要:

屏幕内容图像(SCI)通常包括具有尖锐边缘的各种内容类型,其中伪影或失真可以通过香草结构相似性度量以完全参考的方式很好地感测。尽管如此,几乎所有当前的SOTA结构相似性度量都是以单级方式“局部”制定的,而真正的人类视觉系统(HVS)遵循多级方式,并且这种不匹配可能最终阻止这些度量实现可信的质量评估。为了改进这一问题,本文从稀疏表示的角度提出了一种“全局”度量结构相似性的新方法。为了根据真实的HVS进行多级质量评估,上述全局度量将通过诉诸新设计的选择性深度融合网络与传统的局部度量相结合。为了验证该方法的有效性,我们在两个广泛使用的大规模SCI数据集上将该方法与12种SOTA方法进行了比较,定量结果表明,该方法与主观质量评分的一致性明显高于目前的主流方法。源代码和数据也是公开的,以获得广泛的接受,并促进新的进步及其验证。

英文摘要:

The screen content images (SCIs) usually comprise various content types with sharp edges, in which the artifacts or distortions can be well sensed by the vanilla structure similarity measurement in a full reference manner. Nonetheless, almost all of the current SOTA structure similarity metrics are "locally" formulated in a single-level manner, while the true human visual system (HVS) follows the multi-level manner, and such mismatch could eventually prevent these metrics from achieving trustworthy quality assessment. To ameliorate, this paper advocates a novel solution to measure structure similarity "globally" from the perspective of sparse representation. To perform multi-level quality assessment in accordance with the real HVS, the above-mentioned global metric will be integrated with the conventional local ones by resorting to the newly devised selective deep fusion network. To validate its efficacy and effectiveness, we have compared our method with 12 SOTA methods over two widely-used large-scale public SCI datasets, and the quantitative results indicate that our method yields significantly higher consistency with subjective quality score than the currently leading works. Both the source code and data are also publicly available to gain widespread acceptance and facilitate new advancement and its validation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑