arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.02397cs.GR
收藏

纹理网格质量评估:大规模数据集与基于深度学习的质量度量

Textured Mesh Quality Assessment: Large-Scale Dataset and Deep Learning-based Quality Metric

Yana Nehmé, Johanna Delanoy, Florent Dupont, Jean-Philippe Farrugia, Patrick Le Callet, Guillaume Lavoué

AI总结:

本研究构建了包含343k失真刺激的大规模纹理网格数据集,通过众包收集近15万主观评分,提出基于学习的质量度量,在多个数据集上达到最先进性能,并应用于探索失真交互影响。

摘要:

在过去的十年中,3D图形已经变得高度详细以模拟真实世界,导致其尺寸和复杂性急剧增加。某些应用和设备限制要求对其进行简化和/或有损压缩,这可能降低其视觉质量。因此,为了确保最佳体验质量(QoE),评估视觉质量以准确驱动压缩并找到视觉质量与数据大小之间的正确折衷非常重要。在这项工作中,我们专注于纹理3D网格的主观和客观质量评估。我们首先建立了一个大规模数据集,该数据集包含55个源模型,这些模型在几何、颜色和语义复杂性方面进行了定量表征,并通过组合5种基于压缩的失真类型(应用于网格的几何、纹理映射和纹理图像)进行破坏。该数据集包含超过343k个失真刺激。我们提出了一种方法来选择具有挑战性的3000个刺激子集,并为这些刺激在大型众包主观实验中从超过4500名参与者那里收集了148929个质量判断。利用我们的主观评分数据集,提出了一种基于学习的3D图形质量度量。我们的度量在纹理网格数据集和带有顶点颜色的失真网格数据集上展示了最先进的结果。最后,我们展示了我们的度量数据集在探索失真交互和内容特征对压缩纹理网格感知质量影响方面的应用。

英文摘要:

Over the past decade, 3D graphics have become highly detailed to mimic the real world, exploding their size and complexity. Certain applications and device constraints necessitate their simplification and/or lossy compression, which can degrade their visual quality. Thus, to ensure the best Quality of Experience (QoE), it is important to evaluate the visual quality to accurately drive the compression and find the right compromise between visual quality and data size. In this work, we focus on subjective and objective quality assessment of textured 3D meshes. We first establish a large-scale dataset, which includes 55 source models quantitatively characterized in terms of geometric, color, and semantic complexity, and corrupted by combinations of 5 types of compression-based distortions applied on the geometry, texture mapping and texture image of the meshes. This dataset contains over 343k distorted stimuli. We propose an approach to select a challenging subset of 3000 stimuli for which we collected 148929 quality judgments from over 4500 participants in a large-scale crowdsourced subjective experiment. Leveraging our subject-rated dataset, a learning-based quality metric for 3D graphics was proposed. Our metric demonstrates state-of-the-art results on our dataset of textured meshes and on a dataset of distorted meshes with vertex colors. Finally, we present an application of our metric and dataset to explore the influence of distortion interactions and content characteristics on the perceived quality of compressed textured meshes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑