沉浸式内容的视听感知质量模型
Towards a Perceived Audiovisual Quality Model for Immersive Content
摘要：
本文研究了使用盔装显示器和多通道扬声器设置再现的360度视频和立体混响空间音频的多媒体内容的质量。根据360视频的基本视频质量测试条件选择编码参数，并将低比特率编解码器用于音频编码器。三个主观实验分别进行了音频，视频和视听。计算360个视频的峰值信噪比（PSNR）及其变体，以获得客观质量指标，并随后与主观视频分数相关。这项研究表明，跨格式SPSNR-NN在所有视频序列上具有略高的线性和单调相关性。基于视听模型，功效模型显示测试数据和预测分数之间的最高相关性。我们得出的结论是，为了能够开发出更好的预测模型，需要一个高质量的，关键的，同步的视听数据库。此外，在测试之前进行全面的评估者培训可能是有益的，以提高评估者的辨别能力，特别是关于多声道音频再现的辨别能力。为了进一步提高沉浸式内容的视听质量模型的性能，除了开发更广泛和关键的视听数据库外，还需要改进主观测试方法，以提供更高的分辨率和鲁棒性。
英文摘要：
This paper studies the quality of multimedia content focusing on 360 video and ambisonic spatial audio reproduced using a head-mounted display and a multichannel loudspeaker setup. Encoding parameters following basic video quality test conditions for 360 videos were selected and a low-bitrate codec was used for the audio encoder. Three subjective experiments were performed for the audio, video, and audiovisual respectively. Peak signal-to-noise ratio (PSNR) and its variants for 360 videos were computed to obtain objective quality metrics and subsequently correlated with the subjective video scores. This study shows that a Cross-Format SPSNR-NN has a slightly higher linear and monotonic correlation over all video sequences. Based on the audiovisual model, a power model shows a highest correlation between test data and predicted scores. We concluded that to enable the development of superior predictive model, a high quality, critical, synchronized audiovisual database is required. Furthermore, comprehensive assessor training may be beneficial prior to the testing to improve the assessors' discrimination ability particularly with respect to multichannel audio reproduction. In order to further improve the performance of audiovisual quality models for immersive content, in addition to developing broader and critical audiovisual databases, the subjective testing methodology needs to be evolved to provide greater resolution and robustness.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
