arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.05502cs.MMcs.HC
收藏

应用Just-Noteable Difference in Quality作为众包语音质量评估任务的环境适应性测试

Application of Just-Noticeable Difference in Quality as Environment Suitability Test for Crowdsourcing Speech Quality Assessment Task

Babak Naderi, Sebastian Möller

摘要:

众包微任务平台通过提供对高度可扩展的、地理上分布的和人口统计上多样化的众包工作者池的访问来促进主观媒体质量评估。这些工作人员使用自己的硬件,从自己的工作环境远程参与实验。在语音质量评估的情况下,初步的工作表明,环境噪声在听众的一侧和听设备(扬声器或耳机)显着影响感知质量,因此主观评级的可靠性和有效性。因此,ITU-T Rec.P.808规定了在评估语音质量时对人群工作人员的收听环境的要求。在本文中,我们提出了一个新的只是明显的质量差异(JNDQ)测试作为一个远程筛选方法,用于评估是否适合参加语音质量评估任务的工作环境。在实验室实验中,参与者在不同的收听环境中使用不同的收听设备进行了JNDQ测试,包括根据ITU-T Rec. P.800的静音室和模拟的背景噪声场景。结果显示环境和听音设备对JNDQ阈值有显著影响。因此,收听设备和背景噪声的组合需要在众包语音质量测试中被筛选。我们提出了我们的JNDQ测试的最低阈值作为一个容易适用的筛选方法,用于此目的。

英文摘要:

Crowdsourcing micro-task platforms facilitate subjective media quality assessment by providing access to a highly scale-able, geographically distributed and demographically diverse pool of crowd workers. Those workers participate in the experiment remotely from their own working environment, using their own hardware. In the case of speech quality assessment, preliminary work showed that environmental noise at the listener's side and the listening device (loudspeaker or headphone) significantly affect perceived quality, and consequently the reliability and validity of subjective ratings. As a consequence, ITU-T Rec. P.808 specifies requirements for the listening environment of crowd workers when assessing speech quality. In this paper, we propose a new Just Noticeable Difference of Quality (JNDQ) test as a remote screening method for assessing the suitability of the work environment for participating in speech quality assessment tasks. In a laboratory experiment, participants performed this JNDQ test with different listening devices in different listening environments, including a silent room according to ITU-T Rec. P.800 and a simulated background noise scenario. Results show a significant impact of the environment and the listening device on the JNDQ threshold. Thus, the combination of listening device and background noise needs to be screened in a crowdsourcing speech quality test. We propose a minimum threshold of our JNDQ test as an easily applicable screening method for this purpose.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑