众包中的语音质量评估：比较类别评分法
Speech Quality Assessment in Crowdsourcing: Comparison Category Rating Method
摘要：
传统上，通过主观测试来评估通信系统的体验质量（QoE）。言语QoE最常见的测试方法是绝对类别评级（ACR），其中参与者听一组刺激，由基础测试条件处理，并在特定量表上对每个刺激的感知质量进行评级。比较类别评级（CCR）是另一种标准方法，其中参与者听取参考和处理刺激，并将其质量与另一个进行比较。CCR方法特别适用于提高输入语音质量的系统。本文评估了适应CCR测试程序，用于评估语音质量的众包设置。CCR方法在ITU-T Rec.P.800中被引入用于基于实验室的实验。我们根据ITU-T Rec. P.800和P.808的指导方针调整了众包方法的测试。我们表明，通过众包的CCR程序的结果是高度可重复的。我们还将CCR测试结果与实验室和众包中广泛使用的ACR测试程序进行了比较。我们的研究结果表明，在众包CCR程序是一个可靠和有效的测试方法。
英文摘要：
Traditionally, Quality of Experience (QoE) for a communication system is evaluated through a subjective test. The most common test method for speech QoE is the Absolute Category Rating (ACR), in which participants listen to a set of stimuli, processed by the underlying test conditions, and rate their perceived quality for each stimulus on a specific scale. The Comparison Category Rating (CCR) is another standard approach in which participants listen to both reference and processed stimuli and rate their quality compared to the other one. The CCR method is particularly suitable for systems that improve the quality of input speech. This paper evaluates an adaptation of the CCR test procedure for assessing speech quality in the crowdsourcing set-up. The CCR method was introduced in the ITU-T Rec. P.800 for laboratory-based experiments. We adapted the test for the crowdsourcing approach following the guidelines from ITU-T Rec. P.800 and P.808. We show that the results of the CCR procedure via crowdsourcing are highly reproducible. We also compared the CCR test results with widely used ACR test procedures obtained in the laboratory and crowdsourcing. Our results show that the CCR procedure in crowdsourcing is a reliable and valid test method.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
