arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1706.00291cs.MMstat.AP
收藏

多媒体质量评估中的数据分析:再论统计检验

Data Analysis in Multimedia Quality Assessment: Revisiting the Statistical Tests

Manish Narwaria, Lukas Krasula, Patrick Le Callet

摘要:

多媒体质量的评估在很大程度上依赖于主观评估,并且通常由人类主体以偏好或连续评级的形式完成。这些数据对于分析不同的多媒体处理算法以及验证用于所述目的的客观(计算)方法至关重要。为此,统计测试提供了一个理论框架,以得出有意义的推论,并作出有根据的结论和建议。虽然参数检验(如t检验,方差分析和误差估计,如置信区间)在社区中很受欢迎和广泛使用,但在应用此类检验时似乎存在一定程度的混乱。具体来说,正态性和方差齐性的假设往往没有得到很好的理解。因此,本文的主要目标是从理论的角度重新审视它们,并在此过程中提供有益的见解,其实际意义。模拟和真实数据的实验结果支持的论点。执行上述建议的软件也已公开提供,以实现可重复研究的目标。

英文摘要:

Assessment of multimedia quality relies heavily on subjective assessment, and is typically done by human subjects in the form of preferences or continuous ratings. Such data is crucial for analysis of different multimedia processing algorithms as well as validation of objective (computational) methods for the said purpose. To that end, statistical testing provides a theoretical framework towards drawing meaningful inferences, and making well grounded conclusions and recommendations. While parametric tests (such as t test, ANOVA, and error estimates like confidence intervals) are popular and widely used in the community, there appears to be a certain degree of confusion in the application of such tests. Specifically, the assumption of normality and homogeneity of variance is often not well understood. Therefore, the main goal of this paper is to revisit them from a theoretical perspective and in the process provide useful insights into their practical implications. Experimental results on both simulated and real data are presented to support the arguments made. A software implementing the said recommendations is also made publicly available, in order to achieve the goal of reproducible research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑