arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.02618cs.MM
收藏

招募少量观察者并重复的主观评估实验(FOWR)

Subjective Assessment Experiments That Recruit Few Observers With Repetitions (FOWR)

Pablo Perez, Lucjan Janowski, Narciso Garcia, Margaret Pinson

摘要:

最近的研究表明,它是可能的主观评价测试中的主题偏差和方差的特点。在大多数情况下,受试者之间的明显差异可以用随机因素来解释。基于这一理论,我们提出了一个主观测试设计,其中三到四个团队成员每个人都多次评价刺激。结果与高性能客观指标相当。这提供了一种快速简单的方法来分析新技术并执行主观评估的预测试。

英文摘要:

Recent studies have shown that it is possible to characterize subject bias and variance in subjective assessment tests. Apparent differences among subjects can, for the most part, be explained by random factors. Building on that theory, we propose a subjective test design where three to four team members each rate the stimuli multiple times. The results are comparable to a high performing objective metric. This provides a quick and simple way to analyze new technologies and perform pre-tests for subjective assessment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑