arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1909.09633cs.HCcs.SI
收藏

量化认知偏差在问答系统中的影响

Quantifying the Impact of Cognitive Biases in Question-Answering Systems

Keith Burghardt, Tad Hogg, Kristina Lerman

摘要:

众包可以为问题找到高质量的解决方案;然而,个人决策受到认知偏见的限制。我们调查一些这些偏见的问答系统的实验模型。在自然实验和对照实验中,我们观察到一种强烈的立场偏见,有利于答案出现在选择列表的前面。这种效果由三个认知因素增强:答案所受到的关注,其感知的受欢迎程度和认知负荷,以用户必须处理的选择数量来衡量。虽然这些影响单独很弱,但它们协同放大了位置偏差,并将用户对最佳答案的选择与其内在质量分离开来。最后,我们讨论了新的方法,我们可以应用这些研究结果,大大提高如何在问答系统中找到高质量的答案。

英文摘要:

Crowdsourcing can identify high-quality solutions to problems; however, individual decisions are constrained by cognitive biases. We investigate some of these biases in an experimental model of a question-answering system. In both natural and controlled experiments, we observe a strong position bias in favor of answers appearing earlier in a list of choices. This effect is enhanced by three cognitive factors: the attention an answer receives, its perceived popularity, and cognitive load, measured by the number of choices a user has to process. While separately weak, these effects synergistically amplify position bias and decouple user choices of best answers from their intrinsic quality. We end our paper by discussing the novel ways we can apply these findings to substantially improve how high-quality answers are found in question-answering systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑