arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.09049cs.HCcs.CYcs.DL
收藏

研究算法感知对维基数据推荐系统性能的影响

Examining the Impact of Algorithm Awareness on Wikidata's Recommender System Recoin

Jesse Josua Benjamin, Claudia Müller-Birn, Simon Razniewski

摘要:

万维网的全球基础设施被设计为一个开放和透明的系统,对我们的社会产生了重大影响。然而,忽视这些原则的公司实体的算法系统越来越多地充斥着网络。这些算法系统的典型代表是推荐系统,它们在全球政治和日常购物决策方面都影响着我们的社会。最近,这种推荐系统受到了批评,因为它们可能会加强现有的甚至产生新的偏见。为此,越来越多的设计师和工程师被要求使推荐系统的功能和目的更加透明。我们的研究涉及到算法意识的话语,重新考虑算法可见性在界面设计中的作用。我们使用MTurk为推荐系统Wikidata的一个小工具,对105名参与者进行了在线实验。在这些实验中,我们向用户展示了一组三种不同设计的Mr.J.的用户界面中的一种,每一种都表现出不同程度的可解释性和交互性。我们的研究结果包括在我们的交互式重新设计的算法系统的理解和信任之间的正相关。然而,我们的研究结果还不是结论性的,并建议的理解,公平性,准确性和信任的措施还没有穷尽的算法意识的实证研究。我们的定性见解为进一步措施提供了第一个指标。例如,我们的研究参与者不太关心理解算法计算的细节,而是谁或什么在判断算法的结果。

英文摘要:

The global infrastructure of the Web, designed as an open and transparent system, has a significant impact on our society. However, algorithmic systems of corporate entities that neglect those principles increasingly populated the Web. Typical representatives of these algorithmic systems are recommender systems that influence our society both on a scale of global politics and during mundane shopping decisions. Recently, such recommender systems have come under critique for how they may strengthen existing or even generate new kinds of biases. To this end, designers and engineers are increasingly urged to make the functioning and purpose of recommender systems more transparent. Our research relates to the discourse of algorithm awareness, that reconsiders the role of algorithm visibility in interface design. We conducted online experiments with 105 participants using MTurk for the recommender system Recoin, a gadget for Wikidata. In these experiments, we presented users with one of a set of three different designs of Recoin's user interface, each of them exhibiting a varying degree of explainability and interactivity. Our findings include a positive correlation between comprehension of and trust in an algorithmic system in our interactive redesign. However, our results are not conclusive yet, and suggest that the measures of comprehension, fairness, accuracy and trust are not yet exhaustive for the empirical study of algorithm awareness. Our qualitative insights provide a first indication for further measures. Our study participants, for example, were less concerned with the details of understanding an algorithmic calculation than with who or what is judging the result of the algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑