算法使用中的同质性与激励效应
Homophily and Incentive Effects in Use of Algorithms
摘要:
随着算法工具越来越多地帮助专家做出重大决策,了解调解其影响的确切因素的需求也随之增长。在本文中,我们提出了一个众包小插曲研究,旨在评估两个合理的因素对人工智能知情决策的影响。首先,我们研究同质性--人们是否更倾向于认同他们的模型?--在培训期间操纵参与者与算法工具之间的协议。其次,我们考虑了激励措施--人们如何将(已知的)成本结构纳入混合决策环境中?--通过改变与真阳性和真阴性相关的奖励。令人惊讶的是,我们发现有限的影响,无论是同质性和没有证据的激励效果,尽管参与者表现类似于以前的研究。参与者和人工智能工具之间的更高水平的一致性产生了更自信的预测,但只有在没有结果反馈的情况下。这些结果强调了人类与算法交互的复杂性,并表明当人类与算法交互时,社会心理学的发现可能需要重新审视。
英文摘要:
As algorithmic tools increasingly aid experts in making consequential decisions, the need to understand the precise factors that mediate their influence has grown commensurately. In this paper, we present a crowdsourcing vignette study designed to assess the impacts of two plausible factors on AI-informed decision-making. First, we examine homophily -- do people defer more to models that tend to agree with them? -- by manipulating the agreement during training between participants and the algorithmic tool. Second, we considered incentives -- how do people incorporate a (known) cost structure in the hybrid decision-making setting? -- by varying rewards associated with true positives vs. true negatives. Surprisingly, we found limited influence of either homophily and no evidence of incentive effects, despite participants performing similarly to previous studies. Higher levels of agreement between the participant and the AI tool yielded more confident predictions, but only when outcome feedback was absent. These results highlight the complexity of characterizing human-algorithm interactions, and suggest that findings from social psychology may require re-examination when humans interact with algorithms.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。