我们问对问题了吗?:设计社区利益相关者与警务中AI的互动
Are We Asking the Right Questions?: Designing for Community Stakeholders' Interactions with AI in Policing
AI总结:
本研究通过实验与访谈,探讨社区成员、技术专家和执法人员在警务算法犯罪制图中的互动差异,发现领域专家存在锚定偏差,而三类群体均能为AI设计提供关键反馈。
摘要:
针对刑事司法系统中再犯风险预测的研究,已引起人机交互(HCI)、批判性算法研究以及新兴的人机协同决策领域的广泛关注。本研究聚焦于算法犯罪制图,这是该背景下一种普遍但尚未充分探索的算法决策支持(ADS)形式。我们与60名参与者进行了实验和后续访谈,参与者包括社区成员、技术专家和执法机构人员(LEAs),以探索生活经验、技术知识和领域专业知识如何影响与ADS的互动,进而影响人机协同决策。令人意外的是,我们发现领域专家(LEAs)常常表现出锚定偏差,容易接受并参与呈现给他们的第一张犯罪地图。相反,社区成员和技术专家更倾向于使用工具、调整控制并生成不同的地图。我们的研究结果强调,所有三类利益相关者都能就AI的设计和使用提供关键反馈——社区成员质疑工具的核心动机,技术专家提请注意数据科学实践的弹性本质,而LEAs则建议重新设计路径,使工具能够补充他们的领域专业知识。
英文摘要:
Research into recidivism risk prediction in the criminal legal system has garnered significant attention from HCI, critical algorithm studies, and the emerging field of human-AI decision-making. This study focuses on algorithmic crime mapping, a prevalent yet underexplored form of algorithmic decision support (ADS) in this context. We conducted experiments and follow-up interviews with 60 participants, including community members, technical experts, and law enforcement agents (LEAs), to explore how lived experiences, technical knowledge, and domain expertise shape interactions with the ADS, impacting human-AI decision-making. Surprisingly, we found that domain experts (LEAs) often exhibited anchoring bias, readily accepting and engaging with the first crime map presented to them. Conversely, community members and technical experts were more inclined to engage with the tool, adjust controls, and generate different maps. Our findings highlight that all three stakeholders were able to provide critical feedback regarding AI design and use - community members questioned the core motivation of the tool, technical experts drew attention to the elastic nature of data science practice, and LEAs suggested redesign pathways such that the tool could complement their domain expertise.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。