arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.01451cs.CL
收藏

对基于AI的紧急警务调度中的种族偏见进行审计:对十一种大型语言模型的跨语言评估

Auditing demographic bias in AI-based emergency police dispatch: a cross-lingual evaluation of eleven large language models

Department of Industrial Engineering, Tsinghua University(清华大学工业工程系);School of Social Sciences, Tsinghua University(清华大学社会科学部);Department of Industrial Engineering, Federal University of Rio de Janeiro(里约热内卢联邦大学工业工程系)

William Guey, Wei Zhang, Pierrick Bougault, Yi Wang, Bertan Ucar, Vitor D. de Moura, José O. Gomes

AI总结:

本文通过跨语言框架评估11种模型,在19800个输出中发现当事件严重性模糊时种族偏见系统性出现,但当操作优先级由通话内容确定时偏见消失。偏见程度因种族轴而异,宗教外观影响最大,性别次之,种族最小。语言间偏见转移不一致,性别偏见在中文中放大,种族偏见在英文中更明显。

摘要:

大型语言模型(LLMs)正迅速整合到高风险公共安全系统中,包括紧急呼叫分诊和调度决策支持,但其在此背景下的人口公平性仍 largely 未测试。本文引入了跨语言审计框架,将警察优先调度系统作为五级有序分类任务,并采用受控最小对设计来隔离人口线索的影响。在19800个模型输出中,涵盖11种前沿模型、15种场景对、三个人口类别(宗教外观、性别和种族)以及两种语言(英语和中文),发现当事件严重性模糊时人口偏见系统性出现,但当操作优先级由通话内容确定时偏见 largely 消失。偏见程度因人口轴而异,宗教外观影响最大,其次是性别和种族。关键的是,偏见在语言间不一致转移:性别偏见在中文中显著放大,而种族偏见在英文中更明显,揭示了跨语言不对称性,这些不对称性被聚合分析所掩盖。在某些场景中,人口线索产生反向影响,挑战了简单的刻板印象放大模型行为的解释。这些发现表明,基于LLM的调度偏见并非模型本身的固定属性,而是源于人口信号、情境模糊性和语言的相互作用。除了这些实证结果,所提出的框架提供了一种可扩展的审计基础设施,使部署机构能够在实际应用前评估候选模型在相关管辖范围内的情景。

英文摘要:

Large language models (LLMs) are rapidly being integrated into high-stakes public safety systems, including emergency call triage and dispatch decision support, yet their demographic fairness in this context remains largely untested. Here we introduce a cross-lingual audit framework that operationalizes the Police Priority Dispatch System as a five-level ordinal classification task and applies a controlled minimal-pair design to isolate the effect of demographic cues. Across 19,800 model outputs spanning 11 frontier models, 15 scenario pairs, three demographic categories (religious appearance, gender, and race), and two languages (English and Mandarin Chinese), we find that demographic bias emerges systematically when incident severity is ambiguous but largely disappears when the operational priority is clearly determined by call content. Bias magnitude varies by demographic axis, with the largest effects observed for religious appearance, followed by gender and race. Critically, bias does not transfer consistently across languages: gender bias is substantially amplified in Mandarin Chinese, whereas race bias is more pronounced in English, revealing cross-lingual asymmetries that aggregate analyses obscure. In several scenarios, demographic cues produce counter-directional effects, challenging simple stereotype-amplification accounts of model behavior. These findings suggest that bias in LLM-based dispatch is not a fixed property of models alone, but arises from the interaction between demographic signals, contextual ambiguity, and language. Beyond these empirical results, the proposed framework provides a scalable audit infrastructure that enables deploying agencies to evaluate candidate models on jurisdiction-relevant scenarios prior to real-world adoption.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑