arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2206.09305cs.CYcs.LG
收藏

证据统计软件的对抗性审查

Adversarial Scrutiny of Evidentiary Statistical Software

University of California, Berkeley(加州大学伯克利分校);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Washington(华盛顿大学)

Rediet Abebe, Moritz Hardt, Angela Jin, John Miller, Ludwig Schmidt, Rebecca Wexler

摘要:

美国刑事法律系统越来越依赖软件输出来定罪和监禁人。在每年的大量案件中,政府根据统计软件(如概率基因分型、环境音频检测和工具标记分析工具)提供的证据做出这些重要决定,而辩护律师无法充分盘问或审查这些证据。这破坏了对抗性刑事法律制度的承诺,该制度依赖于辩方调查和检验控方案件以保障个人权利的能力。为了应对这种需要对抗性地审查这些软件的输出,我们提出了强大的对抗性测试作为审计框架,以检查证据统计软件的有效性。我们通过借鉴大量最近在鲁棒机器学习和算法公平性方面的工作,定义并实施了用于防御的鲁棒对抗性测试的概念。我们展示了这个框架如何既简化了审查这些工具的过程,又使辩护律师能够在与本案最相关的情况下审查其有效性。我们进一步讨论了美国刑事法律体系中现有的结构性和制度性挑战,这些挑战可能会为实施这一框架和其他此类审计框架造成障碍,最后讨论了有助于解决这些问题的政策变化。

英文摘要:

The U.S. criminal legal system increasingly relies on software output to convict and incarcerate people. In a large number of cases each year, the government makes these consequential decisions based on evidence from statistical software -- such as probabilistic genotyping, environmental audio detection, and toolmark analysis tools -- that defense counsel cannot fully cross-examine or scrutinize. This undermines the commitments of the adversarial criminal legal system, which relies on the defense's ability to probe and test the prosecution's case to safeguard individual rights. Responding to this need to adversarially scrutinize output from such software, we propose robust adversarial testing as an audit framework to examine the validity of evidentiary statistical software. We define and operationalize this notion of robust adversarial testing for defense use by drawing on a large body of recent work in robust machine learning and algorithmic fairness. We demonstrate how this framework both standardizes the process for scrutinizing such tools and empowers defense lawyers to examine their validity for instances most relevant to the case at hand. We further discuss existing structural and institutional challenges within the U.S. criminal legal system that may create barriers for implementing this and other such audit frameworks and close with a discussion on policy changes that could help address these concerns.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑