需要人类监督政府算法的政策缺陷
The Flaws of Policies Requiring Human Oversight of Government Algorithms
摘要:
随着算法成为世界各地政府决策的重要组成部分,政策制定者一直在讨论政府如何在防止算法危害的同时获得算法的好处。有一种机制已经成为全球监管政府算法的核心,那就是要求人工监督算法决策。尽管人们普遍转向人类监督,但这些政策都基于一个未经质疑的假设:人们能够有效地监督算法决策。在本文中,我调查了41项规定人类监督政府算法的政策,发现它们存在两个重大缺陷。首先,有证据表明,人们无法履行所期望的监督职能。其次,由于第一个缺陷,人类监督政策使政府使用有缺陷和有争议的算法合法化,而没有解决这些工具的根本问题。因此,人类的监督政策并没有保护政府免受算法决策的潜在危害,而是在采用算法时提供了一种虚假的安全感,并使供应商和机构能够逃避对算法危害的责任。鉴于这些缺陷,我建议将人类监督转变为机构监督,作为监管政府算法的中央机制。这种体制办法分两个阶段运作。首先,机构必须证明将算法纳入决策是适当的,并且任何拟议的人类监督形式都得到了经验证据的支持。第二,这些理由必须经过民主的公众审查和批准,行政机关才能采用该算法。
英文摘要:
As algorithms become an influential component of government decision-making around the world, policymakers have debated how governments can attain the benefits of algorithms while preventing the harms of algorithms. One mechanism that has become a centerpiece of global efforts to regulate government algorithms is to require human oversight of algorithmic decisions. Despite the widespread turn to human oversight, these policies rest on an uninterrogated assumption: that people are able to effectively oversee algorithmic decision-making. In this article, I survey 41 policies that prescribe human oversight of government algorithms and find that they suffer from two significant flaws. First, evidence suggests that people are unable to perform the desired oversight functions. Second, as a result of the first flaw, human oversight policies legitimize government uses of faulty and controversial algorithms without addressing the fundamental issues with these tools. Thus, rather than protect against the potential harms of algorithmic decision-making in government, human oversight policies provide a false sense of security in adopting algorithms and enable vendors and agencies to shirk accountability for algorithmic harms. In light of these flaws, I propose a shift from human oversight to institutional oversight as the central mechanism for regulating government algorithms. This institutional approach operates in two stages. First, agencies must justify that it is appropriate to incorporate an algorithm into decision-making and that any proposed forms of human oversight are supported by empirical evidence. Second, these justifications must receive democratic public review and approval before the agency can adopt the algorithm.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。