The adoption of human oversight measures makes it possible to regulate, to varying degrees and in different ways, the decision-making process of Artificial Intelligence (AI) systems, for example by placing a human being in charge of supervising the system and, upstream, by developing the AI system to enable such supervision. Within the global governance of AI, the requirement for human oversight is embodied in several regulatory formats, within a diversity of normative sources. On the one hand, it reinforces the accountability of AI systems' users (for example, by requiring them to carry out certain checks) and, on the other hand, it better protects the individuals affected by the AI-based decision (for example, by allowing them to request a review of the decision). In the European context, the AI Act imposes obligations on providers of high-risk AI systems (and to some extent also on professional users of these systems, known as deployers), including the introduction of human oversight tools throughout the life cycle of AI systems, including by design (and their implementation by deployers). The EU legislator is therefore going much further than in the past in "spelling out" the legal requirement for human oversight. But it does not intend to provide for all implementation details; it calls on standardisation to technically flesh out this requirement (and more broadly all the requirements of section 2 of chapter III) on the basis of article 40 of the AI Act. In this multi-level regulatory context, the question of the place of humans in the AI decision-making process should be given particular attention. Indeed, depending on whether it is the law or the technical standard that sets the contours of human oversight, the "regulatory governance" of AI is not the same: its nature, content and scope are different. This analysis is at the heart of the contribution made (or to be made) by legal experts to the central reflection on the most appropriate regulatory governance -- in terms of both its institutional format and its substance -- to ensure the effectiveness of human oversight and AI trustworthiness.
Anti-Regulatory AI: How "AI Safety" is Leveraged Against Regulatory Oversight
Center for Technology Responsibility, Reimagination, and Redesign, Brown University(布朗大学技术责任、重塑与设计中心);Center for Human-Compatible AI, UC Berkeley(加州大学伯克利分校人类兼容人工智能中心)
Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems
University College London(伦敦大学);University of Freiburg(弗赖堡大学);University of Queensland(昆士兰大学);Saarland University(萨尔兰大学);TU Dresden(德累斯顿技术大学);Delft University of Technology(代尔夫特理工大学);University of Minnesota(明尼苏达大学);University College Dublin(都柏林大学);University of Oxford(牛津大学);University of Michigan(密歇根大学);National University of Singapore(新加坡国立大学);Technische Universität Berlin(柏林技术大学);University of Lübeck(吕贝克大学);University of Melbourne(墨尔本大学);University of Chicago(芝加哥大学);Maastricht University(马斯特里赫特大学)
The Signalgate Case is Waiving a Red Flag to All Organizational and Behavioral Cybersecurity Leaders, Practitioners, and Researchers: Are We Receiving the Signal Amidst the Noise?
Pamplin College Business, Virginia Tech(弗吉尼亚理工大学潘普林商学院);College of Business at UNLV(内华达大学拉斯维加斯分校商学院)
Connecting the Dots in Trustworthy Artificial Intelligence: From AI Principles, Ethics, and Key Requirements to Responsible AI Systems and Regulation
University of Granada(格拉纳达大学);DaSCI Andalusian Institute in Data Science and Computational Intelligence(安达卢西亚数据科学与计算智能研究所(DaSCI));TECNALIA(泰克纳利亚研究中心);Basque Research and Technology Alliance (BRTA)(巴斯克研究与技术联盟(BRTA));University of the Basque Country (UPV/EHU)(巴斯克大学(UPV/EHU));University of Vienna(维也纳大学);Cornell University(康奈尔大学);ADIA Lab(阿布扎比投资局实验室);Khalifa University of Science and Technology(哈利法科技大学)