坏苹果、疯苹果与“烹制”苹果:人机军事团队中对平民伤害的道德责任
Bad, mad, and cooked: Moral responsibility for civilian harms in human-AI military teams
AI总结:
本章提出新机制,通过决策责任提示和AI工作场所健康安全框架,厘清人机军事团队中平民伤害的道德责任,支持以人为中心的负责任AI部署。
摘要:
本章探讨了人类-人工智能(AI)军事团队对平民伤害的道德责任问题。尽管军队中可能存在一些对战争罪行负责的“坏苹果”,以及一些在冲突期间无法对自己的行为负责的“疯苹果”,但越来越多的军队可能通过用AI决策取代人类决策的战争进程,将其“好苹果”置于难以维持的决策环境中,从而“烹制”这些好苹果。在人机军事团队中,对平民伤害的责任可能存在争议,这可能导致操作员变得疏离、成为极端的道德见证者、成为道德缓冲地带,或因参与国家授权的大型人机系统而遭受道德伤害。在承认迄今为止的军事伦理、人因工程和AI研究以及批判性案例研究的基础上,本章提供了新的机制来描绘人机团队中道德责任的条件。这些机制包括:1)在认知任务分析中为关键决策方法提供新的决策责任提示;2)应用AI工作场所健康与安全框架,以识别与目标决策中道德责任归属相关的认知和心理风险。此类机制使军队能够设计以人为中心的AI系统,以实现负责任的部署。
英文摘要:
This chapter explores moral responsibility for civilian harms by human-artificial intelligence (AI) teams. Although militaries may have some bad apples responsible for war crimes and some mad apples unable to be responsible for their actions during a conflict, increasingly militaries may 'cook' their good apples by putting them in untenable decision-making environments through the processes of replacing human decision-making with AI determinations in war making. Responsibility for civilian harm in human-AI military teams may be contested, risking operators becoming detached, being extreme moral witnesses, becoming moral crumple zones or suffering moral injury from being part of larger human-AI systems authorised by the state. Acknowledging military ethics, human factors and AI work to date as well as critical case studies, this chapter offers new mechanisms to map out conditions for moral responsibility in human-AI teams. These include: 1) new decision responsibility prompts for critical decision method in a cognitive task analysis, and 2) applying an AI workplace health and safety framework for identifying cognitive and psychological risks relevant to attributions of moral responsibility in targeting decisions. Mechanisms such as these enable militaries to design human-centred AI systems for responsible deployment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。