arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.02649cs.AI
收藏

不应开发完全自主的 AI 智能体

Fully Autonomous AI Agents Should Not be Developed

Margaret Mitchell, Avijit Ghosh, Alexandra Sasha Luccioni, Giada Pistilli

AI总结:

本文通过划分 AI 智能体层级并分析各层级的伦理价值、收益与风险,指出自主性越高、用户让渡控制权越多,人身安全等风险越大,因而主张不应开发完全自主 AI 智能体。

摘要:

本文主张不应开发完全自主的 AI 智能体。为支持这一立场,我们基于既往科学文献和当前产品营销,划分不同的 AI 智能体层级,并详细说明每一层级涉及的伦理价值,记录潜在收益与风险之间的权衡。我们的分析表明,人所面临的风险随系统自主性提高而增加:用户让渡给 AI 智能体的控制权越多,对人产生的风险就越多。尤其令人担忧的是安全风险,它们影响人的生命,并进一步冲击其他价值。

英文摘要:

This paper argues that fully autonomous AI agents should not be developed. In support of this position, we build from prior scientific literature and current product marketing to delineate different AI agent levels and detail the ethical values at play in each, documenting trade-offs in potential benefits and risks. Our analysis reveals that risks to people increase with the autonomy of a system: The more control a user cedes to an AI agent, the more risks to people arise. Particularly concerning are safety risks, which affect human life and impact further values.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑