arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.19629cs.HCcs.AI
收藏

算法之后的合作:超越协作幻觉的人机共存设计

Cooperation After the Algorithm: Designing Human-AI Coexistence Beyond the Illusion of Collaboration

Imperial College London(帝国理工学院)

Tatia Codreanu

AI总结:

本文提出人机共存的制度框架,通过六个设计原则和三个政策工具,构建可持续的可问责合作机制。

摘要:

生成式人工智能系统越来越多地参与研究、法律、教育、媒体和治理领域。它们流畅且适应性强的输出创造了一种协作体验。然而,这些系统不承担责任、不承担风险或不共享下游后果的后果。这种结构性不对称已经产生了制裁、专业错误和治理失败等高风险情境中的问题。我们主张,稳定的人机共存是一种制度成就,依赖于能够分配残余风险的治理基础设施。基于制度分析和进化合作理论,我们引入了一个正式不平等式,规定何时依赖AI会产生正的预期合作价值。该模型明确说明了治理条件、系统政策和问责制度如何共同决定合作是否合理或结构上缺陷。从这种形式化中,我们推导出一个包含六个设计原则的合作生态框架:互惠合同、可见信任基础设施、条件合作模式、退出缓解机制、对抗权威戏剧的叙事素养,以及以地球优先的可持续性约束。我们通过三个政策制品来操作化该框架:《人机合作宪章》、《退出风险登记表》和《合作准备度审计》。这些元素将分析单位从用户-AI双元组转向塑造激励、信号、问责和修复的制度环境。本文为设计能够长期维持可问责、可信赖合作的人机系统提供了理论基础和实用工具。

英文摘要:

Generative artificial intelligence systems increasingly participate in research, law, education, media, and governance. Their fluent and adaptive outputs create an experience of collaboration. However, these systems do not bear responsibility, incur liability, or share stakes in downstream consequences. This structural asymmetry has already produced sanctions, professional errors, and governance failures in high-stakes contexts We argue that stable human-AI coexistence is an institutional achievement that depends on governance infrastructure capable of distributing residual risk. Drawing on institutional analysis and evolutionary cooperation theory, we introduce a formal inequality that specifies when reliance on AI yields positive expected cooperative value. The model makes explicit how governance conditions, system policy, and accountability regimes jointly determine whether cooperation is rational or structurally defective. From this formalization we derive a cooperation ecology framework with six design principles: reciprocity contracts, visible trust infrastructure, conditional cooperation modes, defection-mitigation mechanisms, narrative literacy against authority theatre, and an Earth-first sustainability constraint. We operationalize the framework through three policy artefacts: a Human-AI Cooperation Charter, a Defection Risk Register, and a Cooperation Readiness Audit. Together, these elements shift the unit of analysis from the user-AI dyad to the institutional environment that shapes incentives, signals, accountability, and repair. The paper provides a theoretical foundation and practical toolkit for designing human-AI systems that can sustain accountable, trustworthy cooperation over time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑