社会技术系统中面向AI对齐与治理的激励相容性研究路线图
Roadmap on Incentive Compatibility for AI Alignment and Governance in Sociotechnical Systems
AI总结：
针对现有AI对齐研究多侧重技术、忽视社会技术属性导致场景错位的问题，提出激励相容性社会技术对齐问题，探讨三类经典博弈方法的应用潜力与挑战，呼吁结合博弈论IC原理弥合技术与社会的差距。
摘要：
人工智能（AI）与人类社会的日益融合为社会治理与安全带来了深远影响。尽管在应对AI对齐挑战方面已取得显著进展，但现有方法主要聚焦于技术层面，往往忽视了AI系统复杂的社会技术属性，这可能导致开发与部署场景之间出现错位。为此，我们提出了一个值得探索的新问题：激励相容性社会技术对齐问题（Incentive Compatibility Sociotechnical Alignment Problem, ICSAP）。我们希望借此呼吁更多研究者探索如何运用博弈论中的激励相容性（Incentive Compatibility, IC）原理，弥合技术与社会要素之间的差距，在不同场景下维持AI与人类社会的一致性。我们进一步探讨了实现IC的三类经典博弈问题：机制设计、契约理论与贝叶斯说服，分析了它们在解决ICSAP方面的视角、潜力与挑战，并给出了初步的实现构想。
英文摘要：
The burgeoning integration of artificial intelligence (AI) into human society brings forth significant implications for societal governance and safety. While considerable strides have been made in addressing AI alignment challenges, existing methodologies primarily focus on technical facets, often neglecting the intricate sociotechnical nature of AI systems, which can lead to a misalignment between the development and deployment contexts. To this end, we posit a new problem worth exploring: Incentive Compatibility Sociotechnical Alignment Problem (ICSAP). We hope this can call for more researchers to explore how to leverage the principles of Incentive Compatibility (IC) from game theory to bridge the gap between technical and societal components to maintain AI consensus with human societies in different contexts. We further discuss three classical game problems for achieving IC: mechanism design, contract theory, and Bayesian persuasion, in addressing the perspectives, potentials, and challenges of solving ICSAP, and provide preliminary implementation conceptions.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
