arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.18538cs.MAcs.AI
收藏

多智能体系统中表征智能体异质性的对称性研究

On Symmetry for Characterizing Agent Heterogeneity in Multi-Agent Systems

INFORMED-AI Hub, University of Bristol(布里斯托大学 INFORMED-AI 中心);School of Engineering Mathematics and Technology, University of Bristol(布里斯托大学工程数学与技术学院)

Jianhong Wang, Jonathan Lawry

AI总结:

该研究针对多智能体系统,提出策略评估对称性框架以表征智能体异质性,推导相关条件并验证其在合作Dec-POMDP中的适用性。

摘要:

理解智能体异质性可为共享策略与智能体专属策略表示的设计提供依据,但现有准则缺乏统一的结构性检验方法。我们研究有限时域部分可观测随机博弈(POSG),定义一类与类型兼容的变换为策略评估对称性,当对任意分散式行为策略,完整策略评估均与该变换可交换时,该变换即为策略评估对称性。策略评估对称性构成一个群,其中智能体轨道定义了结构性智能体类型,该分类不依赖于所选特定策略或初始状态分布。我们证明每个分量式环境自同构都是策略评估对称性,但反之不成立。将该框架应用于合作式分散式部分可观测马尔可夫决策过程(Dec-POMDP),结果表明即使智能体共享共同奖励,也可属于不同结构性类型。针对规定的加权奖励聚合,我们推导了精确值恒等式,并给出所得Dec-POMDP继承源POSG策略评估对称性的充分条件。最后,我们给出重复模型分解诱导策略评估对称性的充分条件,并证明在一般情况下,保留最优玻尔兹曼策略集既不蕴含该对称性,也不被该对称性所蕴含。

英文摘要:

Understanding agent heterogeneity can inform the design of shared and agent-specific policy representations, however existing criteria provide no unified structural test. We study finite-horizon POSGs and define a type-compatible transformation as a policy-evaluation symmetry when complete policy evaluation commutes with it for every decentralized behavioral policy. Policy-evaluation symmetries form a group for which agent orbits define structural agent types. This classification does not depend on the particular policy chosen or the distribution of initial states. We prove that every componentwise environment automorphism is a policy-evaluation symmetry, but that the converse does not hold. Applying the framework to cooperative Dec-POMDPs shows that agents can belong to different structural types even when they share a common reward. For prescribed weighted reward aggregation, we derive an exact value identity and sufficient conditions for the resulting Dec-POMDP to inherit the policy-evaluation symmetries of the source POSG. Finally, we give sufficient conditions under which repeated model factorizations induce policy-evaluation symmetry, and show that preserving an optimal Boltzmann policy set neither implies nor follows from this symmetry in general.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑