arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.10923math.OCcs.MA
收藏

多智能体MDP问题中的最优通信和控制策略

Optimal communication and control strategies in a multi-agent MDP problem

Sagar Sudhakara, Dhruva Kartik, Rahul Jain, Ashutosh Nayyar

摘要:

控制多智能体系统下的不同模型的信息共享代理之间的问题,在最近的文献中受到了极大的关注。在本文中,我们考虑的设置,而不是致力于一个固定的信息共享协议(例如,定期共享或不共享等),代理可以动态地决定在每个时间步是否与对方共享信息,并招致由此产生的通信成本。这种设置需要一个联合设计的代理人的通信和控制策略,以优化通信成本和控制目标之间的权衡。我们首先表明,代理可以忽略他们的私人信息的很大一部分,而不影响系统的性能。然后,我们提供了一个公信息方法为基础的解决方案的战略最优化问题。这种方法依赖于构建一个虚构的POMDP,其解决方案(通过动态程序获得)的特点,代理商的最优策略。我们还表明,我们的解决方案可以很容易地修改,以纳入约束时,以及如何频繁的代理可以进行通信。

英文摘要:

The problem of controlling multi-agent systems under different models of information sharing among agents has received significant attention in the recent literature. In this paper, we consider a setup where rather than committing to a fixed information sharing protocol (e.g. periodic sharing or no sharing etc), agents can dynamically decide at each time step whether to share information with each other and incur the resulting communication cost. This setup requires a joint design of agents' communication and control strategies in order to optimize the trade-off between communication costs and control objective. We first show that agents can ignore a big part of their private information without compromising the system performance. We then provide a common information approach based solution for the strategy optimization problem. This approach relies on constructing a fictitious POMDP whose solution (obtained via a dynamic program) characterizes the optimal strategies for the agents. We also show that our solution can be easily modified to incorporate constraints on when and how frequently agents can communicate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑