arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.08481cs.ITcs.LGcs.MAmath.IT
收藏

大规模任务导向通信设计

Task-Oriented Communication Design at Scale

University of Luxembourg(卢森堡大学);Centre for Security Reliability and Trust(安全、可靠性与信任中心)

Arsham Mostaani, Thang X. Vu, Hamed Habibi, Symeon Chatzinotas, Bjorn Ottersten

AI总结:

针对大规模多智能体任务导向通信,提出利用二智能体系统学习信息价值并扩展至N智能体系统的三步框架,以降低计算复杂度并保持任务性能。

摘要:

任务导向通信设计(TOCD)在物联网和工业4.0等众多领域拥有无数有前景的应用,正受到研究界越来越多的关注。本文提出了一种在协作多智能体系统(MAS)中设计可扩展任务导向量化和通信的新方法。所提出的方法利用TOCD框架和信息价值(VoI)概念,使智能体之间能够高效地通信量化观测,同时最大化MAS的平均回报性能,该参数量化了MAS的任务有效性。然而,学习VoI的计算复杂度随智能体数量呈指数增长。因此,我们提出了一个三步框架:i)使用强化学习(RL)为两智能体系统学习VoI,ii)使用学到的VoI在一系列比特预算下为N智能体MAS设计量化策略,以及iii)在遵循前一步设计的量化策略的同时,使用RL学习智能体的控制策略。我们观察到,通过利用从研究类似的二智能体系统中获得的见解,而不是原始的N智能体系统,可以降低获取信息价值的计算成本。然后,我们对智能体的观测进行量化,使其更有价值的观测被更精确地通信。我们的分析结果表明,所提出的框架适用于广泛的问题。数值结果显示,在不损害MAS平均回报性能的情况下,所提出的框架在降低MAS问题中TOCD所需VoI获取的计算复杂度方面取得了显著改进。

英文摘要:

With countless promising applications in various domains such as IoT and industry 4.0, task-oriented communication design (TOCD) is getting accelerated attention from the research community. This paper presents a novel approach for designing scalable task-oriented quantization and communications in cooperative multi-agent systems (MAS). The proposed approach utilizes the TOCD framework and the value of information (VoI) concept to enable efficient communication of quantized observations among agents while maximizing the average return performance of the MAS, a parameter that quantifies the MAS's task effectiveness. The computational complexity of learning the VoI, however, grows exponentially with the number of agents. Thus, we propose a three-step framework: i) learning the VoI (using reinforcement learning (RL)) for a two-agent system, ii) designing the quantization policy for an $N$-agent MAS using the learned VoI for a range of bit-budgets and, (iii) learning the agents' control policies using RL while following the designed quantization policies in the earlier step. We observe that one can reduce the computational cost of obtaining the value of information by exploiting insights gained from studying a similar two-agent system - instead of the original $N$-agent system. We then quantize agents' observations such that their more valuable observations are communicated more precisely. Our analytical results show the applicability of the proposed framework under a wide range of problems. Numerical results show striking improvements in reducing the computational complexity of obtaining VoI needed for the TOCD in a MAS problem without compromising the average return performance of the MAS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑