arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.17030cs.NI
收藏

多智能体深度强化学习通信在网络管理中的应用:一项综述

Applications of Multi-Agent Deep Reinforcement Learning Communication in Network Management: A Survey

Yue Pi, Wang Zhang, Yong Zhang, Hairong Huang, Baoquan Rao, Yulong Ding, Shuanghua Yang

AI总结:

本文综述了多智能体深度强化学习(MADRL)在网络管理中的应用,详细分析了智能体间的通信行为,并探讨了面向自动驾驶网络的未来研究方向。

摘要:

随着人工智能技术的发展,网络管理的自动化,也称为 Autonomous Driving Networks (ADN),正受到广泛关注。网络管理已从传统的同质化和集中化转向异质化和去中心化。Multi-agent deep reinforcement learning (MADRL) 允许智能体基于局部观察独立做出决策。这种方法符合自动化的需求,并引起了学术界和工业界的极大关注。在分布式环境中,智能体之间的信息交互可以有效解决多智能体的非平稳性问题并促进合作。因此,在本综述中,我们首先考察了 MADRL 在网络管理中的应用,包括流量工程、无线网络接入、功率控制和网络安全等具体应用领域。然后,我们对智能体之间的通信行为进行了详细分析,包括通信方案、通信内容构建、通信对象选择、消息处理和通信约束。最后,我们讨论了 MADRL 中智能体通信在面向未来网络管理和 ADN 应用中的开放问题与未来研究方向。

英文摘要:

With the advancement of artificial intelligence technology, the automation of network management, also known as Autonomous Driving Networks (ADN), is gaining widespread attention. The network management has shifted from traditional homogeneity and centralization to heterogeneity and decentralization. Multi-agent deep reinforcement learning (MADRL) allows agents to make decisions based on local observations independently. This approach is in line with the needs of automation and has garnered significant attention from academia and industry. In a distributed environment, information interaction between agents can effectively address the non-stationarity problem of multiple agents and promote cooperation. Therefore, in this survey, we first examined the application of MADRL in network management, including specific application fields such as traffic engineering, wireless network access, power control, and network security. Then, we conducted a detailed analysis of communication behavior between agents, including communication schemes, communication content construction, communication object selection, message processing, and communication constraints. Finally, we discussed the open issues and future research directions of agent communication in MADRL for future network management and ADN applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑