arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.02349cs.NI
收藏

网络代理中的自主学习分析:一个数据包转发应用实例

Analysis of Independent Learning in Network Agents: A Packet Forwarding Use Case

Abu Saleh Md Tayeen, Milan Biswal, Abderrahmen Mtibaa, Satyajayant Misra

摘要:

多智能体强化学习(MARL)被广泛应用于解决现实世界中各种复杂的决策问题。虽然MARL可以分为独立和合作的方法,我们认为独立的方法是一个简单的,更可扩展的,成本更低的方法,大规模的分布式系统,如网络数据包转发。在本文中,我们定量和定性评估的好处,利用这种独立的代理学习方法,特别是基于IQL的算法,在计算机网络中的数据包转发,命名数据网络(NDN)架构作为一个驱动的例子。我们对多种基于IQL的转发策略(IDQF)进行测试,并将其性能与非常基本的转发方案和简单的拓扑/流量模型进行比较,以突出主要的挑战和问题。我们讨论了与IDQF性能不佳相关的主要问题,并在不同的模型调整参数和网络拓扑/特性下训练和测试IDQF模型时量化这些问题对隔离的影响。

英文摘要:

Multi-Agent Reinforcement Learning (MARL) is nowadays widely used to solve real-world and complex decisions in various domains. While MARL can be categorized into independent and cooperative approaches, we consider the independent approach as a simple, more scalable, and less costly method for large-scale distributed systems, such as network packet forwarding. In this paper, we quantitatively and qualitatively assess the benefits of leveraging such independent agents learning approach, in particular IQL-based algorithm, for packet forwarding in computer networking, using the Named Data Networking (NDN) architecture as a driving example. We put multiple IQL-based forwarding strategies (IDQF) to the test and compare their performances against very basic forwarding schemes and simple topologies/traffic models to highlight major challenges and issues. We discuss the main issues related to the poor performance of IDQF and quantify the impact of these issues on isolation when training and testing the IDQF models under different model tuning parameters and network topologies/characteristics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑