arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.11074cs.CR
收藏

通过图神经网络赋能的深度强化学习实现网络韧性

Achieving Network Resilience through Graph Neural Network-enabled Deep Reinforcement Learning

Xuzeng Li, Tao Zhang, Jian Wang, Zhen Han, Jiqiang Liu, Jiawen Kang, Dusit Niyato, Abbas Jamalipour

AI总结:

本文探讨将图神经网络与深度强化学习结合以构建韧性网络,设计防御攻击的框架,并通过真实物联网加密流量数据集验证其有效性。

摘要:

深度强化学习(DRL)已被广泛应用于通信网络的许多重要任务中。为了提高DRL对网络的感知能力,一些研究将图神经网络(GNNs)与DRL相结合,利用GNNs提取网络的无结构特征。然而,随着网络不断演进且日益复杂,现有的GNN-DRL方法在可扩展性和鲁棒性方面仍面临挑战。此外,这些方法不足以解决网络安全问题。从安全性和鲁棒性的角度出发,本文探讨了将GNNs与DRL相结合以构建韧性网络的解决方案。本文首先简要介绍GNNs和DRL的基础教程,并介绍它们在网络中的现有应用。进一步地,我们介绍了可通过GNN-DRL方法加强的网络安全方法。然后,我们设计了一个基于GNN-DRL的框架,用于防御攻击并增强网络韧性。此外,我们使用从真实物联网环境中收集的加密流量数据集进行了案例研究,结果证明了我们框架的有效性和优越性。最后,我们强调了利用GNN-DRL增强网络韧性的关键开放挑战和机遇。

英文摘要:

Deep reinforcement learning (DRL) has been widely used in many important tasks of communication networks. In order to improve the perception ability of DRL on the network, some studies have combined graph neural networks (GNNs) with DRL, which use the GNNs to extract unstructured features of the network. However, as networks continue to evolve and become increasingly complex, existing GNN-DRL methods still face challenges in terms of scalability and robustness. Moreover, these methods are inadequate for addressing network security issues. From the perspective of security and robustness, this paper explores the solution of combining GNNs with DRL to build a resilient network. This article starts with a brief tutorial of GNNs and DRL, and introduces their existing applications in networks. Furthermore, we introduce the network security methods that can be strengthened by GNN-DRL approaches. Then, we designed a framework based on GNN-DRL to defend against attacks and enhance network resilience. Additionally, we conduct a case study using an encrypted traffic dataset collected from real IoT environments, and the results demonstrated the effectiveness and superiority of our framework. Finally, we highlight key open challenges and opportunities for enhancing network resilience with GNN-DRL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑