arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.13052cs.NI
收藏

面向边缘赋能的AI生成内容服务的基于扩散的强化学习

Diffusion-based Reinforcement Learning for Edge-enabled AI-Generated Content Services

Hongyang Du, Zonghang Li, Dusit Niyato, Jiawen Kang, Zehui Xiong, Huawei Huang, Shiwen Mao

AI总结:

针对元宇宙中AIGC模型资源密集导致的服务挑战,提出AaaS架构,并开发基于扩散模型与深度强化学习的D2SAC算法优化ASP选择,实验证明其优于七种主流DRL算法。

摘要:

随着元宇宙作为下一代互联网范式的兴起,高效生成内容的能力变得至关重要。AI生成内容(AIGC)作为一种关键解决方案应运而生,然而大型生成式AI(GAI)模型的资源密集型特性带来了挑战。为解决这一问题,我们提出了一种AIGC即服务(AaaS)架构,将AIGC模型部署在无线边缘网络中,以确保元宇宙用户能够广泛访问AIGC服务。然而,提供个性化用户体验的一个重要方面要求仔细选择能够有效执行用户任务的AIGC服务提供商(ASP),而环境的不确定性和多变性使这一过程变得复杂。针对当前研究中的这一空白,我们引入了AI生成最优决策(AGOD)算法,这是一种基于扩散模型的方法,用于生成最优的ASP选择决策。我们将AGOD与深度强化学习(DRL)相结合,开发了深度扩散软演员-评论家(D2SAC)算法,提升了ASP选择的效率和有效性。我们的综合实验表明,D2SAC优于七种领先的DRL算法。此外,所提出的AGOD算法具有扩展到无线网络中各种优化问题的潜力,使其成为未来AIGC驱动服务研究的有前景的方法。我们提出方法的实现可在以下地址获取:https://github.com/Lizonghang/AGOD。

英文摘要:

As Metaverse emerges as the next-generation Internet paradigm, the ability to efficiently generate content is paramount. AIGenerated Content (AIGC) emerges as a key solution, yet the resource intensive nature of large Generative AI (GAI) models presents challenges. To address this issue, we introduce an AIGC-as-a-Service (AaaS) architecture, which deploys AIGC models in wireless edge networks to ensure broad AIGC services accessibility for Metaverse users. Nonetheless, an important aspect of providing personalized user experiences requires carefully selecting AIGC Service Providers (ASPs) capable of effectively executing user tasks, which is complicated by environmental uncertainty and variability. Addressing this gap in current research, we introduce the AI-Generated Optimal Decision (AGOD) algorithm, a diffusion model-based approach for generating the optimal ASP selection decisions. Integrating AGOD with Deep Reinforcement Learning (DRL), we develop the Deep Diffusion Soft Actor-Critic (D2SAC) algorithm, enhancing the efficiency and effectiveness of ASP selection. Our comprehensive experiments demonstrate that D2SAC outperforms seven leading DRL algorithms. Furthermore, the proposed AGOD algorithm has the potential for extension to various optimization problems in wireless networks, positioning it as a promising approach for future research on AIGC-driven services. The implementation of our proposed method is available at: https://github.com/Lizonghang/AGOD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑