元宇宙中XR内容传输的生成式AI：潜在方法、挑战及一种生成驱动的传输框架
Generative-AI for XR Content Transmission in the Metaverse: Potential Approaches, Challenges, and a Generation-Driven Transmission Framework
浏览论文内容
中文总结 AI 辅助
针对元宇宙中XR内容传输的瓶颈，提出一种基于生成式AI的云边协作传输框架，利用DRL决策模块，实现正常帧率提升2.8倍。
中文摘要 AI 辅助
如何通过当前网络高效传输大量扩展现实（XR）内容一直是实现元宇宙的主要瓶颈。最近兴起的生成式人工智能（GAI）已经彻底改变了各个技术领域，并为这一挑战提供了有前景的解决方案。在本文中，我们首先展示了当前网络在支持元宇宙中XR内容传输方面的瓶颈。然后，我们探讨了利用GAI克服这些瓶颈的潜在方法和挑战。为了解决这些挑战，我们提出了一种基于GAI的XR内容传输框架，该框架利用云边协作架构。云服务器负责存储和渲染原始XR内容，而边缘服务器在网络资源不足以传输这些内容时，利用GAI模型生成XR内容的关键部分（例如，后续帧、选定对象等）。我们提出了一种基于深度强化学习（DRL）的决策模块来解决决策问题。我们的案例研究表明，所提出的基于GAI的传输框架在正常帧率（满足XR内容传输质量和延迟要求的帧的百分比）上比基线方法提高了2.8倍，这凸显了GAI模型在促进元宇宙中XR内容传输方面的潜力。
英文摘要
How to efficiently transmit large volumes of Extended Reality (XR) content through current networks has been a major bottleneck in realizing the Metaverse. The recently emerging Generative Artificial Intelligence (GAI) has already revolutionized various technological fields and provides promising solutions to this challenge. In this article, we first demonstrate current networks' bottlenecks for supporting XR content transmission in the Metaverse. Then, we explore the potential approaches and challenges of utilizing GAI to overcome these bottlenecks. To address these challenges, we propose a GAI-based XR content transmission framework which leverages a cloud-edge collaboration architecture. The cloud servers are responsible for storing and rendering the original XR content, while edge servers utilize GAI models to generate essential parts of XR content (e.g., subsequent frames, selected objects, etc.) when network resources are insufficient to transmit them. A Deep Reinforcement Learning (DRL)-based decision module is proposed to solve the decision-making problems. Our case study demonstrates that the proposed GAI-based transmission framework achieves a 2.8-fold increase in normal frame ratio (percentage of frames that meet the quality and latency requirements for XR content transmission) over baseline approaches, underscoring the potential of GAI models to facilitate XR content transmission in the Metaverse.
