面向元宇宙应用的目标导向语义通信
Goal-oriented Semantic Communication for the Metaverse Application
AI总结:
本文提出面向元宇宙应用的目标导向语义通信框架GSCM,通过目标层级提取语义信息并结合NeRF构建元宇宙,在降低传输延迟的同时提升虚拟对象操作精度和构建清晰度。
摘要:
随着元宇宙的出现及其在实现对现实世界对应物的实时仿真与分析方面的作用,越来越多的个性化元宇宙场景被创建出来,以影响娱乐体验和社会行为。然而,与传统的图像和视频娱乐应用相比,海量元宇宙相关信息的精确传输对现有面向比特的通信网络容量构成了重大挑战。此外,当前元宇宙还见证了一种日益增长的目标转变,即传输定制设计内容背后的含义,例如用户设计的建筑和化身,而非物理对象的精确副本。为了应对这一日益增长的目标转变和带宽挑战,本文提出了一种面向元宇宙应用的目标导向语义通信框架(GSCM),通过目标层级来探索和定义语义信息。具体而言,我们首先分析了元宇宙构建中的传统图像通信框架,然后详细阐述了我们提出的语义信息以及端到端无线通信。接着,我们描述了GSCM框架的设计模块,包括目标导向语义信息提取、基础知识定义以及基于神经辐射场(NeRF)的元宇宙构建。最后,大量实验表明,与图像通信相比,我们提出的GSCM框架将传输延迟降低了高达92.6%,并将虚拟对象操作精度和元宇宙构建清晰度分别提高了高达45.6%和44.7%。
英文摘要:
With the emergence of the metaverse and its role in enabling real-time simulation and analysis of real-world counterparts, an increasing number of personalized metaverse scenarios are being created to influence entertainment experiences and social behaviors. However, compared to traditional image and video entertainment applications, the exact transmission of the vast amount of metaverse-associated information significantly challenges the capacity of existing bit-oriented communication networks. Moreover, the current metaverse also witnesses a growing goal shift for transmitting the meaning behind custom-designed content, such as user-designed buildings and avatars, rather than exact copies of physical objects. To meet this growing goal shift and bandwidth challenge, this paper proposes a goal-oriented semantic communication framework for metaverse application (GSCM) to explore and define semantic information through the goal levels. Specifically, we first analyze the traditional image communication framework in metaverse construction and then detail our proposed semantic information along with the end-to-end wireless communication. We then describe the designed modules of the GSCM framework, including goal-oriented semantic information extraction, base knowledge definition, and neural radiance field (NeRF) based metaverse construction. Finally, numerous experiments have been conducted to demonstrate that, compared to image communication, our proposed GSCM framework decreases transmission latency by up to 92.6% and enhances the virtual object operation accuracy and metaverse construction clearance by up to 45.6% and 44.7%, respectively.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。