arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.00407eess.SYcs.SY
收藏

面向增强现实的任务导向与语义感知通信

Task-oriented and Semantics-aware Communications for Augmented Reality

Zhe Wang, Yansha Deng

AI总结:

本文提出面向增强现实的任务导向与语义感知通信框架TSAR,通过语义提取、任务导向知识选择和姿态恢复,显著降低AR传输时延并提升通信有效性。

摘要:

随着新兴元宇宙及其在增强现实(AR)中相关应用的到来,当前以比特为导向的网络难以支持海量关联信息的实时变化,从而在其发展中形成了显著瓶颈。为解决上述问题,我们提出了一种新颖的面向增强现实的任务导向与语义感知通信框架(TSAR),以显著提升通信效率和有效性。我们首先对传统无线AR点云通信框架进行了分析,随后详细总结了我们在端到端通信中所提出的语义信息提取方法。接着,我们详细介绍了TSAR框架的组成部分,包括结合深度学习的语义提取、任务导向的基础知识选择以及虚拟形象姿态恢复。通过严格的实验,我们证明所提出的TSAR框架显著优于传统点云通信框架,将无线AR应用的传输时延降低了95.6%,并在几何和颜色方面的通信有效性分别提升了最高82.4%和20.4%。

英文摘要:

Upon the advent of the emerging metaverse and its related applications in Augmented Reality (AR), the current bit-oriented network struggles to support real-time changes for the vast amount of associated information, creating a significant bottleneck in its development. To address the above problem, we present a novel task-oriented and semantics-aware communication framework for augmented reality (TSAR) to enhance communication efficiency and effectiveness significantly. We first present an analysis of the traditional wireless AR point cloud communication framework, followed by a detailed summary of our proposed semantic information extraction within the end-to-end communication. Then, we detail the components of the TSAR framework, incorporating semantics extraction with deep learning, task-oriented base knowledge selection, and avatar pose recovery. Through rigorous experimentation, we demonstrate that our proposed TSAR framework considerably outperforms traditional point cloud communication framework, reducing wireless AR application transmission latency by 95.6% and improving communication effectiveness in geometry and color aspects by up to 82.4% and 20.4%, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑