arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.06182cs.NI
收藏

精简传输:一种由生成式人工智能增强的语义感知XR部署框架

Streamlined Transmission: A Semantic-Aware XR Deployment Framework Enhanced by Generative AI

Wanting Yang, Zehui Xiong, Tony Q. S. Quek, Xuemin Shen

AI总结:

本文面向6G无线XR沉浸式体验需求,提出语义感知与生成式AI协同的GeSa-XRF部署框架,覆盖数据采集、分析与交付三阶段,以实现精简传输并减少冗余。

摘要:

在6G时代,数字孪生和元宇宙等引人注目的愿景下,扩展现实(XR)已成为连接数字世界与物理世界的重要通道,引起了广泛关注。确保完全沉浸式的无线XR体验是一项至关重要的技术需求,这要求将XR从有线连接的束缚中解放出来。在本文中,我们首先介绍无线XR领域所应用的技术,深入探讨其优势与局限性,并指出当前面临的持续挑战。随后,受语义通信(SemCom)核心思想的启发——其关注点从“如何”传输转向“传输什么”——我们提出了一种面向广泛XR流水线的新型部署框架,命名为“GeSa-XRF”。具体而言,该框架包含三个阶段:数据采集、数据分析和数据交付。在每个阶段中,我们都融入语义感知以实现精简传输,并采用生成式人工智能(GAI)来实现协同优化。针对具有差异化数据量和异构时延要求的多模态数据采集,我们提出了一种基于多模态融合与分离的新型SemCom范式,以及一种基于GAI的鲁棒叠加方案。为了进行全面数据分析,我们采用多任务学习来执行视场预测和个性化注意力预测,并讨论了由GAI辅助的可能预处理方法。最后,在数据交付阶段,我们提出了一种基于语义感知的多播交付策略,旨在减少像素级冗余传输,并介绍了GAI协同优化方法。通过案例研究初步证明了所提出的GeSa-XRF的性能增益。

英文摘要:

In the era of 6G, featuring compelling visions of digital twins and metaverses, Extended Reality (XR) has emerged as a vital conduit connecting the digital and physical realms, garnering widespread interest. Ensuring a fully immersive wireless XR experience stands as a paramount technical necessity, demanding the liberation of XR from the confines of wired connections. In this paper, we first introduce the technologies applied in the wireless XR domain, delve into their benefits and limitations, and highlight the ongoing challenges. We then propose a novel deployment framework for a broad XR pipeline, termed "GeSa-XRF", inspired by the core philosophy of Semantic Communication (SemCom) which shifts the concern from "how" to transmit to "what" to transmit. Particularly, the framework comprises three stages: data collection, data analysis, and data delivery. In each stage, we integrate semantic awareness to achieve streamlined transmission and employ Generative Artificial Intelligence (GAI) to achieve collaborative refinements. For the data collection of multi-modal data with differentiated data volumes and heterogeneous latency requirements, we propose a novel SemCom paradigm based on multi-modal fusion and separation and a GAI-based robust superposition scheme. To perform a comprehensive data analysis, we employ multi-task learning to perform the prediction of field of view and personalized attention and discuss the possible preprocessing approaches assisted by GAI. Lastly, for the data delivery stage, we present a semantic-aware multicast-based delivery strategy aimed at reducing pixel level redundant transmissions and introduce the GAI collaborative refinement approach. The performance gain of the proposed GeSa-XRF is preliminarily demonstrated through a case study.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑