arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.16575cs.CV
收藏

3D场景表示中的时效性-保真度权衡

Timeliness-Fidelity Tradeoff in 3D Scene Representations

University of Glasgow(格拉斯哥大学);University of Sydney(悉尼大学);University of Manchester(曼彻斯特大学)

Xiangmin Xu, Zhen Meng, Yichi Zhang, Changyang She, Philip G. Zhao

AI总结:

本文研究实时3D场景表示中的时效性与保真度权衡问题,提出利用信息年龄(AoI)和单步PPO方法决定接收图像是否参与3D表示与渲染,有效缓解通信延迟影响并实现最优表示结果。

摘要:

实时三维(3D)场景表示是支撑数字制造、虚拟/增强/扩展/混合现实(VR/AR/XR/MR)和元宇宙等各种创新应用的基础模块之一。尽管在实时通信和计算方面已做出大量努力,但实时3D场景表示仍是一项具有挑战性的任务。本文研究了实时3D场景表示中时效性与保真度之间的权衡。具体而言,我们建立了一个框架来评估通信延迟对该权衡的影响,其中真实世界场景由多个与边缘服务器通信的摄像头进行监控。为了提高3D场景表示的保真度,我们提出使用单步近端策略优化(PPO)方法,该方法利用信息年龄(AoI)来决定接收到的图像是否需要参与3D场景表示和渲染。我们使用不同的知名3D场景表示方法测试了我们的框架和所提出的方法。仿真结果表明,实时3D场景表示会受通信延迟的显著影响,且我们提出的方法能够实现最优的3D场景表示结果。

英文摘要:

Real-time three-dimensional (3D) scene representations serve as one of the building blocks that bolster various innovative applications, e.g., digital manufacturing, Virtual/Augmented/Extended/Mixed Reality (VR/AR/XR/MR), and the metaverse. Despite substantial efforts that have been made to real-time communications and computing, real-time 3D scene representations remain a challenging task. This paper investigates the tradeoff between timeliness and fidelity in real-time 3D scene representations. Specifically, we establish a framework to evaluate the impact of communication delay on the tradeoff, where the real-world scenario is monitored by multiple cameras that communicate with an edge server. To improve fidelity for 3D scene representations, we propose to use a single-step Proximal Policy Optimization (PPO) method that leverages the Age of Information (AoI) to decide if the received image needs to be involved in 3D scene representations and rendering. We test our framework and the proposed approach with different well-known 3D scene representation methods. Simulation results reveal that real-time 3D scene representation can be sensitively affected by communication delay, and our proposed method can achieve optimal 3D scene representation results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑