用于超高清静态360度远程临场的多层系统
A Multi-Layer System for Ultra-High-Resolution Static 360-Degree Telepresence
浏览论文内容
中文总结 AI 辅助
针对静态360度远程临场的分辨率局限，提出结合8K全景与4K PTZ相机的三层系统，通过图块背景优化等技术平衡全景保真度与交互性，效果优于对比方法。
中文摘要 AI 辅助
360度视频远程临场具有强大的沉浸式潜力，但仍受限于当前采集与显示硬件的分辨率。许多远程临场设备配备固定视点且场景基本静态，然而针对此类设置的优化策略却鲜有关注。本文提出一种用于静态360度远程临场的超高清多层系统，它结合了8K全景相机与可旋转的4K云台变焦（PTZ）相机。该方法构建三层表示：（1）基于图块的超高清全景背景，通过将高细节4K PTZ扫描图离线拼接至基础8K全景，实现超出原生采集的有效分辨率，并以一组空间图块形式呈现；（2）动态更新层，通过实时高分辨率背景抠像合成8K流中的前景运动；（3）感兴趣区域4K层，传输所选区域的实时PTZ视图，同时随时间更新对应背景图块。本文通过与代表性视频超分辨率方法对比，以及一项评估感知细节与沉浸式体验的用户研究，对所提系统进行了验证。结果表明，基于图块的背景优化结合用户引导更新，为静态360度远程临场中平衡全景保真度与交互性提供了实用方案。
英文摘要
360-degree video telepresence offers strong immersive potential but remains constrained by the limited resolution of current capture and display hardware. Many telepresence installations feature fixed viewpoints and largely static scenes, yet optimization strategies tailored to such setups have received limited attention. We present a multi-layer, ultra-high-resolution system for static 360-degree telepresence that combines an 8K panoramic camera with a rotatable 4K pan-tilt-zoom (PTZ) camera. Our approach builds a three-layer representation: (1) a tile-based ultra-high-resolution panoramic background, generated by offline stitching high-detail 4K PTZ scans onto the base 8K panorama to achieve effective resolution beyond native capture, and represented as a set of spatial tiles; (2) a dynamic update layer that composites foreground motions from the 8K stream via real-time high-resolution background matting; and (3) a region-of-interest 4K layer that streams a real-time PTZ view of the selected region and additionally updates the corresponding background tiles over time. We evaluate the proposed system through comparisons with representative video super-resolution approaches and a user study assessing perceived detail and immersive experience. Our results indicate that tile-based background refinement, together with user-guided updates, provides a practical way to balance panoramic fidelity and interactivity in static 360-degree telepresence.
发表机构
- University of Central Florida（中佛罗里达大学）
机构由 AI 辅助整理，请以论文原文为准。
