arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.02171cs.HC
收藏

真实与在场:探究在基于HMD的AR远程会议中使用真人等大2D视频化身

Real-and-Present: Investigating the Use of Life-Size 2D Video Avatars in HMD-Based AR Teleconferencing

Xuanyu Wang, Weizhan Zhang, Christian Sandor, Hongbo Fu

AI总结:

为平衡AR远程会议中的保真度与共同在场感,本文提出使用真人等大2D视频化身,通过先导研究确定最优放置方案并构建原型,进一步定量探索HMD视场角对放置的影响,回归出适用于不同设备的放置模型。

摘要:

增强现实(AR)远程会议允许身处不同位置的用户通过各自物理环境中的代理在3D空间中进行互动。利用体积捕获和重建的现有方法可以提供高保真体验,但通常对于日常使用而言过于复杂且昂贵。其他解决方案则针对AR头戴式显示器(HMD)上的移动和易于设置的远程会议,它们要么将传统视频会议直接移植到AR-HMD平台上,要么使用化身来代表远程参与者。然而,这些方法只能支持高保真度或高共同在场感中的一种。此外,HMD有限的视场角(FoV)可能会进一步影响用户的沉浸式体验。为了在保真度和共同在场感之间取得平衡,我们探索在AR远程会议中使用真人等大的基于2D视频的化身(简称视频化身)。具体而言,考虑到FoV对用户距离感知的潜在影响,我们首先进行了一项先导研究,以探索在小型群体AR对话中以本地用户为中心的视频化身最优放置方案。基于该放置结果,我们随后实现了一个基于视频化身的远程会议概念验证原型。我们使用该原型进行了用户评估,以验证其在平衡保真度和共同在场感方面的有效性。遵循先导研究的提示,我们进一步通过一项在VR模拟环境中包含更多FoV条件的用户研究,定量探索了FoV大小对视频化身最优放置的影响。我们回归出放置模型,为在现有各种AR HMD以及未来具有更大FoV的设备上计算确定此类远程会议应用中的视频化身放置方案提供参考。

英文摘要:

Augmented Reality (AR) teleconferencing allows separately located users to interact with each other in 3D through agents in their own physical environments. Existing methods leveraging volumetric capturing and reconstruction can provide a high-fidelity experience but are often too complex and expensive for everyday usage. Other solutions target mobile and effortless-to-setup teleconferencing on AR Head Mounted Displays (HMD). They directly transplant the conventional video conferencing onto an AR-HMD platform or use avatars to represent remote participants. However, they can only support either a high fidelity or a high level of co-presence. Moreover, the limited Field of View (FoV) of HMDs could further influence users' immersive experience. To achieve a balance between fidelity and co-presence, we explore using life-size 2D video-based avatars (video avatars for short) in AR teleconferencing. Specifically, with the potential effect of FoV on users' perception of proximity, we first conduct a pilot study to explore the local-user-centered optimal placement of video avatars in small-group AR conversations. With the placement results, we then implement a proof-of-concept prototype of video-avatar-based teleconferencing. We conduct user evaluations with the prototype to verify its effectiveness in balancing fidelity and co-presence. Following the indication in the pilot study, we further quantitatively explore the effect of FoV size on the video avatar's optimal placement through a user study involving more FoV conditions in a VR-simulated environment. We regress placement models to serve as references for computationally determining video avatar placements in such teleconferencing applications on various existing AR HMDs and future ones with bigger FoVs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑