arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.10154cs.CRcs.AIcs.MM
收藏

PRISM-XR: 通过多模态大语言模型赋能隐私感知的扩展现实协作

PRISM-XR: Empowering Privacy-Aware XR Collaboration with Multimodal Large Language Models

Department of Electrical Engineering, The Pennsylvania State University, University Park, PA 16802, USA(电气工程系,宾夕法尼亚州立大学,University Park,PA 16802,USA)

Jiangong Chen, Mingyu Zhu, Bin Li

AI总结:

本文提出PRISM-XR框架,通过边缘服务器智能预处理过滤敏感数据,实现隐私保护的多用户XR协作,实验表明其在准确性和隐私保护方面表现优异。

摘要:

多模态大语言模型(MLLMs)通过结合自然语言和视觉输入增强了扩展现实(XR)环境中的协作能力,但XR头显捕获的视觉数据可能包含敏感信息。本文提出PRISM-XR框架,通过边缘服务器预处理过滤敏感数据,结合轻量级注册过程和可定制内容共享机制,实现隐私保护的多用户协作。实验结果显示,该平台在满足用户请求准确率接近90%的同时,注册时间低于0.27秒,空间不一致误差小于3.5厘米。

英文摘要:

Multimodal Large Language Models (MLLMs) enhance collaboration in Extended Reality (XR) environments by enabling flexible object and animation creation through the combination of natural language and visual inputs. However, visual data captured by XR headsets includes real-world backgrounds that may contain irrelevant or sensitive user information, such as credit cards left on the table or facial identities of other users. Uploading those frames to cloud-based MLLMs poses serious privacy risks, particularly when such data is processed without explicit user consent. Additionally, existing colocation and synchronization mechanisms in commercial XR APIs rely on time-consuming, privacy-invasive environment scanning and struggle to adapt to the highly dynamic nature of MLLM-integrated XR environments. In this paper, we propose PRISM-XR, a novel framework that facilitates multi-user collaboration in XR by providing privacy-aware MLLM integration. PRISM-XR employs intelligent frame preprocessing on the edge server to filter sensitive data and remove irrelevant context before communicating with cloud generative AI models. Additionally, we introduce a lightweight registration process and a fully customizable content-sharing mechanism to enable efficient, accurate, and privacy-preserving content synchronization among users. Our numerical evaluation results indicate that the proposed platform achieves nearly 90% accuracy in fulfilling user requests and less than 0.27 seconds registration time while maintaining spatial inconsistencies of less than 3.5 cm. Furthermore, we conducted an IRB-approved user study with 28 participants, demonstrating that our system could automatically filter highly sensitive objects in over 90% of scenarios while maintaining strong overall usability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑