arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.03907cs.HCcs.AI
收藏

将大语言模型嵌入扩展现实:包容性、参与度与隐私层面的机遇与挑战

Embedding Large Language Models into Extended Reality: Opportunities and Challenges for Inclusion, Engagement, and Privacy

Technical University of Munich(慕尼黑工业大学);University of Tübingen(蒂宾根大学)

Efe Bozkir, Süleyman Özdel, Ka Hei Carrie Lau, Mengdi Wang, Hong Gao, Enkelejda Kasneci

AI总结:

该研究提出将大语言模型嵌入XR的虚拟化身或叙事中,通过提示工程与微调提升包容性与用户参与度,同时指出该结合可能引发新型隐私风险,认为该领域虽有挑战但前景广阔。

摘要:

人工智能与人机交互的发展可能会推动扩展现实(XR)走向普及。尽管XR能为用户提供互动性强、引人入胜的沉浸式体验,但非玩家角色往往以预设脚本的传统方式被使用。本文主张在XR中应用大语言模型(LLMs),将其嵌入虚拟化身或作为叙事载体,通过提示工程与LLM微调来提升包容性。我们认为这种包容性将促进XR应用的多样性。此外,LLMs多样的对话能力有望提升XR中的用户参与度,助力XR实现普及。最后,我们推测用户向LLM驱动的空间提供的信息,与获取的生物识别数据相结合,可能引发新型隐私侵犯。在探究潜在隐私泄露问题时,考察用户的隐私顾虑与偏好也至关重要。因此,尽管存在挑战,LLM驱动的XR仍是一个充满机遇的前景广阔的领域。

英文摘要:

Advances in artificial intelligence and human-computer interaction will likely lead to extended reality (XR) becoming pervasive. While XR can provide users with interactive, engaging, and immersive experiences, non-player characters are often utilized in pre-scripted and conventional ways. This paper argues for using large language models (LLMs) in XR by embedding them in avatars or as narratives to facilitate inclusion through prompt engineering and fine-tuning the LLMs. We argue that this inclusion will promote diversity for XR use. Furthermore, the versatile conversational capabilities of LLMs will likely increase engagement in XR, helping XR become ubiquitous. Lastly, we speculate that combining the information provided to LLM-powered spaces by users and the biometric data obtained might lead to novel privacy invasions. While exploring potential privacy breaches, examining user privacy concerns and preferences is also essential. Therefore, despite challenges, LLM-powered XR is a promising area with several opportunities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑