arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.23353cs.HC
收藏

基于RAG的虚拟考古中 avatars 的设计空间与实现

Design Space and Implementation of RAG-Based Avatars for Virtual Archaeology

University of Konstanz(康斯坦茨大学);University of Perugia(佩鲁贾大学)
Wilhelm Kerle-Malcharek, Giulio Biondi, Karsten Klein, Ulf Hailer, Steffen Diefenbach, Fabrizio Grosso, Marco Legittimo, Paola Venuti, Carla Binucci, Giuseppe L… 展开作者

Wilhelm Kerle-Malcharek, Giulio Biondi, Karsten Klein, Ulf Hailer, Steffen Diefenbach, Fabrizio Grosso, Marco Legittimo, Paola Venuti, Carla Binucci, Giuseppe Liotta, Falk Schreiber

AI总结:

本文探讨了基于RAG的avatrs在虚拟考古中的应用,设计了涵盖应用场景、avatrs个性及输入输出模式的需求空间,并通过虚拟现实环境中的案例研究验证了其在提升数字文化遗产互动性方面的有效性。

摘要:

沉浸式技术,如虚拟和增强现实,正在通过使用户能够探索和与具有文化意义的遗址互动而改变数字遗产。现在可以查看并增强数字双胞胎,或它们的数字重建版本,并使以前无法到达的地点对更广泛的受众开放。本文研究了基于检索增强生成(RAG)的avatrs作为在专门虚拟环境中获取更多关于数字文化遗产对象信息的接口。我们提出了一个需求设计空间,涵盖了应用领域、avatrs个性和I/O模式。我们通过将RAG系统与虚拟现实(VR)环境中的对话avatrs结合,并以公元4世纪的Maxentius墓葬作为案例研究,使用户能够访问经过编目的按需信息。我们的工作流程利用学术文本,并用元数据丰富它们。我们评估了各种RAG配置在小型专家编写的问答集上的回答质量和使用此类RAG avatrs的VR设置中的用户感知工作量。我们证明了用户认为与此类avatrs交互的整体工作量低于平均水平,并且此类avatrs有助于获得主题参与度。总体而言,我们的工作展示了如何利用RAG驱动的VR avatrs进行考古研究,并提供了证据表明它们可以为沉浸式、AI增强的数字遗产应用提供路径。

英文摘要:

Immersive technologies, such as virtual and augmented reality, are transforming digital heritage by enabling users to explore and interact with culturally significant sites. It is now possible to view and augment digital twins, or digitally reconstructed versions of them, and to enable access to previously unreachable locations for a broader audience. Here, we investigate retrieval-augmented generation (RAG)-based avatars as an interface for accessing further information about digital cultural heritage objects while immersed in dedicated virtual environments. We present a requirement design space that spans the application realm, avatar personality, and I/O modalities. We instantiate it with a RAG system coupled to a conversational avatar in a virtual reality (VR) environment, using the Maxentius mausoleum from the 4th century AD as a case study, through which users gain access to curated on-demand information of the digitised heritage object. Our workflow utilises scholarly texts and enriches them with metadata. We evaluate various RAG configurations in terms of answer quality on a small expert-crafted question-answer set, as well as the perceived workload of users of a VR setup using such a RAG avatar. We demonstrate evidence that users perceive the overall workload for interacting with such an avatar as below average and that such avatars help to gain topical engagement. Overall, our work demonstrates how to utilise RAG-driven VR avatars for archaeological purposes and provides evidence that they can offer a pathway for immersive, AI-enhanced digital heritage applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑