AI 中文总结
本文提出一种面向元宇宙入门环境的基于浏览器的手势驱动交互框架，结合Google MediaPipe手势识别与两种移动技术，经5人评估验证，实现无控制器的轻量交互。
AI 中文摘要
虚拟化身交互决定了元宇宙体验的吸引力与沉浸感，若要让交互显得自然，虚拟化身需响应用户操作，且无需先通过基于控制器的界面强制用户操作。本文介绍了为基于浏览器的元宇宙入门环境构建的手势驱动交互层，在该环境中，用户以虚拟化身身份探索一系列虚拟房间，并通过手、手臂及头部手势与嵌入的视频、文档和测验内容进行交互，而非使用键盘或控制器。该系统将实时手势识别（Google MediaPipe）与两种可选的移动技术——举手导航和原地行走相结合，使用户可根据任务在精度与身体沉浸感之间进行权衡。本文的贡献在于将这些技术整合、部署并评估为单一轻量、可网页部署、无控制器的交互模型，通过包含5名参与者的结构化内部入门会话对其进行评估，报告了该部署系统中这些技术结合后的有效部分、无效部分及设计权衡。
英文摘要
Avatar interaction shapes how engaging and immersive a metaverse experience feels, and for that interaction to feel natural, avatars need to respond to users without forcing them through a controller-based interface first. This paper describes a gesture-driven interaction layer built for a browser-based metaverse onboarding environment, where users explore a set of virtual rooms as an avatar and interact with embedded video, document, and quiz content using hand, arm, and head gestures instead of a keyboard or controller. The system combines real-time gesture recognition (Google MediaPipe) with two alternative locomotion techniques - hand-raise navigation and in-place walking - so users can trade off precision against physical immersion depending on the task. The contribution is the integration, deployment, and evaluation of these techniques as a single lightweight, web-deployable, controller-free interaction model, assessed through a structured internal onboarding session with five participants. We report what worked, what didn't, and the design trade-offs that came out of combining these techniques in one deployed system.
Comments6 pages, 4 figures, 2 tables
