GEMINI:一个通用的多模态视频游戏自然界面框架
GEMINI: A Generic Multi-Modal Natural Interface Framework for Videogames
摘要:
近年来,视频游戏公司已经认识到玩家参与的作用是用户体验和享受的主要因素。这鼓励了更多的投资在新类型的游戏控制器,如WiiMote,摇滚乐队乐器和Kinect。然而,这些控制器的原生软件最初并不是设计用于其他游戏应用程序的。这项工作通过构建一个中间件框架来解决这个问题,该框架将身体姿势或语音命令映射到任何游戏中的动作。这不仅保证了更自然和定制的用户体验,而且还定义了可互操作的虚拟控制器。在这个版本的框架中,身体姿势和语音命令分别通过Kinect内置的摄像头和麦克风识别。然后使用基于空间限制的轻量级方法将所获取的数据实时的转换为本地交互方案。该系统还准备使用任天堂的Wiimote作为辅助和不显眼的游戏手柄,用于物理或口头不切实际的命令。通过分析某些任务的性能和检查用户报告进行系统验证。两者都证实了这种方法是游戏原生交互方案的一种实用而诱人的替代方案。总之,这个框架提供了一个完全可定制的、非常灵活的游戏控制工具,从而扩大了游戏消费者的市场。
英文摘要:
In recent years videogame companies have recognized the role of player engagement as a major factor in user experience and enjoyment. This encouraged a greater investment in new types of game controllers such as the WiiMote, Rock Band instruments and the Kinect. However, the native software of these controllers was not originally designed to be used in other game applications. This work addresses this issue by building a middleware framework, which maps body poses or voice commands to actions in any game. This not only warrants a more natural and customized user-experience but it also defines an interoperable virtual controller. In this version of the framework, body poses and voice commands are respectively recognized through the Kinect's built-in cameras and microphones. The acquired data is then translated into the native interaction scheme in real time using a lightweight method based on spatial restrictions. The system is also prepared to use Nintendo's Wiimote as an auxiliary and unobtrusive gamepad for physically or verbally impractical commands. System validation was performed by analyzing the performance of certain tasks and examining user reports. Both confirmed this approach as a practical and alluring alternative to the game's native interaction scheme. In sum, this framework provides a game-controlling tool that is totally customizable and very flexible, thus expanding the market of game consumers.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。