SketchMeHow：带有用户草图的交互式投影引导任务指令
SketchMeHow: Interactive Projection Guided Task Instruction with User Sketches
摘要：
在这项工作中，我们提出了一个交互式通用教学框架SketchMeHow指导普通用户实时完成日常任务。与传统的基于增强现实的教学系统相比，该框架利用用户草图作为系统输入，从绘图界面获取用户的生产意图。给定用户草图，可以基于每个任务的子任务划分和空间定位来分析指定的任务指令。采用投影仪-摄像机系统，利用空间增强现实技术对终端用户进行投影引导。为了验证所提出的框架，我们进行了多米诺骨牌安排和便当生产的两个案例研究。从我们的用户研究，建议的系统可以帮助新手用户完成任务，有效地与用户满意度。我们相信所提出的SketchMeHow可以拓宽基于草图的现实世界应用在人机交互的研究课题。
英文摘要：
In this work, we propose an interactive general instruction framework SketchMeHow to guidance the common users to complete the daily tasks in real-time. In contrast to the conventional augmented reality-based instruction systems, the proposed framework utilizes the user sketches as system inputs to acquire the users' production intentions from the drawing interfaces. Given the user sketches, the designated task instruction can be analyzed based on the sub-task division and spatial localization for each task. The projector-camera system is adopted in the projection guidance to the end-users with the spatial augmented reality technology. To verify the proposed framework, we conducted two case studies of domino arrangement and bento production. From our user studies, the proposed systems can help novice users complete the tasks efficiently with user satisfaction. We believe the proposed SketchMeHow can broaden the research topics in sketch-based real-world applications in human-computer interaction.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
