ChameleonControl:通过混合现实手势指导远程动手教室的远程操作真实人类代理人
ChameleonControl: Teleoperating Real Human Surrogates through Mixed Reality Gestural Guidance for Remote Hands-on Classrooms
摘要:
我们提出了变色龙控制,一个真正的人类远程操作系统,可扩展的远程教学动手教室。与现有的视频或基于AR/VR的远程实践教育相比,ChameleonControl使用真人作为远程教师的替代品。在现有的基于人的临场感方法的基础上,我们提出了一种新的方法,通过同步的混合现实手势导航和口头交流来远程操作人类代理人。通过在本地用户的MR视图中覆盖远程指导者的虚拟手,远程指导者可以指导和控制本地用户,就好像他们物理上存在一样。这允许本地用户/代理人将他们的手部动作和手势与远程教师同步,有效地远程操作真实的人。我们在物理治疗培训教室以及其他应用领域(如机械装配、手语和烹饪课程)部署和评估我们的系统。研究结果证实,我们的方法可以提高参与度和共同存在感,显示出远程动手教室的未来潜力。
英文摘要:
We present ChameleonControl, a real-human teleoperation system for scalable remote instruction in hands-on classrooms. In contrast to existing video or AR/VR-based remote hands-on education, ChameleonControl uses a real human as a surrogate of a remote instructor. Building on existing human-based telepresence approaches, we contribute a novel method to teleoperate a human surrogate through synchronized mixed reality hand gestural navigation and verbal communication. By overlaying the remote instructor's virtual hands in the local user's MR view, the remote instructor can guide and control the local user as if they were physically present. This allows the local user/surrogate to synchronize their hand movements and gestures with the remote instructor, effectively teleoperating a real human. We deploy and evaluate our system in classrooms of physiotherapy training, as well as other application domains such as mechanical assembly, sign language and cooking lessons. The study results confirm that our approach can increase engagement and the sense of co-presence, showing potential for the future of remote hands-on classrooms.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。