社交机器人中类人目光行为:一种整合人类和非人类刺激的深度学习方法
Human-Like Gaze Behavior in Social Robots: A Deep Learning Approach Integrating Human and Non-Human Stimuli
AI总结:
本研究通过深度学习方法,使社交机器人在各种社交情境中更准确地模仿人类目光行为,提升与人类的互动效果。
摘要:
非语言行为,特别是目光方向,在增强社交互动中的有效沟通中起着关键作用。随着社交机器人越来越多地参与这些互动,它们必须根据人类活动调整目光,并对所有线索保持敏感,无论是人类生成的还是非人类生成的,以确保无缝和有效的沟通。本研究旨在提高机器人和人类在各种社交情境中的目光行为相似性,包括人类和非人类刺激(如对话、指认、门打开和物体掉落)。本研究的关键创新是研究对非人类刺激的目光反应,这是先前研究中关键但未被充分探索的领域。这些场景在Unity软件中被模拟为3D动画和360度真实世界视频。通过虚拟现实(VR)眼镜收集了41名参与者的眼部方向数据。预处理数据训练了两个神经网络——LSTM和Transformer,以基于个体的目光模式构建预测模型。在动画场景中,LSTM和Transformer模型的预测准确率分别为67.6%和70.4%;在真实世界场景中,LSTM和Transformer模型的准确率分别为72%和71.6%。尽管个体之间目光模式存在差异,我们的模型在准确性上优于现有方法,同时独特地考虑了非人类刺激,相较于以往文献具有显著优势。此外,该系统部署在NAO机器人上,通过全面的问卷调查由275名参与者评估,结果显示在互动期间满意度高。这项工作通过使机器人在复杂社交情境中动态模仿人类目光行为,推动了社交机器人学的发展。
英文摘要:
Nonverbal behaviors, particularly gaze direction, play a crucial role in enhancing effective communication in social interactions. As social robots increasingly participate in these interactions, they must adapt their gaze based on human activities and remain receptive to all cues, whether human-generated or not, to ensure seamless and effective communication. This study aims to increase the similarity between robot and human gaze behavior across various social situations, including both human and non-human stimuli (e.g., conversations, pointing, door openings, and object drops). A key innovation in this study, is the investigation of gaze responses to non-human stimuli, a critical yet underexplored area in prior research. These scenarios, were simulated in the Unity software as a 3D animation and a 360-degree real-world video. Data on gaze directions from 41 participants were collected via virtual reality (VR) glasses. Preprocessed data, trained two neural networks-LSTM and Transformer-to build predictive models based on individuals' gaze patterns. In the animated scenario, the LSTM and Transformer models achieved prediction accuracies of 67.6% and 70.4%, respectively; In the real-world scenario, the LSTM and Transformer models achieved accuracies of 72% and 71.6%, respectively. Despite the gaze pattern differences among individuals, our models outperform existing approaches in accuracy while uniquely considering non-human stimuli, offering a significant advantage over previous literature. Furthermore, deployed on the NAO robot, the system was evaluated by 275 participants via a comprehensive questionnaire, with results demonstrating high satisfaction during interactions. This work advances social robotics by enabling robots to dynamically mimic human gaze behavior in complex social contexts.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。