arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2012.04832cs.RO
收藏

智能社交接待机器人的主动交互框架

Proactive Interaction Framework for Intelligent Social Receptionist Robots

Baidu(百度);Baidu Research(百度研究院);Baidu AI Interaction Design Lab(百度AI交互设计实验室);Baidu Natural Language Processing Department(百度自然语言处理部)

Yang Xue, Fan Wang, Hao Tian, Min Zhao, Jiangyong Li, Haiqing Pan, Yueqiang Dong

摘要:

主动式人机交互(HRI)允许接待员机器人主动迎接人们并提供基于视觉的服务,这已被发现可以提高可接受性和客户满意度。现有的方法要么基于多阶段决策过程,要么基于端到端的决策模型。然而,基于规则的方法需要勤奋的专家努力,只处理最小的预定义的情况。另一方面,现有的端到端模型仅限于非常一般的问候或很少的行为模式(通常少于10个)。为了应对这些挑战,我们提出了一个新的端到端框架,Transformer与视觉令牌的人机交互(TFVT-HRI)。该框架首先从RGB相机中提取相对对象的视觉标记。为了确保正确的解释的情况下,一个Transformer决策模型,然后处理的视觉令牌,这是增强的时间和空间信息。它预测在每种情况下采取的适当行动,并确定正确的目标。我们的数据是从办公楼的在职接待员机器人那里收集的,然后由专家进行注释,以确定适当的主动行为。动作集包括1000+种不同的模式,结合语言,表情符号表达和身体动作。我们将我们的模型与其他SOTA端到端模型进行比较,在现实的办公楼环境中进行离线测试集和在线用户实验,以验证此框架。结果表明,该决策模型实现了SOTA性能的动作触发和选择,导致更多的人性化和智能相比,以前的反应式接收政策。

英文摘要:

Proactive human-robot interaction (HRI) allows the receptionist robots to actively greet people and offer services based on vision, which has been found to improve acceptability and customer satisfaction. Existing approaches are either based on multi-stage decision processes or based on end-to-end decision models. However, the rule-based approaches require sedulous expert efforts and only handle minimal pre-defined scenarios. On the other hand, existing works with end-to-end models are limited to very general greetings or few behavior patterns (typically less than 10). To address those challenges, we propose a new end-to-end framework, the TransFormer with Visual Tokens for Human-Robot Interaction (TFVT-HRI). The proposed framework extracts visual tokens of relative objects from an RGB camera first. To ensure the correct interpretation of the scenario, a transformer decision model is then employed to process the visual tokens, which is augmented with the temporal and spatial information. It predicts the appropriate action to take in each scenario and identifies the right target. Our data is collected from an in-service receptionist robot in an office building, which is then annotated by experts for appropriate proactive behavior. The action set includes 1000+ diverse patterns by combining language, emoji expression, and body motions. We compare our model with other SOTA end-to-end models on both offline test sets and online user experiments in realistic office building environments to validate this framework. It is demonstrated that the decision model achieves SOTA performance in action triggering and selection, resulting in more humanness and intelligence when compared with the previous reactive reception policies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑