arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1802.00272cs.HCcs.RO
收藏

基于三维人体活动识别和仿人决策机制的服务机器人实时的人机交互

Real-Time Human-Robot Interaction for a Service Robot Based on 3D Human Activity Recognition and Human-mimicking Decision Mechanism

The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所复杂系统管理与控制国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学)

Kang Li, Jinting Wu, Xiaoguang Zhao, Min Tan

摘要:

本文描述了一个实时的【形】人-机器人交互系统的服务机器人的基础上三维人体活动识别和仿人决策机制的发展。人机交互(HRI)系统允许一个人使用自然肢体语言与服务机器人进行交互,通过Microsoft Kinect收集包含有关用户的丰富人体运动信息的3D骨骼关节序列。这些信息用于训练三层长短期记忆(LSTM)网络,用于人类动作识别。机器人基于在线LSTM网络测试理解用户意图,并通过机器人手臂或底盘的运动响应用户。此外,在此过程中还融合了类似人类的决策机制,使机器人能够根据任务优先级本能地决定是否中断当前任务。整个系统的框架建立在机器人操作系统(ROS)平台上。我们的服务机器人和用户之间的现实生活中的活动进行互动,以证明开发的HRI系统的有效性。

英文摘要:

This paper describes the development of a real-time Human-Robot Interaction (HRI) system for a service robot based on 3D human activity recognition and human-like decision mechanism. The Human-Robot Interactive (HRI) system, which allows one person to interact with a service robot using natural body language, collects sequences of 3D skeleton joints comprising rich human movement information about the user via Microsoft Kinect. This information is used to train a three-layer Long-Short-Term Memory (LSTM) network for human action recognition. The robot understands user intent based on an online LSTM network test, and responds to the user via movements of the robotic arm or chassis. Furthermore, the human-like decision mechanism is also fused into this process, which allows the robot to instinctively decide whether to interrupt the current task according to task priority. The framework of the overall system is established on the Robot Operating System (ROS) platform. The real-life activity interaction between our service robot and the user was conducted to demonstrate the effectiveness of developed HRI system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑