arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.10034cs.ROcs.AI
收藏

仿人健身机器人的合成数据持续学习

Continual Learning from Synthetic Data for a Humanoid Exercise Robot

University of Hamburg(汉堡大学)

Nicolas Duczek, Matthias Kerzel, Stefan Wermter

摘要:

为了检测和纠正身体锻炼,一个生长时需要的网络(GWR)与经常性的连接,情景记忆和一个新的子节点机制,以学习身体动作和姿势的时空关系。一旦执行了锻炼,每帧的姿势和移动的信息就存储在GWR中。对于每一帧,将当前姿势和运动对与GWR的预测输出进行比较,从而不仅允许关于姿势而且允许关于运动速度的反馈。在一个实际的场景中,一个身体锻炼是由一个像物理治疗师这样的专家来完成的,然后作为一个像Pepper这样的人形机器人的参考,对病人执行相同锻炼的情况给出反馈。然而,这种方法带来了两个挑战。首先,GWR还必须考虑到与人形机器人的距离以及用户在人形机器人的摄像机视野中的位置,这需要针对用户在人形机器人的视野中的定位的鲁棒性。其次,由于姿势和动作都依赖于原始表演者的身体测量,因此专家的练习不能轻易用作参考。本文解决了第一个挑战,通过设计一个架构,允许公差的平移和旋转的视野中心。对于第二个挑战,我们允许GWR在增量数据上在线增长。为了进行评估,我们创建了一个带有虚拟化身的新型运动数据集,称为Virtual-Squat数据集。总的来说,我们声称,我们基于GWR的新架构可以通过持续的在线学习将学习到的锻炼参考用于不同的身体变化,同时防止灾难性遗忘,从而实现与人形机器人的长期人机交互。

英文摘要:

In order to detect and correct physical exercises, a Grow-When-Required Network (GWR) with recurrent connections, episodic memory and a novel subnode mechanism is developed in order to learn spatiotemporal relationships of body movements and poses. Once an exercise is performed, the information of pose and movement per frame is stored in the GWR. For every frame, the current pose and motion pair is compared against a predicted output of the GWR, allowing for feedback not only on the pose but also on the velocity of the motion. In a practical scenario, a physical exercise is performed by an expert like a physiotherapist and then used as a reference for a humanoid robot like Pepper to give feedback on a patient's execution of the same exercise. This approach, however, comes with two challenges. First, the distance from the humanoid robot and the position of the user in the camera's view of the humanoid robot have to be considered by the GWR as well, requiring a robustness against the user's positioning in the field of view of the humanoid robot. Second, since both the pose and motion are dependent on the body measurements of the original performer, the expert's exercise cannot be easily used as a reference. This paper tackles the first challenge by designing an architecture that allows for tolerances in translation and rotations regarding the center of the field of view. For the second challenge, we allow the GWR to grow online on incremental data. For evaluation, we created a novel exercise dataset with virtual avatars called the Virtual-Squat dataset. Overall, we claim that our novel architecture based on the GWR can use a learned exercise reference for different body variations through continual online learning, while preventing catastrophic forgetting, enabling for an engaging long-term human-robot interaction with a humanoid robot.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑