arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2008.10078cs.CVcs.AIcs.RO
收藏

让我加入你们!具有社会意识的机器人的实时的F形识别

Let me join you! Real-time F-formation recognition by a socially aware robot

TCS Research & Innovation(塔塔咨询服务研究与创新部);Myanmar Institute of Information Technology(缅甸信息技术学院)

Hrishav Bakul Barua, Pradip Pramanick, Chayan Sarkar, Theint Haythi Mg

摘要:

本文提出了一种新的体系结构,从一个自我视觉相机的连续图像流中实时的【形】检测社会群体。F-形成定义了空间中的社会取向,其中两个或多个人倾向于在社交场所进行交流。因此,从本质上讲,我们在社交聚会中检测F-编队,如会议,讨论等,并预测机器人的接近角度,如果它想加入社交团体。此外,我们还检测离群值,即,不属于所考虑群体的人。我们提出的管道包括- a)骨架关键点估计器(总共17个),b)学习模型,(使用基于骨架点的特征向量)使用CRF来检测场景中的人群和离群人,以及c)使用多类支持向量机(SVM)来预测精确F的单独学习模型。当前场景中人群的形成以及观看机器人的接近角度。该系统使用两个数据集进行评估。结果表明,使用我们的方法在场景中的组和离群点检测建立了91%的准确率。我们已经将我们的系统与最先进的F-编队检测系统进行了严格的比较,发现它在编队检测方面优于最先进的系统29%,在编队和接近角的组合检测方面优于最先进的系统55%。

英文摘要:

This paper presents a novel architecture to detect social groups in real-time from a continuous image stream of an ego-vision camera. F-formation defines social orientations in space where two or more person tends to communicate in a social place. Thus, essentially, we detect F-formations in social gatherings such as meetings, discussions, etc. and predict the robot's approach angle if it wants to join the social group. Additionally, we also detect outliers, i.e., the persons who are not part of the group under consideration. Our proposed pipeline consists of -- a) a skeletal key points estimator (a total of 17) for the detected human in the scene, b) a learning model (using a feature vector based on the skeletal points) using CRF to detect groups of people and outlier person in a scene, and c) a separate learning model using a multi-class Support Vector Machine (SVM) to predict the exact F-formation of the group of people in the current scene and the angle of approach for the viewing robot. The system is evaluated using two data-sets. The results show that the group and outlier detection in a scene using our method establishes an accuracy of 91%. We have made rigorous comparisons of our systems with a state-of-the-art F-formation detection system and found that it outperforms the state-of-the-art by 29% for formation detection and 55% for combined detection of the formation and approach angle.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑