arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.00947cs.HCcs.LGstat.ML
收藏

在人群中寻找多莉:使用多模态移动传感检测社会互动

Finding Dory in the Crowd: Detecting Social Interactions using Multi-Modal Mobile Sensing

Imperial College London(帝国理工学院);Queen Mary University of London(伦敦玛丽女王大学);Telefónica Research(西班牙电信研究公司)

Kleomenis Katevas, Katrin Hänsel, Richard Clegg, Ilias Leontiadis, Hamed Haddadi, Laurissa Tokarchuk

摘要:

记住我们的日常社会交往是具有挑战性的,即使你不是一个蓝色记忆挑战鱼。自动检测和记住这些类型的交互的能力不仅有利于对他们在拥挤情况下的行为感兴趣的个人,而且也有利于分析人群行为的人。目前,检测社会互动往往是使用各种方法,包括人种学研究,计算机视觉技术和手动注释为基础的数据分析。然而,移动电话提供了更容易的数据汇集手段,易于分析,并可保护用户的隐私。在这项工作中,我们提出了一个系统,用于检测人群内的静态社交互动,利用多模态移动传感数据,如蓝牙智能(BLE),加速度计和陀螺仪。为了了解这种系统的发展,我们对24名参与者进行了一项研究,我们要求他们相互交往45分钟。我们建立了一个基于梯度提升树的机器学习系统,该系统预测1:1和群体交互,准确率为77.8%,召回率为86.5%,与基于邻近度的方法相比,性能提高了30.2%。通过利用基于社区发现的方法,我们进一步检测了人群中存在的各种群体形成。使用人群中大多数人已经携带的手机传感器,使我们的方法特别适合于对人群行为和影响策略的现实分析。

英文摘要:

Remembering our day-to-day social interactions is challenging even if you aren't a blue memory challenged fish. The ability to automatically detect and remember these types of interactions is not only beneficial for individuals interested in their behavior in crowded situations, but also of interest to those who analyze crowd behavior. Currently, detecting social interactions is often performed using a variety of methods including ethnographic studies, computer vision techniques and manual annotation-based data analysis. However, mobile phones offer easier means for data collection that is easy to analyze and can preserve the user's privacy. In this work, we present a system for detecting stationary social interactions inside crowds, leveraging multi-modal mobile sensing data such as Bluetooth Smart (BLE), accelerometer and gyroscope. To inform the development of such system, we conducted a study with 24 participants, where we asked them to socialize with each other for 45 minutes. We built a machine learning system based on gradient-boosted trees that predicts both 1:1 and group interactions with 77.8% precision and 86.5% recall, a 30.2% performance increase compared to a proximity-based approach. By utilizing a community detection-based method, we further detected the various group formation that exist within the crowd. Using mobile phone sensors already carried by the majority of people in a crowd makes our approach particularly well suited to real-life analysis of crowd behavior and influence strategies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑