arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.13180cs.CVcs.LGcs.SI
收藏

揭示在线照片共享的真实效果

Unveiling Real-Life Effects of Online Photo Sharing

Université Paris-Saclay(巴黎萨克雷大学);CEA(法国原子能和替代能源委员会)

Van-Khoa Nguyen, Adrian Popescu, Jerome Deshayes-Chossart

摘要:

社交网络提供免费服务,以换取利用用户数据的权利。数据共享在用户选择的初始环境中进行。然而,社交网络和第三方在不同的背景下使用数据,这些背景往往不透明。为了揭示这种用法,我们提出了一种方法,专注于数据共享在有影响力的现实生活中的影响。重点放在视觉内容上,因为它在塑造在线用户简档方面具有强大的影响力。该方法依赖于三个组成部分:(1)一组视觉对象与相关的情况下,通过众包获得的影响评级,(2)一组相应的对象检测器,用于挖掘用户的照片和(3)地面实况数据集由500视觉用户简档,手动评级每种情况。这些组件结合在LERVUP中,LERVUP是一种学习在每种情况下对视觉用户简档进行评级的方法。LERVUP利用了一种新的图像描述符,它在用户级别聚合对象评级和目标检测,以及一种注意力机制,它可以提高高评级的对象,以防止它们被低评级的对象淹没。通过测量个人资料评级的自动排名与手动地面实况之间的相关性,根据情况评估性能。结果表明,LERVUP是有效的,因为两个排名的强相关性。还讨论了该方法在移动应用程序中的实际实现,该移动应用程序提高了用户对共享数据使用的认识。

英文摘要:

Social networks give free access to their services in exchange for the right to exploit their users' data. Data sharing is done in an initial context which is chosen by the users. However, data are used by social networks and third parties in different contexts which are often not transparent. In order to unveil such usages, we propose an approach which focuses on the effects of data sharing in impactful real-life situations. Focus is put on visual content because of its strong influence in shaping online user profiles. The approach relies on three components: (1) a set of visual objects with associated situation impact ratings obtained by crowdsourcing, (2) a corresponding set of object detectors for mining users' photos and (3) a ground truth dataset made of 500 visual user profiles which are manually rated per situation. These components are combined in LERVUP, a method which learns to rate visual user profiles in each situation. LERVUP exploits a new image descriptor which aggregates object ratings and object detections at user level and an attention mechanism which boosts highly-rated objects to prevent them from being overwhelmed by low-rated ones. Performance is evaluated per situation by measuring the correlation between the automatic ranking of profile ratings and a manual ground truth. Results indicate that LERVUP is effective since a strong correlation of the two rankings is obtained. A practical implementation of the approach in a mobile app which raises user awareness about shared data usage is also discussed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑