arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1105.4256cs.SIcs.DC
收藏

MapReduce中的社交内容匹配

Social content matching in MapReduce

Gianmarco De Francisci Morales, Aristides Gionis, Mauro Sozio

摘要:

匹配问题无处不在。它们发生在经济市场、劳动力市场、互联网广告和其他地方。在本文中,我们专注于社交媒体匹配的应用。我们的目标是将内容从信息提供者分发到信息消费者。我们寻求最大限度地提高从供应商到消费者的匹配内容的整体相关性,同时规范整体活动,例如,确保没有消费者被数据淹没,所有供应商都有机会提供他们的内容。我们提出了两个匹配算法,GreedyMR和StackMR,面向MapReduce范式。这两种算法都有可证明的近似保证,在实践中,它们产生高质量的解决方案。虽然这两种算法的扩展性都非常好,但我们可以证明StackMR只需要多对数的MapReduce步骤,这使得它成为具有非常大数据集的应用程序的一个有吸引力的选择。我们的实验表明,我们的解决方案的质量和效率之间的权衡来自现实世界的社交媒体网站的两个大型数据集。

英文摘要:

Matching problems are ubiquitous. They occur in economic markets, labor markets, internet advertising, and elsewhere. In this paper we focus on an application of matching for social media. Our goal is to distribute content from information suppliers to information consumers. We seek to maximize the overall relevance of the matched content from suppliers to consumers while regulating the overall activity, e.g., ensuring that no consumer is overwhelmed with data and that all suppliers have chances to deliver their content. We propose two matching algorithms, GreedyMR and StackMR, geared for the MapReduce paradigm. Both algorithms have provable approximation guarantees, and in practice they produce high-quality solutions. While both algorithms scale extremely well, we can show that StackMR requires only a poly-logarithmic number of MapReduce steps, making it an attractive option for applications with very large datasets. We experimentally show the trade-offs between quality and efficiency of our solutions on two large datasets coming from real-world social-media web sites.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑