arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1811.01013cs.CL
收藏

基于简单注意力的表示学习在社交媒体短帖子排名中的应用

Simple Attention-Based Representation Learning for Ranking Short Social Media Posts

University of Maryland, College Park(马里兰大学帕克分校);David R. Cheriton School of Computer Science, University of Waterloo(滑铁卢大学戴维·R·切里顿计算机科学学院);Facebook AI(脸书人工智能研究院)

Peng Shi, Jinfeng Rao, Jimmy Lin

摘要:

本文探讨了使用神经网络对短社交媒体帖子进行用户查询排名的问题。而不是从一个复杂的体系结构开始,我们从自底向上的进行,并检查一个简单的,字级的连体结构的有效性,增强了基于注意力的机制,用于捕获语义的“软”匹配查询和后令牌。在TREC微博跟踪数据集上进行的大量实验表明,我们的简单模型不仅比现有方法更有效,而且速度也更快。我们的samCNN(简单注意力匹配CNN)模型的实现与社区共享,以支持未来的工作。

英文摘要:

This paper explores the problem of ranking short social media posts with respect to user queries using neural networks. Instead of starting with a complex architecture, we proceed from the bottom up and examine the effectiveness of a simple, word-level Siamese architecture augmented with attention-based mechanisms for capturing semantic "soft" matches between query and post tokens. Extensive experiments on datasets from the TREC Microblog Tracks show that our simple models not only achieve better effectiveness than existing approaches that are far more complex or exploit a more diverse set of relevance signals, but are also much faster. Implementations of our samCNN (Simple Attention-based Matching CNN) models are shared with the community to support future work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑