arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1611.04887cs.CLcs.SI
收藏

通过基本属性预测任务解释Tweet表征的句法和社会元素

Interpreting the Syntactic and Social Elements of the Tweet Representations via Elementary Property Prediction Tasks

IIIT Hyderabad(海德拉巴国际信息技术学院);Microsoft(微软公司)

J Ganesh, Manish Gupta, Vasudeva Varma

摘要:

近年来,社会媒体分析领域的研究正在蓬勃发展,大量的研究工作将表示学习模型应用于解决诸如情感分析、语义文本相似度计算、主题标签预测等高级语义共语义任务。尽管表示学习模型的性能优于传统的任务基线,关于在表示内编码的推特的核心属性知之甚少。理解这些核心属性将使我们能够对表征的质量做出可推广的结论。我们在这里介绍的工作构成了打开社交媒体帖子向量嵌入黑盒的第一步,特别强调推文。为了理解编码在推文表示中的核心属性,我们评估表示以估计它可以在多大程度上模拟每个属性,例如推文长度,单词的存在,主题标签,提及,大写等等。这是在多个分类器的帮助下完成的,这些分类器将表示作为输入。从本质上讲,每个分类器评估一个语法或社会属性,这可以说是突出的鸣叫。这也是第一次全面研究广泛分析各种推文表示模型的编码能力,包括传统的无监督方法(BOW,LDA),无监督表示学习方法(Siamese CBOW,Tweet2Vec)以及监督方法(CNN,BLSTM)。

英文摘要:

Research in social media analysis is experiencing a recent surge with a large number of works applying representation learning models to solve high-level syntactico-semantic tasks such as sentiment analysis, semantic textual similarity computation, hashtag prediction and so on. Although the performance of the representation learning models are better than the traditional baselines for the tasks, little is known about the core properties of a tweet encoded within the representations. Understanding these core properties would empower us in making generalizable conclusions about the quality of representations. Our work presented here constitutes the first step in opening the black-box of vector embedding for social media posts, with emphasis on tweets in particular. In order to understand the core properties encoded in a tweet representation, we evaluate the representations to estimate the extent to which it can model each of those properties such as tweet length, presence of words, hashtags, mentions, capitalization, and so on. This is done with the help of multiple classifiers which take the representation as input. Essentially, each classifier evaluates one of the syntactic or social properties which are arguably salient for a tweet. This is also the first holistic study on extensively analysing the ability to encode these properties for a wide variety of tweet representation models including the traditional unsupervised methods (BOW, LDA), unsupervised representation learning methods (Siamese CBOW, Tweet2Vec) as well as supervised methods (CNN, BLSTM).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑