arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1602.06979cs.CLcs.AI
收藏

Empath:理解大规模文本中的主题信号

Empath: Understanding Topic Signals in Large-Scale Text

Stanford University(斯坦福大学)

Ethan Fast, Binbin Chen, Michael Bernstein

摘要:

人类语言是由广泛的主题着色,但现有的文本分析工具只关注其中的一小部分。我们提出了Empath,一个工具,可以生成和验证新的词汇类别的需求,从一个小的一组种子条款(如“流血”和“冲床”生成类别暴力)。Empath通过深度学习在超过18亿字的现代小说中进行神经嵌入,从而在单词和短语之间绘制出内涵。给定一小组表征类别的种子词,Empath使用其神经嵌入来发现新的相关术语,然后使用群体驱动的过滤器验证类别。Empath还分析了200个内置的、预先验证的类别中的文本,这些类别是我们从网络数据集中的常见主题中生成的,比如忽视、政府和社交媒体。我们发现,Empath的数据驱动,人类验证的类别是高度相关的(r = 0.906)与LIWC中的类似类别。

英文摘要:

Human language is colored by a broad range of topics, but existing text analysis tools only focus on a small number of them. We present Empath, a tool that can generate and validate new lexical categories on demand from a small set of seed terms (like "bleed" and "punch" to generate the category violence). Empath draws connotations between words and phrases by deep learning a neural embedding across more than 1.8 billion words of modern fiction. Given a small set of seed words that characterize a category, Empath uses its neural embedding to discover new related terms, then validates the category with a crowd-powered filter. Empath also analyzes text across 200 built-in, pre-validated categories we have generated from common topics in our web dataset, like neglect, government, and social media. We show that Empath's data-driven, human validated categories are highly correlated (r=0.906) with similar categories in LIWC.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑