混合组合和聚合信息的概念检测
Mixing syntagmatic and paradigmatic information for concept detection
摘要:
在过去的几十年里,哲学家们已经开始使用经验数据进行概念分析,但基于语料库的概念分析迄今未能发展,部分原因是缺乏可靠的方法来自动检测文本数据中的概念。以往的尝试表明,主题模型可以构成有效的概念检测算法,但虽然他们利用语料库中的组合关系,他们未能利用聚合关系,因此可能无法准确地建模概念。在这篇文章中,我们展示了使用主题模型,在词嵌入的空间上对概念进行建模(Hu和Tsujii,2016)可以显著提高概念检测性能,并使目标概念能够使用词向量以更灵活的方式表达。
英文摘要:
In the last decades, philosophers have begun using empirical data for conceptual analysis, but corpus-based conceptual analysis has so far failed to develop, in part because of the absence of reliable methods to automatically detect concepts in textual data. Previous attempts have shown that topic models can constitute efficient concept detection heuristics, but while they leverage the syntagmatic relations in a corpus, they fail to exploit paradigmatic relations, and thus probably fail to model concepts accurately. In this article, we show that using a topic model that models concepts on a space of word embeddings (Hu and Tsujii, 2016) can lead to significant increases in concept detection performance, as well as enable the target concept to be expressed in more flexible ways using word vectors.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。