arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.13138cs.LGmath.ATstat.ML
收藏

文本分类中的拓扑数据分析:利用附加信息提取特征

Topological Data Analysis in Text Classification: Extracting Features with Additive Information

University of North Carolina at Charlotte(北卡罗来纳大学夏洛特分校)

Shafie Gholizadeh, Ketki Savle, Armin Seyeditabari, Wlodek Zadrozny

摘要:

虽然拓扑数据分析的优势已经在许多高维数值数据的研究中得到了探索,但将其应用于文本仍然是一项具有挑战性的任务。由于拓扑数据分析的主要目标是定义和量化数字数据中的形状,因此定义文本中的形状更具挑战性,即使向量空间和概念空间的几何形状与信息检索和语义明显相关。在本文中,我们研究了两种不同的方法从文本中提取的拓扑特征,作为基本的表示的话,两个最流行的方法,即词嵌入和TF-IDF向量。为了从词嵌入空间中提取拓扑特征,我们将文本文档的嵌入解释为高维时间序列,并分析底层图的拓扑结构,其中顶点对应于不同的嵌入维度。对于TF-IDF表示的拓扑数据分析,我们分析其顶点来自文本文档中不同块的TF-IDF向量的图的拓扑。在这两种情况下,我们应用同调持久性,以揭示不同的距离分辨率下的几何结构。我们的研究结果表明,这些拓扑特征进行了一些独家的信息,是没有捕捉到传统的文本挖掘方法。在我们的实验中,我们观察到在集成模型中将拓扑特征添加到传统特征中可以提高分类结果(高达5%)。另一方面,正如预期的那样,拓扑特征本身可能不足以进行有效分类。看看来自词嵌入的TDA特征是否足够是一个开放的问题,因为它们似乎在使用线性支持向量分类器获得的顶部结果的几个点的范围内执行。

英文摘要:

While the strength of Topological Data Analysis has been explored in many studies on high dimensional numeric data, it is still a challenging task to apply it to text. As the primary goal in topological data analysis is to define and quantify the shapes in numeric data, defining shapes in the text is much more challenging, even though the geometries of vector spaces and conceptual spaces are clearly relevant for information retrieval and semantics. In this paper, we examine two different methods of extraction of topological features from text, using as the underlying representations of words the two most popular methods, namely word embeddings and TF-IDF vectors. To extract topological features from the word embedding space, we interpret the embedding of a text document as high dimensional time series, and we analyze the topology of the underlying graph where the vertices correspond to different embedding dimensions. For topological data analysis with the TF-IDF representations, we analyze the topology of the graph whose vertices come from the TF-IDF vectors of different blocks in the textual document. In both cases, we apply homological persistence to reveal the geometric structures under different distance resolutions. Our results show that these topological features carry some exclusive information that is not captured by conventional text mining methods. In our experiments we observe adding topological features to the conventional features in ensemble models improves the classification results (up to 5\%). On the other hand, as expected, topological features by themselves may be not sufficient for effective classification. It is an open problem to see whether TDA features from word embeddings might be sufficient, as they seem to perform within a range of few points from top results obtained with a linear support vector classifier.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑