arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.06168cs.DL
收藏

利用引文网络评估文本长度对相关概念识别的影响

Using citation networks to evaluate the impact of text length on the identification of relevant concepts

Jorge A. V. Tohalino, Thiago C. Silva, Diego R. Amancio

摘要:

非结构化数据中最重要概念的识别在各种实际应用中至关重要。尽管已经提出了大量的方法来提取文本的主要主题,但有限数量的研究探讨了文本长度对关键词提取(KE)方法性能的影响。在这项研究中,我们采用了一种基于网络的方法来评估是否从论文摘要中提取的关键字与从全文中提取的关键字兼容。我们采用社区发现方法来识别引文网络中的相关论文组。这些论文集群,然后提取关键词的摘要。我们的研究结果表明,虽然我们的KE方法中采用的各种社区发现方法产生了相似的准确性水平,相关性分析显示,这些方法产生不同的关键字列表为每个摘要。我们还观察到,所有考虑的方法,然而,达到低的准确度值。令人惊讶的是,文本聚类方法优于所有基于引用的方法。研究结果表明,使用不同的信息来源提取关键字可能会导致显着差异的表现。这种效应在依赖于相关概念识别的应用中可以发挥重要作用。

英文摘要:

The identification of the most significant concepts in unstructured data is of critical importance in various practical applications. Despite the large number of methods that have been put forth to extract the main topics of texts, a limited number of studies have probed the impact of the text length on the performance of keyword extraction (KE) methods. In this study, we adopted a network-based approach to evaluate whether keywords extracted from paper abstracts are compatible with keywords extracted from full papers. We employed a community detection method to identify groups of related papers in citation networks. These paper clusters were then employed to extract keywords from abstracts. Our results indicate that while the various community detection methods employed in our KE approach yielded similar levels of accuracy, a correlation analysis revealed that these methods produced distinct keyword lists for each abstract. We also observed that all considered approaches, however, reach low values of accuracy. Surprisingly, text clustering approaches outperformed all citation-based methods. The findings suggest that using different sources of information to extract keywords can lead to significant differences in performance. This effect can play an important role in applications relying upon the identification of relevant concepts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑