复杂网络中的结构-语义相互作用及其对文本相似度预测的影响
Structure-semantics interplay in complex networks and its effects on the predictability of similarity in texts
摘要:
有不同的方法来定义相似性,以将相似的文本分组到集群中,因为相似性的概念可能取决于任务的目的。例如,在主题提取中,相似文本意味着那些在相同的语义场,而在作者识别中,应该考虑文体特征。在这项研究中,我们介绍的方法来分类文本采用复杂网络的概念,它可能能够捕捉句法,语义,甚至语用功能。复杂网络的各种指标之间的相互作用进行了分析与三个应用程序,即识别的机器翻译(MT)系统,机器翻译文本的质量评估和作者识别。我们将表明,代表文本的网络的拓扑特征可以提高识别MT系统在特定情况下的能力。另一方面,为了评估MT文本的质量,使用能够捕获语义的方法获得了高相关性。这是意料之中的,因为所使用的黄金标准本身就是基于单词共现的。尽管如此,Katz相似性,其中涉及文本比较中的语义和结构,实现了与NIST测量的最高相关性,这表明在某些情况下,这两种方法的结合可以提高量化MT质量的能力。在作者身份识别中,拓扑特征在某些情况下也是相关的,尽管对于所分析的书籍和作者,语义特征也获得了良好的结果。由于混合的方法,包括语义和拓扑特征还没有被广泛使用,我们认为,这里提出的方法可能是有用的,大大提高文本分类,因为它结合了完善的战略。
英文摘要:
There are different ways to define similarity for grouping similar texts into clusters, as the concept of similarity may depend on the purpose of the task. For instance, in topic extraction similar texts mean those within the same semantic field, whereas in author recognition stylistic features should be considered. In this study, we introduce ways to classify texts employing concepts of complex networks, which may be able to capture syntactic, semantic and even pragmatic features. The interplay between the various metrics of the complex networks is analyzed with three applications, namely identification of machine translation (MT) systems, evaluation of quality of machine translated texts and authorship recognition. We shall show that topological features of the networks representing texts can enhance the ability to identify MT systems in particular cases. For evaluating the quality of MT texts, on the other hand, high correlation was obtained with methods capable of capturing the semantics. This was expected because the golden standards used are themselves based on word co-occurrence. Notwithstanding, the Katz similarity, which involves semantic and structure in the comparison of texts, achieved the highest correlation with the NIST measurement, indicating that in some cases the combination of both approaches can improve the ability to quantify quality in MT. In authorship recognition, again the topological features were relevant in some contexts, though for the books and authors analyzed good results were obtained with semantic features as well. Because hybrid approaches encompassing semantic and topological features have not been extensively used, we believe that the methodology proposed here may be useful to enhance text classification considerably, as it combines well-established strategies.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。