arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.09404cs.CLcs.AI
收藏

台湾国语中不规范文本与规范文本的词共现网络和词相似网络结构对比

Comparison between the Structures of Word Co-occurrence and Word Similarity Networks for Ill-formed and Well-formed Texts in Taiwan Mandarin

University of Southern California(南加州大学);Taipei Medical University(台北医学大学)

Po-Hsuan Huang, Hsuan-Lei Shao

AI总结:

本研究针对台湾国语的不规范论坛文本与规范司法文本,对比词共现网络和词相似网络的无标度、小世界、异配性三种结构属性,验证相关特征在不同语言与网络类型间的普适性。

摘要:

词共现网络的研究因其潜在意义与应用价值受到研究者关注,因此理解词共现网络的结构对于充分发挥其价值与用途至关重要。过往研究发现,基于规范文本构建的词共现网络具备小世界性、服从双段幂律分布、整体呈异配性等特征。另一方面,过往研究表明,由微博帖子等不规范文本构建的词共现网络表现可能与规范文档构建的网络存在差异:两类词共现网络均具备小世界性且呈异配性,但不规范文本构建的词共现网络是无标度的,服从幂律分布而非双段幂律分布。然而,过往针对不规范文本词共现网络特性的研究仅以英语为研究对象,这类特征在不同语言中的普适性仍有待验证。此外,词共现网络与其他具备可比性的网络之间是否存在相似性或差异,也尚未得到探究。因此,本研究以台湾国语的不规范网络论坛帖子为基础,构建词共现网络与词相似网络,将其结构与用规范司法判决书构建的对应网络进行对比,旨在探究前述三种属性(无标度、小世界、异配性)在不规范与规范文本中、在不同语言间以及在词共现网络与词相似网络之间是否具有普适性。

英文摘要:

The study of word co-occurrence networks has attracted the attention of researchers due to their potential significance as well as applications. Understanding the structure of word co-occurrence networks is therefore important to fully realize their significance and usages. In past studies, word co-occurrence networks built on well-formed texts have been found to possess certain characteristics, including being small-world, following a two-regime power law distribution, and being generally disassortative. On the flip side, past studies have found that word co-occurrence networks built from ill-formed texts such as microblog posts may behave differently from those built from well-formed documents. While both kinds of word co-occurrence networks are small-world and disassortative, word co-occurrence networks built from ill-formed texts are scale-free and follow the power law distribution instead of the two-regime power law distribution. However, since past studies on the behavior of word co-occurrence networks built from ill-formed texts only investigated English, the universality of such characteristics remains to be seen among different languages. In addition, it is yet to be investigated whether there could be possible similitude/differences between word co-occurrence networks and other potentially comparable networks. This study therefore investigates and compares the structure of word co-occurrence networks and word similarity networks based on Taiwan Mandarin ill-formed internet forum posts and compare them with those built with well-formed judicial judgments, and seeks to find out whether the three aforementioned properties (scale-free, small-world, and disassortative) for ill-formed and well-formed texts are universal among different languages and between word co-occurrence and word similarity networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑