arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 0810.0139cs.AI
收藏

用概率方法确定词序列的统一性

Determining the Unithood of Word Sequences using a Probabilistic Approach

University of Western Australia(西澳大利亚大学)

Wilson Wong, Wei Liu, Mohammed Bennamoun

摘要:

大多数与统一性有关的研究都是作为确定统一性的更大努力的一部分进行的。因此,在术语提取的这个小的子领域中,新颖性是罕见的。此外,现有的工作大多是经验性的动机和派生。我们提出了一个新的概率衍生的措施,独立于任何影响的termhood,提供专门的措施,收集语言证据,从解析文本和统计证据,从谷歌搜索引擎的测量团结。我们使用1,825个测试用例与现有的派生函数进行了比较研究,结果显示在精确度,召回率和准确性方面都有所提高。

英文摘要:

Most research related to unithood were conducted as part of a larger effort for the determination of termhood. Consequently, novelties are rare in this small sub-field of term extraction. In addition, existing work were mostly empirically motivated and derived. We propose a new probabilistically-derived measure, independent of any influences of termhood, that provides dedicated measures to gather linguistic evidence from parsed text and statistical evidence from Google search engine for the measurement of unithood. Our comparative study using 1,825 test cases against an existing empirically-derived function revealed an improvement in terms of precision, recall and accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑