利用互信息和独立性测度判定词序列的统一性
Determining the Unithood of Word Sequences using Mutual Information and Independence Measure
摘要:
大多数与统一有关的工作是作为确定任期的更大努力的一部分进行的。因此,研究团结概念并提出衡量团结的专门技术的独立研究极少。我们提出了一种新的方法,独立于任何影响的termhood,提供专门的措施,收集语言证据,从解析文本和统计证据,从谷歌搜索引擎的测量团结。在对1005个测试用例的测试中,准确率和召回率分别为98.68%和91.82%,准确率为95.42%。
英文摘要:
Most works related to unithood were conducted as part of a larger effort for the determination of termhood. Consequently, the number of independent research that study the notion of unithood and produce dedicated techniques for measuring unithood is extremely small. We propose a new approach, independent of any influences of termhood, that provides dedicated measures to gather linguistic evidence from parsed text and statistical evidence from Google search engine for the measurement of unithood. Our evaluations revealed a precision and recall of 98.68% and 91.82% respectively with an accuracy at 95.42% in measuring the unithood of 1005 test cases.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。