arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1207.1847cs.CLcs.IR
收藏

在文本、基因组和其他符号序列中发现结构

Finding Structure in Text, Genome and Other Symbolic Sequences

The University of Sheffield(谢菲尔德大学)

Ted Dunning

摘要:

本论文所推导和描述的统计方法为阐明文本和其他符号序列的结构特性提供了新的途径。一般来说,这些方法允许检测单个特征的频率差异,检测特征集合的频率之间的差异以及文本来源的归属。这三个抽象的任务足以解决各种各样的问题。此外,在这篇论文中描述的技术可以扩展到提供一个广泛的额外的测试超出这里描述的。这些方法的各种应用进行了详细研究。这些应用程序来自文本分析和基因序列分析领域。面向文本的任务包括发现有趣的搭配和共现短语、语言识别和信息检索。面向生物学的任务包括物种鉴定和发现以前未报道的基因中的长程结构。在这里报告的应用程序中,直接比较是可能的,这些新方法的性能大大超过了最先进的。总体而言,这里描述的方法提供了新的和有效的方法来分析文本和其他符号序列。它们的特殊优势在于,它们能够很好地处理可获得的数据相对较少的情况。由于这些方法本质上是抽象的,因此它们可以相对容易地应用于新的情况。

英文摘要:

The statistical methods derived and described in this thesis provide new ways to elucidate the structural properties of text and other symbolic sequences. Generically, these methods allow detection of a difference in the frequency of a single feature, the detection of a difference between the frequencies of an ensemble of features and the attribution of the source of a text. These three abstract tasks suffice to solve problems in a wide variety of settings. Furthermore, the techniques described in this thesis can be extended to provide a wide range of additional tests beyond the ones described here. A variety of applications for these methods are examined in detail. These applications are drawn from the area of text analysis and genetic sequence analysis. The textually oriented tasks include finding interesting collocations and cooccurent phrases, language identification, and information retrieval. The biologically oriented tasks include species identification and the discovery of previously unreported long range structure in genes. In the applications reported here where direct comparison is possible, the performance of these new methods substantially exceeds the state of the art. Overall, the methods described here provide new and effective ways to analyse text and other symbolic sequences. Their particular strength is that they deal well with situations where relatively little data are available. Since these methods are abstract in nature, they can be applied in novel situations with relative ease.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑