arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1101.5506cs.DS
收藏

压缩字符串字典

Compressed String Dictionaries

Nieves R. Brisaboa, Rodrigo Cánovas, Miguel A. Martínez-Prieto, Gonzalo Navarro

摘要:

在许多情况下,以紧凑的形式存储一组字符串(字符串字典)的问题自然会出现。虽然传统上它代表了要处理的整个数据的一小部分(例如,用于自然语言处理或用于索引文本集合),在Web引擎、Web挖掘、RDF图、因特网路由、生物信息学和许多其它领域中的更近期的应用利用非常大的字符串字典,其大小是整个数据的重要部分。因此,新的方法来有效地压缩它们是必要的。在本文中,我们实验比较的时间和空间性能的一些现有的替代品,以及我们提出的新的。我们表明,空间减少高达20%的字符串的原始大小是可能的,同时支持快速字典搜索。

英文摘要:

The problem of storing a set of strings --- a string dictionary --- in compact form appears naturally in many cases. While classically it has represented a small part of the whole data to be processed (e.g., for Natural Language processing or for indexing text collections), more recent applications in Web engines, Web mining, RDF graphs, Internet routing, Bioinformatics, and many others, make use of very large string dictionaries, whose size is a significant fraction of the whole data. Thus novel approaches to compress them efficiently are necessary. In this paper we experimentally compare time and space performance of some existing alternatives, as well as new ones we propose. We show that space reductions of up to 20% of the original size of the strings is possible while supporting fast dictionary searches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑