arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1609.06378cs.DS
收藏

小空间下的线性时间串索引与分析

Linear-time string indexing and analysis in small space

Djamal Belazzougui, Fabio Cunial, Juha Kärkkäinen, Veli Mäkinen

摘要:

简洁数据结构领域在过去的16年里蓬勃发展。从Grossi和Vitter(STOC 2000)的压缩后缀数组(CSA)和Ferragina和Manzini(FOCS 2000)的FM索引开始,已经开发了许多基于Burrows-Wheeler变换(BWT)的字符串索引的推广和应用,所有这些都占用了接近输入大小的空间。在许多大规模的应用程序中,索引的构造和使用需要被视为一个计算单元。在小空间中的高效字符串索引和分析也是高通量DNA测序的数据密集型领域中的许多原语的核心。我们报告了以下字符串索引和分析方面的进展。我们表明,一个字符串$T\in \{1,\ldots,σ\}^n$的BWT可以内置的确定的$O(n)$时间使用的只是$O(n\logσ)$位的空间,其中$σ\leq n$。在相同的时间和空间预算内,我们可以基于BWT构建一个索引,该索引允许枚举$T$的后缀树的所有内部节点。许多基本的字符串分析问题可以被映射到这样的枚举,并且因此可以在确定性的$O(n)$时间和来自输入字符串的$O(n\logσ)$位空间中被解决。我们还展示了如何建立许多现有的索引的基础上的BWT,如CSA,压缩后缀树(CST),和双向BWT索引,在随机$O(n)$时间和空间的$O(n\logσ)$位。以前最快的BWT、CSA和CST构造算法使用$O(n\logσ)$空间位,前两个结构需要$O(n\log{\logσ})$时间,第三个结构需要$O(n\log^εn)$时间,其中$ε$是任何正常数。与现有技术相反,我们的双向BWT索引支持其输出中每个元素的恒定时间内的每个操作。

英文摘要:

The field of succinct data structures has flourished over the last 16 years. Starting from the compressed suffix array (CSA) by Grossi and Vitter (STOC 2000) and the FM-index by Ferragina and Manzini (FOCS 2000), a number of generalizations and applications of string indexes based on the Burrows-Wheeler transform (BWT) have been developed, all taking an amount of space that is close to the input size in bits. In many large-scale applications, the construction of the index and its usage need to be considered as one unit of computation. Efficient string indexing and analysis in small space lies also at the core of a number of primitives in the data-intensive field of high-throughput DNA sequencing. We report the following advances in string indexing and analysis. We show that the BWT of a string $T\in \{1,\ldots,σ\}^n$ can be built in deterministic $O(n)$ time using just $O(n\logσ)$ bits of space, where $σ\leq n$. Within the same time and space budget, we can build an index based on the BWT that allows one to enumerate all the internal nodes of the suffix tree of $T$. Many fundamental string analysis problems can be mapped to such enumeration, and can thus be solved in deterministic $O(n)$ time and in $O(n\logσ)$ bits of space from the input string. We also show how to build many of the existing indexes based on the BWT, such as the CSA, the compressed suffix tree (CST), and the bidirectional BWT index, in randomized $O(n)$ time and in $O(n\logσ)$ bits of space. The previously fastest construction algorithms for BWT, CSA and CST, which used $O(n\logσ)$ bits of space, took $O(n\log{\logσ})$ time for the first two structures, and $O(n\log^εn)$ time for the third, where $ε$ is any positive constant. Contrary to the state of the art, our bidirectional BWT index supports every operation in constant time per element in its output.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑