arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2001.10049cs.DC
收藏

diBELLA:分布式长读比对

diBELLA: Distributed Long Read to Long Read Alignment

Marquita Ellis, Giulia Guidi, Aydın Buluç, Leonid Oliker, Katherine Yelick

摘要:

我们提出了一个并行算法和可扩展的实现基因组分析,特别是从“第三代”长读测序仪的数据发现重叠和对齐的问题。虽然DNA的长序列为生物分析和洞察提供了巨大的优势,但目前的长读取测序仪器具有高出错率,因此需要与其短读取对应物不同的分析方法。我们的工作集中在一个有效的分布式内存并行化的准确的单节点算法重叠和对齐长读。我们实现了这种不规则的算法的可扩展性,通过解决竞争的问题,增加并行度,最大限度地减少通信,限制内存占用,并确保良好的负载平衡。由此产生的应用程序diBELLA是第一个专门为长时间读取和并行可扩展性设计的分布式内存分配器和对齐器。我们描述并提出了高层次的设计权衡分析,并进行了广泛的实证分析,比较性能特征的国家的最先进的HPC系统以及商业云架构,突出国家的最先进的网络技术的优势。

英文摘要:

We present a parallel algorithm and scalable implementation for genome analysis, specifically the problem of finding overlaps and alignments for data from "third generation" long read sequencers. While long sequences of DNA offer enormous advantages for biological analysis and insight, current long read sequencing instruments have high error rates and therefore require different approaches to analysis than their short read counterparts. Our work focuses on an efficient distributed-memory parallelization of an accurate single-node algorithm for overlapping and aligning long reads. We achieve scalability of this irregular algorithm by addressing the competing issues of increasing parallelism, minimizing communication, constraining the memory footprint, and ensuring good load balance. The resulting application, diBELLA, is the first distributed memory overlapper and aligner specifically designed for long reads and parallel scalability. We describe and present analyses for high level design trade-offs and conduct an extensive empirical analysis that compares performance characteristics across state-of-the-art HPC systems as well as a commercial cloud architectures, highlighting the advantages of state-of-the-art network technologies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑