AMGC:基于自适应匹配的基因组压缩算法
AMGC: Adaptive match-based genomic compression algorithm
AI总结:
针对NGS数据中读段压缩空间大的问题,提出可集成于各类工具的FASTQ读段压缩算法AMGC,通过分析并优化匹配位置、错配位置及未匹配读段三个关键组件,平均压缩率较次优方法提升81.23%。
摘要:
动机:尽管第三代测序(TGS)技术取得了重大进展,但第二代测序(NGS)技术在当前测序市场中仍占主导地位。这是因为NGS比TGS具有更低的错误率和更丰富的分析软件。NGS技术会产生海量的基因组数据,包括短读段、质量值和读段标识符。因此,高效压缩此类数据已成为迫切需求,促使大量研究致力于设计FASTQ压缩器。先前的研究表明,质量值的无损压缩似乎已达到极限。但读段部分的压缩仍有很大空间。结果:通过研究测序过程的特征,我们提出了一种用于压缩FASTQ文件中读段的新算法,该算法可集成到各种基因组压缩工具中。我们首先回顾了基于参考序列的算法流程,并确定了严重影响存储的三个关键组件:读段在参考序列上的匹配位置(refpos)、读段上碱基的不匹配位置(mispos)以及匹配失败的读段(unmapseq)。为了减小它们的大小,我们对匹配位置和测序错误的分布进行了详细分析,随后开发了AMGC的三个模块。实验结果表明,AMGC优于当前最先进的方法,与表现次优的压缩器相比,平均压缩率提升了81.23%。
英文摘要:
Motivation: Despite significant advances in Third-Generation Sequencing (TGS) technologies, Next-Generation Sequencing (NGS) technologies remain dominant in the current sequencing market. This is due to the lower error rates and richer analytical software of NGS than that of TGS. NGS technologies generate vast amounts of genomic data including short reads, quality values and read identifiers. As a result, efficient compression of such data has become a pressing need, leading to extensive research efforts focused on designing FASTQ compressors. Previous researches show that lossless compression of quality values seems to reach its limits. But there remain lots of room for the compression of the reads part. Results: By investigating the characters of the sequencing process, we present a new algorithm for compressing reads in FASTQ files, which can be integrated into various genomic compression tools. We first reviewed the pipeline of reference-based algorithms and identified three key components that heavily impact storage: the matching positions of reads on the reference sequence(refpos), the mismatched positions of bases on reads(mispos) and the matching failed reads(unmapseq). To reduce their sizes, we conducted a detailed analysis of the distribution of matching positions and sequencing errors and then developed the three modules of AMGC. According to the experiment results, AMGC outperformed the current state-of-the-art methods, achieving an 81.23% gain in compression ratio on average compared with the second-best-performing compressor.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。