arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.05478cs.ETcs.LGq-bio.GN
收藏

基于Transformers的DNA数据存储单次读取重构

Single-Read Reconstruction for DNA Data Storage Using Transformers

Reichman University (IDC Herzliya)(赖希曼大学(赫兹利亚跨学科中心));Ben-Gurion University of the Negev(内盖夫本-古里安大学)

Yotam Nahum, Eyar Ben-Tolila, Leon Anavy

摘要:

随着全球对大规模数据存储的需求呈指数级增长,现有的存储技术在密度和能耗方面正在接近其理论和功能极限,使得基于DNA的存储成为未来数据存储的潜在解决方案。一些研究引入了具有高信息密度(PB/g)的基于DNA的存储系统。然而,DNA合成和测序技术产生错误的输出。校正这些错误的化学方法依赖于读取每个序列的多个拷贝,并导致过度的读取成本。Transformers作为一种用于语言建模的深度学习架构取得了前所未有的成功,这导致它被重新用于解决各个领域的各种任务。在这项工作中,我们提出了一种新的方法,单读重建使用编码器-解码器Transformer架构的DNA为基础的数据存储。我们将纠错过程作为一个自我监督的序列到序列任务,并使用合成噪声注入来训练仅使用解码的读取的模型。我们的方法利用每个解码文件的固有冗余来学习其底层结构。为了演示我们提出的方法,我们将文本,图像和代码脚本文件编码到DNA中,用高保真错误模拟器产生错误,并从嘈杂的读取中重建原始文件。与使用2-3个拷贝的最新算法相比,我们的模型在从每条DNA链的单个读取重建原始数据时实现了较低的出错率。这是第一次使用深度学习模型在基于DNA的存储中进行单读重建,从而降低了该过程的总体成本。我们表明,这种方法是适用于各种领域,并可以推广到新的领域。

英文摘要:

As the global need for large-scale data storage is rising exponentially, existing storage technologies are approaching their theoretical and functional limits in terms of density and energy consumption, making DNA based storage a potential solution for the future of data storage. Several studies introduced DNA based storage systems with high information density (petabytes/gram). However, DNA synthesis and sequencing technologies yield erroneous outputs. Algorithmic approaches for correcting these errors depend on reading multiple copies of each sequence and result in excessive reading costs. The unprecedented success of Transformers as a deep learning architecture for language modeling has led to its repurposing for solving a variety of tasks across various domains. In this work, we propose a novel approach for single-read reconstruction using an encoder-decoder Transformer architecture for DNA based data storage. We address the error correction process as a self-supervised sequence-to-sequence task and use synthetic noise injection to train the model using only the decoded reads. Our approach exploits the inherent redundancy of each decoded file to learn its underlying structure. To demonstrate our proposed approach, we encode text, image and code-script files to DNA, produce errors with high-fidelity error simulator, and reconstruct the original files from the noisy reads. Our model achieves lower error rates when reconstructing the original data from a single read of each DNA strand compared to state-of-the-art algorithms using 2-3 copies. This is the first demonstration of using deep learning models for single-read reconstruction in DNA based storage which allows for the reduction of the overall cost of the process. We show that this approach is applicable for various domains and can be generalized to new domains as well.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑