arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1503.02974q-bio.GNcs.CEcs.PF
收藏

下一代测序的计算资源建模16 S rRNA样本的生物信息学分析

Modelling Computational Resources for Next Generation Sequencing Bioinformatics Analysis of 16S rRNA Samples

Matthew J. Wade, Thomas P. Curtis, Russell J. Davenport

摘要:

在快速发展的下一代测序和生物信息学分析领域,数据生成是伴随增长的一个方面。与处理大量测序数据相关的负担强调了分配足够的计算资源以在尽可能短的时间内以可管理和可预测的成本完成分析的需要。针对流行的生物信息学软件QIIME,提出了一种新的预测完成时间的方法,该方法利用输入数据的关键变量特性来影响处理时间。开发了多元线性回归模型来确定两种去噪算法和通用生物信息学管道的运行时间。这些模型能够准确地预测来自自然组装的社区数据集的去噪序列的时钟时间,而不是人工社区。对AmpliconNoise的加速和效率测试也强调了在为数据的并行处理分配资源时需要谨慎。使用易于测量的预测器对计算处理时间进行精确建模,可以帮助NGS分析人员确定生物信息学软件和管道的资源需求。虽然在一组特定的脚本上进行了演示,但该方法可以扩展到包含在多个架构上并行或顺序运行的其他包。

英文摘要:

In the rapidly evolving domain of next generation sequencing and bioinformatics analysis, data generation is one aspect that is increasing at a concomitant rate. The burden associated with processing large amounts of sequencing data has emphasised the need to allocate sufficient computing resources to complete analyses in the shortest possible time with manageable and predictable costs. A novel method for predicting time to completion for a popular bioinformatics software (QIIME), was developed using key variables characteristic of the input data assumed to impact processing time. Multiple Linear Regression models were developed to determine run time for two denoising algorithms and a general bioinformatics pipeline. The models were able to accurately predict clock time for denoising sequences from a naturally assembled community dataset, but not an artificial community. Speedup and efficiency tests for AmpliconNoise also highlighted that caution was needed when allocating resources for parallel processing of data. Accurate modelling of computational processing time using easily measurable predictors can assist NGS analysts in determining resource requirements for bioinformatics software and pipelines. Whilst demonstrated on a specific group of scripts, the methodology can be extended to encompass other packages running on multiple architectures, either in parallel or sequentially.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑