使用GPU分析HCP数据集:科学参与的剖析
Analyzing the HCP Datasets using GPUs: The Anatomy of a Science Engagement
摘要:
本文记录了提高人类连接组项目的HCP 900数据集分析的数据处理工作流程的性能的经验。它描述了在科学参与过程中如何发现和解决网络和计算瓶颈。描述了对FSL BedpostX工作流程的一系列计算增强。这些增强功能将工作流程从Slurm调度程序不兼容导致的缓慢串行计算执行迁移到GPU资源上的最终执行,从单个CPU核心上的21天执行到GPU上的2小时执行。此工作流程为使用额外GPU构建园区计算集群提供了重要的用例,并增强了网络带宽。它还分享了对科学软件分发的潜在改进的见解,以避免特定地点部署决策的停滞。讨论强调了开放许可证和流行的代码协作网站(如GitHub.com)在上游提供贡献方面的优势。
英文摘要:
This paper documents the experience improving the performance of a data processing workflow for analysis of the Human Connectome Project's HCP900 data set. It describes how network and compute bottlenecks were discovered and resolved during the course of a science engagement. A series of computational enhancements to the stock FSL BedpostX workflow are described. These enhancements migrated the workflow from a slow serial execution of computations resulting from Slurm scheduler incompatibilities to eventual execution on GPU resources, going from a 21-day execution on a single CPU core to a 2 hour execution on a GPU. This workflow contributed a vital use-case to the build-out of the campus compute cluster with additional GPUs and resulted in enhancements to network bandwidth. It also shares insights on potential improvements to distribution of scientific software to avoid stagnation in site-specific deployment decisions. The discussion highlights the advantages of open licenses and popular code collaboration sites like GitHub.com in feeding contributions upstream.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。