软件炼金术:将复杂的统计计算转化为令人尴尬的并行计算
Software Alchemy: Turning Complex Statistical Computations into Embarrassingly-Parallel Ones
摘要:
计算密集型统计程序的使用增长,特别是大数据,需要在多核、GPU、集群和云等不同平台上使用并行计算。然而,由于进程间通信成本而导致的减速通常将此类方法限制为“并行”(EP)算法,特别是在非共享内存平台上。本文提出了一种将许多非EP算法转换为统计等价的EP算法的方法。所示的方法,以产生良好的水平的各种统计计算的加速。它还克服了内存限制的某些问题。
英文摘要:
The growth in the use of computationally intensive statistical procedures, especially with Big Data, has necessitated the usage of parallel computation on diverse platforms such as multicore, GPU, clusters and clouds. However, slowdown due to interprocess communication costs typically limits such methods to "embarrassingly parallel" (EP) algorithms, especially on non-shared memory platforms. This paper develops a broadly-applicable method for converting many non-EP algorithms into statistically equivalent EP ones. The method is shown to yield excellent levels of speedup for a variety of statistical computations. It also overcomes certain problems of memory limitations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。