arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1412.6249cs.NEcs.LG
收藏

Purine:一个基于双图的深度学习框架

Purine: A bi-graph based deep learning framework

National University of Singapore(新加坡国立大学);Zhiyuan College, Shanghai Jiao Tong University(上海交通大学致远学院)

Min Lin, Shuo Li, Xuan Luo, Shuicheng Yan

摘要:

在本文中,我们介绍了一个新的深度学习框架,称为嘌呤。在Purine中,深度网络被表示为二分图(bi-graph),它由互连的运算符和数据张量组成。有了双图抽象,网络很容易解决与事件驱动的任务调度。然后,我们证明了不同的并行方案在GPU和/或CPU上的单个或多个PC可以普遍实现的图形组成。这使得研究人员可以轻松地编写各种并行化方案,并且可以使用相同的调度器来解决变体图。通过任务调度器的调度,内存传输与其他计算完全重叠,这大大减少了通信开销,并帮助我们实现近似线性加速。

英文摘要:

In this paper, we introduce a novel deep learning framework, termed Purine. In Purine, a deep network is expressed as a bipartite graph (bi-graph), which is composed of interconnected operators and data tensors. With the bi-graph abstraction, networks are easily solvable with event-driven task dispatcher. We then demonstrate that different parallelism schemes over GPUs and/or CPUs on single or multiple PCs can be universally implemented by graph composition. This eases researchers from coding for various parallelization schemes, and the same dispatcher can be used for solving variant graphs. Scheduled by the task dispatcher, memory transfers are fully overlapped with other computations, which greatly reduce the communication overhead and help us achieve approximate linear acceleration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑