arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1711.03386cs.DCcs.LGcs.PF
收藏

Docker容器中深度学习工具的性能评估

Performance Evaluation of Deep Learning Tools in Docker Containers

Hong Kong Baptist University(香港浸会大学)

Pengfei Xu, Shaohuai Shi, Xiaowen Chu

摘要:

随着深度学习技术在广泛应用领域的成功,许多深度学习软件框架被开发出来,并不断更新以适应新的硬件功能和软件库,这给最终用户和系统管理员带来了很大的挑战。为了解决这个问题,容器技术被广泛用于简化深度学习软件的部署和管理。然而,容器技术是否会给深度学习应用程序带来任何性能损失仍然是未知的。这项工作的目的是系统地评估Docker容器对深度学习应用程序性能的影响。我们首先对Docker容器和主机系统中的系统组件(IO,CPU和GPU)的性能进行基准测试,并比较结果,看看是否有任何差异。根据我们的结果,我们发现计算密集型作业,无论是在CPU还是GPU上运行,都有很小的开销,这表明Docker容器可以应用于深度学习程序。然后,我们评估了部署在Docker容器和主机系统中的一些流行的深度学习工具的性能。事实证明,Docker容器在运行那些深度学习工具时不会造成明显的缺点。因此,将深度学习工具封装在容器中是一个可行的解决方案。

英文摘要:

With the success of deep learning techniques in a broad range of application domains, many deep learning software frameworks have been developed and are being updated frequently to adapt to new hardware features and software libraries, which bring a big challenge for end users and system administrators. To address this problem, container techniques are widely used to simplify the deployment and management of deep learning software. However, it remains unknown whether container techniques bring any performance penalty to deep learning applications. The purpose of this work is to systematically evaluate the impact of docker container on the performance of deep learning applications. We first benchmark the performance of system components (IO, CPU and GPU) in a docker container and the host system and compare the results to see if there's any difference. According to our results, we find that computational intensive jobs, either running on CPU or GPU, have small overhead indicating docker containers can be applied to deep learning programs. Then we evaluate the performance of some popular deep learning tools deployed in a docker container and the host system. It turns out that the docker container will not cause noticeable drawbacks while running those deep learning tools. So encapsulating deep learning tool in a container is a feasible solution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑