arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.02645cs.LGcs.ARcs.PF
收藏

选择正确的边缘设备:GPGPU上基于CUDA的CNN的功耗和性能评估

Pick the Right Edge Device: Towards Power and Performance Estimation of CUDA-based CNNs on GPGPUs

Institute of Computer Science, University of Bremen(不来梅大学计算机科学研究所);Cyber-Physical Systems, DFKI GmbH(德国人工智能研究中心网络物理系统部门)

Christopher A. Metz, Mehran Goli, Rolf Drechsler

摘要:

机器学习(ML)作为一种强大的技术的出现,已经帮助几乎所有的业务领域提高运营效率或开发新的价值主张。除了部署和维护ML模型的挑战外,选择正确的边缘设备(例如,GPGPU)来运行这些模型(例如,CNN与大规模的计算过程)是当今组织面临的最紧迫的挑战之一。由于租用(云)或购买边缘设备的成本与最终产品或服务的成本直接相关,因此选择最高效的设备至关重要。然而,这种决策需要深入了解在边缘设备上运行的ML模型的性能和功耗,这些必须在ML工作流的早期阶段确定。在本文中,我们提出了一种新的基于ML的方法,为ML工程师提供了GPGPU上基于CUDA的CNN的功耗和性能的早期估计。所提出的方法使ML工程师能够在开发的早期阶段为给定的CNN模型选择最有效的GPGPU。

英文摘要:

The emergence of Machine Learning (ML) as a powerful technique has been helping nearly all fields of business to increase operational efficiency or to develop new value propositions. Besides the challenges of deploying and maintaining ML models, picking the right edge device (e.g., GPGPUs) to run these models (e.g., CNN with the massive computational process) is one of the most pressing challenges faced by organizations today. As the cost of renting (on Cloud) or purchasing an edge device is directly connected to the cost of final products or services, choosing the most efficient device is essential. However, this decision making requires deep knowledge about performance and power consumption of the ML models running on edge devices that must be identified at the early stage of ML workflow. In this paper, we present a novel ML-based approach that provides ML engineers with the early estimation of both power consumption and performance of CUDA-based CNNs on GPGPUs. The proposed approach empowers ML engineers to pick the most efficient GPGPU for a given CNN model at the early stage of development.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑