arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1904.02838cs.LGcs.DC
收藏

深度神经网络系统性能建模的迁移学习

Transfer Learning for Performance Modeling of Deep Neural Network Systems

University of South Carolina(南卡罗来纳大学);University of Wyoming(怀俄明大学)

Md Shahriar Iqbal, Lars Kotthoff, Pooyan Jamshidi

摘要:

现代深度神经网络(DNN)系统是高度可配置的,具有大量显著影响其非功能行为的选项,例如推理时间和能耗。性能模型允许理解和预测这样的配置选项对系统行为的影响,但由于配置空间大,构建成本高。一个环境中的性能模型不能直接转移到另一个环境中;通常模型是针对不同的环境(例如不同的硬件)从头开始重建的。最近,迁移学习方法已被应用于从在一个环境中训练的性能模型在另一个环境中重用知识。在本文中,我们进行了一项实证研究,以了解不同的迁移学习策略的有效性,建立DNN系统的性能模型。我们的研究结果表明,最有影响力的配置选项及其相互作用的信息传输是一种有效的方法,降低成本,建立性能模型在新的环境中。

英文摘要:

Modern deep neural network (DNN) systems are highly configurable with large a number of options that significantly affect their non-functional behavior, for example inference time and energy consumption. Performance models allow to understand and predict the effects of such configuration options on system behavior, but are costly to build because of large configuration spaces. Performance models from one environment cannot be transferred directly to another; usually models are rebuilt from scratch for different environments, for example different hardware. Recently, transfer learning methods have been applied to reuse knowledge from performance models trained in one environment in another. In this paper, we perform an empirical study to understand the effectiveness of different transfer learning strategies for building performance models of DNN systems. Our results show that transferring information on the most influential configuration options and their interactions is an effective way of reducing the cost to build performance models in new environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑