arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1908.05792cs.LGcs.DCstat.ML
收藏

多任务和迁移学习在Exascale应用中的应用

Multitask and Transfer Learning for Autotuning Exascale Applications

Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室);Texas A&M University(得克萨斯农工大学);University of California, Berkeley(加州大学伯克利分校)

Wissam M. Sid-Lakhdar, Mohsen Mahmoudi Aznaveh, Xiaoye S. Li, James W. Demmel

摘要:

多任务学习和迁移学习已被证明在机器学习领域中当附加知识可用于帮助预测任务时是有用的。我们的目标是在这些范例中使用的自动调优,其中的目标是找到一个应用程序的最佳性能参数作为一个黑盒功能。我们展示了与最先进的自动调谐技术的比较结果。例如,与OpenTuner和HpBandSter自动调谐器相比,我们观察到应用程序运行时的平均$1.5x$改进。我们解释了我们的方法如何比一些最先进的自动调谐器更适合于一般任何应用程序的调谐,特别是昂贵的兆兆级应用程序的调谐。

英文摘要:

Multitask learning and transfer learning have proven to be useful in the field of machine learning when additional knowledge is available to help a prediction task. We aim at deriving methods following these paradigms for use in autotuning, where the goal is to find the optimal performance parameters of an application treated as a black-box function. We show comparative results with state-of-the-art autotuning techniques. For instance, we observe an average $1.5x$ improvement of the application runtime compared to the OpenTuner and HpBandSter autotuners. We explain how our approaches can be more suitable than some state-of-the-art autotuners for the tuning of any application in general and of expensive exascale applications in particular.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑