arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.07135cs.LGstat.ML

Model Reuse with Reduced Kernel Mean Embedding Specification

National Key Laboratory for Novel Software Technology, Nanjing University, China(南京大学计算机软件新技术国家重点实验室);Gatsby Unit of Computational Neuroscience, University College London, UK(伦敦大学学院盖茨比计算神经科学单元);School of Mathematics, University of Bristol, UK(布里斯托大学数学学院);The Alan Turing Institute, UK(艾伦图灵研究所)

Xi-Zhu Wu, Wenkai Xu, Song Liu, Zhi-Hua Zhou

英文摘要:

Given a publicly available pool of machine learning models constructed for various tasks, when a user plans to build a model for her own machine learning application, is it possible to build upon models in the pool such that the previous efforts on these existing models can be reused rather than starting from scratch? Here, a grand challenge is how to find models that are helpful for the current application, without accessing the raw training data for the models in the pool. In this paper, we present a two-phase framework. In the upload phase, when a model is uploading into the pool, we construct a reduced kernel mean embedding (RKME) as a specification for the model. Then in the deployment phase, the relatedness of the current task and pre-trained models will be measured based on the value of the RKME specification. Theoretical results and extensive experiments validate the effectiveness of our approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑