arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.00453cs.LGmath.FA
收藏

多任务正则化网络的学习率

Learning Rates for Multi-task Regularization Networks

Sun Yat-sen University(中山大学)

Jie Gui, Haizhang Zhang

摘要:

多任务学习是机器学习面向人工智能和大数据时代的重要发展趋势。尽管人们对各种单任务机器学习算法的学习率估计进行了大量的研究,但对多任务机器学习的并行研究却很少。基于向量值再生核Hilbert空间和矩阵值再生核理论,对多任务学习的学习率估计进行了数学分析.对于典型的多任务正则化网络,得到了同时依赖于样本数据数和任务数的显式学习率。这表明多任务学习算法的泛化能力确实会随着任务数量的增加而受到影响。

英文摘要:

Multi-task learning is an important trend of machine learning in facing the era of artificial intelligence and big data. Despite a large amount of researches on learning rate estimates of various single-task machine learning algorithms, there is little parallel work for multi-task learning. We present mathematical analysis on the learning rate estimate of multi-task learning based on the theory of vector-valued reproducing kernel Hilbert spaces and matrix-valued reproducing kernels. For the typical multi-task regularization networks, an explicit learning rate dependent both on the number of sample data and the number of tasks is obtained. It reveals that the generalization ability of multi-task learning algorithms is indeed affected as the number of tasks increases.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑