arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.11775cs.LG
收藏

多样性在元学习中的作用

The Effect of Diversity in Meta-Learning

Google Research(谷歌研究院);Mila, Québec Artificial Intelligence Institute(Mila——魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);CIFAR(加拿大高等研究院);IVADO(IVADO数据价值研究所)

Ramnath Kumar, Tristan Deleu, Yoshua Bengio

摘要:

近年来的研究表明,任务分配对元学习者的学习成绩起着至关重要的作用。传统观点认为,任务多样性应该提高元学习的性能。在这项工作中,我们发现了相反的证据;(i)我们的实验对我们学习模型的有效性提出了质疑:可以用数据的子集(较低的任务多样性)学习类似的流形。这一发现的问题的优势,提供更多的数据模型,和(ii)增加多样性的任务分布(更高的任务多样性)有时会阻碍模型,并不会导致性能的显着改善,因为以前认为。为了加强我们的研究结果,我们提供了经验和理论证据。

英文摘要:

Recent studies show that task distribution plays a vital role in the meta-learner's performance. Conventional wisdom is that task diversity should improve the performance of meta-learning. In this work, we find evidence to the contrary; (i) our experiments draw into question the efficacy of our learned models: similar manifolds can be learned with a subset of the data (lower task diversity). This finding questions the advantage of providing more data to the model, and (ii) adding diversity to the task distribution (higher task diversity) sometimes hinders the model and does not lead to a significant improvement in performance as previously believed. To strengthen our findings, we provide both empirical and theoretical evidence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑