多任务学习中迁移的测量与利用
Measuring and Harnessing Transference in Multi-Task Learning
摘要:
多任务学习可以利用一个任务所学到的信息来帮助其他任务的训练。尽管有这样的能力,天真的配方往往会降低性能,特别是,确定将受益于共同训练的任务仍然是一个具有挑战性的设计问题。在本文中,我们分析了在整个训练过程中跨任务的信息传递或传递的动态。具体来说,我们开发了一种相似性度量,可以量化任务之间的迁移,并使用这个量来更好地理解多任务学习的优化动态,以及提高整体学习性能。在后一种情况下,我们提出了两种方法来利用我们的移情度量。第一个在宏观层面上通过选择哪些任务应该一起训练来操作,而第二个在微观层面上通过确定如何在每个训练步骤组合任务梯度来操作。我们发现,这些方法可以导致显着的改进,比以前的工作在三个监督多任务学习基准和一个多任务强化学习范例。
英文摘要:
Multi-task learning can leverage information learned by one task to benefit the training of other tasks. Despite this capacity, naive formulations often degrade performance and in particular, identifying the tasks that would benefit from co-training remains a challenging design question. In this paper, we analyze the dynamics of information transfer, or transference, across tasks throughout training. Specifically, we develop a similarity measure that can quantify transference among tasks and use this quantity to both better understand the optimization dynamics of multi-task learning as well as improve overall learning performance. In the latter case, we propose two methods to leverage our transference metric. The first operates at a macro-level by selecting which tasks should train together while the second functions at a micro-level by determining how to combine task gradients at each training step. We find these methods can lead to significant improvement over prior work on three supervised multi-task learning benchmarks and one multi-task reinforcement learning paradigm.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。