arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1206.6417cs.LGstat.ML
收藏

多任务学习中的学习任务重叠与重叠

Learning Task Grouping and Overlap in Multi-task Learning

University of Maryland(马里兰大学)

Abhishek Kumar, Hal Daume

摘要:

在多任务学习的范例中,多个相关的预测任务被联合学习,跨任务共享信息。我们提出了一个多任务学习的框架,使人们能够有选择地共享跨任务的信息。我们假设每个任务参数向量是有限数量的基本任务的线性组合。线性组合的系数本质上是稀疏的,并且两个任务的稀疏模式中的重叠控制了这些任务之间的共享量。我们的模型是基于这样的假设,即一个组内的任务参数位于一个低维子空间中,但允许不同组中的任务在一个或多个基中相互重叠。四个数据集上的实验结果表明,我们的方法优于竞争的方法。

英文摘要:

In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information across the tasks. We assume that each task parameter vector is a linear combi- nation of a finite number of underlying basis tasks. The coefficients of the linear combina- tion are sparse in nature and the overlap in the sparsity patterns of two tasks controls the amount of sharing across these. Our model is based on on the assumption that task pa- rameters within a group lie in a low dimen- sional subspace but allows the tasks in differ- ent groups to overlap with each other in one or more bases. Experimental results on four datasets show that our approach outperforms competing methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑