arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1803.04062cs.LGstat.ML
收藏

伪任务增强:从深度多任务学习到任务内共享

Pseudo-task Augmentation: From Deep Multitask Learning to Intratask Sharing---and Back

The University of Texas at Austin(得克萨斯大学奥斯汀分校);Sentient Technologies, Inc.(Sentient科技公司)

Elliot Meyerson, Risto Miikkulainen

摘要:

深度多任务学习通过在相关任务之间共享学习到的结构来提高性能。本文将深度多任务学习的思想适应于只有单个任务可用的环境。该方法被形式化为伪任务增强,其中每个任务都使用多个解码器来训练模型。伪任务模拟训练对来自同一宇宙的密切相关任务的影响。在一系列实验中,伪任务增强被证明可以提高单任务学习问题的性能。当与多任务学习相结合时,可以实现进一步的改进,包括CelebA数据集上最先进的性能,这表明伪任务增强和多任务学习具有互补价值。总而言之,伪任务增强是提高深度学习系统性能的一种广泛适用且有效的方法。

英文摘要:

Deep multitask learning boosts performance by sharing learned structure across related tasks. This paper adapts ideas from deep multitask learning to the setting where only a single task is available. The method is formalized as pseudo-task augmentation, in which models are trained with multiple decoders for each task. Pseudo-tasks simulate the effect of training towards closely-related tasks drawn from the same universe. In a suite of experiments, pseudo-task augmentation is shown to improve performance on single-task learning problems. When combined with multitask learning, further improvements are achieved, including state-of-the-art performance on the CelebA dataset, showing that pseudo-task augmentation and multitask learning have complementary value. All in all, pseudo-task augmentation is a broadly applicable and efficient way to boost performance in deep learning systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑