Deep multitask learning boosts performance by sharing learned structure across related tasks. This paper adapts ideas from deep multitask learning to the setting where only a single task is available. The method is formalized as pseudo-task augmentation, in which models are trained with multiple decoders for each task. Pseudo-tasks simulate the effect of training towards closely-related tasks drawn from the same universe. In a suite of experiments, pseudo-task augmentation is shown to improve performance on single-task learning problems. When combined with multitask learning, further improvements are achieved, including state-of-the-art performance on the CelebA dataset, showing that pseudo-task augmentation and multitask learning have complementary value. All in all, pseudo-task augmentation is a broadly applicable and efficient way to boost performance in deep learning systems.
Deep Multitask Learning for Mixed-Type Outcomes with Shared Sparsity
School of Mathematical Sciences, University of Chinese Academy of Sciences(中国科学院大学数学科学学院);School of Statistics and Data Science, Southeast University(东南大学统计与数据科学学院);Key Laboratory of Big Data Mining and Knowledge Management, Chinese Academy of Sciences(中国科学院大数据挖掘与知识管理重点实验室);Department of Biostatistics, Yale School of Public Health(耶鲁大学公共卫生学院生物统计学系)
Should I use Synthetic Data for That? An Analysis of the Suitability of Synthetic Data for Data Sharing and Augmentation
Lausanne University Hospital(拉索纳大学医院);Swiss Data Science Center, EPFL(瑞士数据科学中心,EPFL);University of Lausanne(洛桑大学);Max Planck Institute for Security & Privacy EPFL(马克斯·普朗克安全与隐私研究所 EPFL)