arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.11892cs.LG
收藏

用于预测表观遗传事件的深度多任务学习的高度可扩展的任务建模

Highly Scalable Task Grouping for Deep Multi-Task Learning in Prediction of Epigenetic Events

Old Dominion University(奥多明尼昂大学)

Mohammad Shiri, Jiangwen Sun

摘要:

训练用于从DNA序列预测细胞事件的深度神经网络已成为新兴工具,以帮助阐明全基因组关联研究中确定的关联背后的生物学机制。为了增强训练,多任务学习(MTL)在以前的工作中被普遍利用,其中训练的网络需要用于事件模态或细胞类型不同的多个配置文件。所有现有的作品采用了一个简单的MTL框架,所有的任务共享一个单一的特征提取网络。这种策略虽然在一定程度上有效,但也会导致大量的负迁移,这意味着存在很大一部分任务,通过MTL获得的模型比通过单任务学习获得的模型表现得更差。已经开发了一些方法来解决诸如计算机视觉等其他领域中的这种负迁移。然而,这些方法通常难以扩展以处理大量任务。在本文中,我们提出了一个高度可扩展的任务分组框架,以解决负迁移,只有联合训练的任务,是潜在的相互有益的。所提出的方法利用与任务特定的分类头,可以便宜地获得一次性联合训练的所有任务相关联的网络权重。我们的结果使用的数据集组成的367表观遗传配置文件证明了所提出的方法的有效性和其优于基线方法。

英文摘要:

Deep neural networks trained for predicting cellular events from DNA sequence have become emerging tools to help elucidate the biological mechanism underlying the associations identified in genome-wide association studies. To enhance the training, multi-task learning (MTL) has been commonly exploited in previous works where trained networks were needed for multiple profiles differing in either event modality or cell type. All existing works adopted a simple MTL framework where all tasks share a single feature extraction network. Such a strategy even though effective to certain extent leads to substantial negative transfer, meaning the existence of large portion of tasks for which models obtained through MTL perform worse than those by single task learning. There have been methods developed to address such negative transfer in other domains, such as computer vision. However, these methods are generally difficult to scale up to handle large amount of tasks. In this paper, we propose a highly scalable task grouping framework to address negative transfer by only jointly training tasks that are potentially beneficial to each other. The proposed method exploits the network weights associated with task specific classification heads that can be cheaply obtained by one-time joint training of all tasks. Our results using a dataset consisting of 367 epigenetic profiles demonstrate the effectiveness of the proposed approach and its superiority over baseline methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑