arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1708.03446cs.CL
收藏

在生物医学领域中,用于关系分类的可转移神经网络模型中有什么重要的?

What matters in a transferable neural network model for relation classification in the biomedical domain?

Indian Institute of Technology Guwahati(印度理工学院古瓦哈提分校)

Sunil Kumar Sahu, Ashish Anand

摘要:

缺乏足够的标记数据通常会限制高级机器学习算法对现实生活问题的适用性。然而,有效地使用迁移学习(TL)已被证明是非常有用的跨域。TL利用在一个任务(源任务)中学习到的有价值的知识,其中有足够的数据,以感兴趣的任务(目标任务)。在生物医学和临床领域,缺乏足够的训练数据不允许充分利用机器学习模型是相当常见的。在这项工作中,我们提出了两个统一的递归神经模型,导致三个迁移学习框架的关系分类任务。我们系统地研究了所提出的框架在与源任务和目标任务相关的多个方面下传递知识的有效性,例如,源任务和目标任务之间的相似性或相关性,以及源任务的训练数据的大小。我们的实证结果表明,所提出的框架一般提高模型的性能,但这些改进依赖于与源和目标任务相关的方面。这种依赖关系最终决定了特定TL框架的选择。

英文摘要:

Lack of sufficient labeled data often limits the applicability of advanced machine learning algorithms to real life problems. However efficient use of Transfer Learning (TL) has been shown to be very useful across domains. TL utilizes valuable knowledge learned in one task (source task), where sufficient data is available, to the task of interest (target task). In biomedical and clinical domain, it is quite common that lack of sufficient training data do not allow to fully exploit machine learning models. In this work, we present two unified recurrent neural models leading to three transfer learning frameworks for relation classification tasks. We systematically investigate effectiveness of the proposed frameworks in transferring the knowledge under multiple aspects related to source and target tasks, such as, similarity or relatedness between source and target tasks, and size of training data for source task. Our empirical results show that the proposed frameworks in general improve the model performance, however these improvements do depend on aspects related to source and target tasks. This dependence then finally determine the choice of a particular TL framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑