Lack of sufficient labeled data often limits the applicability of advanced machine learning algorithms to real life problems. However efficient use of Transfer Learning (TL) has been shown to be very useful across domains. TL utilizes valuable knowledge learned in one task (source task), where sufficient data is available, to the task of interest (target task). In biomedical and clinical domain, it is quite common that lack of sufficient training data do not allow to fully exploit machine learning models. In this work, we present two unified recurrent neural models leading to three transfer learning frameworks for relation classification tasks. We systematically investigate effectiveness of the proposed frameworks in transferring the knowledge under multiple aspects related to source and target tasks, such as, similarity or relatedness between source and target tasks, and size of training data for source task. Our empirical results show that the proposed frameworks in general improve the model performance, however these improvements do depend on aspects related to source and target tasks. This dependence then finally determine the choice of a particular TL framework.
Context Variance Evaluation of Pretrained Language Models for Prompt-based Biomedical Knowledge Probing
College of Information and Computer Science, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校信息与计算机科学学院);Department of Computer Science, University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校计算机科学系);Department of Medicine, University of Massachusetts Medical School(马萨诸塞大学医学院医学系);Center for Healthcare Organization and Implementation Research, Bedford Veterans Affairs Medical Center(贝德福德退伍军人事务医疗中心医疗保健组织与实施研究中心)
Leveraging Speech to Identify Signatures of Insight and Transfer in Problem Solving
Department of Psychology, Stanford University(斯坦福大学心理学系);Graduate School of Education, Stanford University(斯坦福大学教育研究生院);Department of Computer Science, Stanford University(斯坦福大学计算机科学系)
What Don't You Understand? Using Large Language Models to Identify and Characterize Student Misconceptions About Challenging Topics
Harvard Medical School and Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center(哈佛医学院和肺科、重症医学及睡眠医学部门,贝斯以色列德aconess医疗中心)
Video-Language Critic: Transferable Reward Functions for Language-Conditioned Robotics
Department of Computer Science, Aalto University(艾尔沃斯大学计算机科学系);Department of Computer Science, Toronto Metropolitan University(多伦多 Metropolitan 大学计算机科学系);Department of Computer Science, University of Manchester(曼彻斯特大学计算机科学系);Intel Corporation(英特尔公司)