新的检索任务不断涌现,促使新的检索模型不断发展。然而,为每个新的检索任务实例化检索模型是资源密集且耗时的,特别是对于采用大规模预训练的语言模型的检索模型。为了解决这个问题,我们转向一种新的检索范式称为模块化检索,其目的是解决新的检索任务,而不是组成多个现有的检索模块。在此基础上,我们提出了一个具有模块化提示微调的检索模型REMP。该方法通过深度提示微调,构造出服从任务属性的检索模块,并通过模块组合得到服从任务属性的检索模型。我们验证,REMP固有的模块化,不仅具有吸引力的概括性和可解释性在初步探索,但也取得了相当的性能,以国家的最先进的检索模型上的zero-shot检索基准。\footnote{Our code is available at \url{https://github.com/FreedomIntelligence/REMOP}}
英文摘要:
New retrieval tasks have always been emerging, thus urging the development of new retrieval models. However, instantiating a retrieval model for each new retrieval task is resource-intensive and time-consuming, especially for a retrieval model that employs a large-scale pre-trained language model. To address this issue, we shift to a novel retrieval paradigm called modular retrieval, which aims to solve new retrieval tasks by instead composing multiple existing retrieval modules. Built upon the paradigm, we propose a retrieval model with modular prompt tuning named REMOP. It constructs retrieval modules subject to task attributes with deep prompt tuning, and yields retrieval models subject to tasks with module composition. We validate that, REMOP inherently with modularity not only has appealing generalizability and interpretability in preliminary explorations, but also achieves comparable performance to state-of-the-art retrieval models on a zero-shot retrieval benchmark.\footnote{Our code is available at \url{https://github.com/FreedomIntelligence/REMOP}}
MODOC: A Modular Interface for Flexible Interlinking of Text Retrieval and Text Generation Functions
Institute of Neuroinformatics, University of Zurich and ETH Zurich(苏黎世大学与苏黎世联邦理工学院神经信息学研究所);ETH Zurich(苏黎世联邦理工学院);Linguistic Research Infrastructure, University of Zurich(苏黎世大学语言研究基础设施)
Lab-AI: Using Retrieval Augmentation to Enhance Language Models for Personalized Lab Test Interpretation in Clinical Medicine
Department of Statistics(统计学系);Florida State University(佛罗里达州立大学);School of Information(信息学院);Oklahoma State University(俄克拉荷马州立大学);Morsani College of Medicine(医学学院);University of South Florida(佛罗里达大学);College of Social Work(社会工作学院);Department of Computer Science(计算机科学系);Emory University(埃默里大学)
Medical Information Retrieval and Interpretation: A Question-Answer based Interaction Model
Subir Chowdhury School of Quality and Reliability, IIT Kharagpur(印度理工学院卡拉格普尔分校苏比尔·乔杜里质量与可靠性学院);Department of Chemical Engineering, IIT Kharagpur(印度理工学院卡拉格普尔分校化学工程系);Department of Computer Science and Engineering, IIT Kharagpur(印度理工学院卡拉格普尔分校计算机科学与工程系)
Visual Lifelog Retrieval through Captioning-Enhanced Interpretation
Department of Computer Science;Information Engineering National Taiwan University Taipei, Taiwan;Department of Computer Science National Yang Ming Chiao Tung University Hsinchu, Taiwan;Institute of Information Science Academia Sinica Taipei, Taiwan;Information Engineering AI Research Center (AINTU) National Taiwan University Taipei, Taiwan