INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Beijing Academy of Artificial Intelligence(北京人工智能研究院);School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院);School of Artificial Intelligence, Nankai University(南开大学人工智能学院)
Large language models (LLMs) have demonstrated impressive capabilities in various natural language processing tasks. Despite this, their application to information retrieval (IR) tasks is still challenging due to the infrequent occurrence of many IR-specific concepts in natural language. While prompt-based methods can provide task descriptions to LLMs, they often fall short in facilitating a comprehensive understanding and execution of IR tasks, thereby limiting LLMs' applicability. To address this gap, in this work, we explore the potential of instruction tuning to enhance LLMs' proficiency in IR tasks. We introduce a novel instruction tuning dataset, INTERS, encompassing 20 tasks across three fundamental IR categories: query understanding, document understanding, and query-document relationship understanding. The data are derived from 43 distinct datasets with manually written templates. Our empirical results reveal that INTERS significantly boosts the performance of various publicly available LLMs, such as LLaMA, Mistral, and Phi, in IR tasks. Furthermore, we conduct extensive experiments to analyze the effects of instruction design, template diversity, few-shot demonstrations, and the volume of instructions on performance. We make our dataset and the fine-tuned models publicly accessible at https://github.com/DaoD/INTERS.
PACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning
Nanjing University(南京大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Southern University of Science and Technology(南方科技大学);Shanghai University of Finance and Economics(上海财经大学)
From Completion to Editing: Unlocking Context-Aware Code Infilling via Search-and-Replace Instruction Tuning
USTC(University of Science and Technology of China);Alibaba Group(阿里巴巴集团);CASIA(Chinese Academy of Sciences Institute of Automation);SIAT(Institute of Automation, Chinese Academy of Sciences)
Beyond the Covariance Trap: Unlocking Generalization in Same-Subject Knowledge Editing for Large Language Models
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院)
Instruction-Tuning Large Language Models with Medical Classification Data Improves ICD Coding of German Tumor Diagnoses
University Medical Center of the Johannes Gutenberg University Mainz(美因茨约翰内斯·古腾堡大学医学中心);University Cancer Center of the Johannes Gutenberg University Mainz(美因茨约翰内斯·古腾堡大学癌症中心)
RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via Romanization
Nilekani Centre at AI4Bharat(AI4Bharat的尼莱卡尼中心);National Institute of Information and Communications Technology(国家信息通信技术研究所);Indian Institute of Technology Madras(印度马德拉斯理工学院);Flipkart;Microsoft(微软);IIIT D&M Kancheepuram;Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Institute for Infocomm Research (IR), A * STAR, Singapore(新加坡资讯通信研究院(A*STAR));Indian Institute of Technology Bombay(印度孟买理工学院)
Eliciting Causal Abilities in Large Language Models for Reasoning Tasks
BNU-HKBU United International College(北师港浸大);Hong Kong Baptist University(香港浸会大学);Beijing Normal University at Zhuhai(北京师范大学珠海校区);The Chinese University of Hong Kong(香港中文大学)
From Reweighting to Rewriting: Unlocking the Intervention Effects of Influential Samples in Training Data Attribution
State Key Laboratory of Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室);YiXin-AILab(翼星人工智能实验室);Beijing Academy of Artificial Intelligence(北京人工智能研究院)
Bridge-Coder: Unlocking LLMs' Potential to Overcome Language Gaps in Low-Resource Code
The Hong Kong University of Science and Technology(香港科技大学);Southern University of Science and Technology(南方科技大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks
University of Connecticut(康涅狄格大学);San Francisco State University(旧金山州立大学);University of California, Riverside(加州大学河滨分校);University of North Carolina at Charlotte(北卡罗来纳大学夏洛特分校);Florida State University(佛罗里达州立大学);University of Notre Dame(圣约翰大学)
Think Carefully and Check Again! Meta-Generation Unlocking LLMs for Low-Resource Cross-Lingual Summarization
University of California, San Diego(加利福尼亚大学圣迭戈分校);Nanyang Technological University(南洋理工大学);National University of Singapore(新加坡国立大学);Tsinghua University(清华大学)
Unlocking LLM Safeguards for Low-Resource Languages via Reasoning and Alignment with Minimal Training Data
Guangdong University of Foreign Studies(广东外语外贸大学);Guangzhou Key Laboratory of Multilingual Intelligent Processing(广州多语智能处理重点实验室);University of Pittsburgh(匹兹堡大学)
Unlocking Korean Verbs: A User-Friendly Exploration into the Verb Lexicon
Seoultech(首尔科技大学);The University of British Columbia(不列颠哥伦比亚大学);The Chinese University of Hong Kong(香港中文大学);dot Inc.(42dot公司);Seoul National University(首尔大学);National Institute of Korean Language(韩国国立国语院);KAIST(韩国科学技术院);Anyang University(安阳大学)