Large Language Models (LLMs) have made remarkable strides in various tasks. Whether LLMs are competitive few-shot solvers for information extraction (IE) tasks, however, remains an open problem. In this work, we aim to provide a thorough answer to this question. Through extensive experiments on nine datasets across four IE tasks, we demonstrate that current advanced LLMs consistently exhibit inferior performance, higher latency, and increased budget requirements compared to fine-tuned SLMs under most settings. Therefore, we conclude that LLMs are not effective few-shot information extractors in general. Nonetheless, we illustrate that with appropriate prompting strategies, LLMs can effectively complement SLMs and tackle challenging samples that SLMs struggle with. And moreover, we propose an adaptive filter-then-rerank paradigm to combine the strengths of LLMs and SLMs. In this paradigm, SLMs serve as filters and LLMs serve as rerankers. By prompting LLMs to rerank a small portion of difficult samples identified by SLMs, our preliminary system consistently achieves promising improvements (2.4% F1-gain on average) on various IE tasks, with an acceptable time and cost investment.
Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractors
School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Beijing Institute of Computer Technology and Application(北京计算机技术及应用研究所)
LegalMALR:Multi-Agent Query Understanding and LLM-Based Reranking for Chinese Statute Retrieval
Faculty of Data Science(数据科学学院);City University of Macau(澳门城市大学);Shenzhen Key Laboratory for High Performance Data Mining(深圳高性能数据挖掘重点实验室);Shenzhen Institutes of Advanced Technology(深圳先进技术研究所);Chinese Academy of Sciences(中国科学院);Southern University of Science and Technology(南方科技大学);Artificial Intelligence Research Institute(人工智能研究院);Shenzhen University of Advanced Technology(深圳大学先进技术学院)
NOWJ@COLIEE 2026: Adaptive Pipelines for Legal Retrieval and Reasoning
VNU University of Engineering and Technology(越南国立工程技术大学);Center for Juris-Informatics, ROIS-DS College of Engineering & Computer Science, VinUniversity(越南Vin大学工程与计算机科学学院法律信息学中心)
FILM: How can Few-Shot Image Classification Benefit from Pre-Trained Language Models?
Qing Yuan Research Institute(清源研究院);Shanghai Jiao Tong University(上海交通大学);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);Microsoft Research Asia(微软亚洲研究院)
Multi-label Few-shot ICD Coding as Autoregressive Generation with Prompt
College of Information and Computer Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校信息与计算机科学学院);Department of Computer Science, University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校计算机科学系);Center for Healthcare Organization and Implementation Research, Veterans Affairs Bedford Healthcare System(退伍军人事务部贝德福德医疗系统医疗保健组织与实施研究中心)
自动国际疾病分类(ICD)编码旨在将多个ICD代码分配给平均超过3,000个标记的医疗记录。由于多标签分配的高维空间(155,000 + ICD代码候选者)和长尾挑战-许多ICD代码很少分配,但不常见的ICD代码在临床上很重要,因此这项任务具有挑战性。本研究通过将多标签分类任务转换为自回归生成任务来解决长尾挑战。具体来说,我们首先介绍了一种新的预训练目标,使用SOAP结构生成自由文本诊断和程序,医疗逻辑医生用于说明文档。其次,我们的模型不是直接预测ICD代码的高维空间,而是生成较低维的文本描述,然后推断ICD代码。第三,设计了一种新的多标签分类提示模板。我们评估我们的生成与提示模型与基准的所有代码分配(MIMIC-III-full)和Few Shot ICD代码分配评估基准(MIMIC-III-few)。在MIMIC-III-few上的实验表明,我们的模型在marco F1 30.2上的性能大大优于以前的MIMIC-III-full SOTA模型(marco F1 4.3)和专门为few/zero shot设置设计的模型(marco F1 18.7)。最后,我们设计了一个新的集成学习器,一个交叉注意reranker提示,集成以前的SOTA和我们最好的Few-Shot编码预测。MIMIC-III-full上的实验表明,我们的集成学习器大大提高了宏观和微观F1,分别从10.4到14.6…
Few-shot Named Entity Recognition via Superposition Concept Discrimination
University of Chinese Academy of Sciences(中国科学院大学);State Key Laboratory of Computer Science(计算机科学国家重点实验室);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);Ricoh Software Research Center Beijing Co., Ltd(理光软件研究中心(北京)有限公司)
Enhancing Black-Box Few-Shot Text Classification with Prompt-Based Data Augmentation
National University of Singapore(新加坡国立大学);Institute of Infocomm Research (I2R), A*STAR(新加坡科技研究局资讯通信研究院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Kriston AI Lab(Kriston人工智能实验室)
Inductive Unsupervised Domain Adaptation for Few-Shot Classification via Clustering
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Xiaomi Inc.(小米公司)