Natural Language Inference Generation task is to generate a text hypothesis given a text premise and a logical relation between the two. This task can be used in data augmentation and controllable text generation in practice. In this paper, we propose language models with prompt and dynamic demonstration (LM-PDD) to tackle this problem in few-shot settings. Our framework outperforms standard fine-tuned models with low resource, achieving an average 8% absolute improvement on SNLI and MNLI datasets, and the results on 13 natural language classification tasks also show that our dynamic demonstration method has good generalizability.
LLM-based MOFs Synthesis Condition Extraction using Few-Shot Demonstrations
School of Computer Science, Beihang University(北京航空航天大学计算机学院);School of Materials Science & Engineering, University of Science and Technology Beijing(北京科技大学材料科学与工程学院);Westlake University(西湖大学)
Metacognition-Enhanced Few-Shot Prompting With Positive Reinforcement
Institute of AI for Education, East China Normal University(华东师范大学教育人工智能研究院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);Shanghai Changning Mental Health Center(上海市长宁区精神卫生中心)
Demonstration Augmentation for Zero-shot In-context Learning
School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
What Makes In-context Learning Effective for Mathematical Reasoning: A Theoretical Analysis
University of Science and Technology of China(中国科学技术大学);State Key Laboratory of Cognitive Intelligence(认知智能国家重点实验室);Hong Kong University of Science and Technology(香港科技大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Selecting Demonstrations for Many-Shot In-Context Learning via Gradient Matching
School of Computer Science and Engineering, Beihang University, China(北京航空航天大学计算机科学与工程学院);Meituan, Inc.(美团公司);Beijing Institute for General Artificial Intelligence, China(北京通用人工智能研究院);Ping An Technology, China(平安科技);Department of Computer Science, University of Manchester, UK(曼彻斯特大学计算机科学系)
TEGEE: Task dEfinition Guided Expert Ensembling for Generalizable and Few-shot Learning
HKUST(香港科技大学);University of Manchester(曼彻斯特大学);Institute of Automation, CAS(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);M-A-P;Beijing University of Posts and Telecommunications(北京邮电大学);Ohio State University(俄亥俄州立大学);University of Waterloo(滑铁卢大学);Peking University(北京大学);BAAI(北京智源人工智能研究院)
Adaptive Cross-lingual Text Classification through In-Context One-Shot Demonstrations
Mathematics Research Center (CIMAT)(数学研究中心(CIMAT));Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Consejo Nacional de Humanidades, Ciencias y Tecnologías(国家人文科学技术委员会);University of Houston(休斯顿大学)
ZS4IE: A toolkit for Zero-Shot Information Extraction with simple Verbalizations
HiTZ Basque Center for Language Technologies(HiTZ巴斯克语言技术中心);Raytheon BBN Technologies(雷神BBN技术公司);University of the Basque Country (UPV/EHU)(巴斯克大学(UPV/EHU))
PANDAS: Improving Many-shot Jailbreaking via Positive Affirmation, Negative Demonstration, and Adaptive Sampling
University of Toronto, Vector Institute(多伦多大学,向量研究所);University of Oxford(牛津大学);Polytechnique Montréal, Mila - Quebec AI Institute, University of Toronto(蒙特利尔理工学院,魁北克人工智能研究所,多伦多大学)
Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context Experts
School of Interactive Computing(交互计算学院);Georgia Institute of Technology(佐治亚理工学院)
指代消解是跨语言、文本类型和领域的信息抽取的重要任务,激发了对不需要大的注释数据集的方法的需求。上下文学习是一种很有前途的方法,但将上下文学习应用于指代消解还存在一些挑战。例如,编码一个由以下内容组成的上下文演示:一个照应词、一个段落长度的上下文和一个相应的先行词列表,需要在一个长序列的标记上调节语言模型,限制每个提示的演示数量。在本文中,我们提出了MICE(Mixtures of In-Context Experts),我们证明了它对于科学协议中的Few-Shot回指解析是有效的(Tamari et al.,2021年)。在只给出少量训练样本的情况下,MICE结合了数百名上下文专家的预测,使F1分数比竞争性即时检索基线提高了30%。此外,我们表明MICE可以用于训练紧凑的学生模型,而不牺牲性能。据我们所知,这是第一个工作,目前的实验结果表明,在上下文学习的有效性的任务,Few-Shot照应决议在科学协议。
BMIKE-53: Investigating Cross-Lingual Knowledge Editing with In-Context Learning
LMU Munich(慕尼黑大学);Munich Center for Machine Learning(慕尼黑机器学习中心);Technical University of Munich(慕尼黑技术大学);Bosch Center for Artificial Intelligence(博世人工智能中心);University of Oxford(牛津大学);CISPA Helmholtz Center for Information Security(CISPA海德堡信息安全中心)
Beyond Many-Shot Translation: Scaling In-Context Demonstrations For Low-Resource Machine Translation
Institute of Information Science, Academia Sinica(台湾“中央研究院”信息科学研究所);National Taiwan University of Science and Technology(台湾科技大学);Ecole Centrale de Marseille(马赛中央理工学院);National University of Singapore(新加坡国立大学)
Few-Shot Degradation Is Not What It Seems: Behavioral Evidence, Representation Analysis, and a Random-Text Control Across 12 Models, 2 Tasks, and 2 Architectures
LEX AI Platform, legal.org.ua(LEX AI平台,legal.org.ua)
DemoShapley: Valuation of Demonstrations for In-Context Learning
Department of Mathematics and Computer Science(数学与计算机科学系);Eindhoven University of Technology(埃因霍温理工大学);Intel Lab(英特尔实验室);Department of Psychology(心理学系);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Department of Data Science(数据科学系);New Jersey Institute of Technology(新泽西理工学院);Department of Computer Science(计算机科学系);University of Illinois Chicago(伊利诺伊大学芝加哥分校)
Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations
Carnegie Mellon University(卡内基梅隆大学);University of Southern California(南加州大学);University of California, Berkeley(加州大学伯克利分校);MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室)
Domain-Specific Pruning of Large Mixture-of-Experts Models with Few-shot Demonstrations
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学北京校区人工智能学院);University of International Business and Economics(国际商务经济大学);YanTron Technology Co. Ltd(燕tron技术有限公司);EBTech Co. Ltd(EBTech有限公司)