与英语相比,德语词序更自由,因此给自然语言推理(NLI)带来了额外挑战。我们构建了 WOGLI(Word Order in German Language Inference,德语语言推理中的词序),这是首个针对德语词序的对抗性 NLI 数据集,具有以下特性:(i) 每个前提都有一个被蕴涵的假设和一个不被蕴涵的假设;(ii) 前提与假设之间仅在词序以及为标记格和数而必需的形态变化上有所不同。具体而言,每个前提及其两个假设包含完全相同的词元。我们的对抗样本要求模型利用形态标记来识别或拒绝蕴涵。我们表明,当前在翻译得到的 NLI 数据上微调的德语自编码模型在该挑战集上可能表现困难,这反映出翻译得到的 NLI 数据集不会再现目标语言中所有必要的语言现象。我们还考察了数据增强后的表现,以及在由 WOGLI 派生的相关词序现象上的表现。我们的数据集已公开发布于 https://github.com/ireinig/wogli。
英文摘要:
Compared to English, German word order is freer and therefore poses additional challenges for natural language inference (NLI). We create WOGLI (Word Order in German Language Inference), the first adversarial NLI dataset for German word order that has the following properties: (i) each premise has an entailed and a non-entailed hypothesis; (ii) premise and hypotheses differ only in word order and necessary morphological changes to mark case and number. In particular, each premise andits two hypotheses contain exactly the same lemmata. Our adversarial examples require the model to use morphological markers in order to recognise or reject entailment. We show that current German autoencoding models fine-tuned on translated NLI data can struggle on this challenge set, reflecting the fact that translated NLI datasets will not mirror all necessary language phenomena in the target language. We also examine performance after data augmentation as well as on related word order phenomena derived from WOGLI. Our datasets are publically available at https://github.com/ireinig/wogli.
Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language Inference
Indiana University Bloomington(印第安纳大学伯明顿分校);Brigham Young University(杨百翰大学);Northwestern University(西北大学);UNC Chapel Hill(北卡罗来纳大学教堂山分校);Allen Institute for AI(艾伦人工智能研究所);Shanghai Jiaotong Univ.(上海交通大学)
Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement
University of Manchester(曼彻斯特大学);Idiap Research Institute(Idiap研究所);National Biomarker Centre, CRUK-MI, University of Manchester(曼彻斯特大学英国癌症研究中心曼彻斯特研究所国家生物标志物中心)
The "Small World of Words" German Free-Association Norms
Center for Cognitive and Decision Sciences, Faculty of Psychology, University of Basel(巴塞尔大学心理学系认知与决策科学中心);Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin(柏林洪堡人类发展研究所适应性理性中心);Institute of Estonian and General Linguistics, University of Tartu(塔尔图大学爱沙尼亚与一般语言学研究所);Melbourne School of Psychological Sciences, University of Melbourne(墨尔本大学心理科学学院)
Breaking Boundaries: Investigating the Effects of Model Editing on Cross-linguistic Performance
Indian Institute of Technology Kharagpur(印度理工学院克勒格布尔分校);National Institute of Standards and Technology(美国国家标准与技术研究院);INSAIT(保加利亚索菲亚大学INSAIT研究院);Sofia University “St. Kliment Ohridski”(圣基里曼·奥赫里德斯基索菲亚大学)
MultiMWE: Building a Multi-lingual Multi-Word Expression (MWE) Parallel Corpora
ADAPT Research Centre(ADAPT研究中心);Insight Centre for Data Analytics(洞察数据分析中心);Dublin City University(都柏林城市大学)
多词表达式(MWE)是自然语言处理(NLP)领域的一个研究热点,包括MWE检测、MWE分解以及MWE在机器翻译等其他NLP领域的应用研究。然而,双语或多语的MWE语料库的可用性是非常有限的。我们所知道的唯一的双语MWE语料库来自PARSEME(PARSing and Multi-word Expressions)EU Project。这是一个只有871对英语-德语MWE的小集合。在本文中,我们提出了多语言和双语MWE语料库,我们已经从根平行语料库中提取。我们收集到的双语MWE对分别为3,159,226和143,042德英和中英过滤后。我们检查这些提取的双语MWE在MT实验的质量。我们的初步实验表明,在MT中应用MWE的定性分析和更好的一般评价分数在定量分析中,无论是德国-英语和中国-英语语言对MWE术语的翻译性能提高。我们遵循一个标准的实验管道来创建我们的MultiMWE语料库,这些语料库可以在网上找到。研究人员可以使用这个免费的语料库为自己的模型或使用它们在知识库中作为模型功能。