Natural language processing models often exploit spurious correlations between task-independent features and labels in datasets to perform well only within the distributions they are trained on, while not generalising to different task distributions. We propose to tackle this problem by generating a debiased version of a dataset, which can then be used to train a debiased, off-the-shelf model, by simply replacing its training data. Our approach consists of 1) a method for training data generators to generate high-quality, label-consistent data samples; and 2) a filtering mechanism for removing data points that contribute to spurious correlations, measured in terms of z-statistics. We generate debiased versions of the SNLI and MNLI datasets, and we evaluate on a large suite of debiased, out-of-distribution, and adversarial test sets. Results show that models trained on our debiased datasets generalise better than those trained on the original datasets in all settings. On the majority of the datasets, our method outperforms or performs comparably to previous state-of-the-art debiasing strategies, and when combined with an orthogonal technique, product-of-experts, it improves further and outperforms previous best results of SNLI-hard and MNLI-hard.
CoBA: Counterbias Text Augmentation for Mitigating Various Spurious Correlations via Semantic Triples
DATUMO;AITRICS;Brainventures;Graduate School of Advanced Imaging Sciences, Multimedia and Film, Chung-Ang University(Chung-Ang大学高级影像科学、多媒体与电影研究生院);Department of Artificial Intelligence, Chung-Ang University(Chung-Ang大学人工智能系)
COPO: Causal-Oriented Policy Optimization for Hallucinations of MLLMs
University of Chinese Academy of Sciences(中国科学院大学);Institute of Software Chinese Academy of Sciences(中国科学院软件研究所);Wangxuan Institute of Computer Technology, Peking University(北京大学王轩计算机技术研究所);Amazon.com, Inc.(亚马逊公司)
Multi-View Incongruity Learning for Multimodal Sarcasm Detection
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);State Key Laboratory of Software Development Environment, Beihang University(北京航空航天大学软件开发环境国家重点实验室);School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机学院);Department of Computer Science, University of Illinois at Chicago(伊利诺伊大学芝加哥分校计算机系)
A Rationale-centric Counterfactual Data Augmentation Method for Cross-Document Event Coreference Resolution
School of Engineering, Westlake University(西湖大学工程学院);Zhejiang University(浙江大学);Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Advanced Technology, Westlake Institute for Advanced Study(西湖高等研究院先进技术研究院)
针对跨文档事件共指消解中触发词词汇匹配的虚假偏差,本文基于结构因果模型提出 LLM 参与闭环的理据中心反事实数据增强方法,在三个基准上达到 SOTA 并具备域外鲁棒性。