Let's Stop Incorrect Comparisons in End-to-end Relation Extraction!
Sorbonne Université（索邦大学）；CNRS（法国国家科学研究中心）；Laboratoire d’Informatique de Paris 6（巴黎第六大学计算机实验室）；LIP6（LIP6实验室）；BNP Paribas（法国巴黎银行）；Criteo AI Lab（Criteo人工智能实验室）
Bruno Taillé, Vincent Guigue, Geoffrey Scoutheeten, Patrick Gallinari
Despite efforts to distinguish three different evaluation setups (Bekoulis et al., 2018), numerous end-to-end Relation Extraction (RE) articles present unreliable performance comparison to previous work. In this paper, we first identify several patterns of invalid comparisons in published papers and describe them to avoid their propagation. We then propose a small empirical study to quantify the impact of the most common mistake and evaluate it leads to overestimating the final RE performance by around 5% on ACE05. We also seize this opportunity to study the unexplored ablations of two recent developments: the use of language model pretraining (specifically BERT) and span-level NER. This meta-analysis emphasizes the need for rigor in the report of both the evaluation setting and the datasets statistics and we call for unifying the evaluation setting in end-to-end RE.
Boosting Event Extraction with Denoised Structure-to-Text Augmentation
Beijing Institute of Technology（北京理工大学）；Ministry of Industry and Information Technology（工业和信息化部）；Beijing University of Technology（北京工业大学）；Baidu Inc.（百度公司）
Uncovering Main Causalities for Long-tailed Information Extraction
Singapore University of Technology and Design（新加坡科技设计大学）；Carnegie Mellon University（卡内基梅隆大学）；National University of Singapore（新加坡国立大学）；University of Cambridge（剑桥大学）
Hallucination-Resistant Relation Extraction via Dependency-Aware Sentence Simplification and Two-tiered Hierarchical Refinement
Shanghai Jiao Tong University（上海交通大学）；University of California San Diego（加州大学圣地亚哥分校）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）；Alibaba Group（阿里巴巴集团）
Applying Relation Extraction and Graph Matching to Answering Multiple Choice Questions
Graduate School of Informatics, Kyoto University（京都大学信息科学研究生院）；Center for Innovative Research and Education in Data Science, Kyoto University（京都大学数据科学创新研究与教育中心）
Automated Extraction of Records of Processing Activities (RoPA) Using Hybrid RAG and Locally Deployed Large Language Models
Academy of Cryptography Techniques（密码技术学院）；Government Cipher Committee（政府密码委员会）；Ho Chi Minh City University of Technology (HCMUT)（胡志明市理工大学）；Vietnam National University Ho Chi Minh City（越南胡志明市国家大学）
