Causal Graph based Event Reasoning using Semantic Relation Experts
Stony Brook University(石英 Brook 大学);University of Pennsylvania(宾夕法尼亚大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);United States Naval Academy(美国海军学院)
Understanding how events in a scenario causally connect with each other is important for effectively modeling and reasoning about events. But event reasoning remains a difficult challenge, and despite recent advances, Large Language Models (LLMs) still struggle to accurately identify causal connections between events. This struggle leads to poor performance on deeper reasoning tasks like event forecasting and timeline understanding. To address this challenge, we investigate the generation of causal event graphs (e.g., A enables B) as a parallel mechanism to help LLMs explicitly represent causality during inference. This paper evaluates both how to generate correct graphs as well as how graphs can assist reasoning. We propose a collaborative approach to causal graph generation where we use LLMs to simulate experts that focus on specific semantic relations. The experts engage in multiple rounds of discussions which are then consolidated by a final expert. Then, to demonstrate the utility of causal graphs, we use them on multiple downstream applications, and also introduce a new explainable event prediction task that requires a causal chain of events in the explanation. These explanations are more informative and coherent than baseline generations. Finally, our overall approach not finetuned on any downstream task, achieves competitive results with state-of-the-art models on both forecasting and next event prediction tasks.
Causal Order: The Key to Leveraging Imperfect Experts in Causal Inference
UIUC(伊利诺伊大学厄巴纳-香槟分校);CISPA Helmholtz Center for Information Security(CISPA亥姆霍兹信息安全研究中心);MIT(麻省理工学院);IIT Hyderabad(印度理工学院海得拉巴分校);Microsoft Research(微软研究院)
CausalMoE: A Billion-Scale Multimodal Foundation Model for Granger Causal Discovery with Pattern-Routed Heterogeneous Experts
State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院通用人工智能国家重点实验室);National Institute of Health Data Science, and Institute for Artificial Intelligence, Peking University(北京大学健康医疗大数据国家研究院、人工智能研究院)
Learning to Defer for Causal Discovery with Imperfect Experts
University of Oxford(牛津大学);Mila – Quebec Artificial Intelligence Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);ServiceNow Research(ServiceNow研究院);University of Amsterdam(阿姆斯特丹大学);Université Laval(拉瓦尔大学)
Unveiling Causal Reasoning in Large Language Models: Reality or Mirage?
Intelligent Game and Decision Lab(智能游戏与决策实验室);National University of Defense Technology(国防科技大学);University of Melbourne(墨尔本大学);University of Sydney(悉尼大学);Hong Kong Baptist University(香港 Baptist 大学)
Causal Ensemble Agent: Hierarchical Causal Discovery with LLM-guided Expert Reweighting
The University of Melbourne(墨尔本大学);MBZUAI(穆罕默德·本·扎耶德人工智能大学);Peking University(北京大学);Adelaide University(阿德莱德大学);Hong Kong Baptist University(香港浸会大学);The University of Sydney(悉尼大学);Carnegie Mellon University(卡内基梅隆大学)
METER: Evaluating Multi-Level Contextual Causal Reasoning in Large Language Models
College of Computer Science, Sichuan University(四川大学计算机学院);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究所);Engineering Research Center of Machine Learning and Industry Intelligence, Ministry of Education, China(中国教育部机器学习与产业智能工程研究中心)
ChainReaction: Causal Chain-Guided Reasoning for Modular and Explainable Causal-Why Video Question Answering
Institute of High Performance Computing, Agency for Science, Technology and Research, Singapore(新加坡高性能计算研究所,科技研究局);Centre for Frontier AI Research, Agency for Science, Technology and Research, Singapore(科技研究局前沿人工智能研究中心,新加坡);College of Computing and Data Science, Nanyang Technological University, Singapore(新加坡南洋理工大学计算与数据科学学院)
Eliciting Causal Abilities in Large Language Models for Reasoning Tasks
BNU-HKBU United International College(北师港浸大);Hong Kong Baptist University(香港浸会大学);Beijing Normal University at Zhuhai(北京师范大学珠海校区);The Chinese University of Hong Kong(香港中文大学)
CLadder: Assessing Causal Reasoning in Language Models
MPI for Intelligent Systems, Tübingen(马克斯·普朗克智能系统研究所,蒂宾根);ETH Zürich(苏黎世联邦理工学院);IIT Kharagpur(印度理工学院卡拉格普尔分校);University of Hong Kong(香港大学);University of Washington(华盛顿大学)