因果发现(CD)与大语言模型(LLM)已成为人工智能中具有变革性的两个领域,并且在很大程度上是各自独立发展的。CD 专注于从数据中揭示因果关系,而 LLM 擅长自然语言处理与生成,二者的融合为推进因果理解提供了独特机遇。本综述考察了 LLM 如何在三个关键维度上变革 CD:从文本中直接提取因果关系、将领域知识整合到统计方法中,以及精炼因果结构。我们系统分析了利用 LLM 完成 CD 任务的方法,重点说明它们如何创新性地使用元数据和自然语言进行因果推断。分析表明,LLM 既有增强传统 CD 方法的潜力,也存在作为不完美专家系统的当前局限。我们识别了关键研究空白,概述了基于 LLM 的因果发现的评估框架和基准,并倡导未来在因果性研究中利用 LLM。作为对 LLM 与 CD 协同作用的首次全面考察,本工作为该领域的未来进展奠定了基础。
英文摘要:
Causal discovery (CD) and Large Language Models (LLMs) have emerged as transformative fields in artificial intelligence that have evolved largely independently. While CD specializes in uncovering cause-effect relationships from data, and LLMs excel at natural language processing and generation, their integration presents unique opportunities for advancing causal understanding. This survey examines how LLMs are transforming CD across three key dimensions: direct causal extraction from text, integration of domain knowledge into statistical methods, and refinement of causal structures. We systematically analyze approaches that leverage LLMs for CD tasks, highlighting their innovative use of metadata and natural language for causal inference. Our analysis reveals both LLMs' potential to enhance traditional CD methods and their current limitations as imperfect expert systems. We identify key research gaps, outline evaluation frameworks and benchmarks for LLM-based causal discovery, and advocate future research efforts for leveraging LLMs in causality research. As the first comprehensive examination of the synergy between LLMs and CD, this work lays the groundwork for future advances in the field.
Causal Ensemble Agent: Hierarchical Causal Discovery with LLM-guided Expert Reweighting
The University of Melbourne(墨尔本大学);MBZUAI(穆罕默德·本·扎耶德人工智能大学);Peking University(北京大学);Adelaide University(阿德莱德大学);Hong Kong Baptist University(香港浸会大学);The University of Sydney(悉尼大学);Carnegie Mellon University(卡内基梅隆大学)
Integrating Large Language Model for Improved Causal Discovery
School of Computer Science and Technology, University of Science and Technology of China(计算机科学与技术学院,中国科学技术大学);University of Science and Technology of China(中国科学技术大学);Laboratory for Big Data and Decision, University of Science and Technology of China(大数据与决策实验室,中国科学技术大学);First Affiliated Hospital of University of Science and Technology of China(中国科学技术大学第一附属医院)
Exploring Multi-Modal Data with Tool-Augmented LLM Agents for Precise Causal Discovery
University of Houston(德克萨斯大学休斯顿分校);NEC Laboratories America(NEC美国实验室);Florida International University(佛罗里达国际大学);North Carolina State University(北卡罗来纳州立大学)
Learning to Defer for Causal Discovery with Imperfect Experts
University of Oxford(牛津大学);Mila – Quebec Artificial Intelligence Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);ServiceNow Research(ServiceNow研究院);University of Amsterdam(阿姆斯特丹大学);Université Laval(拉瓦尔大学)
Can Large Language Models Help Experimental Design for Causal Discovery?
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));MBZUAI(穆罕默德·本·扎耶德人工智能大学);Hong Kong Baptist University(香港浸会大学);The University of Sydney(悉尼大学);Carnegie Mellon University(卡内基梅隆大学)
Regularized Multi-LLMs Collaboration for Enhanced Score-based Causal Discovery
University of New South Wales(新南威尔士大学);School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);School of Computing, Macquarie University(麦考瑞大学计算学院);CSIRO’s Data61(澳大利亚联邦科学与工业研究组织数据61)
Causal Discovery with Inverted Self-attention for Multivariate Time Series
School of Computer Science, University of Technology Sydney(悉尼科技大学计算机科学学院);Technical University of Denmark(丹麦技术大学);TianFu YongXing Laboratory(天府永兴实验室);Faculty of Data Science, City University of Macau(澳门城市大学数据科学学院)