arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.15073cs.AIcs.CL
收藏

多智能体因果发现使用大型语言模型

Multi-Agent Causal Discovery Using Large Language Models

Department of Industrial Engineering, Tsinghua University(清华大学工业工程系)

Hao Duong Le, Xin Xia, Haijie Xu, Chen Zhang

AI总结:

提出多智能体因果发现框架MAC,通过元融合机制结合自主选择SCD算法的辩论编码模块和基于元数据的对抗性辩论模块,在多个基准上取得最优性能。

摘要:

因果发现旨在识别变量之间的因果关系,是各科学领域的基本问题。传统的统计因果发现(SCD)方法仅依赖观测数据,忽略元数据中可用的上下文信息,而近期基于LLM的方法利用元数据但将大型语言模型(LLM)视为单一智能体,使其判断易受记忆或偏见关联影响。为解决这一差距,我们引入MAC(多智能体因果发现框架),将因果发现转化为多智能体辩论与自主选择SCD算法相结合。MAC通过元融合机制桥接两个互补模块:辩论编码模块(DCM)通过自主选择并执行最合适的SCD算法将初始图基于数据,以及元辩论模块(MDM)通过对抗性的肯定-否定-裁判辩论基于元数据精炼图。在五个基准数据集和三个指标(F1、SHD、NHD)上,MAC在五个统计基线和四个基于LLM的基线中取得了最佳综合性能,在使用Gemini-2.0-Flash时在15个评估点中排名第一10次——包括完美重建地震图——并在三个骨干LLM上保持稳健。

英文摘要:

Causal discovery aims to identify causal relationships between variables and is a fundamental problem across the sciences. Traditional statistical causal discovery (SCD) methods rely solely on observational data and ignore the contextual information available in metadata, whereas recent LLM-based methods exploit metadata but treat the large language model (LLM) as a single agent, leaving its judgments vulnerable to memorized or biased associations. To address this gap, we introduce MAC (Multi-Agent Causal Discovery Framework), which casts causal discovery as a multi-agent debate coupled with the autonomous selection of an SCD algorithm. MAC combines two complementary modules, bridged by a Meta Fusion mechanism: a Debate-Coding Module (DCM) that grounds an initial graph in data by autonomously selecting and executing the best-suited SCD algorithm, and a Meta-Debate Module (MDM) that refines the graph through an adversarial Affirmative-Negative-Judge debate over the metadata. Across five benchmark datasets and three metrics (F1, SHD, NHD), MAC achieves the best aggregate performance among five statistical and four LLM-based baselines, ranking first on 10 of 15 evaluation points with Gemini-2.0-Flash -- including a perfect reconstruction of the Earthquake graph -- and remains robust across three backbone LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑