arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.07943cs.AI
收藏

IV共科学家:多智能体LLM框架用于因果工具变量发现

IV Co-Scientist: Multi-Agent LLM Framework for Causal Instrumental Variable Discovery

CISPA Helmholtz Center for Information Security(CISPA亥姆霍兹信息安全中心);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Jinesis AI Lab(Jinesis AI实验室);University of Toronto(多伦多大学);Vector Institute(向量研究所);EuroSafeAI;Carnegie Mellon University(卡内基梅隆大学);Amazon(亚马逊)

Ivaxi Sheth, Zhijing Jin, Bryan Wilder, Dominik Janzing, Mario Fritz

AI总结:

本文探讨LLM在发现因果工具变量中的作用,提出IV共科学家多智能体系统,通过测试和评估LLM恢复已知工具及避免无效工具的能力,展示LLM在大规模观测数据中发现有效工具的潜力。

摘要:

在内生变量与结果之间存在混杂因素时,工具变量(IVs)用于隔离内生变量的因果效应。识别有效工具需要跨学科知识、创造力和上下文理解,是一项非平凡任务。本文探讨LLM是否能帮助此任务。我们进行了两阶段评估框架。首先,测试LLM能否从文献中恢复已知工具,评估其复制标准推理的能力。其次,评估LLM能否识别并避免已被经验或理论驳斥的工具。基于这些结果,我们引入IV共科学家,一个多智能体系统,为给定的治疗-结果对提出、批评和改进IVs。我们还引入一种统计检验,以在没有真实标签的情况下 contextualize 一致性。我们的结果表明LLM在大规模观测数据库中发现有效工具的潜力。

英文摘要:

In the presence of confounding between an endogenous variable and the outcome, instrumental variables (IVs) are used to isolate the causal effect of the endogenous variable. Identifying valid instruments requires interdisciplinary knowledge, creativity, and contextual understanding, making it a non-trivial task. In this paper, we investigate whether large language models (LLMs) can aid in this task. We perform a two-stage evaluation framework. First, we test whether LLMs can recover well-established instruments from the literature, assessing their ability to replicate standard reasoning. Second, we evaluate whether LLMs can identify and avoid instruments that have been empirically or theoretically discredited. Building on these results, we introduce IV Co-Scientist, a multi-agent system that proposes, critiques, and refines IVs for a given treatment-outcome pair. We also introduce a statistical test to contextualize consistency in the absence of ground truth. Our results show the potential of LLMs to discover valid instrumental variables from a large observational database.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑