Integrating Large Language Models in Causal Discovery: A Statistical Causal Approach
Data Science and AI Innovation Research Promotion Center, Shiga University(Shiga大学数据科学与人工智能创新研究促进中心);National Institute of Science and Technology Policy (NISTEP)(国家科学技术政策研究所);Department of Health Data Science, Tokyo Medical University Graduate School of Medicine(东京医科大学医学研究生院健康数据科学系);Human Health Sciences, Kyoto University(京都大学人类健康科学);Graduate School of Medicine Human Health Sciences, Kyoto University(京都大学医学研究生院人类健康科学);Center for Advanced Intelligence Project, RIKEN(RIKEN高级智能项目);Department of Epidemiology Infectious Disease Control and Prevention, Hiroshima University(广岛大学流行病学与传染病防控系);Graduate School of Biomedical and Health Sciences Data Science and AI Innovation Research Promotion Center, Shiga University(Shiga大学生物医学与健康科学研究生院数据科学与人工智能创新研究促进中心);SANKEN, The University of Osaka Faculty of Data Science, Shiga University(大阪大学数据科学学院,Shiga大学SANKEN);Institute for the Advanced Study of Human Biology, Kyoto University(京都大学人类生物学高级研究机构);Department of Physics, Kyoto University(京都大学物理系);Graduate School of Engineering, The University of Tokyo(东京大学工学研究生院);Research and Development Center for Large Language Models, National Institute of Informatics(信息处理研究所大型语言模型研究开发中心)
In practical statistical causal discovery (SCD), embedding domain expert knowledge as constraints into the algorithm is important for reasonable causal models reflecting the broad knowledge of domain experts, despite the challenges in the systematic acquisition of background knowledge. To overcome these challenges, this paper proposes a novel method for causal inference, in which SCD and knowledge-based causal inference (KBCI) with a large language model (LLM) are synthesized through ``statistical causal prompting (SCP)'' for LLMs and prior knowledge augmentation for SCD. The experiments in this work have revealed that the results of LLM-KBCI and SCD augmented with LLM-KBCI approach the ground truths, more than the SCD result without prior knowledge. These experiments have also revealed that the SCD result can be further improved if the LLM undergoes SCP. Furthermore, with an unpublished real-world dataset, we have demonstrated that the background knowledge provided by the LLM can improve the SCD on this dataset, even if this dataset has never been included in the training data of the LLM. For future practical application of this proposed method across important domains such as healthcare, we also thoroughly discuss the limitations, risks of critical errors, expected improvement of techniques around LLMs, and realistic integration of expert checks of the results into this automatic process, with SCP simulations under various conditions both in successful and failure scenarios. The careful and appropriate application of the proposed approach in this work, with improvement and customization for each domain, can thus address challenges such as dataset biases and limitations, illustrating the potential of LLMs to improve data-driven causal inference across diverse scientific domains.
The code used in this work is publicly available at: www.github.com/mas-takayama/LLM-and-SCD
The Robustness of Differentiable Causal Discovery in Misspecified Scenarios
School of Mathematics, Southeast University, Nanjing 210096, China(数学学院,东南大学,南京210096,中国);School of Cyber Science and Engineering, Southeast University, Nanjing 210096, China(网络科学与工程学院,东南大学,南京210096,中国)
Carnegie Mellon University(卡内基梅隆大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of California, San Diego(加利福尼亚大学圣迭戈分校);Guangdong University of Technology(广东工业大学);University of Melbourne(墨尔本大学);Shiga University(滋贺大学);RIKEN(理化学研究所)
Exploring Multi-Modal Data with Tool-Augmented LLM Agents for Precise Causal Discovery
University of Houston(德克萨斯大学休斯顿分校);NEC Laboratories America(NEC美国实验室);Florida International University(佛罗里达国际大学);North Carolina State University(北卡罗来纳州立大学)
Learning to Defer for Causal Discovery with Imperfect Experts
University of Oxford(牛津大学);Mila – Quebec Artificial Intelligence Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);ServiceNow Research(ServiceNow研究院);University of Amsterdam(阿姆斯特丹大学);Université Laval(拉瓦尔大学)
Can Large Language Models Help Experimental Design for Causal Discovery?
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));MBZUAI(穆罕默德·本·扎耶德人工智能大学);Hong Kong Baptist University(香港浸会大学);The University of Sydney(悉尼大学);Carnegie Mellon University(卡内基梅隆大学)
$\texttt{causalAssembly}$: Generating Realistic Production Data for Benchmarking Causal Discovery
Technical University of Munich(慕尼黑工业大学);Robert Bosch GmbH(罗伯特·博世有限公司);University of Applied Sciences Kempten(肯普滕应用科学大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)
Regularized Multi-LLMs Collaboration for Enhanced Score-based Causal Discovery
University of New South Wales(新南威尔士大学);School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);School of Computing, Macquarie University(麦考瑞大学计算学院);CSIRO’s Data61(澳大利亚联邦科学与工业研究组织数据61)