Recent work shows that causal facts can be effectively extracted from LLMs through prompting, facilitating the creation of causal graphs for causal inference tasks. However, it is unclear if this success is limited to explicitly-mentioned causal facts in the pretraining data which the model can memorize. Thus, this work investigates: Can LLMs infer causal relations from other relational data in text? To disentangle the role of memorized causal facts vs inferred causal relations, we finetune LLMs on synthetic data containing temporal, spatial and counterfactual relations, and measure whether the LLM can then infer causal relations. We find that: (a) LLMs are susceptible to inferring causal relations from the order of two entity mentions in text (e.g. X mentioned before Y implies X causes Y); (b) if the order is randomized, LLMs still suffer from the post hoc fallacy, i.e. X occurs before Y (temporal relation) implies X causes Y. We also find that while LLMs can correctly deduce the absence of causal relations from temporal and spatial relations, they have difficulty inferring causal relations from counterfactuals, questioning their understanding of causality.
Max Planck Institute(马克斯·普朗克研究所);ETH Zürich(苏黎世联邦理工学院);BITS Pilani(博拉理工学院);IIT Kharagpur(印度理工学院克勒格布尔分校);Saarland Informatics Campus(萨尔兰信息学园区);University of Michigan(密歇根大学);University of Hong Kong(香港大学)
Causal-aware Large Language Models: Enhancing Decision-Making Through Learning, Adapting and Acting
School of Computer Science, Guangdong University of Technology(广东技术大学计算机科学学院);College of Mathematics and Computer Science, Shantou University(汕头大学数学与计算机科学学院);Huawei Noah’s Ark Lab, Huawei(华为诺亚实验室);Peng Cheng Laboratory, Shenzhen, China(鹏城实验室)
Do Large Language Models Show Biases in Causal Learning?
UBA(布宜诺斯艾利斯大学);Università degli Studi di Genova(热那亚大学);University of Buenos Aires(布宜诺斯艾利斯大学);Universidad Nacional del Sur(南方国立大学);IIIA-CSIC(西班牙国家研究委员会人工智能研究所);Universidad Autónoma de Barcelona(巴塞罗那自治大学);Arizona State University(亚利桑那州立大学)
E-MIA: Exam-Style Black-Box Membership Inference Attacks against RAG Systems
College of Cyber Security, Jinan University(济南大学网络安全学院);School of Computer Science, Shanghai Jiaotong University(上海交通大学计算机科学学院);Institute of Artificial Intelligence, Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Beihang University(北京航空航天大学人工智能研究院);Zhongguancun Laboratory, Beijing(中关村实验室)