arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.11348cs.CLcs.AIcs.IRcs.SI

用于社交媒体因果关系提取的大型语言模型:灾害情报的验证框架

Large Language Models for Causal Relations Extraction in Social Media: A Validation Framework for Disaster Intelligence

Arizona State University(亚利桑那州立大学);DEVCOM Army Research Laboratory(陆军研究实验室)

Ujun Jeong, Saketh Vishnubhatla, Bohan Jiang, Andre Harrison, Adrienne Raglin, Huan Liu

AI总结:

本文研究大型语言模型在灾害社交媒体中提取因果关系的有效性,提出专家导向的评估框架并评估提取关系是否由事后证据支持。

摘要:

在灾害中,从社交媒体中提取因果关系可以加强态势感知,通过识别与伤亡、物质损坏、基础设施中断和连锁影响相关的因素。然而,与灾害相关的帖子通常不正式、碎片化且依赖上下文,可能描述个人经历而非明确的因果关系。在本工作中,我们考察大型语言模型(LLMs)是否能有效从灾害相关社交媒体帖子中提取因果关系。为此,我们(1)提出一个专家导向的评估框架,将LLM生成的因果图与从灾害特定报告中导出的参考图进行比较;(2)评估提取的关系是否由事后证据支持,或只是反映模型先验知识。我们的发现突显了在灾害决策支持系统中使用LLMs进行因果关系提取的潜力和风险。

英文摘要:

During disasters, extracting causal relations from social media can strengthen situational awareness by identifying factors linked to casualties, physical damage, infrastructure disruption, and cascading impacts. However, disaster-related posts are often informal, fragmented, and context-dependent, and they may describe personal experiences rather than explicit causal relations. In this work, we examine whether Large Language Models (LLMs) can effectively extract causal relations from disaster-related social media posts. To this end, we (1) propose an expert-grounded evaluation framework that compares LLM-generated causal graphs with reference graphs derived from disaster-specific reports and (2) assess whether the extracted relations are supported by post-event evidence or instead reflect model priors. Our findings highlight both the potential and risks of using LLMs for causal relation extraction in disaster decision-support systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑