arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.07840cs.CLcs.AIcs.SC
收藏

ONSEP:一种基于大语言模型的新型事件预测在线神经符号框架

ONSEP: A Novel Online Neural-Symbolic Framework for Event Prediction Based on Large Language Model

Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);AI Lab, AIGility Cloud Innovation(AIGility Cloud Innovation AI实验室)

Xuanqing Yu, Wangtao Sun, Jingwei Li, Kang Liu, Chengbao Liu, Jie Tan

AI总结:

针对时序知识图谱预测中现有方法测试难用经验、仅依赖短期历史的问题,提出融合动态因果规则挖掘与双历史增强生成的ONSEP框架,无需大模型重训即可提升多数据集事件预测效果,推动神经符号方法在动态场景的应用。

摘要:

在事件预测领域,时序知识图谱预测(TKGF)是一项核心技术。现有方法面临测试阶段无法利用经验、仅依赖单一短期历史的挑战,限制了其对不断演化数据的适应能力。本文提出在线神经符号事件预测(ONSEP)框架,该框架创新性地融合了动态因果规则挖掘(DCRM)和双历史增强生成(DHAG)。DCRM从实时数据中动态构建因果规则,可快速适配新的因果关系;与此同时,DHAG采用双分支结构融合短期与长期历史上下文,丰富事件预测的信息输入。该框架在多个数据集上均取得显著性能提升,Hit@k(k=1,3,10)指标大幅优化,证明其无需大规模重新训练即可增强大语言模型(LLMs)的事件预测能力。ONSEP框架不仅推动了TKGF领域的发展,也彰显了神经符号方法在动态数据环境中的应用潜力。

英文摘要:

In the realm of event prediction, temporal knowledge graph forecasting (TKGF) stands as a pivotal technique. Previous approaches face the challenges of not utilizing experience during testing and relying on a single short-term history, which limits adaptation to evolving data. In this paper, we introduce the Online Neural-Symbolic Event Prediction (ONSEP) framework, which innovates by integrating dynamic causal rule mining (DCRM) and dual history augmented generation (DHAG). DCRM dynamically constructs causal rules from real-time data, allowing for swift adaptation to new causal relationships. In parallel, DHAG merges short-term and long-term historical contexts, leveraging a bi-branch approach to enrich event prediction. Our framework demonstrates notable performance enhancements across diverse datasets, with significant Hit@k (k=1,3,10) improvements, showcasing its ability to augment large language models (LLMs) for event prediction without necessitating extensive retraining. The ONSEP framework not only advances the field of TKGF but also underscores the potential of neural-symbolic approaches in adapting to dynamic data environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑