arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.07280cs.CL
收藏

从大型语言模型中收获事件模式

Harvesting Event Schemas from Large Language Models

University of Chinese Academy of Sciences(中国科学院大学);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所)

Jialong Tang, Hongyu Lin, Zhuoqun Li, Yaojie Lu, Xianpei Han, Le Sun

AI总结:

本文提出从大规模预训练语言模型中收获事件模式的新范式,并设计ESHer系统,通过上下文生成概念化、置信度感知结构化和图聚合,实现高质量高覆盖率的事件模式归纳。

摘要:

事件模式提供了一种概念性、结构性和形式化的语言来表示事件并建模世界事件知识。然而,由于现实世界事件的开放性、事件表达的多样性以及事件知识的稀疏性,自动归纳高质量和高覆盖率的事件模式具有挑战性。在本文中,我们提出了一种新的事件模式归纳范式——从大规模预训练语言模型中收获知识,该方法通过从PLMs中发现、概念化和结构化事件模式,有效解决了上述挑战。我们设计了一个事件模式收获器(ESHer),通过基于上下文生成的的概念化、置信度感知的模式结构化和基于图的模式聚合,自动归纳高质量的事件模式。实证结果表明,ESHer能够在不同领域归纳出高质量和高覆盖率的事件模式。

英文摘要:

Event schema provides a conceptual, structural and formal language to represent events and model the world event knowledge. Unfortunately, it is challenging to automatically induce high-quality and high-coverage event schemas due to the open nature of real-world events, the diversity of event expressions, and the sparsity of event knowledge. In this paper, we propose a new paradigm for event schema induction -- knowledge harvesting from large-scale pre-trained language models, which can effectively resolve the above challenges by discovering, conceptualizing and structuralizing event schemas from PLMs. And an Event Schema Harvester (ESHer) is designed to automatically induce high-quality event schemas via in-context generation-based conceptualization, confidence-aware schema structuralization and graph-based schema aggregation. Empirical results show that ESHer can induce high-quality and high-coverage event schemas on varying domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑