arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.03282cs.CL
收藏

作为统一语义匹配的通用信息抽取

Universal Information Extraction as Unified Semantic Matching

Baidu Inc.(百度公司);Chinese Information Processing Laboratory(中文信息处理实验室);State Key Laboratory of Computer Science(计算机科学国家重点实验室);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所)

Jie Lou, Yaojie Lu, Dai Dai, Wei Jia, Hongyu Lin, Xianpei Han, Le Sun, Hua Wu

摘要:

信息抽取面临的挑战在于标签模式的多样性和结构的异构性。传统的方法需要特定于任务的模型设计,并且严重依赖昂贵的监督,这使得它们难以推广到新的模式。在本文中,我们解耦IE到两个基本的能力,结构化和概念化,这是由不同的任务和模式共享。基于这种范式,我们提出了统一的语义匹配(USM)框架,它引入了三个统一的令牌链接操作来建模的结构化和概念化的能力,通用的建模各种IE任务。通过这种方式,USM可以联合编码模式和输入文本,并行地统一提取子结构,并根据需要可控地解码目标结构。对4个IE任务的实验结果表明,该方法在有监督的实验中取得了最佳的性能,并在零/Few-Shot传输环境下表现出较强的泛化能力。

英文摘要:

The challenge of information extraction (IE) lies in the diversity of label schemas and the heterogeneity of structures. Traditional methods require task-specific model design and rely heavily on expensive supervision, making them difficult to generalize to new schemas. In this paper, we decouple IE into two basic abilities, structuring and conceptualizing, which are shared by different tasks and schemas. Based on this paradigm, we propose to universally model various IE tasks with Unified Semantic Matching (USM) framework, which introduces three unified token linking operations to model the abilities of structuring and conceptualizing. In this way, USM can jointly encode schema and input text, uniformly extract substructures in parallel, and controllably decode target structures on demand. Empirical evaluation on 4 IE tasks shows that the proposed method achieves state-of-the-art performance under the supervised experiments and shows strong generalization ability in zero/few-shot transfer settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑