arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2010.07620cs.AIcs.CL
收藏

GMH:一种通用的KG完成多跳推理模型

GMH: A General Multi-hop Reasoning Model for KG Completion

Nankai University(南开大学);Sichuan University(四川大学);University of Innsbruck(因斯布鲁克大学);National University of Singapore(新加坡国立大学);Mashang Consumer Finance Co., Ltd.(马上消费金融股份有限公司)

Yao Zhang, Hongru Liang, Adam Jatowt, Wenqiang Lei, Xin Wei, Ning Jiang, Zhenglu Yang

摘要:

知识图谱对于许多下游自然语言处理应用是必不可少的,但通常是不完整的,缺少许多事实。这导致了对多跳推理任务的研究工作,其可以被公式化为搜索过程,并且当前模型通常执行短距离推理。然而,远距离推理对于连接表面上不相关的实体的能力也至关重要。据我们所知,缺乏一个通用的框架,在混合的长短距离推理场景中的方法多跳推理。我们认为,一般的多跳推理模型有两个关键问题:i)去哪里,和ii)何时停止。因此,我们提出了一个通用模型,它解决了三个模块的问题:1)局部-全局知识模块估计可能的路径,2)差分动作退出模块探索不同的路径集,和3)自适应停止搜索模块,以避免过度搜索。在三个数据集上的综合结果表明,我们的模型在短距离和长距离推理场景中相对于基线都有显着改进。

英文摘要:

Knowledge graphs are essential for numerous downstream natural language processing applications, but are typically incomplete with many facts missing. This results in research efforts on multi-hop reasoning task, which can be formulated as a search process and current models typically perform short distance reasoning. However, the long-distance reasoning is also vital with the ability to connect the superficially unrelated entities. To the best of our knowledge, there lacks a general framework that approaches multi-hop reasoning in mixed long-short distance reasoning scenarios. We argue that there are two key issues for a general multi-hop reasoning model: i) where to go, and ii) when to stop. Therefore, we propose a general model which resolves the issues with three modules: 1) the local-global knowledge module to estimate the possible paths, 2) the differentiated action dropout module to explore a diverse set of paths, and 3) the adaptive stopping search module to avoid over searching. The comprehensive results on three datasets demonstrate the superiority of our model with significant improvements against baselines in both short and long distance reasoning scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑