arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2208.05720cs.CLcs.AIcs.LGcs.NE
收藏

基于层理论类量子语境和BERT的照应歧义模型

A Model of Anaphoric Ambiguities using Sheaf Theoretic Quantum-like Contextuality and BERT

University College London(伦敦大学学院);Quandela

Kin Ian Lo, Mehrnoosh Sadrzadeh, Shane Mansfield

摘要:

自然语言的歧义性并不妨碍我们使用它,语境有助于表达思想。尽管如此,它们对开发能够理解自然语言并像人类一样使用它的机器提出了关键挑战。语境性是量子力学中一种独特的现象,人们提出了不同的数学形式来理解和推理它。本文构建了一个具有量子语境性的照应歧义图式。我们使用最近开发的标准,适用于信令模型的层理论的上下文。然后,我们利用神经词嵌入引擎BERT将模式实例化为自然语言示例,并提取实例的概率分布。因此,在BERT使用的自然语言语料库中发现了大量的上下文相关的例子。我们希望这些例子将为未来的研究铺平道路,并找到将量子计算应用扩展到自然语言处理的方法。

英文摘要:

Ambiguities of natural language do not preclude us from using it and context helps in getting ideas across. They, nonetheless, pose a key challenge to the development of competent machines to understand natural language and use it as humans do. Contextuality is an unparalleled phenomenon in quantum mechanics, where different mathematical formalisms have been put forwards to understand and reason about it. In this paper, we construct a schema for anaphoric ambiguities that exhibits quantum-like contextuality. We use a recently developed criterion of sheaf-theoretic contextuality that is applicable to signalling models. We then take advantage of the neural word embedding engine BERT to instantiate the schema to natural language examples and extract probability distributions for the instances. As a result, plenty of sheaf-contextual examples were discovered in the natural language corpora BERT utilises. Our hope is that these examples will pave the way for future research and for finding ways to extend applications of quantum computing to natural language processing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑