arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1502.00831cs.CLcs.LOmath.CTmath.QA
收藏

自然语言处理中的开放系统范畴量子语义

Open System Categorical Quantum Semantics in Natural Language Processing

University of Oxford(牛津大学);Queen Mary University of London(伦敦大学玛丽皇后学院)

Robin Piedeleu, Dimitri Kartsaklis, Bob Coecke, Mehrnoosh Sadrzadeh

摘要:

最初受到范畴量子力学(Abramsky和Coecke,LiCS'04)的启发,Coecke,Sadrzadeh和Clark的自然语言含义的范畴成分分布模型提供了一个概念上有动机的程序来计算句子的含义,给定其在Lambek前群中的语法结构及其部分含义的矢量表示。在大规模数据的主流经验语言处理任务中,第一个模型的预测结果优于其他模型。此外,就像CQM允许我们改变解释量子公理的模型一样,我们也可以改变解释词义的模型。在本文中,我们表明,进一步发展的范畴量子力学有关的自然语言处理了。首先,塞林格的CPM构式允许明确考虑词汇歧义,并区分同音异义和多义两个本质上不同的概念。就我们解释词义的模型而言,这意味着从向量空间模型到密度矩阵的过渡。尽管模型发生了这种变化,但可以很容易地采用标准的经验方法来比较意义,我们通过对真实世界数据的小规模实验来证明这一点。此外,这个实验提供了初步的证据,我们提出的新模型的有效性的词义。其次,在CPM构式的图像中出现的交换经典结构以及它们的非交换对应物允许对关系代词、动词和形容词进行编码,最后,CPM构式的迭代(在量子领域中没有对应物)使人们能够容纳蕴涵和歧义。

英文摘要:

Originally inspired by categorical quantum mechanics (Abramsky and Coecke, LiCS'04), the categorical compositional distributional model of natural language meaning of Coecke, Sadrzadeh and Clark provides a conceptually motivated procedure to compute the meaning of a sentence, given its grammatical structure within a Lambek pregroup and a vectorial representation of the meaning of its parts. The predictions of this first model have outperformed that of other models in mainstream empirical language processing tasks on large scale data. Moreover, just like CQM allows for varying the model in which we interpret quantum axioms, one can also vary the model in which we interpret word meaning. In this paper we show that further developments in categorical quantum mechanics are relevant to natural language processing too. Firstly, Selinger's CPM-construction allows for explicitly taking into account lexical ambiguity and distinguishing between the two inherently different notions of homonymy and polysemy. In terms of the model in which we interpret word meaning, this means a passage from the vector space model to density matrices. Despite this change of model, standard empirical methods for comparing meanings can be easily adopted, which we demonstrate by a small-scale experiment on real-world data. This experiment moreover provides preliminary evidence of the validity of our proposed new model for word meaning. Secondly, commutative classical structures as well as their non-commutative counterparts that arise in the image of the CPM-construction allow for encoding relative pronouns, verbs and adjectives, and finally, iteration of the CPM-construction, something that has no counterpart in the quantum realm, enables one to accommodate both entailment and ambiguity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑