基于SLAM的增量会话句的同时语境化与口译
SLAM-Inspired Simultaneous Contextualization and Interpreting for Incremental Conversation Sentences
摘要:
词的分布式表示提高了许多自然语言任务的性能。然而,在许多方法中,一个词的一个标签只考虑一个含义,并且取决于上下文的多义词的多个含义很少被处理。虽然研究工作涉及多义词,但都是根据一批大的文献来确定多义词的意义。因此,将这些方法应用于连续的句子有两个问题,例如在包含歧义表达的对话中。第一个问题是这些方法不能顺序地处理语境和词义之间的相互依赖关系,即语境决定词义,词义决定语境。因此,语境估计必须并行进行,以寻求多种解释。第二个问题是,以前的方法使用大规模的句子集来离线学习新的解释,学习和推理的步骤被明确分离。这种使用离线学习的方法在对话期间无法获得新的解释。因此,为了动态估计会话语境和连续句子中多义词的解释,本文在传统的同时定位与地图构建(SLAM)算法的基础上,提出了一种同时语境化与解释(SCAIN)方法。通过使用SCAIN算法,我们可以顺序优化上下文和单词解释之间的相互依赖关系,同时在线获得新的解释。为了进行实验评估,我们创建了两个数据集:一个来自维基百科的消歧页面,另一个来自真实对话。对于这两个数据集,结果证实SCAIN可以有效地实现顺序优化的相互依赖性和收购新的解释。
英文摘要:
Distributed representation of words has improved the performance for many natural language tasks. In many methods, however, only one meaning is considered for one label of a word, and multiple meanings of polysemous words depending on the context are rarely handled. Although research works have dealt with polysemous words, they determine the meanings of such words according to a batch of large documents. Hence, there are two problems with applying these methods to sequential sentences, as in a conversation that contains ambiguous expressions. The first problem is that the methods cannot sequentially deal with the interdependence between context and word interpretation, in which context is decided by word interpretations and the word interpretations are decided by the context. Context estimation must thus be performed in parallel to pursue multiple interpretations. The second problem is that the previous methods use large-scale sets of sentences for offline learning of new interpretations, and the steps of learning and inference are clearly separated. Such methods using offline learning cannot obtain new interpretations during a conversation. Hence, to dynamically estimate the conversation context and interpretations of polysemous words in sequential sentences, we propose a method of Simultaneous Contextualization And INterpreting (SCAIN) based on the traditional Simultaneous Localization And Mapping (SLAM) algorithm. By using the SCAIN algorithm, we can sequentially optimize the interdependence between context and word interpretation while obtaining new interpretations online. For experimental evaluation, we created two datasets: one from Wikipedia's disambiguation pages and the other from real conversations. For both datasets, the results confirmed that SCAIN could effectively achieve sequential optimization of the interdependence and acquisition of new interpretations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。