arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.07522cs.CL
收藏

学习回答多语言和代码混合问题

Learning to Answer Multilingual and Code-Mixed Questions

INDIAN INSTITUTE OF TECHNOLOGY PATNA(印度理工学院巴特那分校)

Deepak Gupta

摘要:

问答(QA)是人类自然产生的,是无缝人机交互的关键组成部分。它已经成为与网络交互的最方便和最自然的方法之一,在语音控制的环境中尤其可取。尽管是最古老的研究领域之一,目前的QA系统面临着处理多语言查询的关键挑战。为了构建一个能够为多语言最终用户服务的人工智能(AI)代理,QA系统需要具有语言通用性并适合多语言环境。QA模型的最新进展已经能够超越人类的表现,主要是由于大量高质量数据集的可用性。然而,大多数此类注释数据集的创建成本很高,并且仅限于英语语言,这使得承认外语方面的进展具有挑战性。因此,要衡量多语种质量保证系统的类似改进,就必须投资于高质量的多语种评价基准。在这篇论文中,我们专注于先进的QA技术,在多语言环境中处理最终用户查询。本论文由两部分组成。在第一部分中,我们探讨了多语制和多语制的一个新的层面,即语码混合。其次,我们提出了一种技术来解决利用多个文档的多跳问题生成的任务。实验表明,我们的模型实现了最先进的性能的答案提取,排名和生成任务的多个领域的MQA,VQA,和语言生成。所提出的技术是通用的,可以广泛用于各种领域和语言,以提高QA系统。

英文摘要:

Question-answering (QA) that comes naturally to humans is a critical component in seamless human-computer interaction. It has emerged as one of the most convenient and natural methods to interact with the web and is especially desirable in voice-controlled environments. Despite being one of the oldest research areas, the current QA system faces the critical challenge of handling multilingual queries. To build an Artificial Intelligent (AI) agent that can serve multilingual end users, a QA system is required to be language versatile and tailored to suit the multilingual environment. Recent advances in QA models have enabled surpassing human performance primarily due to the availability of a sizable amount of high-quality datasets. However, the majority of such annotated datasets are expensive to create and are only confined to the English language, making it challenging to acknowledge progress in foreign languages. Therefore, to measure a similar improvement in the multilingual QA system, it is necessary to invest in high-quality multilingual evaluation benchmarks. In this dissertation, we focus on advancing QA techniques for handling end-user queries in multilingual environments. This dissertation consists of two parts. In the first part, we explore multilingualism and a new dimension of multilingualism referred to as code-mixing. Second, we propose a technique to solve the task of multi-hop question generation by exploiting multiple documents. Experiments show our models achieve state-of-the-art performance on answer extraction, ranking, and generation tasks on multiple domains of MQA, VQA, and language generation. The proposed techniques are generic and can be widely used in various domains and languages to advance QA systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑