arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.10019cs.IR
收藏

基于关键词的序列到序列学习的高效FAQ检索

Sequence-to-Sequence Learning on Keywords for Efficient FAQ Retrieval

Sourav Dutta, Haytham Assem, Edward Burgin

摘要:

常见问题解答(FAQ)检索提供了一种有效的程序来响应用户基于自然语言的查询。这样的平台在企业聊天机器人、产品问答和为客户提供初步技术支持方面正变得越来越普遍。然而,在这种情况下的挑战在于弥合不同的查询公式和相应的答案之间的词汇和语义差距,这两者通常具有非常短的跨度。本文提出了TI-S2 S,一种新的学习框架,结合了基于TF-IDF的关键字提取和Word 2 Vec嵌入,用于训练序列到序列(Seq 2Seq)架构。它实现了高精度的FAQ检索更好地理解通过代表性的关键字捕获的用户问题的潜在意图。我们进一步提出了一个变种,一个额外的神经网络模块,用于指导检索通过相关的候选人识别的基础上的相似性特征。在公开数据集上的实验显示,我们的方法在rank-5时的精度约为92%,比现有方法提高了近13%。

英文摘要:

Frequently-Asked-Question (FAQ) retrieval provides an effective procedure for responding to user's natural language based queries. Such platforms are becoming common in enterprise chatbots, product question answering, and preliminary technical support for customers. However, the challenge in such scenarios lies in bridging the lexical and semantic gap between varied query formulations and the corresponding answers, both of which typically have a very short span. This paper proposes TI-S2S, a novel learning framework combining TF-IDF based keyword extraction and Word2Vec embeddings for training a Sequence-to-Sequence (Seq2Seq) architecture. It achieves high precision for FAQ retrieval by better understanding the underlying intent of a user question captured via the representative keywords. We further propose a variant with an additional neural network module for guiding retrieval via relevant candidate identification based on similarity features. Experiments on publicly available dataset depict our approaches to provide around 92% precision-at-rank-5, exhibiting nearly 13% improvement over existing approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑