arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1708.04326cs.IRcs.CL
收藏

使用预训练词嵌入改进答案选择

Improved Answer Selection with Pre-Trained Word Embeddings

IBM Watson;AI Foundations, IBM Research(IBM研究院人工智能基础)

Rishav Chakravarti, Jiri Navratil, Cicero Nogueira dos Santos

AI总结:

研究基于预训练词嵌入的答案选择方法,通过在公开数据集上实验,对比传统方法有显著提升,将词嵌入特征与传统排序学习技术结合,性能可媲美最先进神经网络。

摘要:

本文评估了基于预训练词嵌入的现有和新提出的答案选择方法。词嵌入在各种自然语言处理任务中非常有效,将其集成到传统信息检索(IR)系统中可以捕捉问题和答案之间的语义相关性。在三个公开数据集上的实证结果表明,在有监督和无监督设置下,相对于传统基于词频的方法都有显著提升。我们表明,将这些词嵌入特征与传统排序学习技术相结合,可以达到与为答案选择任务训练的最先进神经网络相似的性能。

英文摘要:

This paper evaluates existing and newly proposed answer selection methods based on pre-trained word embeddings. Word embeddings are highly effective in various natural language processing tasks and their integration into traditional information retrieval (IR) systems allows for the capture of semantic relatedness between questions and answers. Empirical results on three publicly available data sets show significant gains over traditional term frequency based approaches in both supervised and unsupervised settings. We show that combining these word embedding features with traditional learning-to-rank techniques can achieve similar performance to state-of-the-art neural networks trained for the answer selection task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑