arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.00677cs.CL
收藏

用于答案选择的分层排序

Hierarchical Ranking for Answer Selection

Nankai University(南开大学)

Hang Gao, Mengting Hu, Renhong Cheng, Tiegang Gao

摘要:

答案选择是从给定问题的候选答案池中选择肯定答案的任务。在本文中,我们提出了一种新的策略,答案选择,所谓的层次排序。我们介绍了三个层次的排名:点级排名,对级排名和列表级排名。它们通过从不同的角度使用监督信息来制定优化目标,以实现对候选答案进行排序的相同目标。因此,这三个层次的排名是相关的,它们可以相互促进。我们以性能良好的比较-聚合模型为骨干,探索了三种方案来实现联合应用分层排名的想法:多任务学习(MTL)策略下的方案,排名集成(RI)方案,渐进排名集成(PRI)方案。在两个公共数据集WikiQA和TREC-QA上的实验结果表明,该方法是有效的.我们的方法在TREC-QA和WikiQA上都达到了最先进的(非BERT)性能。

英文摘要:

Answer selection is a task to choose the positive answers from a pool of candidate answers for a given question. In this paper, we propose a novel strategy for answer selection, called hierarchical ranking. We introduce three levels of ranking: point-level ranking, pair-level ranking, and list-level ranking. They formulate their optimization objectives by employing supervisory information from different perspectives to achieve the same goal of ranking candidate answers. Therefore, the three levels of ranking are related and they can promote each other. We take the well-performed compare-aggregate model as the backbone and explore three schemes to implement the idea of applying the hierarchical rankings jointly: the scheme under the Multi-Task Learning (MTL) strategy, the Ranking Integration (RI) scheme, and the Progressive Ranking Integration (PRI) scheme. Experimental results on two public datasets, WikiQA and TREC-QA, demonstrate that the proposed hierarchical ranking is effective. Our method achieves state-of-the-art (non-BERT) performance on both TREC-QA and WikiQA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑