arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.05009cs.IR
收藏

Few-Shot生成式会话查询重写

Few-Shot Generative Conversational Query Rewriting

Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu

摘要:

会话查询重写的目的是将一个简洁的会话查询重新表达为一个完全指定的、上下文无关的查询,从而可以被现有的信息检索系统有效地处理。本文提出了一种用于会话查询重写的Few-Shot生成方法。我们开发了两种方法,基于规则和自监督学习,使用大量的临时搜索会话生成弱监督数据,并微调GPT-2重写会话查询。在TREC会话辅助跟踪上,我们的弱监督GPT-2重写器将最先进的排名准确性提高了12%,仅使用非常有限的手动查询重写。在零样本学习设置中,重写器仍然给出与先前最先进的系统相当的结果。我们的分析表明,GPT-2有效地拿起任务语法,并学会捕捉上下文依赖关系,即使是涉及组引用和长时间依赖关系的困难情况。

英文摘要:

Conversational query rewriting aims to reformulate a concise conversational query to a fully specified, context-independent query that can be effectively handled by existing information retrieval systems. This paper presents a few-shot generative approach to conversational query rewriting. We develop two methods, based on rules and self-supervised learning, to generate weak supervision data using large amounts of ad hoc search sessions, and to fine-tune GPT-2 to rewrite conversational queries. On the TREC Conversational Assistance Track, our weakly supervised GPT-2 rewriter improves the state-of-the-art ranking accuracy by 12%, only using very limited amounts of manual query rewrites. In the zero-shot learning setting, the rewriter still gives a comparable result to previous state-of-the-art systems. Our analyses reveal that GPT-2 effectively picks up the task syntax and learns to capture context dependencies, even for hard cases that involve group references and long-turn dependencies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑