arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.00166cs.IR
收藏

从用户交互中分析和学习搜索澄清

Analyzing and Learning from User Interactions for Search Clarification

Hamed Zamani, Bhaskar Mitra, Everest Chen, Gord Lueck, Fernando Diaz, Paul N. Bennett, Nick Craswell, Susan T. Dumais

摘要:

响应于搜索查询而提出澄清性问题已经被认为是用于揭示查询的潜在意图的有用技术。澄清在具有不同接口的检索系统中具有应用,从传统的web搜索接口到仅语音和小屏幕设备中的有限带宽接口。澄清性问题的产生和评价是近年来的研究热点。然而,与澄清问题的用户交互相对未被探索。在本文中,我们进行了全面的研究,通过分析大规模的用户互动与澄清问题,在一个主要的网络搜索引擎。更详细地说,我们分析了通过澄清问题的搜索查询,澄清问题,及其候选答案的不同属性的基础上收到的用户参与。我们进一步研究了数据中的点击偏差,发现即使阅读澄清问题和候选答案并不需要花费很大的努力,但数据中仍然存在一些位置和呈现偏差。我们还提出了一个模型,用于学习表示澄清问题的基础上,用户交互数据作为隐式反馈。该模型是用于重新排名的一些自动生成的澄清问题,为一个给定的查询。对点击数据和人工标注数据的评价表明了该方法的高质量。

英文摘要:

Asking clarifying questions in response to search queries has been recognized as a useful technique for revealing the underlying intent of the query. Clarification has applications in retrieval systems with different interfaces, from the traditional web search interfaces to the limited bandwidth interfaces as in speech-only and small screen devices. Generation and evaluation of clarifying questions have been recently studied in the literature. However, user interaction with clarifying questions is relatively unexplored. In this paper, we conduct a comprehensive study by analyzing large-scale user interactions with clarifying questions in a major web search engine. In more detail, we analyze the user engagements received by clarifying questions based on different properties of search queries, clarifying questions, and their candidate answers. We further study click bias in the data, and show that even though reading clarifying questions and candidate answers does not take significant efforts, there still exist some position and presentation biases in the data. We also propose a model for learning representation for clarifying questions based on the user interaction data as implicit feedback. The model is used for re-ranking a number of automatically generated clarifying questions for a given query. Evaluation on both click data and human labeled data demonstrates the high quality of the proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑