arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.06192cs.IRcs.HC
收藏

基于预测的用户参与度对澄清问题进行排名

Ranking Clarifying Questions Based on Predicted User Engagement

Tom Lotze, Stefan Klut, Mohammad Aliannejadi, Evangelos Kanoulas

摘要:

为了改善网上搜索结果,澄清问题可以用来阐明用户的信息需求。本研究的目的是预测用户与澄清窗格的相关性的基础上的词汇信息:查询,问题和答案的指示器的参与。随后,预测的用户参与可以用作对澄清窗格进行排名的特征。回归和分类用于预测用户参与度,并与新MIMICS数据集上的朴素启发式基线(例如平均值)进行比较[20]。使用RankNet模型进行消融研究,以确定预测的用户参与度是否提高了澄清窗格排名性能。预测模型能够在原始基线上显着改进,预测用户参与度功能显着改善了NDCG和MRR方面的RankNet结果。这项研究证明了仅基于词汇信息对澄清窗格进行排名的潜力,可以作为未来研究改进的第一个神经基线。

英文摘要:

To improve online search results, clarification questions can be used to elucidate the information need of the user. This research aims to predict the user engagement with the clarification pane as an indicator of relevance based on the lexical information: query, question, and answers. Subsequently, the predicted user engagement can be used as a feature to rank the clarification panes. Regression and classification are applied for predicting user engagement and compared to naive heuristic baselines (e.g. mean) on the new MIMICS dataset [20]. An ablation study is carried out using a RankNet model to determine whether the predicted user engagement improves clarification pane ranking performance. The prediction models were able to improve significantly upon the naive baselines, and the predicted user engagement feature significantly improved the RankNet results in terms of NDCG and MRR. This research demonstrates the potential for ranking clarification panes based on lexical information only and can serve as a first neural baseline for future research to improve on. The code is available online.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑