arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1609.00552cs.IR
收藏

将点击、注意力和满意度纳入搜索引擎结果页面评价模型

Incorporating Clicks, Attention and Satisfaction into a Search Engine Result Page Evaluation Model

Aleksandr Chuklin, Maarten de Rijke

摘要:

现代搜索引擎的结果页面通常为用户提供即时价值,并以易于导航的方式组织信息。核心排名功能有助于实现这一点,结果片段,结果块的智能组织以及对一箱答案或侧面板的广泛使用也是如此。虽然它们对用户有用,并帮助搜索引擎脱颖而出,但这些功能对评估提出了两大挑战。首先,在搜索引擎结果页面(SERP)上存在这样的元素可能会导致点击的缺失,然而,这与不满意无关,即所谓的“良好放弃”。“其次,SERP项目的非线性布局和视觉差异可能会导致用户注意力的非平凡模式,这是现有评估指标无法捕捉的。在本文中,我们提出了一个模型,共同捕捉点击行为,用户注意力和满意度,CAS模型的SERP用户行为,并证明它提供了更准确的预测用户的行动和自我报告的满意度比现有的模型的基础上点击单独。我们使用CAS模型来构建一个新的评估指标,该指标可应用于非线性SERP布局,并可考虑用户直接在SERP上获得的效用。我们证明,这个指标显示出更好的协议与用户报告的满意度比传统的评价指标。

英文摘要:

Modern search engine result pages often provide immediate value to users and organize information in such a way that it is easy to navigate. The core ranking function contributes to this and so do result snippets, smart organization of result blocks and extensive use of one-box answers or side panels. While they are useful to the user and help search engines to stand out, such features present two big challenges for evaluation. First, the presence of such elements on a search engine result page (SERP) may lead to the absence of clicks, which is, however, not related to dissatisfaction, so-called "good abandonments." Second, the non-linear layout and visual difference of SERP items may lead to non-trivial patterns of user attention, which is not captured by existing evaluation metrics. In this paper we propose a model of user behavior on a SERP that jointly captures click behavior, user attention and satisfaction, the CAS model, and demonstrate that it gives more accurate predictions of user actions and self-reported satisfaction than existing models based on clicks alone. We use the CAS model to build a novel evaluation metric that can be applied to non-linear SERP layouts and that can account for the utility that users obtain directly on a SERP. We demonstrate that this metric shows better agreement with user-reported satisfaction than conventional evaluation metrics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑