arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.00239cs.IR
收藏

我们做对了吗?电子商业搜索中查询性能的预测

Did We Get It Right? Predicting Query Performance in E-commerce Search

Rohan Kumar, Mohit Kumar, Neil Shah, Christos Faloutsos

摘要:

在本文中,我们解决的问题,评估是否由电子商业搜索引擎的查询结果是好还是不好。这是评估任何电子商业搜索引擎的关键问题。虽然这个问题是传统上回答使用简单的指标,如查询点击率(CTR),我们观察到,在电子商业搜索,这样的指标可能是误导。在检查时,我们发现CTR高但结果差的情况,反之亦然。类似的情况也存在其他指标,如点击时间,这也经常用于评估搜索引擎。我们的目标是了解质量的结果服务的搜索引擎的基础上,用户的互动与结果。虽然这个问题已经在网络搜索环境中进行了研究,但据我们所知,这是第一次对电子商业搜索进行研究。尽管与评估网络搜索引擎有某些共性,但也有几个主要的差异,例如搜索失败的根本原因,以及丰富的用户与产品交互数据的可用性(例如将产品添加到购物车)。我们研究了来自Flipkart搜索引擎的大规模用户交互日志,分析了行为模式,并建立了基于用户行为信号对查询进行分类的模型。我们证明了这种模型在准确预测查询性能的可行性和有效性。我们的分类器能够在保持的测试集上实现0.75的平均AUC。

英文摘要:

In this paper, we address the problem of evaluating whether results served by an e-commerce search engine for a query are good or not. This is a critical question in evaluating any e-commerce search engine. While this question is traditionally answered using simple metrics like query click-through rate (CTR), we observe that in e-commerce search, such metrics can be misleading. Upon inspection, we find cases where CTR is high but the results are poor and vice versa. Similar cases exist for other metrics like time to click which are often also used for evaluating search engines. We aim to learn the quality of the results served by the search engine based on users' interactions with the results. Although this problem has been studied in the web search context, this is the first study for e-commerce search, to the best of our knowledge. Despite certain commonalities with evaluating web search engines, there are several major differences such as underlying reasons for search failure, and availability of rich user interaction data with products (e.g. adding a product to the cart). We study large-scale user interaction logs from Flipkart's search engine, analyze behavioral patterns and build models to classify queries based on user behavior signals. We demonstrate the feasibility and efficacy of such models in accurately predicting query performance. Our classifier is able to achieve an average AUC of 0.75 on a held-out test set.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑