arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.11632cs.IR
收藏

Facebook搜索中基于嵌入的检索

Embedding-based Retrieval in Facebook Search

Jui-Ting Huang, Ashish Sharma, Shuying Sun, Li Xia, David Zhang, Philip Pronin, Janani Padmanabhan, Giuseppe Ottaviano, Linjun Yang

摘要:

在诸如Facebook的社交网络中进行搜索与在传统网络搜索中进行搜索相比提出了不同的挑战:除了查询文本之外,重要的是要考虑查询者的上下文以提供相关的结果。他们的社交图谱是这一背景的一个组成部分,也是Facebook搜索的一个独特方面。虽然基于嵌入的检索(EBR)已经在eb搜索引擎中应用多年,但Facebook搜索仍然主要基于布尔匹配模型。在本文中,我们讨论了将EBR应用于Facebook搜索系统的技术。我们介绍了统一的嵌入框架开发的个性化搜索的语义嵌入模型,并在一个典型的搜索系统的基础上,一个倒排索引的系统,以服务于基于嵌入的检索。我们讨论了整个系统端到端优化的各种技巧和经验,包括ANN参数调整和全栈优化。最后,我们提出了我们的进展,在两个选定的高级主题建模。我们评估了Facebook搜索垂直领域的EBR,在在线A/B实验中观察到了显著的指标收益。我们相信,本文将提供有益的见解和经验,以帮助人们开发嵌入式检索系统的搜索引擎。

英文摘要:

Search in social networks such as Facebook poses different challenges than in classical web search: besides the query text, it is important to take into account the searcher's context to provide relevant results. Their social graph is an integral part of this context and is a unique aspect of Facebook search. While embedding-based retrieval (EBR) has been applied in eb search engines for years, Facebook search was still mainly based on a Boolean matching model. In this paper, we discuss the techniques for applying EBR to a Facebook Search system. We introduce the unified embedding framework developed to model semantic embeddings for personalized search, and the system to serve embedding-based retrieval in a typical search system based on an inverted index. We discuss various tricks and experiences on end-to-end optimization of the whole system, including ANN parameter tuning and full-stack optimization. Finally, we present our progress on two selected advanced topics about modeling. We evaluated EBR on verticals for Facebook Search with significant metrics gains observed in online A/B experiments. We believe this paper will provide useful insights and experiences to help people on developing embedding-based retrieval systems in search engines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑