arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.07309cs.IRcs.AIcs.LG
收藏

LinkedIn 的语义搜索

Semantic Search At LinkedIn

LinkedIn(领英)
Fedor Borisyuk, Sriram Vasudevan, Muchen Wu, Guoyao Li, Benjamin Le, Shaobo Zhang, Qianqi Kay Shen, Yuchin Juan, Kayhan Behdin, Liming Dong, Kaixu Yang, Shusen … 展开作者

Fedor Borisyuk, Sriram Vasudevan, Muchen Wu, Guoyao Li, Benjamin Le, Shaobo Zhang, Qianqi Kay Shen, Yuchin Juan, Kayhan Behdin, Liming Dong, Kaixu Yang, Shusen Jing, Ravi Pothamsetty, Rajat Arora, Sophie Yanying Sheng, Vitaly Abdrashitov, Yang Zhao, Lin Su, Xiaoqing Wang, Chujie Zheng, Sarang Metkar, Rupesh Gupta, Igor Lapchuk, David N. Racca, Madhumitha Mohan, Yanbo Li, Haojun Li, Saloni Gandhi, Xueying Lu, Chetan Bhole, Ali Hooshmand, Xin Yang, Raghavan Muthuregunathan, Jiajun Zhang, Mathew Teoh, Adam Coler, Abhinav Gupta, Xiaojing Ma, Sundara Raman Ramachandran, Morteza Ramezani, Yubo Wang, Lijuan Zhang, Richard Li, Jian Sheng, Chanh Nguyen, Yen-Chi Chen, Chuanrui Zhu, Claire Zhang, Jiahao Xu, Deepti Kulkarni, Qing Lan, Arvind Subramaniam, Ata Fatahibaarzi, Steven Shimizu, Yanning Chen, Zhipeng Wang, Ran He, Zhengze Zhou, Qingquan Song, Yun Dai, Caleb Johnson, Ping Liu, Shaghayegh Gharghabi, Gokulraj Mohanasundaram, Juan Bottaro, Santhosh Sachindran, Qi Guo, Yunxiang Ren, Chengming Jiang, Di Mo, Luke Simon, Jianqiang Shen, Jingwei Wu, Wenjing Zhang

AI总结:

LinkedIn推出基于大语言模型的语义搜索框架,通过优化相关性和参与度,在保持效率的同时提升检索质量和用户参与度。

摘要:

基于大语言模型(LLMs)的语义搜索通过意义而非关键词重叠来实现检索,但将其扩展需要重大推理效率的提升。我们提出了LinkedIn用于人工智能职位搜索和人工智能人员搜索的LLM基于语义搜索框架,结合了LLM相关性判断、基于嵌入的检索以及通过多教师蒸馏训练的紧凑小型语言模型,共同优化相关性和参与度。一种面向预填充的推理架构与模型剪枝、上下文压缩和文本嵌入混合交互共同设计,使在固定延迟约束下排名吞吐量提高超过75倍,同时保持接近教师水平的NDCG,使成为首个具有与传统方法相当效率的LLM基于排名系统之一,并在质量和用户参与度上带来显著提升。

英文摘要:

Semantic search with large language models (LLMs) enables retrieval by meaning rather than keyword overlap, but scaling it requires major inference efficiency advances. We present LinkedIn's LLM-based semantic search framework for AI Job Search and AI People Search, combining an LLM relevance judge, embedding-based retrieval, and a compact Small Language Model trained via multi-teacher distillation to jointly optimize relevance and engagement. A prefill-oriented inference architecture co-designed with model pruning, context compression, and text-embedding hybrid interactions boosts ranking throughput by over 75x under a fixed latency constraint while preserving near-teacher-level NDCG, enabling one of the first production LLM-based ranking systems with efficiency comparable to traditional approaches and delivering significant gains in quality and user engagement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑