arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.03025cs.IRcs.AIcs.CLcs.LG
收藏

LORE:一种大规模生成模型用于搜索相关性

LORE: A Large Generative Model for Search Relevance

Alibaba Group(阿里巴巴集团)

Chenji Lu, Zhuo Chen, Hui Zhao, Zhiyuan Zeng, Gang Zhao, Junjie Ren, Ruicong Xu, Haoran Li, Songyan Liu, Pengjie Wang, Jian Xu, Bo Zheng

AI总结:

LORE提出了一种基于大规模生成模型的搜索相关性框架,通过两阶段训练和分层部署策略提升搜索效果,为垂直领域提供方法参考。

摘要:

我们介绍了LORE,一种基于大规模生成模型的系统框架,用于电子商务搜索中的相关性。经过三年的部署和迭代,LORE在在线GoodRate指标上实现了累计+27%的提升。本报告分享了其开发生命周期中获得的宝贵经验,涵盖了数据、特征、训练、评估和部署等方面。洞察。虽然现有工作将链式思维(CoT)应用于增强相关性,但往往遇到性能瓶颈。我们认为这是因为将相关性视为单一任务,缺乏系统性的分解。我们的关键洞察是相关性包含不同的能力:知识和推理、多模态匹配以及规则遵循。我们主张,一种定性驱动的分解对于突破当前性能瓶颈至关重要。贡献。LORE提供了一个完整的LLM相关性生命周期蓝图。主要贡献包括:(1)一种结合渐进式CoT合成通过SFT与人类偏好对齐通过RL的两阶段训练范式。(2)一个全面的基准测试RAIR,用于评估这些核心能力。(3)一种按查询频率分层的部署策略,能够高效地将离线LLM能力转移到在线系统。LORE既是一种实用的解决方案,也是其他垂直领域的参考方法。

英文摘要:

Achievement. We introduce LORE, a systematic framework for Large Generative Model-based relevance in e-commerce search. Deployed and iterated over three years, LORE achieves a cumulative +27\% improvement in online GoodRate metrics. This report shares the valuable experience gained throughout its development lifecycle, spanning data, features, training, evaluation, and deployment. Insight. While existing works apply Chain-of-Thought (CoT) to enhance relevance, they often hit a performance ceiling. We argue this stems from treating relevance as a monolithic task, lacking principled deconstruction. Our key insight is that relevance comprises distinct capabilities: knowledge and reasoning, multi-modal matching, and rule adherence. We contend that a qualitative-driven decomposition is essential for breaking through current performance bottlenecks. Contributions. LORE provides a complete blueprint for the LLM relevance lifecycle. Key contributions include: (1) A two-stage training paradigm combining progressive CoT synthesis via SFT with human preference alignment via RL. (2) A comprehensive benchmark, RAIR, designed to evaluate these core capabilities. (3) A query frequency-stratified deployment strategy that efficiently transfers offline LLM capabilities to the online system. LORE serves as both a practical solution and a methodological reference for other vertical domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑