让代理引导:通过影响交换实现闭环排名优化
Let the Agent Steer: Closed-Loop Ranking Optimization via Influence Exchange
AI总结:
本文提出Sortify,首个自主LLM驱动的排名优化代理,通过影响交换闭环实现从诊断到参数部署的自动化优化,解决了结构问题并提升了GMV和广告收入。
摘要:
推荐排序本质上是一个影响力分配问题:排序公式在竞争因素间分配排名影响力,而业务成果取决于找到其中的最优'交换率'。然而,离线代理指标系统性地误判了影响力再分配如何转化为在线影响,存在跨指标的不对称偏差,单一校准因子无法纠正。我们提出Sortify,首个完全自主的LLM驱动排名优化代理,已在大规模生产推荐系统中部署。该代理将排名优化重新框架为连续影响力交换,闭环从诊断到参数部署,无需人工干预。它通过三种机制解决结构性问题:(1)基于Savage主观期望效用(SEU)的双通道框架,将离线-在线转移校正(信念通道)与约束惩罚调整(偏好通道)解耦;(2)一个基于框架级参数而非低级搜索变量的LLM元控制器;(3)一个具有7个关系表的持久内存数据库用于跨轮次学习。其核心指标,影响力份额,提供了一个可分解的度量,所有因素的贡献总和恰好为100%。Sortify已在两个市场部署。在国家A,代理在7轮内将GMV从-3.6%提升至+9.2%,峰值订单达到+12.5%。在国家B,冷启动部署在7天A/B测试中实现+4.15% GMV/UU和+3.58%广告收入,最终实现全生产部署。
英文摘要:
Recommendation ranking is fundamentally an influence allocation problem: a sorting formula distributes ranking influence among competing factors, and the business outcome depends on finding the optimal "exchange rates" among them. However, offline proxy metrics systematically misjudge how influence reallocation translates to online impact, with asymmetric bias across metrics that a single calibration factor cannot correct. We present Sortify, the first fully autonomous LLM-driven ranking optimization agent deployed in a large-scale production recommendation system. The agent reframes ranking optimization as continuous influence exchange, closing the full loop from diagnosis to parameter deployment without human intervention. It addresses structural problems through three mechanisms: (1) a dual-channel framework grounded in Savage's Subjective Expected Utility (SEU) that decouples offline-online transfer correction (Belief channel) from constraint penalty adjustment (Preference channel); (2) an LLM meta-controller operating on framework-level parameters rather than low-level search variables; (3) a persistent Memory DB with 7 relational tables for cross-round learning. Its core metric, Influence Share, provides a decomposable measure where all factor contributions sum to exactly 100%. Sortify has been deployed across two markets. In Country A, the agent pushed GMV from -3.6% to +9.2% within 7 rounds with peak orders reaching +12.5%. In Country B, a cold-start deployment achieved +4.15% GMV/UU and +3.58% Ads Revenue in a 7-day A/B test, leading to full production rollout.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。