2604.12110
2026-06-05
cs.LG
SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scaling
SOLARIS: 预测性卸载基于潜在表示的推理扩展
Zikun Liu, Liang Luo, Qianru Li, Zhengyu Zhang, Wei Ling, Jingyi Shen, Zeliang Chen, Yaning Huang, Jingxian Huang, Abdallah Aboelela, Chonglin Sun, Feifan Gu, Fenggang Wu, Hang Qu, Huayu Li, Jill Pan, Kaidi Pei, Laming Chen, Longhao Jin, Qin Huang, Tongyi Tang, Varna Puvvada, Wenlin Chen, Xiaohan Wei, Xu Cao, Yantao Yao, Yuan Jin, Yunchen Pu, Yuxin Chen, Zijian Shen, Zhengkai Zhang, Jing Zhu, Dong Liang, Ellie Wen
机构
*
Meta AI
AI总结
本文提出SOLARIS框架,通过预测未来请求中的用户-项目交互嵌入,将昂贵的基础模型推理与关键服务路径解耦,从而在大规模应用中实现实时知识转移,提升服务效率和收益。