Efficient Training-Free Multi-Token Prediction via Embedding-Space Probing
通过嵌入空间探测的高效无训练多令牌预测
机构 * Qualcomm AI Research(高通人工智能研究)
AI总结 提出ESP方法,利用嵌入空间中的掩码令牌进行无训练的多令牌预测,通过并行验证和轻量剪枝实现无损解码,提升吞吐量。
Comments v2: Accepted at ICML 2026. Updated experiments replaced tok/s with speedup ratio over AR baseline; improved exposition in Section 3.1 (mask token initialization) and Section 4 (ablations)