CAST: Non-Privileged Clipped Asymmetric Self-Teaching with Advantage Flipping for GRPO
CAST:用于GRPO的非特权裁剪非对称自教学与优势翻转
机构 * School of Software and Microelectronics, Peking University, Beijing(北京大学软件与微电子学院) ; School of Artificial Intelligence, Peking University, Beijing(北京大学人工智能学院) ; School of Computer Science, Peking University, Beijing(北京大学计算机科学学院) ; School of Future Technology, Peking University, Beijing(北京大学未来技术学院)
专题命中 数学推理 :reasoning(abstract);verifier(abstract);分类 cs.AI
AI总结 提出CAST方法,通过无答案的自教师模型和双向局部优势符号翻转,解决GRPO中奖励稀疏和组相对优势消失的问题,提升数学推理性能。
Comments 10 pages