Why GRPO Needs Normalization: A Local-Curvature Perspective on Adaptive Gradients
为何GRPO需要规范化:从局部曲率角度探讨自适应梯度
机构 * Department of Aeronautics and Astronautics, MIT(麻省理工学院航空与宇航系) ; Department of Statistics, University of Wisconsin--Madison(威斯康星大学麦迪逊分校统计系) ; Department of Informatics, King's College London(伦敦国王学院信息学系) ; Department of Computer Sciences, University of Wisconsin--Madison(威斯康星大学麦迪逊分校计算机科学系)
AI总结 GRPO中标准差规范化通过局部曲率视角解释了其自适应梯度机制,理论和实验表明规范化能提升收敛速度并优化训练阶段表现。