Radial Suppression Accelerates Algorithmic Generalization: A Geometric Analysis of Delayed Generalization
径向抑制加速算法泛化:延迟泛化的几何分析
机构 * Indian Institute of Technology Roorkee(印度理工学院罗尔基分校)
AI总结 通过几何分析揭示交叉熵优化下隐藏表示的径向膨胀导致记忆-泛化延迟,提出径向惩罚加速泛化,在模算术和加法任务上实现最高6倍加速。
Comments 16 pages, 5 figures, 10 tables. Presented at the Workshop on High-dimensional Learning Dynamics at the 43rd International Conference on Machine Learning (ICML 2026)