Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
基于耦合的收敛诊断与步长方案用于随机梯度下降
AI总结 本文研究了固定步长下随机梯度下降的收敛诊断,提出一种基于耦合的动态步长方案,通过监测耦合迭代距离检测平稳性,实现更高效的收敛性能。
Comments 13 pages, 30 figures, to be published in AAAI 2025
Journal ref Proceedings of the AAAI Conference on Artificial Intelligence, 39(17):18494-18501, 2025