Exact Risk Curves of signSGD in High-Dimensions: Quantifying Preconditioning and Noise-Compression Effects
高维空间中signSGD的精确风险曲线:量化预条件和噪声压缩效应
Ke Liang Xiao, Noah Marshall, Atish Agarwala, Elliot Paquette
机构
*
Department of Mathematics and Statistics, McGill University, Montreal, Canada(数学与统计学系,麦吉尔大学,蒙特利尔,加拿大)
;
Department of Mathematics(数学系)
;
Statistics, McGill University, Montreal, Canada(统计学,麦吉尔大学,蒙特利尔,加拿大)
;
Google Deepmind, Mountain View, United States of America(DeepMind,谷歌,山景城,美国)