On the Adaptivity of Stochastic Gradient-Based Optimization
Comments Accepted by SIAM Journal on Optimization; 54 pages
作者
Machine Learning
Comments Accepted by SIAM Journal on Optimization; 54 pages
Comments Fixed typographical errors in Theorem 1.2, Lemmas 4.3 and C.8
Comments ICML 2020, code available at https://github.com/dongyin92/noise_covariance
Comments To appear in SIAM Journal on Optimization. v1 -> v2: minor edits + added funding acknowledgements, v2 -> v3: revised presentation, upon journal revision
Comments To appear at 34th Conference on Neural Information Processing Systems (NeurIPS 2020); first two authors contributed equally to this work
Comments NeurIPS 2020
Journal ref Advances in Neural Information Processing Systems 2020
Comments Published at the REVEAL 2020 workshop (RecSys 2020)
Comments 6 Pages. Accepted by ACC 2020
Comments 36 pages, 16 figures
Comments This paper has been published at ICML2020. This new version made a correction to Proposition 19, and added more related works
Comments 13 pages
Comments 15 pages, 3 figures. A version appears in the Proceedings of The 23nd International Conference on Artificial Intelligence and Statistics (AISTATS), 2020
Comments 78 pages, 2 figures
Comments 29 pages
Comments 18 pages, 35 figures
Comments Substantial text overlap with arXiv:1710.02903. This manuscript focuses on the LR fluctuations and the detection problem. The result is strengthened and the proof (execution of the interpolation and cavity methods) substantially simplified. Reflects more accurately the version to be published
Journal ref Ann. Statist., Volume 48, Number 2 (2020), 863-885
Comments Changes from v1: improved algorithm with $O (d^{1/4} / \varepsilon^{1/2})$ mixing time