arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1602.02442stat.MLcs.LG
收藏

一种简单实用的有限和加速算法

A Simple Practical Accelerated Method for Finite Sums

Ambiata

Aaron Defazio

摘要:

我们描述了一种新的优化方法,有限和(如经验风险最小化问题)的基础上最近推出的SAGA方法。我们的方法实现了加速收敛速度强凸光滑问题。我们的方法只有一个参数(步长),是从根本上简单比其他有限和的加速方法。此外,它可以应用于当条款是非光滑的,产生一个方法适用于许多领域,算子分裂方法将传统上应用。

英文摘要:

We describe a novel optimization method for finite sums (such as empirical risk minimization problems) building on the recently introduced SAGA method. Our method achieves an accelerated convergence rate on strongly convex smooth problems. Our method has only one parameter (a step size), and is radically simpler than other accelerated methods for finite sums. Additionally it can be applied when the terms are non-smooth, yielding a method applicable in many areas where operator splitting methods would traditionally be applied.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑