arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.08601cs.LGcs.ROstat.ML

CoNES: Convex Natural Evolutionary Strategies

Princeton University(普林斯顿大学)

Sushant Veer, Anirudha Majumdar

英文摘要:

We present a novel algorithm -- convex natural evolutionary strategies (CoNES) -- for optimizing high-dimensional blackbox functions by leveraging tools from convex optimization and information geometry. CoNES is formulated as an efficiently-solvable convex program that adapts the evolutionary strategies (ES) gradient estimate to promote rapid convergence. The resulting algorithm is invariant to the parameterization of the belief distribution. Our numerical results demonstrate that CoNES vastly outperforms conventional blackbox optimization methods on a suite of functions used for benchmarking blackbox optimizers. Furthermore, CoNES demonstrates the ability to converge faster than conventional blackbox methods on a selection of OpenAI's MuJoCo reinforcement learning tasks for locomotion.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑