arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.02001stat.MLcs.LG
收藏

潜在重尾条件下基于CVaR-based反馈的学习

Learning with CVaR-based feedback under potentially heavy tails

Osaka University(大阪大学);CentraleSupélec(巴黎中央理工-高等电力学院)

Matthew J. Holland, El Mehdi Haress

摘要:

我们研究学习算法,寻求最小化的条件风险价值(CVaR),当所有的学习者知道的是,所发生的损失可能是重尾的。首先,我们研究了一个通用的估计CVaR潜在的重尾随机变量,这是很容易实现的,只需要有限的方差和分布函数,不改变太快或太慢,只是分位数的兴趣。有了这个估计,我们得到了一个新的学习算法,该算法在随机梯度驱动的子过程产生的候选人中进行鲁棒选择。对于这个过程中,我们提供了高概率超额CVaR的界限,并补充理论,我们进行实证测试的基础CVaR估计和学习算法从它派生。

英文摘要:

We study learning algorithms that seek to minimize the conditional value-at-risk (CVaR), when all the learner knows is that the losses incurred may be heavy-tailed. We begin by studying a general-purpose estimator of CVaR for potentially heavy-tailed random variables, which is easy to implement in practice, and requires nothing more than finite variance and a distribution function that does not change too fast or slow around just the quantile of interest. With this estimator in hand, we then derive a new learning algorithm which robustly chooses among candidates produced by stochastic gradient-driven sub-processes. For this procedure we provide high-probability excess CVaR bounds, and to complement the theory we conduct empirical tests of the underlying CVaR estimator and the learning algorithm derived from it.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑