arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.07889stat.MLcs.LGstat.ME
收藏

通过随机优势比较两个样本:一种图形方法

Comparing Two Samples Through Stochastic Dominance: A Graphical Approach

BCAM - Basque Center for Applied Mathematics(BCAM - 巴斯克应用数学中心);University of the Basque Country UPV/EHU(巴斯克大学 UPV/EHU);Télécom Paris(巴黎电信学院)

Etor Arza, Josu Ceberio, Ekhiñe Irurozki, Aritz Pérez

摘要:

不确定性测量在现实世界中很常见:随机最优化算法的性能或强化学习代理在混沌环境中的总回报只是不可预测结果常见的两个例子。这些测量可以被建模为随机变量,并通过其期望值或更复杂的工具(如原假设统计检验)相互比较。在本文中,我们提出了一种替代框架,根据估计的累积分布函数来直观地比较两个样本。首先,我们引入了一个优势措施,两个随机变量,量化的比例,其中累积分布函数的随机变量的随机优势占主导地位的另一个。然后,我们提出了一个图形的方法,分解分位数i)建议的优势措施和ii)的概率,其中一个随机变量采取较低的值比其他。为了说明的目的,我们重新评估了已经发表的工作与建议的方法的实验,我们表明,其他结论(错过了其余的方法)可以推断。此外,创建了软件包RVCompare,作为应用和试验所提出的框架的方便方法。

英文摘要:

Non-deterministic measurements are common in real-world scenarios: the performance of a stochastic optimization algorithm or the total reward of a reinforcement learning agent in a chaotic environment are just two examples in which unpredictable outcomes are common. These measures can be modeled as random variables and compared among each other via their expected values or more sophisticated tools such as null hypothesis statistical tests. In this paper, we propose an alternative framework to visually compare two samples according to their estimated cumulative distribution functions. First, we introduce a dominance measure for two random variables that quantifies the proportion in which the cumulative distribution function of one of the random variables stochastically dominates the other one. Then, we present a graphical method that decomposes in quantiles i) the proposed dominance measure and ii) the probability that one of the random variables takes lower values than the other. With illustrative purposes, we re-evaluate the experimentation of an already published work with the proposed methodology and we show that additional conclusions (missed by the rest of the methods) can be inferred. Additionally, the software package RVCompare was created as a convenient way of applying and experimenting with the proposed framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑