arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.01956cs.ITmath.IT
收藏

基于似然比观测值的最优受试者工作特征曲线的最大似然估计

Maximum Likelihood Estimation of Optimal Receiver Operating Characteristic Curves from Likelihood Ratio Observations

Bruce Hajek, Xiaohan Kang

AI总结:

针对仅能观测似然比独立样本的二元假设检验问题,本文提出最优ROC曲线的最大似然估计量,证明其Lévy度量下的几乎必然收敛性与AUC一致性,并给出优于经验估计量的有限样本界和仿真结果。

摘要:

最优受试者工作特征(ROC)曲线给出作为虚警概率函数的最大检测概率,是二元假设检验问题(BHT)难度的关键信息论指标。众所周知,给定BHT的最优ROC曲线对应于似然比检验,由两种假设下观测数据的概率分布所决定。在某些情况下,这两个分布可能未知或在计算上难以处理,但可以观测到似然比的独立样本。这就引出了从此类样本估计BHT最优ROC的问题。本文推导了最优ROC曲线的最大似然估计量,并证明当观测次数趋于无穷大时,该估计量在Lévy度量下几乎必然收敛于真实最优ROC曲线。本文还得到了另外三种估计量的有限样本量界:经典经验估计量(基于从两组独立样本中估计两类错误概率),以及最大似然估计量的两种变体,分别称为分裂估计量和融合估计量。仿真实验表明,最大似然估计量比经验估计量精确得多,尤其是当在两种假设之一之下获得的样本数较少时。本文推导了最大似然估计量的曲线下面积;它是真实最优ROC曲线下面积的一致估计量。

英文摘要:

The optimal receiver operating characteristic (ROC) curve, giving the maximum probability of detection as a function of the probability of false alarm, is a key information-theoretic indicator of the difficulty of a binary hypothesis testing problem (BHT). It is well known that the optimal ROC curve for a given BHT, corresponding to the likelihood ratio test, is determined by the probability distribution of the observed data under each of the two hypotheses. In some cases, these two distributions may be unknown or computationally intractable, but independent samples of the likelihood ratio can be observed. This raises the problem of estimating the optimal ROC for a BHT from such samples. The maximum likelihood estimator of the optimal ROC curve is derived, and it is shown to converge almost surely to the true optimal ROC curve in the \levy\ metric, as the number of observations tends to infinity. Finite sample size bounds are obtained for three other estimators: the classical empirical estimator, based on estimating the two types of error probabilities from two separate sets of samples, and two variations of the maximum likelihood estimator called the split estimator and fused estimator, respectively. The maximum likelihood estimator is observed in simulation experiments to be considerably more accurate than the empirical estimator, especially when the number of samples obtained under one of the two hypotheses is small. The area under the maximum likelihood estimator is derived; it is a consistent estimator of the area under the true optimal ROC curve.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑