arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1909.09816cs.LGcs.CVstat.ML
收藏

使用理论ROC曲线分析机器学习二进制分类器

Using theoretical ROC curves for analysing machine learning binary classifiers

Durham University(杜伦大学)

Luma Omar, Ioannis Ivrissimtzis

摘要:

大多数二进制分类器的工作原理是处理输入以产生标量响应并将其与阈值进行比较。分类器性能的各种度量明确地或隐含地假设属于任一类别的响应的概率分布$P_s$和$P_n$、每种类型的误分类的成本的概率分布,并且从预期成本计算性能分数。在机器学习中,分类器响应是通过实验获得的,性能分数是直接从它们中计算出来的,对$P_s$和$P_n$没有任何假设。在这里,我们认为,省略的步骤估计理论分布的$P_s$和$P_n$可能是有用的。在一个生物识别安全的例子中,我们将beta分布拟合到两个分类器的响应中,一个基于逻辑回归,一个基于ANN,并使用它们来建立一个分类,将其分类为在ROC曲线末端具有不同极端行为的少量类别。

英文摘要:

Most binary classifiers work by processing the input to produce a scalar response and comparing it to a threshold value. The various measures of classifier performance assume, explicitly or implicitly, probability distributions $P_s$ and $P_n$ of the response belonging to either class, probability distributions for the cost of each type of misclassification, and compute a performance score from the expected cost. In machine learning, classifier responses are obtained experimentally and performance scores are computed directly from them, without any assumptions on $P_s$ and $P_n$. Here, we argue that the omitted step of estimating theoretical distributions for $P_s$ and $P_n$ can be useful. In a biometric security example, we fit beta distributions to the responses of two classifiers, one based on logistic regression and one on ANNs, and use them to establish a categorisation into a small number of classes with different extremal behaviours at the ends of the ROC curves.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑