arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1609.09471cs.LGstat.ML
收藏

使用精度进行分类器比较

Classifier comparison using precision

Simon Fraser University(西蒙菲莎大学)

Lovedeep Gondara

摘要:

新提出的模型通常使用统计显著性检验与最先进的模型进行比较。文献是稀缺的分类器比较使用的指标,而不是准确性。我们提出了一个调查的统计方法,可用于分类器比较使用精度,占精度间的相关性所产生的使用相同的数据集。使用每类精度和方法进行比较,以测试整体模型比较的全局零假设。比较扩展到多个多类分类器和使用交叉验证或其变体的模型。当一类人群患病率已知时,引入部分贝叶斯精度更新。比较深的架构的应用程序进行了研究。

英文摘要:

New proposed models are often compared to state-of-the-art using statistical significance testing. Literature is scarce for classifier comparison using metrics other than accuracy. We present a survey of statistical methods that can be used for classifier comparison using precision, accounting for inter-precision correlation arising from use of same dataset. Comparisons are made using per-class precision and methods presented to test global null hypothesis of an overall model comparison. Comparisons are extended to multiple multi-class classifiers and to models using cross validation or its variants. Partial Bayesian update to precision is introduced when population prevalence of a class is known. Applications to compare deep architectures are studied.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑