arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.03318cs.LGmath.STstat.MEstat.MLstat.TH
收藏

二进制分类的最优输入无关基线:荷兰抽签

The Optimal Input-Independent Baseline for Binary Classification: The Dutch Draw

Centrum Wiskunde & Informatica(数学与计算机科学研究中心);Vrije Universiteit(阿姆斯特丹自由大学)

Joris Pries, Etienne van de Bijl, Jan Klein, Sandjai Bhulai, Rob van der Mei

摘要:

在将任何二元分类模型付诸实践之前,重要的是在适当的测试集上验证其性能。如果没有基准方法提供的参照系,就不可能确定一个分数是“好”还是“坏”。本文的目标是检查所有的基线方法,是独立的特征值,并确定哪个模型是“最好的”,为什么。通过确定哪些基线模型是最佳的,简化了评估过程中的关键选择决策。我们证明,最近提出的荷兰画基线是最好的输入无关分类器(独立的特征值)的所有位置不变的措施(独立的序列顺序)假设样本随机洗牌。这意味着荷兰式抽签基线是这些直观要求下的最佳基线,因此应在实践中使用。

英文摘要:

Before any binary classification model is taken into practice, it is important to validate its performance on a proper test set. Without a frame of reference given by a baseline method, it is impossible to determine if a score is `good' or `bad'. The goal of this paper is to examine all baseline methods that are independent of feature values and determine which model is the `best' and why. By identifying which baseline models are optimal, a crucial selection decision in the evaluation process is simplified. We prove that the recently proposed Dutch Draw baseline is the best input-independent classifier (independent of feature values) for all positional-invariant measures (independent of sequence order) assuming that the samples are randomly shuffled. This means that the Dutch Draw baseline is the optimal baseline under these intuitive requirements and should therefore be used in practice.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑