arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.08528cs.LG
收藏

给SMOTE,还是不给SMOTE?

To SMOTE, or not to SMOTE?

Amazon(亚马逊);Cornell University(康奈尔大学)

Yotam Elor, Hadar Averbuch-Elor

摘要:

在训练分类器之前平衡数据是解决表格数据中不平衡二进制分类挑战的流行技术。平衡通常通过复制少数样品或通过生成合成少数样品来实现。虽然众所周知,平衡对每个分类器的影响不同,但大多数先前的实证研究并不包括强大的最先进的(SOTA)分类器作为基线。在这项工作中,我们有兴趣了解平衡是否有益,特别是在SOTA分类器的上下文中。因此,我们进行了广泛的实验,考虑三个SOTA分类器沿较弱的学习者在以前的调查。此外,我们仔细辨别适当的指标,一致和不一致的算法和超参数选择方法,并表明这些对预测质量和平衡的有效性有显着的影响。我们的研究结果支持弱分类器平衡的已知效用。然而,我们发现,平衡并没有提高预测性能的强。我们进一步确定了其他几种情况下,平衡是有效的,并观察到以前的研究表明,侧重于这些设置的平衡的效用。

英文摘要:

Balancing the data before training a classifier is a popular technique to address the challenges of imbalanced binary classification in tabular data. Balancing is commonly achieved by duplication of minority samples or by generation of synthetic minority samples. While it is well known that balancing affects each classifier differently, most prior empirical studies did not include strong state-of-the-art (SOTA) classifiers as baselines. In this work, we are interested in understanding whether balancing is beneficial, particularly in the context of SOTA classifiers. Thus, we conduct extensive experiments considering three SOTA classifiers along the weaker learners used in previous investigations. Additionally, we carefully discern proper metrics, consistent and non-consistent algorithms and hyper-parameter selection methods and show that these have a significant impact on prediction quality and on the effectiveness of balancing. Our results support the known utility of balancing for weak classifiers. However, we find that balancing does not improve prediction performance for the strong ones. We further identify several other scenarios for which balancing is effective and observe that prior studies demonstrated the utility of balancing by focusing on these settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑