arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.09535cond-mat.dis-nncs.LG
收藏

恢复平衡:用于最优分类的数据欠/过采样的原则性方法

Restoring balance: principled under/oversampling of data for optimal classification

Emanuele Loffredo, Mauro Pastore, Simona Cocco, Rémi Monasson

AI总结:

针对机器学习中类别不平衡导致的泛化瓶颈,本研究在高维机制下推导出线性分类器泛化曲线的精确解析表达式,并基于数据统计特性预测欠/过采样策略的效果,证明混合采样策略能提升性能且在真实数据集与深层架构上有效。

摘要:

现实世界数据中的类别不平衡是机器学习任务的常见瓶颈,因为在代表性不足的样本上实现良好的泛化通常具有挑战性。缓解策略(例如根据数据丰度对数据进行欠采样或过采样)通常被提出并经过经验性测试,但它们应如何适应数据统计特性仍然知之甚少。在本研究中,我们确定了高维机制下线性分类器(Support Vector Machines)泛化曲线的精确解析表达式。我们还根据类别不平衡、数据的一阶和二阶矩以及所考虑的性能指标,对欠/过采样策略的效果提供了敏锐的预测。我们表明,涉及数据欠采样和过采样的混合策略可带来性能提升。通过数值实验,我们展示了理论预测在真实数据集、更深架构以及基于无监督概率模型的采样策略上的相关性。

英文摘要:

Class imbalance in real-world data poses a common bottleneck for machine learning tasks, since achieving good generalization on under-represented examples is often challenging. Mitigation strategies, such as under or oversampling the data depending on their abundances, are routinely proposed and tested empirically, but how they should adapt to the data statistics remains poorly understood. In this work, we determine exact analytical expressions of the generalization curves in the high-dimensional regime for linear classifiers (Support Vector Machines). We also provide a sharp prediction of the effects of under/oversampling strategies depending on class imbalance, first and second moments of the data, and the metrics of performance considered. We show that mixed strategies involving under and oversampling of data lead to performance improvement. Through numerical experiments, we show the relevance of our theoretical predictions on real datasets, on deeper architectures and with sampling strategies based on unsupervised probabilistic models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑