arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2111.03306stat.MEstat.ML
收藏

基于数据分裂的高维不平衡分类硬阈值规则

New Hard-thresholding Rules based on Data Splitting in High-dimensional Imbalanced Classification

Arezou Mojiri, Abbas Khalili, Ali Zeinal Hamadani

摘要:

在二元分类中,不平衡是指一类严重代表性不足的情况。这个问题是由于数据收集过程或因为一个类确实是罕见的人口。不平衡分类经常出现在生物学、医学、工程学和社会科学等应用中。在本文中,我们首次从理论上研究了不平衡的类大小对线性判别分析(LDA)的高维影响。我们发现,由于数据稀缺的一类,被称为少数类,和高维的特征空间,LDA忽略少数类产生最大的错误分类率。然后,我们提出了一个新的建设的硬阈值规则的基础上的数据分裂技术,减少了大的差异之间的错误分类率。我们证明了该方法是渐近最优的。我们进一步研究了两个著名的稀疏版本的LDA在不平衡的情况下。我们评估有限样本的性能不同的方法,使用模拟和分析两个真实的数据集。结果表明,我们的方法要么优于其竞争对手,要么具有相当的性能,基于一个小得多的子集的选定功能,同时计算效率更高。

英文摘要:

In binary classification, imbalance refers to situations in which one class is heavily under-represented. This issue is due to either a data collection process or because one class is indeed rare in a population. Imbalanced classification frequently arises in applications such as biology, medicine, engineering, and social sciences. In this paper, for the first time, we theoretically study the impact of imbalance class sizes on the linear discriminant analysis (LDA) in high dimensions. We show that due to data scarcity in one class, referred to as the minority class, and high-dimensionality of the feature space, the LDA ignores the minority class yielding a maximum misclassification rate. We then propose a new construction of hard-thresholding rules based on a data splitting technique that reduces the large difference between the misclassification rates. We show that the proposed method is asymptotically optimal. We further study two well-known sparse versions of the LDA in imbalanced cases. We evaluate the finite-sample performance of different methods using simulations and by analyzing two real data sets. The results show that our method either outperforms its competitors or has comparable performance based on a much smaller subset of selected features, while being computationally more efficient.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑