基于熵的离散化与样本量交互作用的实证研究
The Interaction of Entropy-Based Discretization and Sample Size: An Empirical Study
摘要:
样本量和离散化的相互作用的实证调查-在这种情况下,基于熵的方法CAIM(类属性相互依赖最大化)-进行了评估的影响和潜在的偏见引入到数据挖掘性能指标,由于样本量的变化,因为它影响离散化过程。特别令人感兴趣的是交叉验证折叠内的离散化反对外部离散化折叠的效果。以前的出版物表明,离散外部可以偏见的性能结果,但是,彻底审查的文献发现没有实证证据支持这样的说法。这项调查涉及在UCI(加州大学欧文分校)机器学习库的七个不同数据集上构建超过117,000个模型,以及跨各种样本量和离散化配置的多种建模方法,每个独特的“设置”独立重复十次。分析显示,随着样本量的减少和离散化,存在显著的乐观偏倚。该研究还表明,产生这种偏差的相互作用与预测属性的数量和类型之间可能存在关系,将“维数灾难”概念从特征选择扩展到离散化领域。进一步探索的方向,以及根据这些结果的离散化的适当应用的一些一般准则。
英文摘要:
An empirical investigation of the interaction of sample size and discretization - in this case the entropy-based method CAIM (Class-Attribute Interdependence Maximization) - was undertaken to evaluate the impact and potential bias introduced into data mining performance metrics due to variation in sample size as it impacts the discretization process. Of particular interest was the effect of discretizing within cross-validation folds averse to outside discretization folds. Previous publications have suggested that discretizing externally can bias performance results; however, a thorough review of the literature found no empirical evidence to support such an assertion. This investigation involved construction of over 117,000 models on seven distinct datasets from the UCI (University of California-Irvine) Machine Learning Library and multiple modeling methods across a variety of configurations of sample size and discretization, with each unique "setup" being independently replicated ten times. The analysis revealed a significant optimistic bias as sample sizes decreased and discretization was employed. The study also revealed that there may be a relationship between the interaction that produces such bias and the numbers and types of predictor attributes, extending the "curse of dimensionality" concept from feature selection into the discretization realm. Directions for further exploration are laid out, as well some general guidelines about the proper application of discretization in light of these results.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。