arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.04668cs.LGcs.AI
收藏

相关特征空间中的动态实例分类

Dynamic Instance-Wise Classification in Correlated Feature Spaces

University at Albany, SUNY(纽约州立大学奥尔巴尼分校)

Yasitha Warahena Liyanage, Daphney-Stavroula Zois, Charalampos Chelmis

摘要:

在典型的监督机器学习设置中,对所有测试实例的预测都基于在模型训练期间发现的特征的公共子集。然而,单独使用每个测试实例信息量最大的不同特征子集不仅可以提高预测准确性,还可以提高模型的整体可解释性。同时,当许多特征不相关和/或不相关时,已知用于分类的特征选择方法是最有效的。事实上,忽略特征之间的相关性的特征选择会导致较差的分类性能。在这项工作中,贝叶斯网络被用来建模功能的依赖关系。使用依赖网络,提出了一种新的方法,顺序地选择最好的功能来评估每个测试实例,并停止选择过程中作出预测,一旦它确定没有进一步的改进,可以实现相对于分类精度。每个测试实例的最佳数量的功能来获取和最佳的分类策略。分析了最优解的理论性质,并提出了一种新的算法,利用这些性质实现了高维环境下的鲁棒性和可扩展性。所提出的方法的有效性,通用性和可扩展性说明了各种现实世界的数据集,从不同的应用领域。

英文摘要:

In a typical supervised machine learning setting, the predictions on all test instances are based on a common subset of features discovered during model training. However, using a different subset of features that is most informative for each test instance individually may not only improve prediction accuracy, but also the overall interpretability of the model. At the same time, feature selection methods for classification have been known to be the most effective when many features are irrelevant and/or uncorrelated. In fact, feature selection ignoring correlations between features can lead to poor classification performance. In this work, a Bayesian network is utilized to model feature dependencies. Using the dependency network, a new method is proposed that sequentially selects the best feature to evaluate for each test instance individually, and stops the selection process to make a prediction once it determines that no further improvement can be achieved with respect to classification accuracy. The optimum number of features to acquire and the optimum classification strategy are derived for each test instance. The theoretical properties of the optimum solution are analyzed, and a new algorithm is proposed that takes advantage of these properties to implement a robust and scalable solution for high dimensional settings. The effectiveness, generalizability, and scalability of the proposed method is illustrated on a variety of real-world datasets from diverse application domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑