arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2207.04258cs.LGcs.AIcs.DC
收藏

一种新的有监督特征排序算法评价方法

A novel evaluation methodology for supervised Feature Ranking algorithms

University of Groningen(格罗宁根大学)

Jeroen G. S. Overschie

摘要:

在特征选择和可解释的人工智能领域中,都存在基于特征的重要性对其进行“排名”的愿望。这样的特征重要性排名可以用于:(1)减少数据集大小或(2)解释机器学习模型。然而,在文献中,这些特征排名并没有以系统、一致的方式进行评估。许多论文用不同的方式来讨论哪个特征重要性排名器最有效。本文填补了这一空白,提出了一种新的评价方法。通过使用合成数据集,可以预先知道特征重要性分数,从而允许更系统的评估。为了便于使用新方法进行大规模实验,在Python中构建了一个基准测试框架,称为fseval。该框架允许在HPC系统上并行运行和分布在机器上的实验。通过与名为Weights and Biases的在线平台集成,可以在实时仪表板上交互式地探索图表。该软件作为开源软件发布,并作为PyPi平台上的软件包发布。研究的结论是探索这样一个大规模的实验,以找到参与算法的优势和劣势,在许多方面。

英文摘要:

Both in the domains of Feature Selection and Interpretable AI, there exists a desire to `rank' features based on their importance. Such feature importance rankings can then be used to either: (1) reduce the dataset size or (2) interpret the Machine Learning model. In the literature, however, such Feature Rankers are not evaluated in a systematic, consistent way. Many papers have a different way of arguing which feature importance ranker works best. This paper fills this gap, by proposing a new evaluation methodology. By making use of synthetic datasets, feature importance scores can be known beforehand, allowing more systematic evaluation. To facilitate large-scale experimentation using the new methodology, a benchmarking framework was built in Python, called fseval. The framework allows running experiments in parallel and distributed over machines on HPC systems. By integrating with an online platform called Weights and Biases, charts can be interactively explored on a live dashboard. The software was released as open-source software, and is published as a package on the PyPi platform. The research concludes by exploring one such large-scale experiment, to find the strengths and weaknesses of the participating algorithms, on many fronts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑