通过量子、混沌与Lasso改进基于差分进化的特征选择
Improved Differential Evolution based Feature Selection through Quantum, Chaos, and Lasso
AI总结:
针对高维任务中深度学习牺牲可解释性的问题,提出用混沌变量替代量子启发式差分进化中的随机变量,结合Lasso剪枝和岛屿集群并行化,提升医学特征选择性能。
摘要:
现代深度学习在种类惊人的各类高维任务上持续取得出色性能。在实践中,这种性能是通过将深度神经模型拟合到所有输入数据、仅进行极少特征工程而获得的,因此在很多情况下牺牲了可解释性。但在医学等可解释性至关重要的应用场景中,特征子集选择成为重要问题。二元差分进化等元启发式算法是常用的特征选择方法,相关研究文献不断引入新思路(例如源自量子计算和混沌理论的思路)对其进行改进。本文证明,在量子启发式元启发式算法中,用基于李雅普诺夫时间生成的混沌变量替代随机变量,可显著提升其在高维医学分类任务上的性能,且效果优于其他方法。我们在多种底层量子启发式元启发式算法上验证了这一混沌带来的提升,证明该现象具有普遍性。通过Lasso辅助的特征剪枝可进一步提升性能。在实现层面,我们通过一种可扩展的基于岛屿的计算集群并行化技术,大幅提升了算法的运行速度。
英文摘要:
Modern deep learning continues to achieve outstanding performance on an astounding variety of high-dimensional tasks. In practice, this is obtained by fitting deep neural models to all the input data with minimal feature engineering, thus sacrificing interpretability in many cases. However, in applications such as medicine, where interpretability is crucial, feature subset selection becomes an important problem. Metaheuristics such as Binary Differential Evolution are a popular approach to feature selection, and the research literature continues to introduce novel ideas, drawn from quantum computing and chaos theory, for instance, to improve them. In this paper, we demonstrate that introducing chaos-generated variables, generated from considerations of the Lyapunov time, in place of random variables in quantum-inspired metaheuristics significantly improves their performance on high-dimensional medical classification tasks and outperforms other approaches. We show that this chaos-induced improvement is a general phenomenon by demonstrating it for multiple varieties of underlying quantum-inspired metaheuristics. Performance is further enhanced through Lasso-assisted feature pruning. At the implementation level, we vastly speed up our algorithms through a scalable island-based computing cluster parallelization technique.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。