Neural Gaussian Mirror for Controlled Feature Selection in Neural Networks
Department of Statistics, Virginia Tech(弗吉尼亚理工大学统计系);Department of Statistics, University of Chicago(芝加哥大学统计系);Department of Statistics, Harvard University(哈佛大学统计系)
Deep neural networks (DNNs) have become increasingly popular and achieved outstanding performance in predictive tasks. However, the DNN framework itself cannot inform the user which features are more or less relevant for making the prediction, which limits its applicability in many scientific fields. We introduce neural Gaussian mirrors (NGMs), in which mirrored features are created, via a structured perturbation based on a kernel-based conditional dependence measure, to help evaluate feature importance. We design two modifications of the DNN architecture for incorporating mirrored features and providing mirror statistics to measure feature importance. As shown in simulated and real data examples, the proposed method controls the feature selection error rate at a predefined level and maintains a high selection power even with the presence of highly correlated features.
Sparse PCA with False Discovery Rate Controlled Variable Selection
Technische Universität Darmstadt(达姆施塔特工业大学);Conservatoire National des Arts et Métiers(法国国立工艺学院);The Hong Kong University of Science and Technology(香港科技大学)
Risk-Controlled DFT Selection for Machine-Learned Interatomic Potentials
Pritzker School of Molecular Engineering, The University of Chicago(芝加哥大学普里茨克分子工程学院);Department of Statistics, The University of Chicago(芝加哥大学统计学系);Department of Material Science and Engineering, National University of Singapore(新加坡国立大学材料科学与工程系)