We propose a general approach to handle data contaminations that might disrupt the performance of feature selection and estimation procedures for high-dimensional linear models. Specifically, we consider the co-occurrence of mean-shift and variance-inflation outliers, which can be modeled as additional fixed and random components, respectively, and evaluated independently. Our proposal performs feature selection while detecting and down-weighting variance-inflation outliers, detecting and excluding mean-shift outliers, and retaining non-outlying cases with full weights. Feature selection and mean-shift outlier detection are performed through a robust class of nonconcave penalization methods. Variance-inflation outlier detection is based on the penalization of the restricted posterior mode. The resulting approach satisfies a robust oracle property for feature selection in the presence of data contamination -- which allows the number of features to exponentially increase with the sample size -- and detects truly outlying cases of each type with asymptotic probability one. This provides an optimal trade-off between a high breakdown point and efficiency. Computationally efficient heuristic procedures are also presented. We illustrate the finite-sample performance of our proposal through an extensive simulation study and a real-world application.
Simultaneous Feature Selection and Outlier Detection with Optimality Guarantees
Scuola Normale Superiore(高等师范学院);Penn State University(宾夕法尼亚州立大学);Sant’Anna School of Advanced Studies(圣安娜高等研究学院);Istituto di Analisi dei Sistemi ed Informatica, Consiglio Nazionale delle Ricerche(意大利国家研究委员会系统与信息分析研究所)
MMDCP: A Distribution-free Approach to Outlier Detection and Classification with Coverage Guarantees and SCW-FDR Control
Guanghua School of Management, Peking University(北京大学光华管理学院);School of Mathematics and Computing Science, Guilin University of Electronic Technology(桂林电子科技大学数学与计算机学院);College of Energy and Power Engineering, Nanjing University of Aeronautics and Astronautics(南京航空航天大学能源与动力学院);School of Business, Guangdong University of Foreign Studies(广东外语外贸大学商学院)
Penalized Empirical Likelihood for Doubly Robust Causal Inference under Contamination in High Dimensions
Department of Mathematics and Physics, Gangneung-Wonju National University(数学与物理系,江陵-Wonju国立大学);Department of Applied Statistics, Yonsei University(应用统计学系,延世大学);Department of Statistics, Dongguk University(统计学系,东国大学);Department of Marketing Bigdata, Mokwon University(市场营销大数据系,摩斯大学);Department of Data Science, Gangneung-Wonju National University(数据科学系,江陵-Wonju国立大学)
Doubly Robust Proximal Causal Learning for Continuous Treatments
Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University(复旦大学类脑智能科学与技术研究院);School of Data Science, Fudan University(复旦大学数据科学学院);Zhangjiang Fudan International Innovation Center(张江复旦国际创新中心);Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University)(复旦大学计算神经科学与类脑智能重点实验室);MOE Frontiers Center for Brain Science, Fudan University(教育部脑科学前沿中心(复旦大学));Shanghai Engineering Research Center of AI & Robotics, Fudan University(上海市人工智能与机器人工程技术研究中心(复旦大学));Engineering Research Center of AI & Robotics, Ministry of Education, Fudan University(教育部人工智能与机器人工程研究中心(复旦大学))