Subgroup analysis has garnered increasing attention for its ability to identify meaningful subgroups within heterogeneous populations, thereby enhancing predictive power. However, in many fields such as social science and biology, covariates are often highly correlated due to common factors. This correlation poses significant challenges for subgroup identification, an issue that is often overlooked in existing literature. In this paper, we aim to address this gap in the ``diverging dimension" regime by proposing a center-augmented subgroup identification method within the Factor Augmented (sparse) Linear Model framework. This method bridges dimension reduction and sparse regression. Our proposed approach is adaptable to the high cross-sectional dependence among covariates and offers computational advantages with a complexity of $O(nK)$, compared to the $O(n^2)$ complexity of the conventional pairwise fusion penalty method in the literature, where $n$ is the sample size and $K$ is the number of subgroups. We also investigate the asymptotic properties of the oracle estimators under conditions on the minimal distance between group centroids. To implement the proposed approach, we introduce a Difference of Convex functions-based Alternating Direction Method of Multipliers (DC-ADMM) algorithm and demonstrate its convergence to a local minimizer in a finite number of steps. We illustrate the superiority of the proposed method through extensive numerical experiments and a real macroeconomic data example. An \texttt{R} package, \texttt{SILFS}, implementing the method is also available on CRAN.
Group-Aware Matrix Estimation and Latent Subspace Recovery
Department of Statistics, Columbia University(哥伦比亚大学统计系);Irving Institute for Cellular Dynamics, Zuckerman Institute Columbia University(Zuckerman研究所细胞动力学院,哥伦比亚大学);School of Data and Information Sciences, University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校数据与信息科学学院)
Supervised Bayesian joint graphical model for simultaneous network estimation and subgroup identification
School of Statistics and Data Science, Shanghai University of International Business and Economics(上海对外经贸大学统计与数据科学学院);School of Statistics and Data Science, Shanghai University of Finance and Economics(上海财经大学统计与数据科学学院);Department of Biostatistics, Yale School of Public Health(耶鲁公共卫生学院生物统计学系)
Identification of complier and noncomplier average causal effects in the presence of latent missing-at-random (LMAR) outcomes: a unifying view and choices of assumptions
Johns Hopkins Bloomberg School of Public Health(约翰斯·霍普金斯大学布隆伯格公共卫生学院)
Identifying Direct Causal Effects in Latent Factor Models by Accounting for Unidentified Parents
German Aerospace Center (DLR), Institute of Data Science(德国航空航天中心数据科学研究所);Technische Universität Berlin(柏林工业大学);Institute of Mathematics, École Polytechnique Fédérale de Lausanne (EPFL)(洛桑联邦理工学院数学研究所);Institute of Computer Science, University of Potsdam(波茨坦大学计算机研究所);Department of Mathematics, TUM School of Computation, Information and Technology, Technical University of Munich(慕尼黑工业大学计算、信息与技术学院数学系);Munich Center for Machine Learning(慕尼黑机器学习中心)
Tutorial: a priori estimation of sample size, effect size, and statistical power for cluster analysis, latent class analysis, and multivariate mixture models
School of Psychological Science, University of Bristol(布里斯托大学心理科学学院)
Identification of Causal Structure with Latent Variables Based on Higher Order Cumulants
Guangdong University of Technology(广东工业大学);Peng Cheng Laboratory(鹏城实验室);Shantou University(汕头大学);Carnegie Mellon University(卡内基梅隆大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Causal Effect Identification in LiNGAM Models with Latent Confounders
Technical University of Munich(慕尼黑工业大学);Ecole Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);Leiden University(莱顿大学);Munich Center for Machine Learning(慕尼黑机器学习中心)