Linear mixed models (LMMs) are a popular class of methods for analyzing longitudinal and clustered data. However, such models can be sensitive to outliers, and this can lead to biased inference on model parameters and inaccurate prediction of random effects if the data are contaminated. We propose a new approach to robust estimation and inference for LMMs using a hierarchical gamma-divergence, which offers an automated, data-driven approach to downweight the effects of outliers occurring in both the error and the random effects, using normalized powered density weights. For estimation and inference, we develop a computationally scalable minorization-maximization algorithm for the resulting objective function, along with a clustered bootstrap method for uncertainty quantification and a Hyvarinen score criterion for selecting a tuning parameter controlling the degree of robustness. Under suitable regularity conditions, we show the resulting robust estimates can be asymptotically controlled even under a heavy level of (covariate-dependent) contamination. Simulation studies demonstrate hierarchical gamma-divergence consistently outperforms several currently available methods for robustifying LMMs. We also illustrate the proposed method using data from a multi-center AIDS cohort study.
Bayesian Hierarchical Modelling of Noisy Gamma Processes: Model Formulation, Identifiability, Model Fitting, and Extensions to Unit-to-Unit Variability
A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors
具有gamma超先验的分层模型提供了一个灵活的稀疏提升框架,用于将贝叶斯公式中的$L^1$和$L^2$正则化与逆问题联系起来。尽管这些模型的贝叶斯动机,现有的方法仅限于\textit{maximum a posteriori}估计。执行不确定性量化的潜力尚未实现。本文提出了一种求解具有Gamma超先验的递阶反问题的变分迭代交替格式。建议的变分推断方法产生准确的重建,提供有意义的不确定性量化,并且易于实现。此外,它还可以很自然地进行超参数选择的模型选择。我们说明了我们的方法的性能在几个计算的例子,包括反卷积问题和稀疏识别动态系统的时间序列数据。
National Laboratory of Radar Signal Processing(雷达信号处理国家重点实验室);Collaborative Innovation Center of Information Sensing and Understanding(信息感知与理解协同创新中心);Xidian University(西安电子科技大学);McCombs School of Business(麦库姆斯商学院);The University of Texas at Austin(得克萨斯大学奥斯汀分校)