高斯图模型的参数化
Parameterising Gaussian Graphical Models
- Universitat Pompeu Fabra（庞培法布拉大学）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
本文将高斯图模型的精度矩阵分解为边际方差、偏相关系数和方差膨胀因子，解释了精度矩阵惩罚选中心变量差的原因，阐明了偏相关系数方法的优势，还研究了惩罚对边际方差估计的影响。
AI中文摘要：
高斯图模型（Gaussian graphical models, GGMs）用于描述联合高斯随机变量间的依赖结构。然而，GGM最常用的参数化形式——精度矩阵，同时描述了变量的依赖关系与尺度。尽管图模型具有尺度不变性，但这一特性会导致模型选择方法依赖于变量尺度。即便将数据标准化为单位样本方差，精度矩阵的元素仍可能处于不同尺度，进而引发模型选择效果不佳的问题。本文将精度矩阵分解为边际方差与可解释的尺度不变参数——偏相关系数和方差膨胀因子。该分解为精度矩阵元素及模型选择方法（如惩罚似然法）的动态特性提供了新的见解，尤其解释了“对精度矩阵施加惩罚在选择中心变量时表现较差”这一观测现象，并论证了数据标准化的必要性，同时阐明了基于偏相关系数的方法为何具备更优的中心变量检测性能。随后，本文研究了对不同量施加惩罚对边际方差估计的影响，还发现当采用边际方差的最大似然估计时，对数似然会出现有趣的简化。
英文摘要：
Gaussian graphical models (GGMs) describe the dependence structure among jointly Gaussian random variables. However, the most common parameterisation of GGMs, the precision matrix, describes both the dependence and scale of the variables. This has been shown to lead to model selection methods that depend on the scale of the variables, despite graphical models being scale invariant. Even after standardising data to have unit sample variances, entries of the precision matrix can be on different scales leading to poor model selection. This paper decomposes the precision matrix into marginal variances and interpretable scale-invariant parameters - the partial correlations and variance inflation factors. This decomposition gives new insights into the precision matrix entries and the dynamics of model selection methods such as penalised likelihoods. In particular, it explains the observed phenomenon that penalties on the precision matrix perform poorly at selecting hub variables and motivates the necessity of data standardisation. It also shows why methods based on partial correlations have better hub detection properties. The effect of penalisation of different quantities on the estimation of marginal variances is then investigated and an interesting simplification of the log-likelihood is shown when using maximum likelihood estimation of the marginal variances.
