arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1709.08770stat.ML
收藏

Gamma过程边划分模型的模型收缩效应

On the Model Shrinkage Effect of Gamma Process Edge Partition Models

Iku Ohama, Issei Sato, Takuya Kida, Hiroki Arimura

摘要:

边缘划分模型(Edge Partition Model)是一种基本的贝叶斯非参数模型,用于从二进制矩阵中提取重叠结构。在自动缩小活性原子的数量之前,该方法采用伽马处理($Γ$ P)。然而,我们根据经验发现,模型的收缩率通常不能正常工作,并导致过拟合的解决方案。分析的期望值的强度函数表明,伽玛先验的伽玛超参数干扰模型收缩效应的内部$Γ$ P.为了确保模型收缩效应的伽玛工程以适当的方式,我们提出了两种新的生成结构的伽玛:CEPM结合约束伽玛先验,和DEPM结合狄利克雷先验,而不是伽玛先验。此外,包括$Γ$ P先验的无限原子的所有DEPM的模型参数可以被边缘化,因此可以导出可以使用塌陷吉布斯采样器有效推断的真正无限DEPM(IDEPM)。我们的实验证实,所提出的模型的模型收缩工作良好,IDEPM表示的泛化能力,链路预测精度,混合效率和收敛速度的最先进的性能。

英文摘要:

The edge partition model (EPM) is a fundamental Bayesian nonparametric model for extracting an overlapping structure from binary matrix. The EPM adopts a gamma process ($Γ$P) prior to automatically shrink the number of active atoms. However, we empirically found that the model shrinkage of the EPM does not typically work appropriately and leads to an overfitted solution. An analysis of the expectation of the EPM's intensity function suggested that the gamma priors for the EPM hyperparameters disturb the model shrinkage effect of the internal $Γ$P. In order to ensure that the model shrinkage effect of the EPM works in an appropriate manner, we proposed two novel generative constructions of the EPM: CEPM incorporating constrained gamma priors, and DEPM incorporating Dirichlet priors instead of the gamma priors. Furthermore, all DEPM's model parameters including the infinite atoms of the $Γ$P prior could be marginalized out, and thus it was possible to derive a truly infinite DEPM (IDEPM) that can be efficiently inferred using a collapsed Gibbs sampler. We experimentally confirmed that the model shrinkage of the proposed models works well and that the IDEPM indicated state-of-the-art performance in generalization ability, link prediction accuracy, mixing efficiency, and convergence speed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑