arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1206.1874stat.APmath.STstat.MLstat.TH
收藏

多元伯努利分布

Multivariate Bernoulli distribution

Bin Dai, Shilin Ding, Grace Wahba

摘要:

本文考虑用多元伯努利分布作为模型来估计具有二值结点的图的结构。这种分布的指数族的框架中进行了讨论,并证明了其统计特性的节点的独立性。重要的是,该模型不仅可以估计节点之间的主效应和成对相互作用,而且还能够模拟高阶相互作用,允许存在复杂的团效应。我们比较了多元伯努利模型与现有的图形推理模型-伊辛模型和多元高斯模型,其中只考虑成对的相互作用。另一方面,多元伯努利分布有一个有趣的性质,即随机变量的独立性和不相关性是等价的。多元伯努利分布中的一个变量子集的边际分布和条件分布仍然遵循多元伯努利分布。在广义线性模型理论的基础上,利用正则连接函数建立了多元Bernoulli logistic模型,以包含节点、边和集团的协变量信息。我们还考虑变量选择技术,如LASSO在逻辑模型中施加稀疏结构的图。最后,我们讨论了扩展平滑样条方差分析方法的多变量伯努利逻辑模型,使非线性效应的预测变量的估计。

英文摘要:

In this paper, we consider the multivariate Bernoulli distribution as a model to estimate the structure of graphs with binary nodes. This distribution is discussed in the framework of the exponential family, and its statistical properties regarding independence of the nodes are demonstrated. Importantly the model can estimate not only the main effects and pairwise interactions among the nodes but also is capable of modeling higher order interactions, allowing for the existence of complex clique effects. We compare the multivariate Bernoulli model with existing graphical inference models - the Ising model and the multivariate Gaussian model, where only the pairwise interactions are considered. On the other hand, the multivariate Bernoulli distribution has an interesting property in that independence and uncorrelatedness of the component random variables are equivalent. Both the marginal and conditional distributions of a subset of variables in the multivariate Bernoulli distribution still follow the multivariate Bernoulli distribution. Furthermore, the multivariate Bernoulli logistic model is developed under generalized linear model theory by utilizing the canonical link function in order to include covariate information on the nodes, edges and cliques. We also consider variable selection techniques such as LASSO in the logistic model to impose sparsity structure on the graph. Finally, we discuss extending the smoothing spline ANOVA approach to the multivariate Bernoulli logistic model to enable estimation of non-linear effects of the predictor variables.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑