arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.08259stat.MLcs.LG
收藏

高阶Ising模型中通过推断的具有同伴效应的逻辑斯谛回归

Logistic-Regression with peer-group effects via inference in higher order Ising models

MIT(麻省理工学院);SUTD(新加坡科技设计大学)

Constantinos Daskalakis, Nishanth Dikkala, Ioannis Panageas

摘要:

自旋玻璃模型,如Sherrington-Kirkpatrick,Hopfield和Ising模型,都是离散分布的指数族的研究成员,并已在许多应用领域产生影响,其中它们被用来模拟网络上的相关现象。传统上,这些模型具有二次充分统计量,因此捕获由成对相互作用产生的相关性。在这项工作中,我们研究这些模型的高阶充分统计量的扩展,建模行为的社会网络与同龄人群体的影响。特别是,我们将网络上的二元结果建模为高阶自旋玻璃,其中个体的行为取决于他们自己的协变量向量的线性函数和其他人行为的多项式函数,从而捕获对等群体效应。使用{ \em单},高维样本从这样的模型,我们的目标是恢复的线性函数的系数,以及同级组效应的强度。我们的结果的核心是一种新的方法,用于显示模型的对数伪似然的强对数似然,这意味着最大伪似然估计(MPLE)的统计错误率为$\sqrt{d/n}$,其中$d$是协变量向量的维数,$n$是网络的大小(节点数)。我们的模型概括了香草逻辑斯谛回归以及在最近的作品中研究的同行效应模型,我们的结果扩展这些结果,以适应高阶相互作用。

英文摘要:

Spin glass models, such as the Sherrington-Kirkpatrick, Hopfield and Ising models, are all well-studied members of the exponential family of discrete distributions, and have been influential in a number of application domains where they are used to model correlation phenomena on networks. Conventionally these models have quadratic sufficient statistics and consequently capture correlations arising from pairwise interactions. In this work we study extensions of these to models with higher-order sufficient statistics, modeling behavior on a social network with peer-group effects. In particular, we model binary outcomes on a network as a higher-order spin glass, where the behavior of an individual depends on a linear function of their own vector of covariates and some polynomial function of the behavior of others, capturing peer-group effects. Using a {\em single}, high-dimensional sample from such model our goal is to recover the coefficients of the linear function as well as the strength of the peer-group effects. The heart of our result is a novel approach for showing strong concavity of the log pseudo-likelihood of the model, implying statistical error rate of $\sqrt{d/n}$ for the Maximum Pseudo-Likelihood Estimator (MPLE), where $d$ is the dimensionality of the covariate vectors and $n$ is the size of the network (number of nodes). Our model generalizes vanilla logistic regression as well as the peer-effect models studied in recent works, and our results extend these results to accommodate higher-order interactions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑