arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1605.06359stat.ML
收藏

学习发现稀疏图形模型

Learning to Discover Sparse Graphical Models

Eugene Belilovsky, Kyle Kastner, Gaël Varoquaux, Matthew Blaschko

摘要:

我们考虑从观测数据中发现无向图模型的结构。从少数例子中推断可能的结构是一项复杂的任务,通常需要制定先验知识和复杂的推理程序。流行的方法依赖于估计精度矩阵的惩罚极大似然。然而,在这些方法中,结构恢复是数据拟合项的间接结果,惩罚可能难以适应特定领域的知识,并且推理在计算上要求很高。相比之下,生成从具有期望结构属性的图产生的数据的训练样本可能更容易。我们在这里建议利用后一种信息源作为训练数据来学习一个函数,该函数由神经网络参数化,该神经网络将经验协方差阵映射到估计的图结构。学习这个函数有两个好处:它隐式地对所需的结构或稀疏性属性进行建模,以形成合适的先验,并且它可以针对边缘结构发现的特定问题进行定制,而不是最大化数据可能性。应用这个框架,我们发现我们在合成数据上训练的可学习的图发现方法推广得很好:识别合成数据和真实数据中的相关边缘,在训练时完全未知。我们发现,在遗传学,脑成像和模拟数据,我们获得的性能一般优于分析方法。

英文摘要:

We consider structure discovery of undirected graphical models from observational data. Inferring likely structures from few examples is a complex task often requiring the formulation of priors and sophisticated inference procedures. Popular methods rely on estimating a penalized maximum likelihood of the precision matrix. However, in these approaches structure recovery is an indirect consequence of the data-fit term, the penalty can be difficult to adapt for domain-specific knowledge, and the inference is computationally demanding. By contrast, it may be easier to generate training samples of data that arise from graphs with the desired structure properties. We propose here to leverage this latter source of information as training data to learn a function, parametrized by a neural network that maps empirical covariance matrices to estimated graph structures. Learning this function brings two benefits: it implicitly models the desired structure or sparsity properties to form suitable priors, and it can be tailored to the specific problem of edge structure discovery, rather than maximizing data likelihood. Applying this framework, we find our learnable graph-discovery method trained on synthetic data generalizes well: identifying relevant edges in both synthetic and real data, completely unknown at training time. We find that on genetics, brain imaging, and simulation data we obtain performance generally superior to analytical methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑