arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1807.00944stat.MLcs.LG
收藏

马尔可夫随机场结构学习的增长-收缩最大伪随机估计

Structure Learning of Markov Random Fields through Grow-Shrink Maximum Pseudolikelihood Estimation

Waseda University(早稻田大学);Cybozu Labs, Inc.(Cybozu实验室公司)

Yuya Takashina, Shuyo Nakatani, Masato Inoue

摘要:

学习马尔可夫随机场(MRF)的结构在多元分析中起着重要的作用。随着近年来统计关系模型的兴起,MRF的重要性不断增加,因为MRF是这些模型(如马尔可夫逻辑网络)的构建块。MRFs结构学习的基本方法有两种:基于参数学习的方法和基于独立性检验的方法。前一种方法或多或少地假设了某些形式的分布,因此当不满足假设时,它们可能表现不佳。后者可以在没有强分布假设的情况下学习MRF结构,但有时不清楚在这些方法中最大化/最小化什么目标函数。在本文中,我们遵循后者,但我们明确定义的MRF结构学习的优化问题的最大伪随机估计(MPLE)的边缘集。因此,所提出的解决方案成功地处理了MRF中的{ \em不确定性},而这种不确定性在大多数现有的独立性测试技术中没有考虑。当实验中存在非对称依赖关系时,该方法比以前的方法获得了更高的准确率。

英文摘要:

Learning the structure of Markov random fields (MRFs) plays an important role in multivariate analysis. The importance has been increasing with the recent rise of statistical relational models since the MRF serves as a building block of these models such as Markov logic networks. There are two fundamental ways to learn structures of MRFs: methods based on parameter learning and those based on independence test. The former methods more or less assume certain forms of distribution, so they potentially perform poorly when the assumption is not satisfied. The latter can learn an MRF structure without a strong distributional assumption, but sometimes it is unclear what objective function is maximized/minimized in these methods. In this paper, we follow the latter, but we explicitly define the optimization problem of MRF structure learning as maximum pseudolikelihood estimation (MPLE) with respect to the edge set. As a result, the proposed solution successfully deals with the {\em symmetricity} in MRFs, whereas such symmetricity is not taken into account in most existing independence test techniques. The proposed method achieved higher accuracy than previous methods when there were asymmetric dependencies in our experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑