arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1805.11908stat.MEstat.ML
收藏

谁能更好地学习贝叶斯网络结构:结构学习算法的精度和速度

Who Learns Better Bayesian Network Structures: Accuracy and Speed of Structure Learning Algorithms

Marco Scutari, Catharina Elisabeth Graafland, José Manuel Gutiérrez

摘要:

从数据中学习贝叶斯网络结构的三种算法在文献中很常见:基于约束的算法,它使用条件独立性测试来学习数据的依赖结构;基于分数的算法,它使用拟合优度分数作为目标函数来最大化;以及结合两种方法的混合算法。当条件独立性和拟合优度都使用熵进行评估并且网络的拓扑排序已知时,基于约束和基于分数的算法已经被证明可以学习相同的结构(Cowell,2001)。在本文中,我们研究了这三类算法在离散和高斯贝叶斯网络的网络重建速度和准确性方面如何在上述假设之外执行。我们通过认识到结构学习是由统计标准和确定如何将标准应用于数据的算法相结合来定义的来解决这个问题。去除不同的选择的统计标准的混杂效应,我们发现使用模拟和真实世界的复杂数据,基于约束的算法往往不如基于分数的算法准确,但很少更快(即使在大样本量),混合算法既不快,也不比基于约束的算法更准确。这表明,通常持有的信念在文献中的结构学习的强烈影响的选择特定的统计标准,而不仅仅是由算法本身的属性。

英文摘要:

Three classes of algorithms to learn the structure of Bayesian networks from data are common in the literature: constraint-based algorithms, which use conditional independence tests to learn the dependence structure of the data; score-based algorithms, which use goodness-of-fit scores as objective functions to maximise; and hybrid algorithms that combine both approaches. Constraint-based and score-based algorithms have been shown to learn the same structures when conditional independence and goodness of fit are both assessed using entropy and the topological ordering of the network is known (Cowell, 2001). In this paper, we investigate how these three classes of algorithms perform outside the assumptions above in terms of speed and accuracy of network reconstruction for both discrete and Gaussian Bayesian networks. We approach this question by recognising that structure learning is defined by the combination of a statistical criterion and an algorithm that determines how the criterion is applied to the data. Removing the confounding effect of different choices for the statistical criterion, we find using both simulated and real-world complex data that constraint-based algorithms are often less accurate than score-based algorithms, but are seldom faster (even at large sample sizes); and that hybrid algorithms are neither faster nor more accurate than constraint-based algorithms. This suggests that commonly held beliefs on structure learning in the literature are strongly influenced by the choice of particular statistical criteria rather than just by the properties of the algorithms themselves.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑