arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.04259cs.LGcs.AIcs.DC
收藏

快速并行贝叶斯网络结构学习

Fast Parallel Bayesian Network Structure Learning

The University of Western Australia(西澳大学)

Jiantong Jiang, Zeyi Wen, Ajmal Mian

摘要:

贝叶斯网络是机器学习中广泛使用的表示不确定性知识的图形模型。主流的BN结构学习方法需要进行大量的条件独立性(CI)测试。学习过程非常耗时,特别是对于高维问题,这阻碍了BN被更多的应用所采用。现有的作品试图加速学习过程中的并行,但面临的问题,包括负载不平衡,昂贵的原子操作和占主导地位的并行开销。在本文中,我们提出了一个快速的解决方案命名为Fast-BNS在多核CPU上,以提高BN结构学习的效率。Fast-BNS由一系列效率优化提供支持,包括(i)设计动态工作池以监视边缘的处理并更好地调度线程之间的工作负载,(ii)将具有相同端点的边缘的CI测试分组以减少不必要的CI测试的数量,(iii)使用高速缓存友好的数据存储来提高内存效率,以及(iv)在运行中生成调节集以避免额外的存储器消耗。一个全面的实验研究表明,Fast-BNS的顺序版本是高达50倍的速度比它的同行,和Fast-BNS的并行版本达到4.8到24.5倍的加速比国家的最先进的多线程解决方案。此外,Fast-BNS具有良好的可扩展性的网络规模以及样本大小。Fast-BNS源代码可在www.example.com上免费获得。

英文摘要:

Bayesian networks (BNs) are a widely used graphical model in machine learning for representing knowledge with uncertainty. The mainstream BN structure learning methods require performing a large number of conditional independence (CI) tests. The learning process is very time-consuming, especially for high-dimensional problems, which hinders the adoption of BNs to more applications. Existing works attempt to accelerate the learning process with parallelism, but face issues including load unbalancing, costly atomic operations and dominant parallel overhead. In this paper, we propose a fast solution named Fast-BNS on multi-core CPUs to enhance the efficiency of the BN structure learning. Fast-BNS is powered by a series of efficiency optimizations including (i) designing a dynamic work pool to monitor the processing of edges and to better schedule the workloads among threads, (ii) grouping the CI tests of the edges with the same endpoints to reduce the number of unnecessary CI tests, (iii) using a cache-friendly data storage to improve the memory efficiency, and (iv) generating the conditioning sets on-the-fly to avoid extra memory consumption. A comprehensive experimental study shows that the sequential version of Fast-BNS is up to 50 times faster than its counterpart, and the parallel version of Fast-BNS achieves 4.8 to 24.5 times speedup over the state-of-the-art multi-threaded solution. Moreover, Fast-BNS has a good scalability to the network size as well as sample size. Fast-BNS source code is freely available at https://github.com/jjiantong/FastBN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑