arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.12819cs.DCcs.DB
收藏

基于回溯框架的分布式子图枚举

Distributed Subgraph Enumeration via Backtracking-based Framework

Zhaokang Wang, Weiwei Hu, Chunfeng Yuan, Rong Gu, Yihua Huang

摘要:

在数据图中寻找或监视与给定模式图同构的子图实例是许多图分析应用(诸如网络模体挖掘和欺诈检测)中的基本查询操作。现有的分布式方法在通信方面效率低下。在分布式多路连接过程中,它们必须对部分匹配结果进行混洗。部分匹配结果可能比数据图本身大得多。为了克服这个缺点,我们开发了一个分布式子图枚举的Batch-BENU框架(B-BENU)。B-BENU并行执行一组本地搜索任务。每个任务在数据图中的顶点周围枚举子图,由基于回溯的执行计划指导。B-BENU不混洗任何部分匹配结果。相反,它将数据图存储在分布式数据库中。每个任务根据需要查询数据图的邻接集。为了支持动态数据图,我们提出了增量模式图的概念,并将连续子图枚举转化为在每个时间步枚举增量模式图。我们开发了流-BENU框架(S-BENU)来有效地枚举它们的匹配。我们实现了B-BENU和S-BENU与本地数据库缓存和任务拆分技术。大量的实验表明,B-BENU和S-BENU可以扩展到大数据图和复杂模式图。它们分别比最先进的方法高出一个和两个数量级。

英文摘要:

Finding or monitoring subgraph instances that are isomorphic to a given pattern graph in a data graph is a fundamental query operation in many graph analytic applications, such as network motif mining and fraud detection. The state-of-the-art distributed methods are inefficient in communication. They have to shuffle partial matching results during the distributed multiway join. The partial matching results may be much larger than the data graph itself. To overcome the drawback, we develop the Batch-BENU framework (B-BENU) for distributed subgraph enumeration. B-BENU executes a group of local search tasks in parallel. Each task enumerates subgraphs around a vertex in the data graph, guided by a backtracking-based execution plan. B-BENU does not shuffle any partial matching result. Instead, it stores the data graph in a distributed database. Each task queries adjacency sets of the data graph on demand. To support dynamic data graphs, we propose the concept of incremental pattern graphs and turn continuous subgraph enumeration into enumerating incremental pattern graphs at each time step. We develop the Streaming-BENU framework (S-BENU) to enumerate their matches efficiently. We implement B-BENU and S-BENU with the local database cache and the task splitting techniques. The extensive experiments show that B-BENU and S-BENU can scale to big data graphs and complex pattern graphs. They outperform the state-of-the-art methods by up to one and two orders of magnitude, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑