arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2112.09899cs.LGcs.AI
收藏

利用变分图信息瓶颈改进子图识别

Improving Subgraph Recognition with Variational Graph Information Bottleneck

Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Center for Excellence in Brain Science and Intelligence Technology, CAS(中国科学院脑科学与智能技术卓越创新中心)

Junchi Yu, Jie Cao, Ran He

摘要:

子图识别的目的是发现一个压缩的子结构的图,是最丰富的图形属性。它可以通过优化图信息瓶颈(GIB)与互信息估计制定。然而,GIB由于其固有的优化过程而遭受训练不稳定和退化结果。为了解决这些问题,我们重新制定的子图识别问题分为两个步骤:图扰动和子图选择,导致一个新的变分图信息瓶颈(VGIB)框架。VGIB首先采用噪声注入来调制从输入图到扰动图的信息流。然后,扰动图被鼓励是信息的图形属性。VGIB进一步通过滤除扰动图中的噪声来获得期望的子图。与定制的噪声之前,为每个输入,VGIB目标被赋予了一个易于处理的变分上限,从而导致优越的经验性能以及理论属性。对图的解释、图神经网络的可解释性和图的分类进行了大量的实验,结果表明VGIB比现有的方法找到了更好的子图。代码可在https://github.com/Samyu0304/VGIB获得

英文摘要:

Subgraph recognition aims at discovering a compressed substructure of a graph that is most informative to the graph property. It can be formulated by optimizing Graph Information Bottleneck (GIB) with a mutual information estimator. However, GIB suffers from training instability and degenerated results due to its intrinsic optimization process. To tackle these issues, we reformulate the subgraph recognition problem into two steps: graph perturbation and subgraph selection, leading to a novel Variational Graph Information Bottleneck (VGIB) framework. VGIB first employs the noise injection to modulate the information flow from the input graph to the perturbed graph. Then, the perturbed graph is encouraged to be informative to the graph property. VGIB further obtains the desired subgraph by filtering out the noise in the perturbed graph. With the customized noise prior for each input, the VGIB objective is endowed with a tractable variational upper bound, leading to a superior empirical performance as well as theoretical properties. Extensive experiments on graph interpretation, explainability of Graph Neural Networks, and graph classification show that VGIB finds better subgraphs than existing methods. Code is avaliable at https://github.com/Samyu0304/VGIB

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑