arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.03216cs.LGcs.CR

在有限数据资源下遗忘图分类器

Unlearning Graph Classifiers with Limited Data Resources

University of Illinois, Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Chao Pan, Eli Chien, Olgica Milenkovic

AI总结:

本文提出首个基于图散射变换(GST)的非线性近似图遗忘方法,以解决图神经网络在有限训练数据下进行机器遗忘时性能受损的问题,相比完全重训练GNNs,新方法在IMDB数据集上平均实现10.38倍加速且测试准确率提升2.6%。

摘要:

随着用户隐私需求的增长,受控数据移除(机器遗忘)正成为数据敏感型Web应用(如社交网络和推荐系统)中机器学习模型的重要功能。然而,目前如何对图神经网络(GNNs)进行高效的机器遗忘在很大程度上仍属未知;当训练样本数量很少时情况尤其如此,此时遗忘会严重损害模型性能。为了解决这个问题,我们启动了对图散射变换(GST)遗忘的研究,这是一个高效、在特征或图拓扑扰动下可证明稳定的数学框架,并且提供的图分类性能与GNNs相当。我们的主要贡献是首个基于GST的已知非线性近似图遗忘方法。我们的第二个贡献是对所提出遗忘机制的计算复杂度进行了理论分析,这对于深度神经网络来说很难复现。我们的第三个贡献是广泛的模拟结果,结果表明,与每次移除请求后完全重新训练GNNs相比,在从IMDB数据集(10%训练比例)的100个训练图中遗忘90个图的过程中,新的基于GST的方法平均提供了10.38倍的加速,并使测试准确率提高了2.6%。我们的实现可在https://doi.org/10.5281/zenodo.7613150在线获取。

英文摘要:

As the demand for user privacy grows, controlled data removal (machine unlearning) is becoming an important feature of machine learning models for data-sensitive Web applications such as social networks and recommender systems. Nevertheless, at this point it is still largely unknown how to perform efficient machine unlearning of graph neural networks (GNNs); this is especially the case when the number of training samples is small, in which case unlearning can seriously compromise the performance of the model. To address this issue, we initiate the study of unlearning the Graph Scattering Transform (GST), a mathematical framework that is efficient, provably stable under feature or graph topology perturbations, and offers graph classification performance comparable to that of GNNs. Our main contribution is the first known nonlinear approximate graph unlearning method based on GSTs. Our second contribution is a theoretical analysis of the computational complexity of the proposed unlearning mechanism, which is hard to replicate for deep neural networks. Our third contribution are extensive simulation results which show that, compared to complete retraining of GNNs after each removal request, the new GST-based approach offers, on average, a 10.38x speed-up and leads to a 2.6% increase in test accuracy during unlearning of 90 out of 100 training graphs from the IMDB dataset (10% training ratio). Our implementation is available online at https://doi.org/10.5281/zenodo.7613150.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑