arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.06176cs.LGcs.AI
收藏

GOODAT:迈向测试时图分布外检测

GOODAT: Towards Test-time Graph Out-of-Distribution Detection

Tianjin University(天津大学);Monash University(莫纳什大学);National University of Singapore(新加坡国立大学);Griffith University(格里菲斯大学)

Luzhi Wang, Dongxiao He, He Zhang, Yixin Liu, Wenjie Wang, Shirui Pan, Di Jin, Tat-Seng Chua

AI总结:

GOODAT提出一种测试时图分布外检测方法,通过轻量级图掩码器和三个基于信息瓶颈的无监督目标函数,无需训练数据或修改GNN即可捕捉OOD与ID样本的差异子图,并在多个数据集上超越现有基准。

摘要:

图神经网络(GNNs)已在多个领域中广泛应用于图数据建模。虽然GNNs在测试数据与训练数据分布相同(分布内,ID)的场景中表现出色,但当面对来自陌生分布的样本(分布外,OOD)时,它们往往会产生错误的预测。为了利用GNNs识别并拒绝OOD样本,近期研究探索了图OOD检测,通常侧重于在训练好的GNN之上训练特定模型或修改数据。尽管这些方法有效,但它们需要优化基于GNN的模型,带来了沉重的训练资源和成本。此外,它们对修改原始GNNs和访问训练数据的依赖进一步限制了其通用性。为此,本文提出了一种在测试时检测图分布外样本的方法(即GOODAT),这是一种以数据为中心、无监督、即插即用的解决方案,独立于训练数据和GNN架构修改运行。借助轻量级图掩码器,GOODAT能够从测试样本中学习信息丰富的子图,从而捕捉OOD样本与ID样本之间不同的图模式。为优化图掩码器,我们基于图信息瓶颈原理精心设计了三个无监督目标函数,促使掩码器捕捉紧凑且信息丰富的子图以用于OOD检测。综合评估证实,我们的GOODAT方法在多个真实世界数据集上优于最先进的基准方法。代码可在Github获取:https://github.com/Ee1s/GOODAT

英文摘要:

Graph neural networks (GNNs) have found widespread application in modeling graph data across diverse domains. While GNNs excel in scenarios where the testing data shares the distribution of their training counterparts (in distribution, ID), they often exhibit incorrect predictions when confronted with samples from an unfamiliar distribution (out-of-distribution, OOD). To identify and reject OOD samples with GNNs, recent studies have explored graph OOD detection, often focusing on training a specific model or modifying the data on top of a well-trained GNN. Despite their effectiveness, these methods come with heavy training resources and costs, as they need to optimize the GNN-based models on training data. Moreover, their reliance on modifying the original GNNs and accessing training data further restricts their universality. To this end, this paper introduces a method to detect Graph Out-of-Distribution At Test-time (namely GOODAT), a data-centric, unsupervised, and plug-and-play solution that operates independently of training data and modifications of GNN architecture. With a lightweight graph masker, GOODAT can learn informative subgraphs from test samples, enabling the capture of distinct graph patterns between OOD and ID samples. To optimize the graph masker, we meticulously design three unsupervised objective functions based on the graph information bottleneck principle, motivating the masker to capture compact yet informative subgraphs for OOD detection. Comprehensive evaluations confirm that our GOODAT method outperforms state-of-the-art benchmarks across a variety of real-world datasets. The code is available at Github: https://github.com/Ee1s/GOODAT

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑