arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.20067cs.LGcs.AI
收藏

xAI-Drop:不要使用你无法解释的内容

xAI-Drop: Don't Use What You Cannot Explain

University of Trento(特伦托大学);University of Cambridge(剑桥大学)

Vincenzo Marco De Luca, Antonio Longa, Andrea Passerini, Pietro Liò

AI总结:

本文提出xAI-Drop,一种利用可解释性识别并排除噪声节点的拓扑级丢弃正则化器,提升GNN泛化能力与解释质量,在真实数据集上超越现有方法。

摘要:

图神经网络(GNNs)已成为从图结构数据中学习的主要范式,提供了从社交网络分析到生物信息学的广泛应用。尽管具有多功能性,GNNs仍面临泛化能力不足和可解释性差等挑战,这阻碍了其在关键应用中的更广泛采用和可靠性。丢弃(Dropping)已成为提升GNNs泛化能力的有效范式。然而,现有方法往往依赖于随机或基于启发式的选择标准,缺乏一种有原则的方法来识别和排除那些导致模型中噪声和过度复杂性的节点。在这项工作中,我们认为可解释性应成为模型在整个训练阶段质量的关键指标。为此,我们引入了xAI-Drop,一种新颖的拓扑级丢弃正则化器,利用可解释性来精确定位应从GNN传播机制中排除的噪声网络元素。在多个真实世界数据集上的实证评估表明,我们的方法在准确性上优于当前最先进的丢弃方法,并提高了解释质量。

英文摘要:

Graph Neural Networks (GNNs) have emerged as the predominant paradigm for learning from graph-structured data, offering a wide range of applications from social network analysis to bioinformatics. Despite their versatility, GNNs face challenges such as lack of generalization and poor interpretability, which hinder their wider adoption and reliability in critical applications. Dropping has emerged as an effective paradigm for improving the generalization capabilities of GNNs. However, existing approaches often rely on random or heuristic-based selection criteria, lacking a principled method to identify and exclude nodes that contribute to noise and over-complexity in the model. In this work, we argue that explainability should be a key indicator of a model's quality throughout its training phase. To this end, we introduce xAI-Drop, a novel topological-level dropping regularizer that leverages explainability to pinpoint noisy network elements to be excluded from the GNN propagation mechanism. An empirical evaluation on diverse real-world datasets demonstrates that our method outperforms current state-of-the-art dropping approaches in accuracy, and improves explanation quality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑