arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.20293cs.AI
收藏

基于大语言模型的能量对比学习的文本属性图中分布外检测

LLM-Enhanced Energy Contrastive Learning for Out-of-Distribution Detection in Text-Attributed Graphs

Xiaoxu Ma, Dong Li, Minglai Shao, Xintao Wu, Chen Zhao

AI总结:

本文提出LECT方法,结合大语言模型和能量对比学习,在文本属性图中实现节点级分布外检测,提升分类准确性和鲁棒性。

摘要:

文本属性图,其中节点带有文本属性,已成为建模现实网络(如引用、社交和交易网络)的强大工具。然而,现有方法在学习这些图时通常假设训练数据和测试数据的分布一致。这种假设在面对分布外(OOD)数据时会导致显著性能下降。本文针对文本属性图中的节点级OOD检测问题,旨在保持准确的节点分类的同时识别OOD节点。我们提出了一种新颖的方法,即基于大语言模型的能量对比学习的分布外检测(LECT),该方法整合了大语言模型(LLMs)和基于能量的对比学习。所提出的方法包括利用LLMs的语义理解和上下文知识生成高质量的OOD样本,通过生成依赖感知的伪OOD节点,并基于能量函数应用对比学习以区分分布内(IND)和OOD节点。通过在六个基准数据集上的广泛实验,证明了该方法的有效性,结果表明我们的方法在分类准确性和鲁棒的OOD检测能力方面均优于最先进的基线方法。

英文摘要:

Text-attributed graphs, where nodes are enriched with textual attributes, have become a powerful tool for modeling real-world networks such as citation, social, and transaction networks. However, existing methods for learning from these graphs often assume that the distributions of training and testing data are consistent. This assumption leads to significant performance degradation when faced with out-of-distribution (OOD) data. In this paper, we address the challenge of node-level OOD detection in text-attributed graphs, with the goal of maintaining accurate node classification while simultaneously identifying OOD nodes. We propose a novel approach, LLM-Enhanced Energy Contrastive Learning for Out-of-Distribution Detection in Text-Attributed Graphs (LECT), which integrates large language models (LLMs) and energy-based contrastive learning. The proposed method involves generating high-quality OOD samples by leveraging the semantic understanding and contextual knowledge of LLMs to create dependency-aware pseudo-OOD nodes, and applying contrastive learning based on energy functions to distinguish between in-distribution (IND) and OOD nodes. The effectiveness of our method is demonstrated through extensive experiments on six benchmark datasets, where our method consistently outperforms state-of-the-art baselines, achieving both high classification accuracy and robust OOD detection capabilities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑