arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.08008cs.AI
收藏

将LLM语义推理与GNN结构建模相结合的多视图多标签特征选择

Combining LLM Semantic Reasoning with GNN Structural Modeling for Multi-View Multi-Label Feature Selection

Zhiqi Chen, Yuzhou Liu, Jiarui Liu, Wanfu Gao

AI总结:

针对多视图多标签特征选择中现有方法少考虑语义信息的问题,提出结合LLM语义推理与GNN结构建模的方法,通过评估语义相关性、构建双层异构图及学习节点嵌入,在多数据集上优于基线且小规模数据有效。

摘要:

多视图多标签特征选择旨在从异构视图中识别具有信息性的特征,其中每个样本与多个相互依赖的标签相关联。该问题在涉及社交媒体、生物信息学或推荐系统等多维、多模态数据的机器学习任务中尤为重要。现有的多视图多标签特征选择(MVMLFS)方法主要关注分析数据的统计信息,但很少考虑语义信息。在本文中,我们旨在联合使用这两类信息,并提出一种将大型语言模型(LLMs)语义推理与图神经网络(GNNs)结构建模相结合的MVMLFS方法。具体而言,该方法包含三个主要组件:(1)首先将LLM用作评估智能体,以评估特征、视图和标签描述之间的潜在语义相关性;(2)设计一个具有两个层次的语义感知异构图来表示特征、视图和标签之间的关系:一个是表示语义关系的语义图,另一个是统计图;(3)应用轻量级图注意力网络(GAT)在异构图中学习节点嵌入作为特征显著性分数,用于排序和选择。在多个基准数据集上的实验结果表明,我们的方法优于最先进的基线方法,并且在应用于小规模数据集时仍然有效,展示了其鲁棒性、灵活性和泛化能力。

英文摘要:

Multi-view multi-label feature selection aims to identify informative features from heterogeneous views, where each sample is associated with multiple interdependent labels. This problem is particularly important in machine learning involving high-dimensional, multimodal data such as social media, bioinformatics or recommendation systems. Existing Multi-View Multi-Label Feature Selection (MVMLFS) methods mainly focus on analyzing statistical information of data, but seldom consider semantic information. In this paper, we aim to use these two types of information jointly and propose a method that combines Large Language Models (LLMs) semantic reasoning with Graph Neural Networks (GNNs) structural modeling for MVMLFS. Specifically, the method consists of three main components. (1) LLM is first used as an evaluation agent to assess the latent semantic relevance among feature, view, and label descriptions. (2) A semantic-aware heterogeneous graph with two levels is designed to represent relations among features, views and labels: one is a semantic graph representing semantic relations, and the other is a statistical graph. (3) A lightweight Graph Attention Network (GAT) is applied to learn node embedding in the heterogeneous graph as feature saliency scores for ranking and selection. Experimental results on multiple benchmark datasets demonstrate the superiority of our method over state-of-the-art baselines, and it is still effective when applied to small-scale datasets, showcasing its robustness, flexibility, and generalization ability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑