arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.05752cs.CL
收藏

基于大语言模型的多尺度特征融合与图神经网络集成的文本分类方法

Multi-Scale Feature Fusion and Graph Neural Network Integration for Text Classification with Large Language Models

University of Michigan(密歇根大学);Georgia Institute of Technology(佐治亚理工学院);Dartmouth College(达特茅斯学院);University of Pennsylvania(宾夕法尼亚大学);University of Southern California(南加州大学)

Xiangchen Song, Yulin Huang, Jinxu Guo, Yuchen Liu, Yaxuan Luan

AI总结:

本文提出一种融合大语言模型深度特征、特征金字塔多尺度融合与图神经网络结构化建模的文本分类方法,在多项指标上优于现有模型,验证了其有效性与稳定性。

摘要:

本研究探讨了一种用于文本分类的混合方法,该方法整合了来自大语言模型的深度特征提取、通过特征金字塔实现的多尺度融合,以及利用图神经网络进行的结构化建模,以提升复杂语义语境下的分类性能。首先,大语言模型捕获输入文本的上下文依赖关系和深层语义表示,为后续建模提供丰富的特征基础。然后,基于多层级特征表示,特征金字塔机制有效整合不同尺度的语义特征,平衡全局信息与局部细节,从而构建层次化语义表达。此外,融合后的特征被转换为图表示,并采用图神经网络捕获文本中潜在的语义关系和逻辑依赖,从而实现对语义单元之间复杂交互的全面建模。在此基础上,读出与分类模块生成最终的类别预测。所提方法在鲁棒性对齐实验中表现出显著优势,在ACC、F1-Score、AUC和Precision指标上均优于现有模型,验证了该框架的有效性和稳定性。本研究不仅构建了一个兼顾全局与局部信息以及语义与结构的集成框架,还为文本分类任务中的多尺度特征融合和结构化语义建模提供了新的视角。

英文摘要:

This study investigates a hybrid method for text classification that integrates deep feature extraction from large language models, multi-scale fusion through feature pyramids, and structured modeling with graph neural networks to enhance performance in complex semantic contexts. First, the large language model captures contextual dependencies and deep semantic representations of the input text, providing a rich feature foundation for subsequent modeling. Then, based on multi-level feature representations, the feature pyramid mechanism effectively integrates semantic features of different scales, balancing global information and local details to construct hierarchical semantic expressions. Furthermore, the fused features are transformed into graph representations, and graph neural networks are employed to capture latent semantic relations and logical dependencies in the text, enabling comprehensive modeling of complex interactions among semantic units. On this basis, the readout and classification modules generate the final category predictions. The proposed method demonstrates significant advantages in robustness alignment experiments, outperforming existing models on ACC, F1-Score, AUC, and Precision, which verifies the effectiveness and stability of the framework. This study not only constructs an integrated framework that balances global and local information as well as semantics and structure, but also provides a new perspective for multi-scale feature fusion and structured semantic modeling in text classification tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑