arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.19007cs.CL
收藏

重述与对比:微调语言模型以增强对通信与计算机网络的理解

Rephrase and Contrast: Fine-Tuning Language Models for Enhanced Understanding of Communication and Computer Networks

The Chinese University of Hong Kong(香港中文大学);Huazhong University of Science and Technology(华中科技大学)

Liujianfu Wang, Yuyang Du, Jingqi Lin, Kexin Chen, Soung Chang Liew

AI总结:

本文提出RaC高效微调框架,通过问题重述和正误答案对比分析增强轻量级大语言模型对通信网络问题的理解能力,并配套数据挖掘与增强方法,在测试集上较基础模型准确率提升63.73%。

摘要:

大语言模型(LLMs)正在各个学科中得到广泛研究,近期大量工作致力于使LLMs适应对通信网络运行方式的理解。然而,过度依赖提示技术阻碍了这些模型泛化能力的充分发挥,而高效微调方法的缺乏也使得轻量级LLMs的潜力无法完全实现。本文通过提出我们的重述与对比(Rephrase and Contrast,RaC)框架来应对这些挑战,该框架是一种高效微调框架。RaC通过在微调过程中引入问题重述以及对正确与错误答案的对比分析,增强了LLMs的理解能力和批判性思维能力。实验结果表明,在一个综合性网络问题集上进行测试时,相较于基础模型,准确率提升了63.73%。此外,为了高效构建用于RaC微调的数据集,我们开发了一种GPT辅助的数据挖掘方法,用于生成高质量的问答(QA)对;进一步地,我们引入了ChoiceBoost,这是一种数据增强技术,可在扩大数据集规模的同时减少答案顺序偏差。除了这些技术创新之外,我们还通过开源有价值的研究资源为网络社区做出贡献,包括:1)微调后的网络模型RaC-Net;2)用于微调该模型的训练数据集;3)三个不同难度的测试问题集,可作为未来研究的基准;以及4)与上述资源相关的代码。

英文摘要:

Large language models (LLMs) are being widely researched across various disciplines, with significant recent efforts focusing on adapting LLMs for understanding of how communication networks operate. However, over-reliance on prompting techniques hinders the full exploitation of the generalization ability of these models, and the lack of efficient fine-tuning methods prevents the full realization of lightweight LLMs' potential. This paper addresses these challenges by introducing our Rephrase and Contrast (RaC) framework, an efficient fine-tuning framework. RaC enhances LLMs' comprehension and critical thinking abilities by incorporating question reformulation and contrastive analysis of correct and incorrect answers during the fine-tuning process. Experimental results demonstrate a 63.73% accuracy improvement over the foundational model when tested on a comprehensive networking problem set. Moreover, to efficiently construct the dataset for RaC fine-tuning, we develop a GPT-assisted data mining method for generating high-quality question-answer (QA) pairs; furthermore, we introduce ChoiceBoost, a data augmentation technique that expands dataset size while reducing answer-order bias. Apart from these technical innovations, we contribute to the networking community by open-sourcing valuable research resources, including: 1) the fine-tuned networking model referred to as RaC-Net, 2) the training dataset used for fine-tuning the model, 3) three testing problem sets of different difficulties to serve as benchmarks for future research, and 4) code associated with the above resources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑