FroM:基于 Frobenius 范数的无数据自适应模型合并
FroM: Frobenius Norm-Based Data-Free Adaptive Model Merging
AI总结:
本文提出无数据自适应模型合并方法 FroM,通过 Frobenius 范数直接衡量模型参数并引入超参数控制,有效缓解了传统模型合并中的任务干扰问题,在多种微调场景下优于基线方法。
摘要:
随着大语言模型的发展,微调已成为一种通过注入特定领域知识来提升特定场景性能的有效方法。在此背景下,模型合并技术通过组合多个微调模型的参数,为融合其知识提供了解决方案。然而,传统方法在合并全量微调模型时常常遇到任务干扰问题,且该问题在参数高效微调场景中变得更加明显。本文对 RegMean 方法进行了改进,该方法间接利用训练数据来近似合并前后线性层的输出。我们提出了一种名为 FroM 的自适应合并方法,它直接使用 Frobenius 范数衡量模型参数,无需任何训练数据。通过引入额外的超参数进行控制,FroM 在各种微调场景中均优于基线方法,缓解了任务干扰问题。
英文摘要:
With the development of large language models, fine-tuning has emerged as an effective method to enhance performance in specific scenarios by injecting domain-specific knowledge. In this context, model merging techniques provide a solution for fusing knowledge from multiple fine-tuning models by combining their parameters. However, traditional methods often encounter task interference when merging full fine-tuning models, and this problem becomes even more evident in parameter-efficient fine-tuning scenarios. In this paper, we introduce an improvement to the RegMean method, which indirectly leverages the training data to approximate the outputs of the linear layers before and after merging. We propose an adaptive merging method called FroM, which directly measures the model parameters using the Frobenius norm, without any training data. By introducing an additional hyperparameter for control, FroM outperforms baseline methods across various fine-tuning scenarios, alleviating the task interference problem.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。