arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.04529cs.LGcs.AIcs.DC
收藏

提升基础模型联邦微调中的数据质量

Enhancing Data Quality in Federated Fine-Tuning of Foundation Models

University of Cambridge(剑桥大学);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);Flower Labs

Wanru Zhao, Yaxin Du, Nicholas Donald Lane, Siheng Chen, Yanfeng Wang

AI总结:

针对基础模型联邦微调中不共享私有数据的本地训练场景下数据质量控制难的问题,提出一种计算数据质量分数并设全局阈值的控制流水线,可提升训练有效性与模型性能。

摘要:

在当前基础模型训练的格局中,训练高度依赖公共领域数据,而近期研究表明这类数据正趋近枯竭。为进一步扩大训练规模,整合多个专业化、高质量的私有领域数据源开展协作至关重要。然而,需在不共享私有数据的前提下本地训练模型,这一挑战给数据质量控制带来了诸多阻碍。为解决该问题,我们提出一种面向基础模型联邦微调的数据质量控制流水线。该流水线计算反映训练数据质量的分数,并确定全局阈值以形成统一标准,旨在提升全局性能。我们的实验表明,所提出的质量控制流水线提升了模型训练的有效性与可靠性,能带来更优的性能表现。

英文摘要:

In the current landscape of foundation model training, there is a significant reliance on public domain data, which is nearing exhaustion according to recent research. To further scale up, it is crucial to incorporate collaboration among multiple specialized and high-quality private domain data sources. However, the challenge of training models locally without sharing private data presents numerous obstacles in data quality control. To tackle this issue, we propose a data quality control pipeline for federated fine-tuning of foundation models. This pipeline computes scores reflecting the quality of training data and determines a global threshold for a unified standard, aiming for improved global performance. Our experiments show that the proposed quality control pipeline facilitates the effectiveness and reliability of the model training, leading to better performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑