arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.03346cs.CLcs.AIcs.CVcs.LG
收藏

通过模型合并实现高效的去中心化多任务数据集评估

Efficient Decentralized Multi-task Dataset Valuation via Model Merging

Department of Computer Science Rensselaer Polytechnic Institute(罗切斯特理工学院计算机科学系)

Mohammadsajad Alipour, Mohammad Mohammadi Amiri

AI总结:

研究多任务数据集评估问题,提出DMVM框架,利用任务算法从模型组合推断数据集贡献,避免再训练和数据共享,还引入安全聚合协议,给出理论误差界限并实验验证。

摘要:

准确高效的数据集评估对数据市场至关重要,现有方法多限于单任务,不适用于多任务及去中心化场景。我们提出DMVM框架,通过模型合并直接从模型组合推断数据集贡献,避免再训练和数据共享,还引入安全聚合协议,给出理论误差界限并经实验验证。

英文摘要:

Accurate and efficient dataset valuation is essential for enabling fair and transparent data marketplaces, especially when multiple contributors provide data for training multi-task models. Most existing valuation methods, however, are limited to single-task settings, overlooking scenarios where a buyer aims to optimize performance across multiple downstream tasks. Moreover, traditional valuation approaches, such as Shapley-based or retraining-based methods, are computationally expensive and poorly suited for decentralized environments without a trusted central coordinator and with strict privacy constraints. We propose DMVM (Decentralized Multi-task Valuation via Model Merging), a novel framework that bypasses retraining and data sharing by leveraging task arithmetic to infer dataset contributions directly from model combinations. Instead of retraining or sharing raw data, DMVM quantifies how models trained on different datasets combine in parameter space to infer each dataset's marginal utility across multiple tasks. This formulation yields a valuation process that is scalable, computationally efficient, and explicitly aligned with multi-task generalization behavior. To support decentralized deployment, we introduce a secure aggregation protocol that enables collaborative valuation without revealing individual model parameters or private data. We also provide theoretical error bounds characterizing the approximation quality of DMVM and validate our framework through comprehensive experiments on computer vision and natural language processing tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑