arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.04529cs.LGcs.SE
收藏

Git-Theta:一个用于机器学习模型协作开发的 Git 扩展

Git-Theta: A Git Extension for Collaborative Development of Machine Learning Models

University of North Carolina(北卡罗来纳大学)

Nikhil Kandpal, Brian Lester, Mohammed Muqeeth, Anisha Mascarenhas, Monty Evans, Vishal Baskaran, Tenghao Huang, Haokun Liu, Colin Raffel

AI总结:

本文提出 Git-Theta,一个基于 Git 的机器学习模型版本控制扩展,支持参数级变更跟踪、高效更新、自动合并、差异报告和插件扩展,以促进模型的分布式协作与持续开发。

摘要:

目前,大多数机器学习模型由集中式团队训练,并且很少更新。相比之下,开源软件开发涉及通过分布式协作,使用版本控制系统对共享制品进行迭代式开发。为了实现机器学习模型的协作式和持续改进,我们推出了 Git-Theta,这是一个面向机器学习模型的版本控制系统。Git-Theta 是对应用最广泛的版本控制软件 Git 的扩展,它允许在跟踪代码和其他制品的同时,对模型参数的变化进行细粒度跟踪。与现有版本控制系统将模型检查点视为一团数据不同,Git-Theta 利用检查点的结构来支持通信高效的更新、自动模型合并,以及关于两个模型版本之间差异的有意义报告。此外,Git-Theta 包含一个插件系统,使用户能够轻松添加对新功能的支持。在本文中,我们介绍了 Git-Theta 的设计和特性,并给出了一个 Git-Theta 的示例用例,其中一个预训练模型被持续适配和修改。我们公开发布 Git-Theta,希望开启协作式模型开发的新时代。

英文摘要:

Currently, most machine learning models are trained by centralized teams and are rarely updated. In contrast, open-source software development involves the iterative development of a shared artifact through distributed collaboration using a version control system. In the interest of enabling collaborative and continual improvement of machine learning models, we introduce Git-Theta, a version control system for machine learning models. Git-Theta is an extension to Git, the most widely used version control software, that allows fine-grained tracking of changes to model parameters alongside code and other artifacts. Unlike existing version control systems that treat a model checkpoint as a blob of data, Git-Theta leverages the structure of checkpoints to support communication-efficient updates, automatic model merges, and meaningful reporting about the difference between two versions of a model. In addition, Git-Theta includes a plug-in system that enables users to easily add support for new functionality. In this paper, we introduce Git-Theta's design and features and include an example use-case of Git-Theta where a pre-trained model is continually adapted and modified. We publicly release Git-Theta in hopes of kickstarting a new era of collaborative model development.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑