Git-Theta:一个用于机器学习模型协作开发的 Git 扩展
Git-Theta: A Git Extension for Collaborative Development of Machine Learning Models
AI总结:
本文提出 Git-Theta,一个基于 Git 的机器学习模型版本控制扩展,支持参数级变更跟踪、高效更新、自动合并、差异报告和插件扩展,以促进模型的分布式协作与持续开发。
摘要:
目前,大多数机器学习模型由集中式团队训练,并且很少更新。相比之下,开源软件开发涉及通过分布式协作,使用版本控制系统对共享制品进行迭代式开发。为了实现机器学习模型的协作式和持续改进,我们推出了 Git-Theta,这是一个面向机器学习模型的版本控制系统。Git-Theta 是对应用最广泛的版本控制软件 Git 的扩展,它允许在跟踪代码和其他制品的同时,对模型参数的变化进行细粒度跟踪。与现有版本控制系统将模型检查点视为一团数据不同,Git-Theta 利用检查点的结构来支持通信高效的更新、自动模型合并,以及关于两个模型版本之间差异的有意义报告。此外,Git-Theta 包含一个插件系统,使用户能够轻松添加对新功能的支持。在本文中,我们介绍了 Git-Theta 的设计和特性,并给出了一个 Git-Theta 的示例用例,其中一个预训练模型被持续适配和修改。我们公开发布 Git-Theta,希望开启协作式模型开发的新时代。
英文摘要:
Currently, most machine learning models are trained by centralized teams and are rarely updated. In contrast, open-source software development involves the iterative development of a shared artifact through distributed collaboration using a version control system. In the interest of enabling collaborative and continual improvement of machine learning models, we introduce Git-Theta, a version control system for machine learning models. Git-Theta is an extension to Git, the most widely used version control software, that allows fine-grained tracking of changes to model parameters alongside code and other artifacts. Unlike existing version control systems that treat a model checkpoint as a blob of data, Git-Theta leverages the structure of checkpoints to support communication-efficient updates, automatic model merges, and meaningful reporting about the difference between two versions of a model. In addition, Git-Theta includes a plug-in system that enables users to easily add support for new functionality. In this paper, we introduce Git-Theta's design and features and include an example use-case of Git-Theta where a pre-trained model is continually adapted and modified. We publicly release Git-Theta in hopes of kickstarting a new era of collaborative model development.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。