arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.01403cs.SEcs.AI
收藏

开源软件包库ML中软件工程实践的实证研究

Empirical Study on the Software Engineering Practices in Open Source ML Package Repositories

York University(约克大学);École Polytechnique de Montréal(蒙特利尔高等理工学院);Queen’s University(皇后大学)

Minke Xiu, Ellis E. Eghan, Zhen Ming, Jiang, Bram Adams

摘要:

人工智能(AI),特别是机器学习(ML)的最新进展已经引入了各种实际应用(例如,虚拟个人助理和自动驾驶汽车),增强日常用户的体验。然而,像深度学习这样的现代机器学习技术需要大量的技术专业知识和资源来开发、训练和部署这些模型,这使得有效地重用机器学习模型成为必要。实践者和研究人员的这种发现和重用正在由公共ML包存储库解决,该存储库将预先训练的模型捆绑到包中以供发布。由于这类储存库是最近才出现的现象,因此没有关于其现状和挑战的经验数据。因此,本文进行了一项探索性研究,分析了两个流行的ML包存储库TFHub和PyTorch Hub的结构和内容,比较了它们的信息元素(功能和策略),包组织,包管理器功能和使用上下文与流行的软件包存储库(npm,PyPI和CRAN)。通过这些研究,我们确定了共享ML包的独特SE实践和挑战。这些发现和影响对于打算使用这些共享ML包的数据科学家,研究人员和软件开发人员来说非常有用。

英文摘要:

Recent advances in Artificial Intelligence (AI), especially in Machine Learning (ML), have introduced various practical applications (e.g., virtual personal assistants and autonomous cars) that enhance the experience of everyday users. However, modern ML technologies like Deep Learning require considerable technical expertise and resources to develop, train and deploy such models, making effective reuse of the ML models a necessity. Such discovery and reuse by practitioners and researchers are being addressed by public ML package repositories, which bundle up pre-trained models into packages for publication. Since such repositories are a recent phenomenon, there is no empirical data on their current state and challenges. Hence, this paper conducts an exploratory study that analyzes the structure and contents of two popular ML package repositories, TFHub and PyTorch Hub, comparing their information elements (features and policies), package organization, package manager functionalities and usage contexts against popular software package repositories (npm, PyPI, and CRAN). Through these studies, we have identified unique SE practices and challenges for sharing ML packages. These findings and implications would be useful for data scientists, researchers and software developers who intend to use these shared ML packages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑