大规模多任务动态ML系统的可持续开发方法
A Continual Development Methodology for Large-scale Multitask Dynamic ML Systems
摘要:
传统的机器学习(ML)方法需要将开发和实验过程分割成不连续的迭代,其反馈用于指导设计或调整选择。这种方法具有多个效率和可扩展性缺点,例如,导致花费大量资源创建多个试验模型,而这些模型对最终解决方案没有贡献。所提出的工作基于这样一种直觉,即将ML模型定义为模块化和可扩展的人工制品,可以引入一种新颖的ML开发方法,从而将多个设计和评估迭代集成到不断丰富的一个单一的无限智能系统我们定义了一种新的方法来生成动态多任务ML模型作为一系列的扩展和概括。我们首先使用标准的ML经验评估方法来分析所提出的方法的能力。最后,我们提出了一种新的持续开发方法,允许动态扩展预先存在的多任务大规模ML系统,同时分析所提出的方法扩展的属性。这导致能够联合解决124个图像分类任务的ML模型的生成,从而以改进的尺寸和计算成本实现最先进的质量。
英文摘要:
The traditional Machine Learning (ML) methodology requires to fragment the development and experimental process into disconnected iterations whose feedback is used to guide design or tuning choices. This methodology has multiple efficiency and scalability disadvantages, such as leading to spend significant resources into the creation of multiple trial models that do not contribute to the final solution.The presented work is based on the intuition that defining ML models as modular and extensible artefacts allows to introduce a novel ML development methodology enabling the integration of multiple design and evaluation iterations into the continuous enrichment of a single unbounded intelligent system. We define a novel method for the generation of dynamic multitask ML models as a sequence of extensions and generalizations. We first analyze the capabilities of the proposed method by using the standard ML empirical evaluation methodology. Finally, we propose a novel continuous development methodology that allows to dynamically extend a pre-existing multitask large-scale ML system while analyzing the properties of the proposed method extensions. This results in the generation of an ML model capable of jointly solving 124 image classification tasks achieving state of the art quality with improved size and compute cost.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。