arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.09109cs.LGcs.DC
收藏

主动学习即服务:面向数据中心AI的自动高效MLOps系统

Active-Learning-as-a-Service: An Automatic and Efficient MLOps System for Data-Centric AI

Institute for Infocomm Research(信息通信研究院);A*STAR(新加坡科技研究局);Nanyang Technological University(南洋理工大学);Institute of High Performance Computing(高性能计算研究院);National University of Singapore(新加坡国立大学)

Yizheng Huang, Huaizheng Zhang, Yuanming Li, Chiew Tong Lau, Yang You

摘要:

当今人工智能应用的成功不仅需要模型训练(以模型为中心),还需要数据工程(以数据为中心)。在以数据为中心的人工智能中,主动学习(AL)起着至关重要的作用,但目前的AL工具1)需要用户手动选择AL策略,2)不能有效地执行AL任务。为此,本文提出了一个自动和高效的MLOps系统,AL,命名为ALaaS(主动学习-即-服务)。具体而言,1)ALaaS实现了AL代理,包括性能预测器和工作流控制器,以在给定用户的数据集和预算的情况下决定最合适的AL策略。我们称之为基于预测的连续减半早停(PSHEA)过程。2)ALaaS采用服务器-客户端架构来支持AL管道,并实现阶段级并行以提高效率。同时,缓存和缓存技术被用来进一步加速AL过程。除了效率之外,ALAaaS还借助配置即服务的设计理念确保可访问性。大量实验表明,在延迟和吞吐量方面,ALAaaS优于所有其他基准。此外,在AL代理的指导下,ALaaS可以在不同的数据集和预算下为非专家用户自动选择和运行AL策略。我们的代码可在\url{https://github.com/MLSysOps/Active-Learning-as-a-Service}上获得。

英文摘要:

The success of today's AI applications requires not only model training (Model-centric) but also data engineering (Data-centric). In data-centric AI, active learning (AL) plays a vital role, but current AL tools 1) require users to manually select AL strategies, and 2) can not perform AL tasks efficiently. To this end, this paper presents an automatic and efficient MLOps system for AL, named ALaaS (Active-Learning-as-a-Service). Specifically, 1) ALaaS implements an AL agent, including a performance predictor and a workflow controller, to decide the most suitable AL strategies given users' datasets and budgets. We call this a predictive-based successive halving early-stop (PSHEA) procedure. 2) ALaaS adopts a server-client architecture to support an AL pipeline and implements stage-level parallelism for high efficiency. Meanwhile, caching and batching techniques are employed to further accelerate the AL process. In addition to efficiency, ALaaS ensures accessibility with the help of the design philosophy of configuration-as-a-service. Extensive experiments show that ALaaS outperforms all other baselines in terms of latency and throughput. Also, guided by the AL agent, ALaaS can automatically select and run AL strategies for non-expert users under different datasets and budgets. Our code is available at \url{https://github.com/MLSysOps/Active-Learning-as-a-Service}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑