Couler:云端统一机器学习工作流优化
Couler: Unified Machine Learning Workflow Optimization in Cloud
AI总结:
针对多工作流引擎API学习成本高、跨引擎优化缺失的问题,提出集成大语言模型的统一ML工作流优化系统Couler,支持自然语言生成工作流、多阶段缓存等优化,在蚂蚁集团生产环境显著提升资源利用率与工作流完成率。
摘要:
机器学习(ML)已无处不在,为各类组织的数据驱动型应用提供支撑。与研究领域对ML的传统认知不同,ML工作流可能十分复杂、资源消耗大且耗时漫长。将ML工作流扩展以覆盖更广泛的数据基础设施和数据类型,可能会导致工作负载增大、部署成本上升。目前已有众多工作流引擎可用(其中十余个得到广泛认可),这种多样性给终端用户掌握不同引擎的API带来了挑战。现有工作主要聚焦于为特定工作流引擎优化ML运维(MLOps),但当前方法大多忽略了跨不同引擎的工作流优化。\n在本研究中,我们设计并实现了Couler——一款专为云端统一ML工作流优化打造的系统。我们的核心洞见在于能够利用自然语言(NL)描述生成ML工作流。我们将大语言模型(LLM)集成到工作流生成过程中,并为各类工作流引擎提供统一的编程接口,该方法免去了用户学习各类工作流引擎API的需求。此外,Couler通过在多个阶段引入自动缓存、支持大型工作流自动并行化以及自动超参数调优,提升了工作流的计算效率。这些优化减少了冗余计算成本,并提高了深度学习工作流训练过程中的容错性。Couler已在蚂蚁集团的真实生产场景中大规模部署,每日处理约2.2万个工作流,成功将CPU/内存利用率提升了15%以上,工作流完成率提升了约17%。
英文摘要:
Machine Learning (ML) has become ubiquitous, fueling data-driven applications across various organizations. Contrary to the traditional perception of ML in research, ML workflows can be complex, resource-intensive, and time-consuming. Expanding an ML workflow to encompass a wider range of data infrastructure and data types may lead to larger workloads and increased deployment costs. Currently, numerous workflow engines are available (with over ten being widely recognized). This variety poses a challenge for end-users in terms of mastering different engine APIs. While efforts have primarily focused on optimizing ML Operations (MLOps) for a specific workflow engine, current methods largely overlook workflow optimization across different engines. In this work, we design and implement Couler, a system designed for unified ML workflow optimization in the cloud. Our main insight lies in the ability to generate an ML workflow using natural language (NL) descriptions. We integrate Large Language Models (LLMs) into workflow generation, and provide a unified programming interface for various workflow engines. This approach alleviates the need to understand various workflow engines' APIs. Moreover, Couler enhances workflow computation efficiency by introducing automated caching at multiple stages, enabling large workflow auto-parallelization and automatic hyperparameters tuning. These enhancements minimize redundant computational costs and improve fault tolerance during deep learning workflow training. Couler is extensively deployed in real-world production scenarios at Ant Group, handling approximately 22k workflows daily, and has successfully improved the CPU/Memory utilization by more than 15% and the workflow completion rate by around 17%.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。