arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.09781cs.DC
收藏

Clover:面向可持续AI的碳感知机器学习推理服务

Clover: Toward Sustainable AI with Carbon-Aware Machine Learning Inference Service

Baolin Li, Siddharth Samsi, Vijay Gadepally, Devesh Tiwari

AI总结:

本文提出Clover系统,通过混合质量模型与GPU资源分区,在保持高准确率和满足SLA的同时,显著降低大规模ML推理服务的碳排放。

摘要:

本文提出了一种解决方案,旨在缓解大规模机器学习(ML)推理服务托管过程中产生的碳排放挑战。ML推理对现代技术产品至关重要,但同时也是碳足迹的重要贡献者。我们介绍了Clover,一个碳友好的ML推理服务运行时系统,通过混合质量模型和GPU资源分区来平衡性能、准确性和碳排放。我们的实验结果表明,Clover在显著减少碳排放的同时,能够保持高准确性并满足服务等级协议(SLA)目标。

英文摘要:

This paper presents a solution to the challenge of mitigating carbon emissions from hosting large-scale machine learning (ML) inference services. ML inference is critical to modern technology products, but it is also a significant contributor to carbon footprint. We introduce Clover, a carbon-friendly ML inference service runtime system that balances performance, accuracy, and carbon emissions through mixed-quality models and GPU resource partitioning. Our experimental results demonstrate that Clover is effective in substantially reducing carbon emissions while maintaining high accuracy and meeting service level agreement (SLA) targets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑