arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.01666cs.NI
收藏

一种协同大型云模型与小型边缘模型的生成式AI服务供给边缘云协作框架

An Edge-Cloud Collaboration Framework for Generative AI Service Provision with Synergetic Big Cloud Model and Small Edge Models

Yuqing Tian, Zhaoyang Zhang, Yuzhi Yang, Zirui Chen, Zhaohui Yang, Richeng Jin, Tony Q. S. Quek, Kai-Kit Wong

AI总结:

提出一种协同大型云模型与小型边缘模型的BAIM架构及分布式训练框架,通过图像生成用例验证其能有效提供原生GenAI服务并减轻边缘云负担。

摘要:

生成式人工智能(GenAI)通过内容创作为用户提供各种服务,被认为是未来网络中最重要的组成部分之一。然而,训练和部署大型人工智能模型(BAIMs)带来了大量的计算和通信开销。由于需要高性能计算基础设施,以及云服务长距离访问中的可靠性、保密性和时效性问题,这对集中式方法构成了关键挑战。因此,迫切需要将服务去中心化,将其部分从云端迁移至边缘,并建立原生GenAI服务,以实现私密、及时和个性化的体验。在本文中,我们提出了一种全新的自下而上的BAIM架构,协同大型云模型和小型边缘模型,并设计了一个分布式训练框架和面向任务的部署方案,以高效提供原生GenAI服务。所提出的框架能够促进协作智能,增强适应性,收集边缘知识并减轻边缘云负担。通过一个图像生成用例证明了所提框架的有效性。最后,我们概述了基础研究方向,以充分挖掘边缘和云在原生GenAI和BAIM应用中的协作潜力。

英文摘要:

Generative artificial intelligence (GenAI) offers various services to users through content creation, which is believed to be one of the most important components in future networks. However, training and deploying big artificial intelligence models (BAIMs) introduces substantial computational and communication overhead.This poses a critical challenge to centralized approaches, due to the need of high-performance computing infrastructure and the reliability, secrecy and timeliness issues in long-distance access of cloud services. Therefore, there is an urging need to decentralize the services, partly moving them from the cloud to the edge and establishing native GenAI services to enable private, timely, and personalized experiences. In this paper, we propose a brand-new bottom-up BAIM architecture with synergetic big cloud model and small edge models, and design a distributed training framework and a task-oriented deployment scheme for efficient provision of native GenAI services. The proposed framework can facilitate collaborative intelligence, enhance adaptability, gather edge knowledge and alleviate edge-cloud burden. The effectiveness of the proposed framework is demonstrated through an image generation use case. Finally, we outline fundamental research directions to fully exploit the collaborative potential of edge and cloud for native GenAI and BAIM applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑