arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.07245eess.SYcs.NIcs.SYeess.SP
收藏

通过约束学习加速移动边缘生成(MEG)

Accelerating Mobile Edge Generation (MEG) by Constrained Learning

Xiaoxia Xu, Yuanwei Liu, Xidong Mu, Hong Xing, Arumugam Nallanathan

AI总结:

本文提出加速移动边缘生成框架,通过联合优化去噪步数与特征合并比例,并基于约束变分策略优化算法MEG-CVPO,在时延和能耗约束下实现高质量图像生成,较传统方案降低超过40%时延。

摘要:

提出了一种新颖的加速移动边缘生成(MEG)框架,用于在移动设备上生成高分辨率图像。该框架利用分布在边缘服务器(ES)和用户设备(UE)上的大规模潜在扩散模型(LDM),通过在ES与UE之间传输低维特征,实现成本高效的人工智能生成内容(AIGC)。为了降低分布式计算和传输的开销,构思了一种动态扩散与特征合并方案。通过联合优化去噪步数和特征合并比例,在时延和能耗约束下最大化图像生成质量。为解决该问题并定制LDM子模型,开发了一种低复杂度MEG加速协议。具体而言,通过离线蒸馏训练骨干元架构。然后,在在线信道环境中确定动态扩散和特征合并,该过程可视为一个约束马尔可夫决策过程(MDP)。进一步提出了一种基于约束变分策略优化(CVPO)的MEG算法,用于约束保证学习,即MEG-CVPO。数值结果验证:1)所提出的框架能够在噪声信道上生成1024×1024高质量图像,同时与传统生成方案相比降低超过40%的时延。2)所开发的MEG-CVPO有效缓解了约束违反,从而灵活控制图像失真与生成成本之间的权衡。

英文摘要:

A novel accelerated mobile edge generation (MEG) framework is proposed for generating high-resolution images on mobile devices. Exploiting a large-scale latent diffusion model (LDM) distributed across edge server (ES) and user equipment (UE), cost-efficient artificial intelligence generated content (AIGC) is achieved by transmitting low-dimensional features between ES and UE. To reduce overheads of both distributed computations and transmissions, a dynamic diffusion and feature merging scheme is conceived. By jointly optimizing the denoising steps and feature merging ratio, the image generation quality is maximized subject to latency and energy consumption constraints. To address this problem and tailor LDM sub-models, a low-complexity MEG acceleration protocol is developed. Particularly, a backbone meta-architecture is trained via offline distillation. Then, dynamic diffusion and feature merging are determined in online channel environment, which can be viewed as a constrained Markov Decision Process (MDP). A constrained variational policy optimization (CVPO) based MEG algorithm is further proposed for constraint-guaranteed learning, namely MEG-CVPO. Numerical results verify that: 1) The proposed framework can generate 1024$\times$1024 high-quality images over noisy channels while reducing over $40\%$ latency compared to conventional generation schemes. 2) The developed MEG-CVPO effectively mitigates constraint violations, thus flexibly controlling the trade-off between image distortion and generation costs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑