arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2402.04880cs.DCcs.AIcs.LG
收藏

结合云端与移动计算进行机器学习

Combining Cloud and Mobile Computing for Machine Learning

University of Chicago(芝加哥大学)

Ruiqi Xu, Tianchi Zhang

AI总结:

本文提出通过模型分割在移动设备与云端之间灵活分配机器学习推理任务,并设计调度器综合网络、设备与作业信息,在降低用户等待时间的同时优化云端负载。

摘要:

尽管移动设备的计算能力在不断提升,机器学习模型的规模也在持续增长。由于移动设备在内存容量和电池寿命等方面的限制,这一趋势给它们带来了问题。虽然许多服务(如ChatGPT和Midjourney)将所有推理任务都在云端执行,但我们认为一种灵活且细粒度的任务分配方式更为可取。在这项工作中,我们将模型分割视为改善用户体验的一种解决方案,通过在移动设备和云端之间划分计算任务,将模型中计算量大的部分卸载出去,同时尽量减少所需的数据传输。我们表明,这种划分不仅减少了用户的等待时间,还可以进行微调以优化云端的工作负载。为了实现这一目标,我们设计了一个调度器,该调度器收集有关网络质量、客户端设备能力和作业需求的信息,做出决策以在一系列设备上实现一致的性能,同时减少云端需要执行的工作量。

英文摘要:

Although the computing power of mobile devices is increasing, machine learning models are also growing in size. This trend creates problems for mobile devices due to limitations like their memory capacity and battery life. While many services, like ChatGPT and Midjourney, run all the inferences in the cloud, we believe a flexible and fine-grained task distribution is more desirable. In this work, we consider model segmentation as a solution to improving the user experience, dividing the computation between mobile devices and the cloud in a way that offloads the compute-heavy portion of the model while minimizing the data transfer required. We show that the division not only reduces the wait time for users but can also be fine-tuned to optimize the workloads of the cloud. To achieve that, we design a scheduler that collects information about network quality, client device capability, and job requirements, making decisions to achieve consistent performance across a range of devices while reducing the work the cloud needs to perform.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑