arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.04232cs.LGcs.CRstat.ML
收藏

SplitEasy:一种在移动设备上训练ML模型的实用方法

SplitEasy: A Practical Approach for Training ML models on Mobile Devices

NIT Trichy(印度国家理工学院蒂鲁吉拉伯利分校);Drexel University(德雷塞尔大学);HKUST(香港科技大学)

Kamalesh Palanisamy, Vivek Khimani, Moin Hussain Moti, Dimitris Chatzopoulos

摘要:

现代移动设备虽然资源丰富,但在没有服务器帮助的情况下无法训练最先进的机器学习模型,服务器需要访问潜在的隐私敏感用户数据。分裂学习最近已经成为一种很有前途的技术,用于在低功耗移动设备上训练复杂的深度学习(DL)模型。这种技术背后的核心思想是在移动设备上训练DL模型的敏感层,同时将计算密集型层卸载到服务器。虽然很多作品已经探索了分裂学习在模拟环境中的有效性,但并不存在用于此目的的可用工具包。在这项工作中,我们强调了需要解决的理论和技术挑战,以开发一个功能框架,在移动设备中训练ML模型,而无需将原始数据传输到服务器。针对这些挑战,我们提出了SplitEasy,这是一个使用分割学习在移动设备上训练ML模型的框架。使用SplitEasy提供的抽象,开发人员可以通过进行最小的修改来在分裂学习设置下运行各种DL模型。我们提供了SplitEasy的详细解释,并使用六个最先进的神经网络进行实验。我们演示了如何SplitEasy可以训练模型,不能单独由一个移动终端训练,而每个数据样本几乎恒定的时间。

英文摘要:

Modern mobile devices, although resourceful, cannot train state-of-the-art machine learning models without the assistance of servers, which require access to, potentially, privacy-sensitive user data. Split learning has recently emerged as a promising technique for training complex deep learning (DL) models on low-powered mobile devices. The core idea behind this technique is to train the sensitive layers of a DL model on mobile devices while offloading the computationally intensive layers to a server. Although a lot of works have already explored the effectiveness of split learning in simulated settings, a usable toolkit for this purpose does not exist. In this work, we highlight the theoretical and technical challenges that need to be resolved to develop a functional framework that trains ML models in mobile devices without transferring raw data to a server. Focusing on these challenges, we propose SplitEasy, a framework for training ML models on mobile devices using split learning. Using the abstraction provided by SplitEasy, developers can run various DL models under split learning setting by making minimal modifications. We provide a detailed explanation of SplitEasy and perform experiments with six state-of-the-art neural networks. We demonstrate how SplitEasy can train models that cannot be trained solely by a mobile device while incurring nearly constant time per data sample.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑