Modern mobile devices, although resourceful, cannot train state-of-the-art machine learning models without the assistance of servers, which require access to, potentially, privacy-sensitive user data. Split learning has recently emerged as a promising technique for training complex deep learning (DL) models on low-powered mobile devices. The core idea behind this technique is to train the sensitive layers of a DL model on mobile devices while offloading the computationally intensive layers to a server. Although a lot of works have already explored the effectiveness of split learning in simulated settings, a usable toolkit for this purpose does not exist. In this work, we highlight the theoretical and technical challenges that need to be resolved to develop a functional framework that trains ML models in mobile devices without transferring raw data to a server. Focusing on these challenges, we propose SplitEasy, a framework for training ML models on mobile devices using split learning. Using the abstraction provided by SplitEasy, developers can run various DL models under split learning setting by making minimal modifications. We provide a detailed explanation of SplitEasy and perform experiments with six state-of-the-art neural networks. We demonstrate how SplitEasy can train models that cannot be trained solely by a mobile device while incurring nearly constant time per data sample.
A Practical Cross-Device Federated Learning Framework over 5G Networks
North China Electric Power University(华北电力大学);Fayetteville State University(费耶特维尔州立大学);Stevens Institute of Technology(史蒂文斯理工学院);Qatar University(卡塔尔大学)
Practical Physical Layer Authentication for Mobile Scenarios Using a Synthetic Dataset Enhanced Deep Learning Approach
Department of Electrical Engineering and Electronics, University of Liverpool(利物浦大学电子工程与电子系);Institute of Communications Engineering, National Tsing Hua University(国立清华大学通讯工程研究所)
TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platforms
THEMIS: Towards Practical Intellectual Property Protection for Post-Deployment On-Device Deep Learning Models
The University of Melbourne(墨尔本大学);The University of Western Australia(西澳大学);City University of Hong Kong(香港城市大学);Technical University of Munich(慕尼黑工业大学)
Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission
University of Houston(休斯顿大学);Beijing University of Posts and Telecommunications(北京邮电大学);University of Science and Technology of China(中国科学技术大学);University of Florida(佛罗里达大学)
Cost-Effective Federated Learning in Mobile Edge Networks
Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人学会);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Yale University(耶鲁大学);IBM T. J. Watson Research Center(IBM T. J. 沃森研究中心)