Recent breakthroughs in deep learning and artificial intelligence technologies have enabled numerous mobile applications. While traditional computation paradigms rely on mobile sensing and cloud computing, deep learning implemented on mobile devices provides several advantages. These advantages include low communication bandwidth, small cloud computing resource cost, quick response time, and improved data privacy. Research and development of deep learning on mobile and embedded devices has recently attracted much attention. This paper provides a timely review of this fast-paced field to give the researcher, engineer, practitioner, and graduate student a quick grasp on the recent advancements of deep learning on mobile devices. In this paper, we discuss hardware architectures for mobile deep learning, including Field Programmable Gate Arrays, Application Specific Integrated Circuit, and recent mobile Graphic Processing Units. We present Size, Weight, Area and Power considerations and their relation to algorithm optimizations, such as quantization, pruning, compression, and approximations that simplify computation while retaining performance accuracy. We cover existing systems and give a state-of-the-industry review of TensorFlow, MXNet, Mobile AI Compute Engine, and Paddle-mobile deep learning platform. We discuss resources for mobile deep learning practitioners, including tools, libraries, models, and performance benchmarks. We present applications of various mobile sensing modalities to industries, ranging from robotics, healthcare and multi-media, biometrics to autonomous drive and defense. We address the key deep learning challenges to overcome, including low quality data, and small training/adaptation data sets. In addition, the review provides numerous citations and links to existing code bases implementing various technologies.
Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission
University of Houston(休斯顿大学);Beijing University of Posts and Telecommunications(北京邮电大学);University of Science and Technology of China(中国科学技术大学);University of Florida(佛罗里达大学)
Towards Energy Efficient Federated Learning over 5G+ Mobile Devices
University of Houston(休斯顿大学);Xidian University(西安电子科技大学);University of Florida(佛罗里达大学)
机器学习算法、5G及5G+无线通信和人工智能硬件实现的不断融合催生了5G+移动设备上的联邦学习(FL),将人工智能功能推向移动设备,开启了设备上人工智能应用的新时代。尽管FL取得了显着进展,但巨大的能耗是限制FL在电池受限的5G+移动设备上发展的最重要障碍之一。为了解决这个问题,在本文中,我们研究了如何通过在“工作”的能耗(即,本地计算)和用于“通话”的(即,无线通信),以提高整体能源效率。具体来说,我们首先研究图形处理单元(GPU)计算和无线传输的能耗模型。然后,我们概述了将FL过程与节能学习技术(例如,梯度稀疏化、权重量化、修剪等)。最后,我们从能源效率的角度提出了FL over 5G+移动设备的几个潜在的未来研究方向。
REWAFL: Residual Energy and Wireless Aware Participant Selection for Efficient Federated Learning over Mobile Devices
Beijing University of Posts and Telecommunications(北京邮电大学);Peng Cheng Laboratory(鹏城实验室);University of Houston(休斯顿大学);University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校)