arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2002.02897cs.LGcs.NIstat.ML
收藏

MDLdroid:一种用于个人移动感知的移动深度学习的ChainSGD-reduce方法

MDLdroid: a ChainSGD-reduce Approach to Mobile Deep Learning for Personal Mobile Sensing

RMIT University(皇家墨尔本理工大学)

Yu Zhang, Tao Gu, Xi Zhang

摘要:

个人移动传感正在迅速渗透到我们的日常生活中,以实现活动监测、医疗保健和康复。与深度学习相结合,这些应用在近年来取得了重大成功。与传统的基于云的范例不同,在设备上运行深度学习提供了几个优点,包括数据隐私保护和模型推理和更新的低延迟响应。由于数据汇集在现实中是昂贵的,谷歌的联邦学习不仅提供了完整的数据隐私,而且基于多个用户数据提供了更好的模型鲁棒性。然而,个人移动传感应用大多是用户特定的,受环境的影响很大。因此,连续的局部变化可能会严重影响由联邦学习生成的全局模型的性能。此外,在本地服务器上部署联邦学习,例如,边缘服务器由于资源的限制和受到攻击的严重故障,可能很快达到瓶颈。为了推动设备上的深度学习,我们提出了MDLdroid,一个新的分散式移动深度学习框架,使资源感知的个人移动传感应用程序的设备上的协作学习。为了解决资源的限制,我们提出了一个ChainSGD减少方法,其中包括一个新的链定向同步随机梯度下降算法,以有效地减少多个设备之间的开销。我们还设计了一个基于代理的多目标强化学习机制,以公平和有效的方式平衡资源。我们的评估表明,我们在现成移动设备上的模型训练比单设备训练快2倍到3.5倍,比主从方法快1.5倍。

英文摘要:

Personal mobile sensing is fast permeating our daily lives to enable activity monitoring, healthcare and rehabilitation. Combined with deep learning, these applications have achieved significant success in recent years. Different from conventional cloud-based paradigms, running deep learning on devices offers several advantages including data privacy preservation and low-latency response for both model inference and update. Since data collection is costly in reality, Google's Federated Learning offers not only complete data privacy but also better model robustness based on multiple user data. However, personal mobile sensing applications are mostly user-specific and highly affected by environment. As a result, continuous local changes may seriously affect the performance of a global model generated by Federated Learning. In addition, deploying Federated Learning on a local server, e.g., edge server, may quickly reach the bottleneck due to resource constraint and serious failure by attacks. Towards pushing deep learning on devices, we present MDLdroid, a novel decentralized mobile deep learning framework to enable resource-aware on-device collaborative learning for personal mobile sensing applications. To address resource limitation, we propose a ChainSGD-reduce approach which includes a novel chain-directed Synchronous Stochastic Gradient Descent algorithm to effectively reduce overhead among multiple devices. We also design an agent-based multi-goal reinforcement learning mechanism to balance resources in a fair and efficient manner. Our evaluations show that our model training on off-the-shelf mobile devices achieves 2x to 3.5x faster than single-device training, and 1.5x faster than the master-slave approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑