arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.07129cs.LGcs.DC
收藏

AdaptiveNet:针对不同边缘环境的部署后神经架构适配

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments

Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));Shanghai AI Laboratory(上海人工智能实验室);Shanghai University(上海大学);Microsoft Research(微软研究院);AsiaInfo Technologies (China), Inc.(亚信科技(中国)有限公司)

Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu

摘要:

深度学习模型越来越多地被部署到边缘设备上,用于实时应用。为了确保跨不同边缘环境的稳定服务质量,非常需要为不同条件生成量身定制的模型架构。然而,由于难以处理边缘环境的多样性和对边缘信息的需求,传统的预部署模型生成方法并不令人满意。在本文中,我们建议在目标环境中部署后调整模型架构,其中可以精确测量模型质量并保留私有边缘数据。为了实现高效和有效的边缘模型生成,我们引入了一种预训练辅助的云上模型弹性化方法和一种边缘友好的设备上架构搜索方法。模型弹性化在开发人员指定的oracle模型的指导下生成模型架构的高质量搜索空间。空间中的每个子网都是具有不同环境亲和力的有效模型,每个设备都可以基于一系列边缘定制优化来有效地找到并维护最合适的子网。在各种边缘设备上进行的大量实验表明,我们的方法能够以最小的开销(云中13个GPU小时,边缘服务器上2分钟)实现比强基线更好的准确性-延迟权衡(例如,平均准确性高出46.74%,延迟预算为60%)。

英文摘要:

Deep learning models are increasingly deployed to edge devices for real-time applications. To ensure stable service quality across diverse edge environments, it is highly desirable to generate tailored model architectures for different conditions. However, conventional pre-deployment model generation approaches are not satisfactory due to the difficulty of handling the diversity of edge environments and the demand for edge information. In this paper, we propose to adapt the model architecture after deployment in the target environment, where the model quality can be precisely measured and private edge data can be retained. To achieve efficient and effective edge model generation, we introduce a pretraining-assisted on-cloud model elastification method and an edge-friendly on-device architecture search method. Model elastification generates a high-quality search space of model architectures with the guidance of a developer-specified oracle model. Each subnet in the space is a valid model with different environment affinity, and each device efficiently finds and maintains the most suitable subnet based on a series of edge-tailored optimizations. Extensive experiments on various edge devices demonstrate that our approach is able to achieve significantly better accuracy-latency tradeoffs (e.g. 46.74\% higher on average accuracy with a 60\% latency budget) than strong baselines with minimal overhead (13 GPU hours in the cloud and 2 minutes on the edge server).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑