Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Deploying deep-learning-based intelligence near the end-user enhances privacy protection, responsiveness, and reliability. Resource-constrained end-devices must be carefully managed in order to meet the latency and energy requirements of computationally-intensive deep learning services. Collaborative end-edge-cloud computing for deep learning provides a range of performance and efficiency that can address application requirements through computation offloading. The decision to offload computation is a communication-computation co-optimization problem that varies with both system parameters (e.g., network condition) and workload characteristics (e.g., inputs). On the other hand, deep learning model optimization provides another source of tradeoff between latency and model accuracy. An end-to-end decision-making solution that considers such computation-communication problem is required to synergistically find the optimal offloading policy and model for deep learning services. To this end, we propose a reinforcement-learning-based computation offloading solution that learns optimal offloading policy considering deep learning model selection techniques to minimize response time while providing sufficient accuracy. We demonstrate the effectiveness of our solution for edge devices in an end-edge-cloud system and evaluate with a real-setup implementation using multiple AWS and ARM core configurations. Our solution provides 35% speedup in the average response time compared to the state-of-the-art with less than 0.9% accuracy reduction, demonstrating the promise of our online learning framework for orchestrating DL inference in end-edge-cloud systems.
Intelligent Autonomous Orchestration for Distributed Cloud Resources using Complex-Stability Analysis
Department of Computer Science \& Engineering Presidency University, Bengaluru, India Email;Department of Computer Science \& Engineering REVA University, Bengaluru, India Email
Machine Learning-based Orchestration of Containers: A Taxonomy and Future Directions
The University of Melbourne(墨尔本大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);The University of Macau(澳门大学)
A Robust Adaptive Workload Orchestration in Pure Edge Computing
University College Dublin(都柏林大学);University Kasdi Merbah(卡斯迪·梅尔巴大学);Laboratory of Artificial Intelligence and Information Technology (LINATI)(人工智能与信息技术实验室(LINATI))
CNFP: Optimizing Cloud-Native Network Function Placement with Diffusion Models on the Cloud Continuum
atlanTTic - I&C Lab - Universidade de Vigo(atlanTTic - I&C实验室 - 维戈大学);Centro Tecnolóxico de Telecomunicacións de Galicia (GRADIANT)(加利西亚电信技术中心(GRADIANT))