Deep neural networks provide state-of-the-art accuracy for vision tasks but they require significant resources for training. Thus, they are trained on cloud servers far from the edge devices that acquire the data. This issue increases communication cost, runtime and privacy concerns. In this study, a novel hierarchical training method for deep neural networks is proposed that uses early exits in a divided architecture between edge and cloud workers to reduce the communication cost, training runtime and privacy concerns. The method proposes a brand-new use case for early exits to separate the backward pass of neural networks between the edge and the cloud during the training phase. We address the issues of most available methods that due to the sequential nature of the training phase, cannot train the levels of hierarchy simultaneously or they do it with the cost of compromising privacy. In contrast, our method can use both edge and cloud workers simultaneously, does not share the raw input data with the cloud and does not require communication during the backward pass. Several simulations and on-device experiments for different neural network architectures demonstrate the effectiveness of this method. It is shown that the proposed method reduces the training runtime for VGG-16 and ResNet-18 architectures by 29% and 61% in CIFAR-10 classification and by 25% and 81% in Tiny ImageNet classification when the communication with the cloud is done over a low bit rate channel. This gain in the runtime is achieved whilst the accuracy drop is negligible. This method is advantageous for online learning of high-accuracy deep neural networks on sensor-holding low-resource devices such as mobile phones or robots as a part of an edge-cloud system, making them more flexible in facing new tasks and classes of data.
You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language Model
North Carolina State University(北卡罗来纳州立大学);Google Research(谷歌研究院);Northeastern University(东北大学);University of Michigan(密歇根大学);The University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);University of Connecticut(康涅狄格大学)
LGViT: Dynamic Early Exiting for Accelerating Vision Transformer
Beijing Institute of Technology(北京理工大学);JD Explore Academy(京东探索研究院);Wuhan University(武汉大学);China Academic of Electronics and Information Technology(中国电子信息技术研究院);City, University of London(伦敦大学城市学院)
Early Exiting Predictive Coding Neural Networks for Edge AI
TICLab, International University of Rabat, Morocco(TICLab,拉巴特国际大学,摩洛哥);College of Computing, University Mohammed VI Polytechnic, Morocco(计算机学院,穆罕默德六世理工大学,摩洛哥);School of Electronic and Electrical Engineering, University of Leeds, UK(电子与电气工程学院,利兹大学,英国)
Balancing Stability and Plasticity in Sequentially Trained Early-Exiting Neural Networks
TICLab, International University of Rabat, Morocco(拉巴特国际大学TIC实验室,摩洛哥);College of Computing, University Mohammed VI Polytechnic, Morocco(摩洛哥穆莱·伊斯梅尔Polytechnic大学计算机学院);School of Electronic and Electrical Engineering, University of Leeds, UK(利兹大学电子与电气工程学院)
ViT-FREE: Efficient Face Recognition via Early Exiting and Synthetic Adaptation
Fraunhofer Institute for Computer Graphics Research IGD, Germany(德国弗劳恩霍夫计算机图形学研究所IGD);Department of Computer Science, TU Darmstadt, Germany(德国达姆施塔特工业大学计算机科学系)
An Uncertainty-aware Hierarchical Probabilistic Network for Early Prediction, Quantification and Segmentation of Pulmonary Tumour Growth
Eurecat Centre Tecnològic de Catalunya(加泰罗尼亚技术中心Eurecat);Universitat Pompeu Fabra(庞培法布拉大学);Vall d’Hebron University Hospital(巴尔德希伯伦大学医院);ICREA(加泰罗尼亚高等研究院)
A Retrospective Systematic Study on Hierarchical Sparse Query Transformer-assisted Ultrasound Screening for Early Hepatocellular Carcinoma
Northwestern Polytechnical University(西北工业大学);The First Affiliated Hospital of Sun Yat-Sen University(中山大学附属第一医院);The Seventh Affiliated Hospital of Sun Yat-Sen University(中山大学附属第七医院);The First Affiliated Hospital of Guangxi Medical University(广西医科大学附属第一医院);Xi’an Jiaotong University(西安交通大学)
HiDrop: Hierarchical Vision Token Reduction in MLLMs via Late Injection, Concave Pyramid Pruning, and Early Exit
Institute of Digital Twin, Eastern Institute of Technology(数字孪生研究所,东部技术研究所);Ningbo Key Laboratory of Spatial Intelligence and Digital Derivative(宁波空间智能与数字衍生关键实验室);University of Science and Technology of China(中国科学技术大学);Shanghai Jiao Tong University(上海交通大学);Munich Center for Machine Learning, LMU Munich(慕尼黑大学机器学习中心,慕尼黑大学)