AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));Shanghai AI Laboratory(上海人工智能实验室);Shanghai University(上海大学);Microsoft Research(微软研究院);AsiaInfo Technologies (China), Inc.(亚信科技(中国)有限公司)
Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu
Deep learning models are increasingly deployed to edge devices for real-time applications. To ensure stable service quality across diverse edge environments, it is highly desirable to generate tailored model architectures for different conditions. However, conventional pre-deployment model generation approaches are not satisfactory due to the difficulty of handling the diversity of edge environments and the demand for edge information. In this paper, we propose to adapt the model architecture after deployment in the target environment, where the model quality can be precisely measured and private edge data can be retained. To achieve efficient and effective edge model generation, we introduce a pretraining-assisted on-cloud model elastification method and an edge-friendly on-device architecture search method. Model elastification generates a high-quality search space of model architectures with the guidance of a developer-specified oracle model. Each subnet in the space is a valid model with different environment affinity, and each device efficiently finds and maintains the most suitable subnet based on a series of edge-tailored optimizations. Extensive experiments on various edge devices demonstrate that our approach is able to achieve significantly better accuracy-latency tradeoffs (e.g. 46.74\% higher on average accuracy with a 60\% latency budget) than strong baselines with minimal overhead (13 GPU hours in the cloud and 2 minutes on the edge server).
DANCE: Resource-Efficient Neural Architecture Search with Data-Aware and Continuous Adaptation
City University of Hong Kong(香港城市大学);Australian Artificial Intelligence Institute, University of Technology Sydney(澳大利亚人工智能研究所,悉尼技术大学);Wuhan University(武汉大学);Southern University of Science and Technology(南方科技大学)
Transferable Reinforcement Learning via Probabilistic Latent Embeddings and Dynamic Policy Adaptation for Sim-to-Real Deployment
Lyles School of Civil and Construction Engineering, Purdue University, West Lafayette, USA(普渡大学土木与建设工程学院);Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, USA(普渡大学埃尔莫尔家庭电气与计算机工程学院)
CASCADE: Case-Based Continual Adaptation for Large Language Models During Deployment
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Jilin University(吉林大学知识驱动人机智能工程研究中心);International Center of Future Science, Jilin University(吉林大学未来科学国际中心);Department of Informatics, King’s College London(伦敦国王学院信息学院);The Alan Turing Institute(艾伦·图灵研究所);AI Centre, Department of Computer Science, UCL(UCL计算机科学系人工智能中心)
LeanTTA: A Backpropagation-Free and Stateless Approach to Quantized Test-Time Adaptation on Edge Devices
Paul G. Allen School of Computer Science and Engineering, University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学院);University of Cambridge(剑桥大学);School of Computing and Information Systems, University of Melbourne(墨尔本大学计算与信息系统学院);Samsung AI Center(三星人工智能中心)
Channel Adaptation for EEG Foundation Models: A Systematic Benchmark Across Architectures, Tasks, and Training Regimes
Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego(斯瓦茨计算神经科学中心,神经计算研究所,加州大学圣地亚哥分校);Yneuro;Centre de Recherche Cerveau et Cognition, CNRS, Université Paul Sabatier(脑与认知研究中心,法国国家科学研究中心,保罗·萨巴蒂埃大学)
PlugSI: Plug-and-Play Test-Time Graph Adaptation for Spatial Interpolation
College of Computer Science and Technology, Harbin Engineering University(哈尔滨工程大学计算机科学与技术学院);Department of Computer Science, City University of Hong Kong(香港城市大学计算机科学系);Department of Computer Science and Engineering, University of Bologna(博洛尼亚大学计算机科学与工程系)
Transferable Deployment of Semantic Edge Inference Systems via Unsupervised Domain Adaption
State Key Laboratory of Radio Frequency Heterogeneous Integration(射频异质集成国家重点实验室);College of Electronics and Information Engineering, Shenzhen University(深圳大学电子与信息工程学院);Peng Cheng Laboratory(鹏城实验室)
EDAPT: Towards Calibration-Free BCIs with Continual Online Adaptation
Excellence Cluster Machine Learning, University of Tübingen(卓越集群机器学习中心,图宾根大学);Tübingen AI Center, University of Tübingen(图宾根人工智能中心,图宾根大学);Department of Neurology and Stroke, University of Tübingen(神经学与中风部门,图宾根大学);Hertie Institute for Clinical Brain Research, University of Tübingen(赫尔特研究所,图宾根大学);Department of Empirical Inference, Max Planck Institute for Intelligent Systems(经验推理部门,智能系统马克斯·普朗克研究所);Hertie Institute for AI in Brain Health, Tübingen(赫尔特人工智能与脑健康研究所,图宾根)