Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillation
Sun Yat-sen University(中山大学);National University of Singapore(新加坡国立大学);Singapore Institute of Manufacturing Technology, A*STAR(新加坡科技研究局新加坡制造技术研究院);University of Melbourne(墨尔本大学)
Recent neural methods for vehicle routing problems always train and test the deep models on the same instance distribution (i.e., uniform). To tackle the consequent cross-distribution generalization concerns, we bring the knowledge distillation to this field and propose an Adaptive Multi-Distribution Knowledge Distillation (AMDKD) scheme for learning more generalizable deep models. Particularly, our AMDKD leverages various knowledge from multiple teachers trained on exemplar distributions to yield a light-weight yet generalist student model. Meanwhile, we equip AMDKD with an adaptive strategy that allows the student to concentrate on difficult distributions, so as to absorb hard-to-master knowledge more effectively. Extensive experimental results show that, compared with the baseline neural methods, our AMDKD is able to achieve competitive results on both unseen in-distribution and out-of-distribution instances, which are either randomly synthesized or adopted from benchmark datasets (i.e., TSPLIB and CVRPLIB). Notably, our AMDKD is generic, and consumes less computational resources for inference.
Towards Omni-generalizable Neural Methods for Vehicle Routing Problems
Nanyang Technological University(南洋理工大学);Eindhoven University of Technology(埃因霍温理工大学);Shandong University(山东大学);Singapore Management University(新加坡管理大学)
Learning to Reduce Search Space for Generalizable Neural Routing Solver
School of Automation and Intelligent Manufacturing(自动化与智能制造学院);Southern University of Science and Technology(南方科技大学);School of Mathematics and Statistics(数学与统计学学院);Xi'an Jiaotong University(西安交通大学);Department of Computer Science(计算机科学系);City University of Hong Kong(香港城市大学)
MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);School of Automation and Intelligent Manufacturing, Southern University of Science and Technology(南方科技大学自动化与智能制造学院);Guangdong Provincial Key Laboratory of Fully Actuated System Control Theory and Technology, Southern University of Science and Technology(广东省全驱动系统控制理论与技术重点实验室,南方科技大学);Department of Industrial Engineering and Innovation Sciences, Eindhoven University of Technology(埃因霍温理工大学工业工程与创新科学系)
Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation
The Hong Kong University of Science and Technology(香港科技大学);Southern Medical University(南方医科大学);Guangdong Provincial Key Laboratory of Molecular Tumor Pathology(广东省分子肿瘤病理学重点实验室);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital(山东第一医科大学第一附属医院暨山东省千佛山医院);Sun Yat-sen University(中山大学);The Chinese University of Hong Kong(香港中文大学)
Data-Efficient Symbolic Regression via Foundation Model Distillation
Institute for Clarity in Documentation(文档清晰研究所);Inria Paris-Rocquencourt(巴黎-罗克琴特研究所);Rajiv Gandhi University(拉吉夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕尔默研究实验室);Arizona State University(亚利桑那州立大学);Clemson University(克莱姆森大学)
OD-Gear: Online Decomposition and Group Sampling for Expert-Guided Adversarial Routing in Scalable Capacitated Vehicle Routing
School of Information Science(信息科学学院);Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation, Department of CSE, SUSTech, Shenzhen 518055, P. R. China(脑启发智能计算广东省重点实验室、计算机科学与工程系、南方科技大学、深圳518055,中华人民共和国)
Quantum-Gated Task-interaction Knowledge Distillation for Pre-trained Model-based Class-Incremental Learning
School of Information and Communication Engineering, BUPT(北京邮电大学信息与通信工程学院);BUPT: Beijing University of Posts and Telecommunications(北京邮电大学);Engineering Research Center for Information Network, Ministry of Education(教育部信息网络工程研究中心)
Spatial-temporal-demand clustering for solving large-scale vehicle routing problems with time windows
Logistics and Supply Chain Management, School of Management, Technical University of Munich(物流与供应链管理系,管理学院,慕尼黑技术大学);Munich Data Science Institute (MDSI), Technical University of Munich(慕尼黑数据科学研究所(MDSI),慕尼黑技术大学)
MOPD-Router: Rethinking Teacher Routing in Multi-Teacher On-Policy Distillation
Shanghai Jiao Tong University(上海交通大学);GAIR;Alibaba Group(阿里巴巴集团);University of Science and Technology of China(中国科学技术大学);Shanghai Innovation Institute(上海创新研究院)
Unifying Group-Relative and Self-Distillation Policy Optimization via Sample Routing
Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所基础模型研究中心);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);National University of Singapore(新加坡国立大学);Tencent(腾讯);Wuhan AI Research(武汉人工智能研究院)
Beijing University of Posts and Telecommunications(北京邮电大学);ByteDance(字节跳动);USTC(中国科学技术大学);Beijing Key Laboratory of Network System and Network Culture(北京网络系统与网络文化重点实验室);Key Laboratory of Interactive Technology and Experience System, Ministry of Culture and Tourism(文化和旅游部互动技术与体验系统重点实验室);Zhongguancun Academy(中关村科学城)
Knowledge Distillation via Route Constrained Optimization
SenseTime Research(商汤科技研究院);National University of Defense Technology(国防科技大学);The Chinese University of Hong Kong(香港中文大学);Beihang University(北京航空航天大学);Tsinghua University(清华大学)