arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2506.02935cs.LG
收藏

MTL-KD:基于知识蒸馏的多任务学习通用化神经车辆路径求解器

MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver

College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);School of Automation and Intelligent Manufacturing, Southern University of Science and Technology(南方科技大学自动化与智能制造学院);Guangdong Provincial Key Laboratory of Fully Actuated System Control Theory and Technology, Southern University of Science and Technology(广东省全驱动系统控制理论与技术重点实验室,南方科技大学);Department of Industrial Engineering and Innovation Sciences, Eindhoven University of Technology(埃因霍温理工大学工业工程与创新科学系)

Yuepeng Zheng, Fu Luo, Zhenkun Wang, Yaoxin Wu, Yu Zhou

AI总结:

本文提出MTL-KD方法,通过知识蒸馏将多个单任务强化学习模型的策略知识转移到单一重型解码器中,并引入R3C推理策略,实现了在多达1000个节点的多种VRP变体上具有强泛化能力的多任务求解。

摘要:

神经组合优化(NCO)中的多任务学习(MTL)是一种很有前景的方法,用于训练能够求解多种车辆路径问题(VRP)变体的统一模型。然而,现有的基于强化学习(RL)的多任务方法只能在规模较小的问题上训练轻量级解码器模型,在求解大规模问题时表现出有限的泛化能力。为了克服这一限制,本文引入了一种由知识蒸馏驱动的新型多任务学习方法(MTL-KD),该方法能够高效训练具有强泛化能力的重型解码器模型。所提出的MTL-KD方法将策略知识从多个不同的基于RL的单任务模型转移到一个单一的重型解码器模型中,促进了无标签训练,并有效提升了模型在多种任务上的泛化能力。此外,我们引入了一种称为随机重排序重构(R3C)的灵活推理策略,该策略专门适应于多种VRP任务,并进一步提升了多任务模型的性能。在多达1000个节点的6个已见和10个未见VRP变体上的实验结果表明,我们提出的方法在统一基准和真实世界基准上均持续取得优越的性能,展现出强大的泛化能力。

英文摘要:

Multi-Task Learning (MTL) in Neural Combinatorial Optimization (NCO) is a promising approach to train a unified model capable of solving multiple Vehicle Routing Problem (VRP) variants. However, existing Reinforcement Learning (RL)-based multi-task methods can only train light decoder models on small-scale problems, exhibiting limited generalization ability when solving large-scale problems. To overcome this limitation, this work introduces a novel multi-task learning method driven by knowledge distillation (MTL-KD), which enables the efficient training of heavy decoder models with strong generalization ability. The proposed MTL-KD method transfers policy knowledge from multiple distinct RL-based single-task models to a single heavy decoder model, facilitating label-free training and effectively improving the model's generalization ability across diverse tasks. In addition, we introduce a flexible inference strategy termed Random Reordering Re-Construction (R3C), which is specifically adapted for diverse VRP tasks and further boosts the performance of the multi-task model. Experimental results on 6 seen and 10 unseen VRP variants with up to 1000 nodes indicate that our proposed method consistently achieves superior performance on both uniform and real-world benchmarks, demonstrating robust generalization abilities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑