arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.19986cs.LGcs.AIcs.CV
收藏

按需多任务稀疏性用于高效部署大型模型到边缘设备

On-Demand Multi-Task Sparsity for Efficient Large-Model Deployment on Edge Devices

City University of Hongkong(香港城市大学);Mohamed bin Zayed University of Artificial Intelligence(马尔代夫 bin Zayed 人工智能大学)

Lianming Huang, Haibo Hu, Qiao Li, Nan Guan, Chun Jason Xue

AI总结:

本文提出一种按需多任务稀疏性框架,通过最大化参数重用减少边缘设备上任务切换的I/O开销,实验表明其在自动驾驶场景中显著提升了任务切换效率。

摘要:

稀疏性对于在资源受限的边缘平台上部署大型模型至关重要。然而,单独优化每个任务的稀疏模式会忽略频繁任务切换过程中显著的I/O开销。我们引入了一个按需多任务稀疏性框架,专门设计用于通过最大化参数重用来最小化切换成本。与整体方法不同,我们将权重分解为可重用的块级单元,并对齐任务间的稀疏结构以最大化重叠。通过动态加载下一个任务所需的小型差分块集,我们的方法有效缓解了传统整体方法中固有的冷启动延迟。在真实世界的自动驾驶平台上的实验表明,我们的框架实现了优越的切换效率,平均比现有稀疏性方法加速任务切换超过6.6倍。

英文摘要:

Sparsity is essential for deploying large models on resource constrained edge platforms. However, optimizing sparsity patterns for individual tasks in isolation ignores the significant I/O overhead incurred during frequent task switching. We introduce an on-demand multi-task sparsity framework specifically designed to minimize switching costs by maximizing parameter reuse. Unlike monolithic approaches, we decompose weights into reusable block-granular units and align sparse structures across tasks to maximize overlap. By dynamically loading only the small differential set of blocks required for the next task, our method effectively mitigates the cold-start latency inherent in traditional monolithic approaches.Experiments on a real-world autonomous driving platform demonstrate that our framework achieves superior switching efficiency, accelerating task switching by over 6.6X on average compared to existing sparsity methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑