arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.08751cs.CVcs.DC
收藏

偏度引导的多模态Swin Transformer剪枝用于边缘设备上的联邦皮肤病变分类

Skewness-Guided Pruning of Multimodal Swin Transformers for Federated Skin Lesion Classification on Edge Devices

University of Hull(赫尔大学)

Kuniko Paxton, Koorosh Aslansefat, Dhavalkumar Thakker, Yiannis Papadopoulos

AI总结:

本研究提出基于偏度的剪枝方法,用于在边缘设备上高效压缩多模态Swin Transformer,实现联邦学习中的隐私保护与高精度皮肤病变分类。

摘要:

近年来,高性能计算机视觉模型在医学影像领域取得了显著成功,一些皮肤病变分类系统甚至在诊断准确性上超过了皮肤科专家。然而,此类模型计算密集且体积庞大,不适合在边缘设备上部署。此外,严格的隐私约束阻碍了集中式数据管理,推动了联邦学习(FL)的采用。为解决这些挑战,本研究提出了一种偏度引导的剪枝方法,该方法基于多头自注意力和多层感知机层输出分布的统计偏度,选择性地剪枝多模态Swin Transformer。该方法在水平FL环境中得到验证,显示在大幅减少模型复杂度的同时保持性能。在紧凑型Swin Transformer上的实验表明,模型大小可减少约36%,而准确率无损失。这些发现突显了在边缘设备上实现高效模型压缩和隐私保护分布式学习在多模态医疗AI中的可行性。

英文摘要:

In recent years, high-performance computer vision models have achieved remarkable success in medical imaging, with some skin lesion classification systems even surpassing dermatology specialists in diagnostic accuracy. However, such models are computationally intensive and large in size, making them unsuitable for deployment on edge devices. In addition, strict privacy constraints hinder centralized data management, motivating the adoption of Federated Learning (FL). To address these challenges, this study proposes a skewness-guided pruning method that selectively prunes the Multi-Head Self-Attention and Multi-Layer Perceptron layers of a multimodal Swin Transformer based on the statistical skewness of their output distributions. The proposed method was validated in a horizontal FL environment and shown to maintain performance while substantially reducing model complexity. Experiments on the compact Swin Transformer demonstrate approximately 36\% model size reduction with no loss in accuracy. These findings highlight the feasibility of achieving efficient model compression and privacy-preserving distributed learning for multimodal medical AI on edge devices.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑