arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.08446cs.CV
收藏

基于变分信息瓶颈的弱监督病理切片整张图像分类任务优化

Task-specific Fine-tuning via Variational Information Bottleneck for Weakly-supervised Pathology Whole Slide Image Classification

Zhejiang University(浙江大学);Westlake University(西湖大学);The University of Hong Kong(香港大学)

Honglin Li, Chenglu Zhu, Yunlong Zhang, Yuxuan Sun, Zhongyi Shui, Wenwei Kuang, Sunyi Zheng, Lin Yang

摘要:

虽然多实例学习(MIL)在数字病理学全切片图像(WSI)分类中显示出有希望的结果,但由于千兆像素WSI的高计算成本和模型训练的样本量有限,这种范式仍然面临性能和泛化问题。为了处理计算问题,大多数MIL方法首先使用ImageNet中的冻结预训练模型来获得表示。该过程可能会由于较大的域间隙而丢失必要的信息,并且由于缺乏图像级的训练时间增强而阻碍模型的泛化。尽管自监督学习(SSL)提出了可行的表示学习方案,但从SSL的任务不可知特征到部分标签监督学习下的任务特定特征的转换,下游任务的改进仍需进一步探索。为了缓解计算成本和性能的困境,我们提出了一个有效的WSI微调框架的信息瓶颈理论的动机。该理论使框架能够找到WSI的最小充分统计量,从而支持我们将骨干微调为仅依赖于WSI级别弱标签的特定于任务的表示。进一步分析了WSI-MIL问题,从理论上推导了我们的微调方法。我们的框架进行评估的五个病理WSI数据集上的各种WSI头。我们微调表示的实验结果表明,与以前的作品相比,在准确性和概括性显着改善。源代码将在https://github.com/invoker-LL/WSI-finetuning上提供。

英文摘要:

While Multiple Instance Learning (MIL) has shown promising results in digital Pathology Whole Slide Image (WSI) classification, such a paradigm still faces performance and generalization problems due to challenges in high computational costs on Gigapixel WSIs and limited sample size for model training. To deal with the computation problem, most MIL methods utilize a frozen pretrained model from ImageNet to obtain representations first. This process may lose essential information owing to the large domain gap and hinder the generalization of model due to the lack of image-level training-time augmentations. Though Self-supervised Learning (SSL) proposes viable representation learning schemes, the improvement of the downstream task still needs to be further explored in the conversion from the task-agnostic features of SSL to the task-specifics under the partial label supervised learning. To alleviate the dilemma of computation cost and performance, we propose an efficient WSI fine-tuning framework motivated by the Information Bottleneck theory. The theory enables the framework to find the minimal sufficient statistics of WSI, thus supporting us to fine-tune the backbone into a task-specific representation only depending on WSI-level weak labels. The WSI-MIL problem is further analyzed to theoretically deduce our fine-tuning method. Our framework is evaluated on five pathology WSI datasets on various WSI heads. The experimental results of our fine-tuned representations show significant improvements in both accuracy and generalization compared with previous works. Source code will be available at https://github.com/invoker-LL/WSI-finetuning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑