arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.10552cs.CVcs.LG
收藏

具有距离感知自注意力的深度多示例学习

Deep Multiple Instance Learning with Distance-Aware Self-Attention

University of St Andrews(圣安德鲁斯大学);University of Cambridge(剑桥大学)

Georg Wölflein, Lucie Charlotte Magister, Pietro Liò, David J. Harrison, Ognjen Arandjelović

AI总结:

提出了一种新型MIL模型DAS-MIL,通过在自注意力机制中引入连续的距离相关项来显式建模图像块间的相对空间关系,在自定义MNIST和CAMELYON16数据集上均优于现有方法。

摘要:

传统的监督学习任务要求训练集中的每个实例都有一个标签,但在许多实际应用中,标签仅适用于实例的集合(包)。这种被称为多示例学习(MIL)的问题设定在医学领域尤为相关,因为高分辨率图像会被分割成较小的块,但标签适用于整个图像。最近的MIL模型通过采用自注意力机制来捕获块之间的对应关系,使它们能够根据包中所有其他块对每个块进行不同的加权。然而,这些方法仍然没有考虑较大图像中块之间的相对空间关系,这在计算病理学中尤为重要。为此,我们引入了一种具有距离感知自注意力(DAS-MIL)的新型MIL模型,该模型在对块之间的交互进行建模时明确考虑了相对空间信息。与现有的离散自注意力相对位置表示不同,我们的方法在注意力权重的计算中引入了连续的距离相关项,并且是首个在MIL背景下应用相对位置表示的方法。我们在一个需要考虑相对空间信息的自定义基于MNIST的MIL数据集,以及CAMELYON16(一个公开可用的癌症转移检测数据集)上评估了我们的模型,其中我们实现了0.91的测试AUROC分数。在这两个数据集上,我们的模型都优于采用绝对位置编码的现有MIL方法,以及应用于MIL的现有相对位置表示方案。我们的代码可在 https://anonymous.4open.science/r/das-mil 获取。

英文摘要:

Traditional supervised learning tasks require a label for every instance in the training set, but in many real-world applications, labels are only available for collections (bags) of instances. This problem setting, known as multiple instance learning (MIL), is particularly relevant in the medical domain, where high-resolution images are split into smaller patches, but labels apply to the image as a whole. Recent MIL models are able to capture correspondences between patches by employing self-attention, allowing them to weigh each patch differently based on all other patches in the bag. However, these approaches still do not consider the relative spatial relationships between patches within the larger image, which is especially important in computational pathology. To this end, we introduce a novel MIL model with distance-aware self-attention (DAS-MIL), which explicitly takes into account relative spatial information when modelling the interactions between patches. Unlike existing relative position representations for self-attention which are discrete, our approach introduces continuous distance-dependent terms into the computation of the attention weights, and is the first to apply relative position representations in the context of MIL. We evaluate our model on a custom MNIST-based MIL dataset that requires the consideration of relative spatial information, as well as on CAMELYON16, a publicly available cancer metastasis detection dataset, where we achieve a test AUROC score of 0.91. On both datasets, our model outperforms existing MIL approaches that employ absolute positional encodings, as well as existing relative position representation schemes applied to MIL. Our code is available at https://anonymous.4open.science/r/das-mil.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑