arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2208.06643eess.IVcs.CV
收藏

基于Transformer的医学图像分析最新进展

Recent Progress in Transformer-based Medical Image Analysis

National University of Singapore(新加坡国立大学);Sun Yat-sen University(中山大学);Tan Tock Seng Hospital(陈笃生医院)

Zhaoshan Liu, Qiujie Lv, Ziduo Yang, Yifan Li, Chau Hung Lee, Lei Shen

AI总结:

本综述回顾了Transformer及其注意力机制,系统梳理了其在医学图像分析各任务(如分类、分割等)中的最新应用,并指出其性能优于现有方法,同时探讨了挑战与未来方向。

摘要:

Transformer主要应用于自然语言处理领域。近年来,它已被引入计算机视觉(CV)领域并展现出巨大潜力。医学图像分析(MIA)作为CV的一个重要分支,也极大地受益于这一前沿技术。在本综述中,我们首先回顾了Transformer的核心组件——注意力机制,以及Transformer的详细结构。随后,我们描述了Transformer在MIA领域的最新进展。我们按照不同任务对应用进行了分类整理,包括分类、分割、图像描述、配准、检测、增强、定位和合成。主流的分割和分类任务进一步细分为十一种医学图像模态。本综述中研究的大量实验表明,通过多种评估指标的比较,基于Transformer的方法优于现有方法。最后,我们讨论了该领域面临的开放挑战和未来机遇。这份包含最新内容、详细信息及全面比较的任务-模态综述,可能使广大的MIA研究群体受益匪浅。

英文摘要:

The transformer is primarily used in the field of natural language processing. Recently, it has been adopted and shows promise in the computer vision (CV) field. Medical image analysis (MIA), as a critical branch of CV, also greatly benefits from this state-of-the-art technique. In this review, we first recap the core component of the transformer, the attention mechanism, and the detailed structures of the transformer. After that, we depict the recent progress of the transformer in the field of MIA. We organize the applications in a sequence of different tasks, including classification, segmentation, captioning, registration, detection, enhancement, localization, and synthesis. The mainstream classification and segmentation tasks are further divided into eleven medical image modalities. A large number of experiments studied in this review illustrate that the transformer-based method outperforms existing methods through comparisons with multiple evaluation metrics. Finally, we discuss the open challenges and future opportunities in this field. This task-modality review with the latest contents, detailed information, and comprehensive comparison may greatly benefit the broad MIA community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑