arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.03942eess.IVcs.CV

阿里阿德涅之线:利用文本提示改进胸部X光图像感染区域分割

Ariadne's Thread:Using Text Prompts to Improve Segmentation of Infected Areas from Chest X-ray images

Beijing University of Posts and Telecommunications(北京邮电大学)

Yi Zhong, Mengqiu Xu, Kongming Liang, Kaixin Chen, Ming Wu

AI总结:

针对胸部X光感染区域分割中图像单一模态方法依赖大量标注数据且精度不足的问题,提出利用文本提示的语言驱动分割方法,在QaTa-COV19数据集上Dice分数至少提升6.09%,并证明多模态方法在文本粒度和训练数据需求上更具优势。

摘要:

肺部感染区域的分割对于量化肺部疾病(如肺部感染)的严重程度至关重要。现有的医学图像分割方法几乎都是基于图像的单一模态方法。然而,这些仅依赖图像的方法除非使用大量标注数据进行训练,否则往往会产生不准确的结果。为克服这一挑战,我们提出了一种语言驱动的分割方法,利用文本提示来改进分割结果。在QaTa-COV19数据集上的实验表明,与单一模态方法相比,我们的方法将Dice分数至少提高了6.09%。此外,我们的扩展研究揭示了多模态方法在文本信息粒度方面的灵活性,并证明多模态方法在所需训练数据规模方面相较于仅依赖图像的方法具有显著优势。

英文摘要:

Segmentation of the infected areas of the lung is essential for quantifying the severity of lung disease like pulmonary infections. Existing medical image segmentation methods are almost uni-modal methods based on image. However, these image-only methods tend to produce inaccurate results unless trained with large amounts of annotated data. To overcome this challenge, we propose a language-driven segmentation method that uses text prompt to improve to the segmentation result. Experiments on the QaTa-COV19 dataset indicate that our method improves the Dice score by 6.09% at least compared to the uni-modal methods. Besides, our extended study reveals the flexibility of multi-modal methods in terms of the information granularity of text and demonstrates that multi-modal methods have a significant advantage over image-only methods in terms of the size of training data required.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑