拆分扩展了Vision Transformer的应用范围--可变Vision Transformer(vViT)
Splitting expands the application range of Vision Transformer -- variable Vision Transformer (vViT)
摘要:
Vision Transformer(ViT)在计算机视觉领域取得了卓越的成果。虽然有许多基于Transformer的架构都是从原始ViT衍生而来的,但补丁的维度通常彼此相同。由于医学领域中的数据集维数不同,如医学图像、患者个人信息、实验室检查等,这一缺点限制了ViT在医学领域的应用范围,为此,我们提出了一种新的ViT衍生类型--可变Vision Transformer(vViT)。本研究的目的是引入vViT,并将vViT应用于胶质瘤T1加权磁共振成像(MRI)的放射组学。在使用放射组学预测胶质瘤患者的365天生存期时,vViT的灵敏度、特异性、准确性和AUC-ROC分别达到0.83、0.82、0.81和0.76。vViT有可能同时处理不同类型的医疗信息。
英文摘要:
Vision Transformer (ViT) has achieved outstanding results in computer vision. Although there are many Transformer-based architectures derived from the original ViT, the dimension of patches are often the same with each other. This disadvantage leads to a limited application range in the medical field because in the medical field, datasets whose dimension is different from each other; e.g. medical image, patients' personal information, laboratory test and so on. To overcome this limitation, we develop a new derived type of ViT termed variable Vision Transformer (vViT). The aim of this study is to introduce vViT and to apply vViT to radiomics using T1 weighted magnetic resonance image (MRI) of glioma. In the prediction of 365 days of survival among glioma patients using radiomics,vViT achieved 0.83, 0.82, 0.81, and 0.76 in sensitivity, specificity, accuracy, and AUC-ROC, respectively. vViT has the potential to handle different types of medical information at once.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。