提示驱动的视觉基础模型（如Segment Anything Model）最近在计算机视觉中展现出显著的适应性。然而，由于异质组织结构、成像伪影和低对比度边界，它们直接应用于医学成像仍具挑战性，尤其是在肿瘤和癌症原发灶中，导致模糊或重叠病变区域的分割效果欠佳。在此，我们提出Segment Any Tumour 3D（SAT3D），这是一种轻量级体积基础模型，旨在实现跨多种医学成像模态的稳健且可泛化的肿瘤分割。SAT3D集成了移位窗口视觉Transformer以获取分层体积表示，并结合不确定性感知训练流程，该流程明确将不确定性估计作为提示，指导低对比度区域的可靠边界预测。对抗学习进一步提升了模型在模糊病理区域的性能。我们在11个公开数据集上对SAT3D与3个近期视觉基础模型及nnUNet进行基准测试，这些数据集包含3884个肿瘤和癌症病例用于训练，694个病例用于分布内评估。在跨多种模态和癌症原发灶的17075个3D体积-掩码对上训练后，SAT3D展现出强大的泛化性和稳健性。为促进实际应用和临床转化，我们开发了3D Slicer插件，支持使用训练后的SAT3D模型进行交互式、提示驱动的分割和可视化。大量实验凸显了其在挑战性和分布外场景中提升分割精度的有效性，强调了其作为医学图像分析可扩展基础模型的潜力。
英文摘要：
Prompt-driven vision foundation models, such as the Segment Anything Model, have recently demonstrated remarkable adaptability in computer vision. However, their direct application to medical imaging remains challenging due to heterogeneous tissue structures, imaging artefacts, and low-contrast boundaries, particularly in tumours and cancer primaries leading to suboptimal segmentation in ambiguous or overlapping lesion regions. Here, we present Segment Any Tumour 3D (SAT3D), a lightweight volumetric foundation model designed to enable robust and generalisable tumour segmentation across diverse medical imaging modalities. SAT3D integrates a shifted-window vision transformer for hierarchical volumetric representation with an uncertainty-aware training pipeline that explicitly incorporates uncertainty estimates as prompts to guide reliable boundary prediction in low-contrast regions. Adversarial learning further enhances model performance for the ambiguous pathological regions. We benchmark SAT3D against three recent vision foundation models and nnUNet across 11 publicly available datasets, encompassing 3,884 tumour and cancer cases for training and 694 cases for in-distribution evaluation. Trained on 17,075 3D volume-mask pairs across multiple modalities and cancer primaries, SAT3D demonstrates strong generalisation and robustness. To facilitate practical use and clinical translation, we developed a 3D Slicer plugin that enables interactive, prompt-driven segmentation and visualisation using the trained SAT3D model. Extensive experiments highlight its effectiveness in improving segmentation accuracy under challenging and out-of-distribution scenarios, underscoring its potential as a scalable foundation model for medical image analysis.
Indian Institute of Technology (IIT), Varanasi (BHU)（印度理工学院（贝拿勒斯印度教大学））；National Institute of Technology (NIT), Tiruchirappalli（国立理工学院蒂鲁奇拉帕利分校）
Brain tumour segmentation is an essential task in medical image processing. Early diagnosis of brain tumours plays a crucial role in improving treatment possibilities and increases the survival rate of the patients. Manual segmentation of the brain tumours for cancer diagnosis, from large number of MRI images, is both a difficult and time-consuming task. There is a need for automatic brain tumour image segmentation. The purpose of this project is to provide an automatic brain tumour segmentation method of MRI images to help locate the tumour accurately and quickly.
University of Oxford（牛津大学）；Australian Institute for Machine Learning（澳大利亚机器学习研究所）；The University of Adelaide（阿德莱德大学）；South Australian Health and Medical Research Institute（南澳大利亚健康与医学研究所）
Gliomas appear with wide variation in their characteristics both in terms of their appearance and location on brain MR images, which makes robust tumour segmentation highly challenging, and leads to high inter-rater variability even in manual segmentations. In this work, we propose a triplanar ensemble network, with an independent tumour core prediction module, for accurate segmentation of these tumours and their sub-regions. On evaluating our method on the MICCAI Brain Tumor Segmentation (BraTS) challenge validation dataset, for tumour sub-regions, we achieved a Dice similarity coefficient of…
Macquarie University（麦考瑞大学）；University of New South Wales（新南威尔士大学）
Accurate brain tumour segmentation is a crucial step towards improving disease diagnosis and proper treatment planning. In this paper, we propose a deep-learning based method to segment a brain tumour into its subregions: whole tumour, tumour core and enhancing tumour. The proposed architecture is a 3D convolutional neural network based on a variant of the U-Net architecture of Ronneberger et al. [17] with three main modifications: (i) a heavy encoder, light decoder structure using residual blocks (ii) employment of dense blocks instead of skip connections, and (iii) utilization of self-ensemb…
Gliomas are the most common malignant brain tumourswith intrinsic heterogeneity. Accurate segmentation of gliomas and theirsub-regions on multi-parametric magnetic resonance images (mpMRI)is of great clinical importance, which defines tumour size, shape andappearance and provides abundant information for preoperative diag-nosis, treatment planning and survival prediction. Recent developmentson deep learning have significantly improved the performance of auto-mated medical image segmentation. In this paper, we compare severalstate-of-the-art convolutional neural network models for brain tumouri…
Automatic segmentation of kidney and kidney tumour in Computed Tomography (CT) images is essential, as it uses less time as compared to the current gold standard of manual segmentation. However, many hospitals are still reliant on manual study and segmentation of CT images by medical practitioners because of its higher accuracy. Thus, this study focuses on the development of an approach for automatic kidney and kidney tumour segmentation in contrast-enhanced CT images. A method based on Convolutional Neural Network (CNN) was proposed, where a 3D U-Net segmentation model was developed and train…
Gliomas are the most common primary brain malignancies, with different degrees of aggressiveness, variable prognosis and various heterogeneous histological sub-regions, i.e., peritumoral edema, necrotic core, enhancing and non-enhancing tumour core. Although brain tumours can easily be detected using multi-modal MRI, accurate tumor segmentation is a challenging task. Hence, using the data provided by the BraTS Challenge 2020, we propose a 3D volume-to-volume Generative Adversarial Network for segmentation of brain tumours. The model, called Vox2Vox, generates realistic segmentation outputs fro…
McGill University（麦吉尔大学）；University of Oxford（牛津大学）
In this paper, we develop a metric designed to assess and rank uncertainty measures for the task of brain tumour sub-tissue segmentation in the BraTS 2019 sub-challenge on uncertainty quantification. The metric is designed to: (1) reward uncertainty measures where high confidence is assigned to correct assertions, and where incorrect assertions are assigned low confidence and (2) penalize measures that have higher percentages of under-confident correct assertions. Here, the workings of the components of the metric are explored based on a number of popular uncertainty measures evaluated on the …
An automatic segmentation algorithm for delineation of the gross tumour volume and pathologic lymph nodes of head and neck cancers in PET/CT images is described. The proposed algorithm is based on a convolutional neural network using the U-Net architecture. Several model hyperparameters were explored and the model performance in terms of the Dice similarity coefficient was validated on images from 15 patients. A separate test set consisting of images from 40 patients was used to assess the generalisability of the algorithm. The performance on the test set showed close-to-oncologist level delin…
Indian Institute of Technology Kharagpur（印度理工学院卡哈拉格普尔分校）
Automated brain tumour segmentation has the potential of making a massive improvement in disease diagnosis, surgery, monitoring and surveillance. However, this task is extremely challenging. Here, we describe our automated segmentation method using 2D CNNs that are based on U-Net. To deal with class imbalance effectively, we have used a weighted Dice loss function. We found that increasing the depth of the 'U' shape beyond a certain level results in a decrease in performance, so it is essential to choose an optimum depth. We also found that 3D contextual information cannot be captured by a sin…
McGill University（麦吉尔大学）；Centre for Intelligent Machines (CIM)（智能机器中心 (CIM)）；Department of Electrical and Computer Engineering（电气与计算机工程系）
Segmentation of enhancing tumours or lesions from MRI is important for detecting new disease activity in many clinical contexts. However, accurate segmentation requires the inclusion of medical images (e.g., T1 post contrast MRI) acquired after injecting patients with a contrast agent (e.g., Gadolinium), a process no longer thought to be safe. Although a number of modality-agnostic segmentation networks have been developed over the past few years, they have been met with limited success in the context of enhancing pathology segmentation. In this work, we present HAD-Net, a novel offline advers…
Indian Institute of Information Technology Allahabad（阿拉哈巴德印度信息技术学院）
In the clinical settings, during digital examination of histopathological slides, the pathologist annotate the slides by marking the rough boundary around the suspected tumour region. The marking or annotation is generally represented as a polygonal boundary that covers the extent of the tumour in the slide. These polygonal markings are difficult to imitate through CAD techniques since the tumour regions are heterogeneous and hence segmenting them would require exhaustive pixel wise ground truth annotation. Therefore, for CAD analysis, the ground truths are generally annotated by pathologist e…
The Hospital for Sick Children（病童医院）；University of Toronto（多伦多大学）；Vector Institute（Vector研究所）
Deep convolutional neural networks (CNNs) have become an essential tool in the medical imaging-based computer-aided diagnostic pipeline. However, training accurate and reliable CNNs requires large fine-grain annotated datasets. To alleviate this, weakly-supervised methods can be used to obtain local information from global labels. This work proposes the use of localized perturbations as a weakly-supervised solution to extract segmentation masks of brain tumours from a pretrained 3D classification model. Furthermore, we propose a novel optimal perturbation method that exploits 3D superpixels to…
The Hospital for Sick Children（病童医院）；University of Toronto（多伦多大学）；Vector Institute（矢量研究所）
Deep learning techniques have greatly benefited computer-aided diagnostic systems. However, unlike other fields, in medical imaging, acquiring large fine-grained annotated datasets such as 3D tumour segmentation is challenging due to the high cost of manual annotation and privacy regulations. This has given interest to weakly-supervise methods to utilize the weakly labelled data for tumour segmentation. In this work, we propose a weakly supervised approach to obtain regions of interest using binary class labels. Furthermore, we propose a novel objective function to train the generator model ba…
It is a challenge to segment the location and size of rectal cancer tumours through deep learning. In this paper, in order to improve the ability of extracting suffi-cient feature information in rectal tumour segmentation, attention enlarged ConvNeXt UNet (AACN-UNet), is proposed. The network mainly includes two improvements: 1) the encoder stage of UNet is changed to ConvNeXt structure for encoding operation, which can not only integrate multi-scale semantic information on a large scale, but al-so reduce information loss and extract more feature information from CT images; 2) CBAM attention m…
Pancreatic cancer will soon be the second leading cause of cancer-related death in Western society. Imaging techniques such as CT, MRI and ultrasound typically help providing the initial diagnosis, but histopathological assessment is still the gold standard for final confirmation of disease presence and prognosis. In recent years machine learning approaches and pathomics pipelines have shown potential in improving diagnostics and prognostics in other cancerous entities, such as breast and prostate cancer. A crucial first step in these pipelines is typically identification and segmentation of t…
How we won BraTS 2023 Adult Glioma challenge? Just faking it! Enhanced Synthetic Data Augmentation and Model Ensemble for brain tumour segmentation
University of Minho（米尼奥大学）；Institute for Artificial Intelligence in Medicine（人工智能医学研究所）；Graz University of Technology（格拉茨工业大学）；University Medicine Essen（埃森大学医学中心）；Cancer Research Center Cologne Essen (CCCE)（科隆-埃森癌症研究中心）；University Hospital Essen（埃森大学医院）；German Cancer Consortium (DKTK)（德国癌症联盟）
Pre- to Post-Contrast Breast MRI Synthesis for Enhanced Tumour Segmentation
Universitat de Barcelona（巴塞罗那大学）；Helmholtz Center Munich（慕尼黑亥姆霍兹中心）；Technical University of Munich（慕尼黑工业大学）；Karolinska Institutet（卡罗林斯卡学院）；King’s College London（伦敦国王学院）
University of British Columbia Data Science Institute（不列颠哥伦比亚大学数据科学研究所）；BC Cancer Research Institute（不列颠哥伦比亚省癌症研究所）；University of British Columbia（不列颠哥伦比亚大学）
Training computer-vision related algorithms on medical images for disease diagnosis or image segmentation is difficult due to the lack of training data, labeled samples, and privacy concerns. For this reason, a robust generative method to create synthetic data is highly sought after. However, most three-dimensional image generators require additional image input or are extremely memory intensive. To address these issues we propose adapting video generation techniques for 3-D image generation. Using the temporal GAN (TGAN) architecture, we show we are able to generate realistic head and neck PE…
The imaging and subsequent accurate diagnosis of paediatric brain tumours presents a radiological challenge, with magnetic resonance imaging playing a key role in providing tumour specific imaging information. Diffusion weighted and perfusion imaging are commonly used to aid the non invasive diagnosis of paediatric brain tumours, but are usually evaluated by expert qualitative review. Quantitative studies are mainly single centre and single modality. The aim of this work was to combine multi centre diffusion and perfusion imaging, with machine learning, to develop machine learning based classi…
Towards Segmenting the Invisible: An End-to-End Registration and Segmentation Framework for Weakly Supervised Tumour Analysis
Institute of Technical；Business Information Systems, Faculty of Computer Science, Otto von Guericke University Magdeburg, Magdeburg, Germany Human Technopole, Milan, Italy Institute of Medical Engineering, Faculty of Electrical Engineering；Information Technology, Otto von Guericke University Magdeburg, Magdeburg, Germany Centre for Behavioural Brain Sciences, Magdeburg, Germany
Management of vestibular schwannoma (VS) is based on tumour size as observed on T1 MRI scans with contrast agent injection. Current clinical practice is to measure the diameter of the tumour in its largest dimension. It has been shown that volumetric measurement is more accurate and more reliable as a measure of VS size. The reference approach to achieve such volumetry is to manually segment the tumour, which is a time intensive task. We suggest that semi-automated segmentation may be a clinically applicable solution to this problem and that it could replace linear measurements as the clinical…
Generalisation of automatic tumour segmentation in histopathological whole-slide images across multiple cancer types
Institute for Cancer Genetics and Informatics（癌症基因组学与信息学研究所）；Oslo University Hospital（奥斯陆大学医院）；University of Oslo（奥斯陆大学）；Department of Gastrointestinal（胃肠科部）；Institute of Clinical Medicine（临床医学研究所）；Department of Gynaecological Oncology（妇科肿瘤科部）；Amsterdam University Medical Centres（阿姆斯特丹大学医学中心）；Department of Obstetrics and Gynaecology（妇产科部）；Comprehensive Cancer Center Innsbruck（因斯布鲁克综合癌症中心）；Innsbruck Medical University（因斯布鲁克医学院）；Vestre Viken Hospital Trust（维斯特维肯医院信托）；Department of Medical Biology（医学生物学部）；UiT The Arctic University of Norway（挪威北极大学（UiT））；Department of Clinical Pathology（临床病理学部）
Technische Universität München（慕尼黑工业大学）；Helmholtz Zentrum München（亥姆霍兹慕尼黑研究中心）；TranslaTUM Center for Translational Cancer Research（TranslaTUM转化癌症研究中心）；University of Zürich（苏黎世大学）
Novel multimodal imaging methods are capable of generating extensive, super high resolution datasets for preclinical research. Yet, a massive lack of annotations prevents the broad use of deep learning to analyze such data. So far, existing generative models fail to mitigate this problem because of frequent labeling errors. In this paper, we introduce a novel generative method which leverages real anatomical information to generate realistic image-label pairs of tumours. We construct a dual-pathway generator, for the anatomical image and label, trained in a cycle-consistent setup, constrained …
Imperial College London（帝国理工学院）；University of Oxford（牛津大学）
Machine learning has been widely adopted for medical image analysis in recent years given its promising performance in image segmentation and classification tasks. As a data-driven science, the success of machine learning, in particular supervised learning, largely depends on the availability of manually annotated datasets. For medical imaging applications, such annotated datasets are not easy to acquire. It takes a substantial amount of time and resource to curate an annotated medical image set. In this paper, we propose an efficient annotation framework for brain tumour images that is able t…
Segmentation of head and neck (H\&N) tumours and prediction of patient outcome are crucial for patient's disease diagnosis and treatment monitoring. Current developments of robust deep learning models are hindered by the lack of large multi-centre, multi-modal data with quality annotations. The MICCAI 2021 HEad and neCK TumOR (HECKTOR) segmentation and outcome prediction challenge creates a platform for comparing segmentation methods of the primary gross target volume on fluoro-deoxyglucose (FDG)-PET and Computed Tomography images and prediction of progression-free survival in H\&N oropharynge…
The accurate automatic segmentation of gliomas and its intra-tumoral structures is important not only for treatment planning but also for follow-up evaluations. Several methods based on 2D and 3D Deep Neural Networks (DNN) have been developed to segment brain tumors and to classify different categories of tumors from different MRI modalities. However, these networks are often black-box models and do not provide any evidence regarding the process they take to perform this task. Increasing transparency and interpretability of such deep learning techniques are necessary for the complete integrati…
Weakly-supervised segmentation using inherently-explainable classification models and their application to brain tumour classification
Knowledge Engineering Group, Faculty of Computer Science, Otto von Guericke University Magdeburg, Germany；Biomedical Magnetic Resonance, Faculty of Nature Sciences, Otto von Guericke University Magdeburg, Germany；Genomics Research Centre, Human Technopole, Milan, Italy；Institute for Medical Engineering, Faculty of Electrical Engineering；Information Technology, Otto von Guericke University Magdeburg, Germany；Digital Engineering Faculty, University of Potsdam, Germany；Machine Learning, Hasso-Plattner-Institute, Potsdam, Germany；Department of Biomedical Data Science, Stanford University, Stanford, CA, United States；Centre for Behavioural Brain Sciences, Magdeburg, Germany；German Centre for Neurodegenerative Disease, Magdeburg, Germany
Technical University of Munich（慕尼黑工业大学）；Klinikum Rechts der Isar（伊萨尔河右岸医院）；Imperial College London（帝国理工学院）；German Cancer Consortium DKTK（德国癌症联盟（DKTK））
The prediction of pancreatic ductal adenocarcinoma therapy response is a clinically challenging and important task in this high-mortality tumour entity. The training of neural networks able to tackle this challenge is impeded by a lack of large datasets and the difficult anatomical localisation of the pancreas. Here, we propose a hybrid deep neural network pipeline to predict tumour response to initial chemotherapy which is based on the Response Evaluation Criteria in Solid Tumors (RECIST) score, a standardised method for cancer response evaluation by clinicians as well as tumour markers, and …
University of Cambridge（剑桥大学）；University of Cincinnati（辛辛那提大学）
Quantitative cancer image analysis relies on the accurate delineation of tumours, a very specialised and time-consuming task. For this reason, methods for automated segmentation of tumours in medical imaging have been extensively developed in recent years, being Computed Tomography one of the most popular imaging modalities explored. However, the large amount of 3D voxels in a typical scan is prohibitive for the entire volume to be analysed at once in conventional hardware. To overcome this issue, the processes of downsampling and/or resampling are generally implemented when using traditional …
University Hospital Essen (AöR)（埃森大学医院）；Cancer Research Center Cologne Essen (CCCE)（科隆-埃森癌症研究中心）；West German Cancer Center Essen（埃森西德癌症中心）；Karlsruhe Institute of Technology (KIT)（卡尔斯鲁厄理工学院）；University of Duisburg-Essen（杜伊斯堡-埃森大学）；Hannover Medical School（汉诺威医学院）
The segmentation of histopathological whole slide images into tumourous and non-tumourous types of tissue is a challenging task that requires the consideration of both local and global spatial contexts to classify tumourous regions precisely. The identification of subtypes of tumour tissue complicates the issue as the sharpness of separation decreases and the pathologist's reasoning is even more guided by spatial context. However, the identification of detailed types of tissue is crucial for providing personalized cancer therapies. Due to the high resolution of whole slide images, existing sem…
We propose a new deep learning method for tumour segmentation when dealing with missing imaging modalities. Instead of producing one network for each possible subset of observed modalities or using arithmetic operations to combine feature maps, our hetero-modal variational 3D encoder-decoder independently embeds all observed modalities into a shared latent representation. Missing data and tumour segmentation can be then generated from this embedding. In our scenario, the input is a random subset of modalities. We demonstrate that the optimisation problem can be seen as a mixture sampling. In a…
Durham University（杜伦大学）；University of Exeter（埃克塞特大学）；County Durham and Darlington NHS Foundation Trust（达勒姆郡和达灵顿国民保健服务基金会信托）
Medical segmentation is performed to determine the bounds of regions of interest (ROI) prior to surgery. By allowing the study of growth, structure, and behaviour of the ROI in the planning phase, critical information can be obtained, increasing the likelihood of a successful operation. Usually, segmentations are performed manually or via machine learning methods trained on manual annotations. In contrast, this paper proposes a fully automatic, unsupervised inpainting-based brain tumour segmentation system for T1-weighted MRI. First, a deep convolutional neural network (DCNN) is trained to rec…
Queen Mary University of London（伦敦玛丽女王大学）；Communication University of Zhejiang（浙江传媒学院）；University of Leicester（莱斯特大学）
Cancer segmentation in whole-slide images is a fundamental step for viable tumour burden estimation, which is of great value for cancer assessment. However, factors like vague boundaries or small regions dissociated from viable tumour areas make it a challenging task. Considering the usefulness of multi-scale features in various vision-related tasks, we present a structure-aware scale-adaptive feature selection method for efficient and accurate cancer segmentation. Based on a segmentation network with a popular encoder-decoder architecture, a scale-adaptive module is proposed for selecting mor…
University of Cambridge（剑桥大学）；University of Salerno（萨莱诺大学）
Automatic segmentation methods are an important advancement in medical image analysis. Machine learning techniques, and deep neural networks in particular, are the state-of-the-art for most medical image segmentation tasks. Issues with class imbalance pose a significant challenge in medical datasets, with lesions often occupying a considerably smaller volume relative to the background. Loss functions used in the training of deep learning algorithms differ in their robustness to class imbalance, with direct consequences for model convergence. The most commonly used loss functions for segmentati…
The optimal treatment strategy of newly diagnosed glioma is strongly influenced by tumour malignancy. Manual non-invasive grading based on MRI is not always accurate and biopsies to verify diagnosis negatively impact overall survival. In this paper, we propose a fully automatic 3D computer-aided diagnosis (CAD) system to non-invasively differentiate high-grade glioblastoma from lower-grade glioma. The approach consists of an automatic segmentation step to extract the tumour ROI followed by classification using a 3D convolutional neural network. Segmentation was performed using a 3D U-Net achie…
Predicting brain tumour enhancement from non-contrast MR imaging with artificial intelligence: a multi-cohort retrospective diagnostic accuracy study
Queen Square Institute of Neurology, University College London, London, UK（伦敦大学学院医院神经科学研究所）；National Hospital for Neurology and Neurosurgery, London, UK（伦敦神经病学与神经外科医院）；NVIDIA, UK（英国NVIDIA公司）；Great Ormond Street Hospital for Children, London, UK（伦敦儿童医院）；Royal National Orthopaedic Hospital, Stanmore, Middlesex, UK（斯坦莫尔皇家骨科医院，中西敏，英国）；University College Hospitals NHS Foundation Trust, London, UK（伦敦大学学院医院 NHS 基础信托）；Royal Free Hospital, London, UK（伦敦皇家自由医院）；Imperial College Healthcare NHS Trust, London, UK（伦敦帝国学院医疗信托）；Imperial College London, London, UK（伦敦帝国学院）
Convolutional neural networks (CNNs) are the current state-of-the-art meta-algorithm for volumetric segmentation of medical data, for example, to localize COVID-19 infected tissue on computer tomography scans or the detection of tumour volumes in magnetic resonance imaging. A key limitation of 3D CNNs on voxelised data is that the memory consumption grows cubically with the training data resolution. Occupancy networks (O-Nets) are an alternative for which the data is represented continuously in a function space and 3D shapes are learned as a continuous decision boundary. While O-Nets are signi…
Recent progress in automated PET/CT lesion segmentation using deep learning methods has demonstrated the feasibility of this task. However, tumor lesion detection and segmentation in whole-body PET/CT is still a chal-lenging task. To promote research on machine learning-based automated tumor lesion segmentation on whole-body FDG-PET/CT data, Automated Lesion Segmentation in Whole-Body FDG-PET/CT (autoPET) challenge is held, and a large, publicly available training dataset is provided. In this report, we present our solution to the autoPET challenge. We employ multi-modal residual U-Net with de…
University of Toronto（多伦多大学）；Lunenfeld-Tanenbaum Research Institute, Sinai Health System（Sinai Health System 伦内菲尔德-塔嫩鲍姆研究所）；Brigham and Women’s Hospital（布莱根妇女医院）；The Hospital for Sick Children（SickKids 医院）
The segmentation of prostate whole gland and transition zone in Diffusion Weighted MRI (DWI) are the first step in designing computer-aided detection algorithms for prostate cancer. However, variations in MRI acquisition parameters and scanner manufacturing result in different appearances of prostate tissue in the images. Convolutional neural networks (CNNs) which have shown to be successful in various medical image analysis tasks including segmentation are typically sensitive to the variations in imaging parameters. This sensitivity leads to poor segmentation performance of CNNs trained on a …
University of Illinois at Chicago（伊利诺伊大学芝加哥分校）；Microsoft Research Asia（微软亚洲研究院）；Vacaville Christian Schools（瓦卡维尔基督教学校）；Tsinghua University（清华大学）；Microsoft Research（微软研究院）；High School Affiliated to Renmin University Of China（中国人民大学附属中学）；Beihang University（北京航空航天大学）
Whole brain segmentation is an important neuroimaging task that segments the whole brain volume into anatomically labeled regions-of-interest. Convolutional neural networks have demonstrated good performance in this task. Existing solutions, usually segment the brain image by classifying the voxels, or labeling the slices or the sub-volumes separately. Their representation learning is based on parts of the whole volume whereas their labeling result is produced by aggregation of partial segmentation. Learning and inference with incomplete information could lead to sub-optimal final segmentation…
There has been growing research interest in using deep learning based method to achieve fully automated segmentation of lesion in Positron emission tomography computed tomography(PET CT) scans for the prognosis of various cancers. Recent advances in the medical image segmentation shows the nnUNET is feasible for diverse tasks. However, lesion segmentation in the PET images is not straightforward, because lesion and physiological uptake has similar distribution patterns. The Distinction of them requires extra structural information in the CT images. The present paper introduces a nnUNet based m…
University of Science and Technology of China（中国科学技术大学）；Hefei University of Technology（合肥工业大学）
Automatic medical image segmentation has wide applications for disease diagnosing. However, it is much more challenging than natural optical image segmentation due to the high-resolution of medical images and the corresponding huge computation cost. The sliding window is a commonly used technique for whole slide image (WSI) segmentation, however, for these methods based on the sliding window, the main drawback is lacking global contextual information for supervision. In this paper, we propose a dual-inputs attention network (denoted as DA-RefineNet) for WSI segmentation, where both local fine-…
In this paper, we propose a novel network named Vision Transformer for Biomedical Image Segmentation (ViTBIS). Our network splits the input feature maps into three parts with $1\times 1$, $3\times 3$ and $5\times 5$ convolutions in both encoder and decoder. Concat operator is used to merge the features before being fed to three consecutive transformer blocks with attention mechanism embedded inside it. Skip connections are used to connect encoder and decoder transformer blocks. Similarly, transformer blocks and multi scale architecture is used in decoder before being linearly projected to prod…
