In this work we present a novel system for generation of virtual PET images using CT scans. We combine a fully convolutional network (FCN) with a conditional generative adversarial network (GAN) to generate simulated PET data from given input CT data. The synthesized PET can be used for false-positive reduction in lesion detection solutions. Clinically, such solutions may enable lesion detection and drug treatment evaluation in a CT-only environment, thus reducing the need for the more expensive and radioactive PET/CT scan. Our dataset includes 60 PET/CT scans from Sheba Medical center. We used 23 scans for training and 37 for testing. Different schemes to achieve the synthesized output were qualitatively compared. Quantitative evaluation was conducted using an existing lesion detection software, combining the synthesized PET as a false positive reduction layer for the detection of malignant lesions in the liver. Current results look promising showing a 28% reduction in the average false positive per case from 2.9 to 2.1. The suggested solution is comprehensive and can be expanded to additional body organs, and different modalities.
the University of Sydney（悉尼大学）；Shanghai Jiao Tong University（上海交通大学）
Segmentation of skin lesions is considered as an important step in computer aided diagnosis (CAD) for automated melanoma diagnosis. In recent years, segmentation methods based on fully convolutional networks (FCN) have achieved great success in general images. This success is primarily due to the leveraging of large labelled datasets to learn features that correspond to the shallow appearance as well as the deep semantics of the images. However, the dependence on large dataset does not translate well into medical images. To improve the FCN performance for skin lesion segmentations, researchers…
How to Segment in 3D Using 2D Models: Automated 3D Segmentation of Prostate Cancer Metastatic Lesions on PET Volumes Using Multi-angle Maximum Intensity Projections and Diffusion Models
BC Cancer Research Institute（BC癌症研究所）；University of British Columbia（不列颠哥伦比亚大学）；BC Cancer（BC癌症中心）
General Electric Healthcare（通用电气医疗集团）；University of Rouen（鲁昂大学）；Henri Becquerel Center（亨利·贝克勒尔中心）
One of the most challenges in medical imaging is the lack of data. It is proven that classical data augmentation methods are useful but still limited due to the huge variation in images. Using generative adversarial networks (GAN) is a promising way to address this problem, however, it is challenging to train one model to generate different classes of lesions. In this paper, we propose a deep convolutional conditional generative adversarial network to generate MIP positron emission tomography image (PET) which is a 2D image that represents a 3D volume for fast interpretation, according to diff…
Tel Aviv University（特拉维夫大学）；Sheba Medical Center（谢巴医疗中心）
In this work we present a novel system for PET estimation using CT scans. We explore the use of fully convolutional networks (FCN) and conditional generative adversarial networks (GAN) to export PET data from CT data. Our dataset includes 25 pairs of PET and CT scans where 17 were used for training and 8 for testing. The system was tested for detection of malignant tumors in the liver region. Initial results look promising showing high detection performance with a TPR of 92.3% and FPR of 0.25 per case. Future work entails expansion of the current system to the entire body using a much larger d…
Data augmentation can effectively resolve a scarcity of images when training machine-learning algorithms. It can make them more robust to unseen images. We present a lesion conditional Generative Adversarial Network LcGAN to generate synthetic Computed Tomography (CT) images for data augmentation. A lesion conditional image (segmented mask) is an input to both the generator and the discriminator of the LcGAN during training. The trained model generates contextual CT images based on input masks. We quantify the quality of the images by using a fully convolutional network (FCN) score and blurrin…
Ohio University（俄亥俄大学）；University of Kentucky（肯塔基大学）
In this paper, we develop a two-stage neural network solution for the challenging task of white-matter lesion segmentation. To cope with the vast vari- ability in lesion sizes, we sample brain MR scans with patches at three differ- ent dimensions and feed them into separate fully convolutional neural networks (FCNs). In the second stage, we process large and small lesion separately, and use ensemble-nets to combine the segmentation results generated from the FCNs. A novel activation function is adopted in the ensemble-nets to improve the segmen- tation accuracy measured by Dice Similarity Coef…
ALL-PET: A Low-resource and Low-shot PET Foundation Model in Projection Domain
School of Information Engineering, Nanchang University（南昌大学信息工程学院）；School of Mathematics and Computer Science, Nanchang University（南昌大学数学与计算机学院）；Institute of Artificial Intelligence, Hefei Comprehensive National Science Center（合肥综合性国家科学中心人工智能研究院）；College of Optical Science and Engineering, Zhejiang University（浙江大学光电科学与工程学院）
Technical University of Munich（慕尼黑工业大学）；LMU Hospital Grosshadern（路德维希-马克西米利安-慕尼黑大学格罗斯哈德恩医院）
Automatic segmentation of the liver and hepatic lesions is an important step towards deriving quantitative biomarkers for accurate clinical diagnosis and computer-aided decision support systems. This paper presents a method to automatically segment liver and lesions in CT and MRI abdomen images using cascaded fully convolutional neural networks (CFCNs) enabling the segmentation of a large-scale medical trial or quantitative image analysis. We train and cascade two FCNs for a combined segmentation of the liver and its lesions. In the first step, we train a FCN to segment the liver as ROI input …
University of Barcelona（巴塞罗那大学）；Universitat Rovira i Virgili（罗维拉-维尔吉利大学）；Khalifa University of Science and Technology（哈利法科学技术大学）；Mil-kin Inc.（Mil-kin公司）；Dhaka Medical College Hospital（达卡医学院附属医院）；University of Warwick（华威大学）；University of Toulouse（图卢兹大学）
The determination of precise skin lesion boundaries in dermoscopic images using automated methods faces many challenges, most importantly, the presence of hair, inconspicuous lesion edges and low contrast in dermoscopic images, and variability in the color, texture and shapes of skin lesions. Existing deep learning-based skin lesion segmentation algorithms are expensive in terms of computational time and memory. Consequently, running such segmentation algorithms requires a powerful GPU and high bandwidth memory, which are not available in dermoscopy devices. Thus, this article aims to achieve …
FlowPET: Physics-Informed Symplectic Flow Matching for Low-Count PET Reconstruction
Centre for Smart Health, The Hong Kong Polytechnic University, Hong Kong, China（智能健康研究中心，香港理工大学，中国香港）；Department of Nuclear Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China（核医学部，中山大学肿瘤中心，中国广州）；Research Center for Medical AI, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China（医学人工智能研究中心，深圳先进技术研究院，中国科学院，中国深圳）
Automated Lesion Segmentation in Whole-Body PET/CT in a multitracer setting
Shanghai United Imaging Healthcare Advanced Technology Research Institute Co., Ltd.（上海联影医疗科技股份有限公司先进技术研究院）；Shanghai Jiao Tong University（上海交通大学）；East China Normal University（华东师范大学）
Technische Universität München（慕尼黑工业大学）；LMU Hospital Grosshadern（LMU格罗斯哈德恩医院）
Automatic segmentation of the liver and its lesion is an important step towards deriving quantitative biomarkers for accurate clinical diagnosis and computer-aided decision support systems. This paper presents a method to automatically segment liver and lesions in CT abdomen images using cascaded fully convolutional neural networks (CFCNs) and dense 3D conditional random fields (CRFs). We train and cascade two FCNs for a combined segmentation of the liver and its lesions. In the first step, we train a FCN to segment the liver as ROI input for a second FCN. The second FCN solely segments lesion…
University of Electronic Science and Technology of China（电子科技大学）
Dermoscopy image detection stays a tough task due to the weak distinguishable property of the object.Although the deep convolution neural network signifigantly boosted the performance on prevelance computer vision tasks in recent years,there remains a room to explore more robust and precise models to the problem of low contrast image segmentation.Towards the challenge of Lesion Segmentation in ISBI 2017,we built a symmetrical identity inception fully convolution network which is based on only 10 reversible inception blocks,every block composed of four convolution branches with combination of d…
A Unified Vision-Language Model for PSMA PET/CT Report Generation, Visual Question Answering, and Lesion Segmentation
University of Florida（佛罗里达大学）；University of California, San Francisco（加利福尼亚大学旧金山分校）；Stony Brook University（纽约州立大学石溪分校）；The University of Texas MD Anderson Cancer Center（得克萨斯大学MD安德森癌症中心）
Melanoma is clinically difficult to distinguish from common benign skin lesions, particularly melanocytic naevus and seborrhoeic keratosis. The dermoscopic appearance of these lesions has huge intra-class variations and high inter-class visual similarities. Most current research is focusing on single-class segmentation irrespective of classes of skin lesions. In this work, we evaluate the performance of deep learning on multi-class segmentation of ISIC-2017 challenge dataset, which consists of 2,750 dermoscopic images. We propose an end-to-end solution using fully convolutional networks (FCNs)…
Enhancing Lesion Segmentation in PET/CT Imaging with Deep Learning and Advanced Data Preprocessing Techniques
Shanghai United Imaging Healthcare Advanced Technology Research Institute Co., Ltd.（上海联影医疗科技先进技术研究院有限公司）；Shanghai Jiao Tong University（上海交通大学）；East China Normal University（华东师范大学）
RADIANT-PET: Reasoning-Augmented PET/CT Lesion Segmentation with Large Language Models and Reinforcement Learning
Division of Hematology, The Ohio State University Comprehensive Cancer Center（血液科，俄亥俄州立大学综合癌症中心）；Department of Radiology, Mahidol University（医学放射科，玛希多大学）；Department of Radiology, Mettapracharak Hospital（医学放射科，Mettapracharak医院）；Department of Radiation Oncology, The Ohio State University Comprehensive Cancer Center（放射肿瘤科，俄亥俄州立大学综合癌症中心）
Automatic segmentation of tumor lesions is a critical initial processing step for quantitative PET/CT analysis. However, numerous tumor lesion with different shapes, sizes, and uptake intensity may be distributed in different anatomical contexts throughout the body, and there is also significant uptake in healthy organs. Therefore, building a systemic PET/CT tumor lesion segmentation model is a challenging task. In this paper, we propose a novel training strategy to build deep learning models capable of systemic tumor segmentation. Our method is validated on the training set of the AutoPET 202…
Fed-NDIF: A Noise-Embedded Federated Diffusion Model For Low-Count Whole-Body PET Denoising
Yale University（耶鲁大学）；Northwestern University（西北大学）；Ruijin Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属瑞金医院）；Inselspital, Bern University Hospital, University of Bern（伯尔尼大学医院 Inselspital，伯尔尼大学）；Technical University of Munich（慕尼黑工业大学）；Yale School of Medicine（耶鲁医学院）
Semantic segmentation is an important preliminary step towards automatic medical image interpretation. Recently deep convolutional neural networks have become the first choice for the task of pixel-wise class prediction. While incorporating prior knowledge about the structure of target objects has proven effective in traditional energy-based segmentation approaches, there has not been a clear way for encoding prior knowledge into deep learning frameworks. In this work, we propose a new loss term that encodes the star shape prior into the loss function of an end-to-end trainable fully convoluti…
Unsupervised Generation of Pseudo Normal PET from MRI with Diffusion Model for Epileptic Focus Localization
University of Michigan-Shanghai Jiao Tong University Joint Institute（上海交通大学密西根学院）；School of Biomedical Engineering, Shanghai Jiao Tong University（上海交通大学生物医学工程学院）；Global Institute of Future Technology, Shanghai Jiao Tong University（上海交通大学未来技术学院）；Ruijin Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属瑞金医院）
University of Sydney（悉尼大学）；Shanghai Jiao Tong University（上海交通大学）
Automatic segmentation of liver lesions is a fundamental requirement towards the creation of computer aided diagnosis (CAD) and decision support systems (CDS). Traditional segmentation approaches depend heavily upon hand-crafted features and a priori knowledge of the user. As such, these methods are difficult to adopt within a clinical environment. Recently, deep learning methods based on fully convolutional networks (FCNs) have been successful in many segmentation problems primarily because they leverage a large labelled dataset to hierarchically learn the features that best correspond to the…
There has been growing research interest in using deep learning based method to achieve fully automated segmentation of lesion in Positron emission tomography computed tomography(PET CT) scans for the prognosis of various cancers. Recent advances in the medical image segmentation shows the nnUNET is feasible for diverse tasks. However, lesion segmentation in the PET images is not straightforward, because lesion and physiological uptake has similar distribution patterns. The Distinction of them requires extra structural information in the CT images. The present paper introduces a nnUNet based m…
Tel Aviv University（特拉维夫大学）；Bar-Ilan University（巴伊兰大学）
This paper explores the use of a soft ground-truth mask ("soft mask'') to train a Fully Convolutional Neural Network (FCNN) for segmentation of Multiple Sclerosis (MS) lesions. Detection and segmentation of MS lesions is a complex task largely due to the extreme unbalanced data, with very small number of lesion pixels that can be used for training. Utilizing the anatomical knowledge that the lesion surrounding pixels may also include some lesion level information, we suggest to increase the data set of the lesion class with neighboring pixel data - with a reduced confidence weight. A soft mask…
A Dual Path Framework with Hotspot Guided Fusion for Three Dimensional CT to PET Synthesis in Head and Neck Cancer
Advanced Molecular Imaging in Radiotherapy (AdMIRe) Research Laboratory, School of Health Sciences, Purdue University, West Lafayette, IN, 47907, USA（高级分子影像在放射治疗（AdMIRe）研究实验室，健康科学学院，普渡大学，西拉法叶，IN，47907，美国）；Department of Radiation Oncology, Indiana University School of Medicine, Indianapolis, IN 46202, USA（放射肿瘤学部，印第安纳大学医学院，印第安纳波利斯，IN，46202，美国）
Automatic segmentation of tumor lesions is a critical initial processing step for quantitative PET/CT analysis. However, numerous tumor lesions with different shapes, sizes, and uptake intensity may be distributed in different anatomical contexts throughout the body, and there is also significant uptake in healthy organs. Therefore, building a systemic PET/CT tumor lesion segmentation model is a challenging task. In this paper, we propose a novel step-by-step 3D segmentation method to address this problem. We achieved Dice score of 0.92, false positive volume of 0.89 and false negative volume …
Zhejiang cancer hospital（浙江省肿瘤医院）；Shanghai Jiao Tong University（上海交通大学）；Eindhoven University of Technology（埃因霍温理工大学）；Tokyo Institute of Technology（东京工业大学）；Yale University（耶鲁大学）；German Research Center of Artificial Intelligence（德国人工智能研究中心）
Breast cancer is the most common invasive cancer with the highest cancer occurrence in females. Handheld ultrasound is one of the most efficient ways to identify and diagnose the breast cancer. The area and the shape information of a lesion is very helpful for clinicians to make diagnostic decisions. In this study we propose a new deep-learning scheme, semi-pixel-wise cycle generative adversarial net (SPCGAN) for segmenting the lesion in 2D ultrasound. The method takes the advantage of a fully convolutional neural network (FCN) and a generative adversarial net to segment a lesion by using prio…
Towards AI Lesion Tracking in PET/CT Imaging: A Siamese-based CNN Pipeline applied on PSMA PET/CT Scans
Technical University of Munich（慕尼黑工业大学）；TUM School of Natural Sciences（慕尼黑工业大学自然科学学院）；Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院）；Munich Institute of Biomedical Engineering（慕尼黑生物医学工程研究所）
PETAR: Localized Findings Generation with Mask-Aware Vision-Language Modeling for PET Automated Reporting
University of Wisconsin–Madison Department of Computer Sciences（威斯康星大学麦迪逊分校计算机科学系）；University of Wisconsin–Madison Department Radiology（威斯康星大学麦迪逊分校放射学系）；Microsoft（微软公司）
IgCONDA-PET: Weakly-Supervised PET Anomaly Detection using Implicitly-Guided Attention-Conditional Counterfactual Diffusion Modeling -- a Multi-Center, Multi-Cancer, and Multi-Tracer Study
organization= Department of Physics \& Astronomy, University of British Columbia , city= Vancouver , state= BC , country= Canada；organization= Department of Integrative Oncology, BC Cancer Research Institute , city= Vancouver , state= BC , country= Canada；organization= Department of Radiology, University of British Columbia , city= Vancouver , state= BC , country= Canada
AI Virtanen Institute for Molecular Sciences, University of Eastern Finland（东芬兰大学AI·维尔塔宁分子科学研究所）；Charles River Discovery Services（查尔斯河发现服务公司）；Centro Fermi - Museo Storico della Fisica e Centro Studi e Ricerche Enrico Fermi（费米中心——恩里科·费米物理历史博物馆与研究中心）
Manual segmentation of rodent brain lesions from magnetic resonance images (MRIs) is an arduous, time-consuming and subjective task that is highly important in pre-clinical research. Several automatic methods have been developed for different human brain MRI segmentation, but little research has targeted automatic rodent lesion segmentation. The existing tools for performing automatic lesion segmentation in rodents are constrained by strict assumptions about the data. Deep learning has been successfully used for medical image segmentation. However, there has not been any deep learning approach…
AutoPET Challenge III: Testing the Robustness of Generalized Dice Focal Loss trained 3D Residual UNet for FDG and PSMA Lesion Segmentation from Whole-Body PET/CT Images
University of British Columbia（不列颠哥伦比亚大学）；BC Cancer Research Institute（不列颠哥伦比亚癌症研究所）
Shanghai AI Lab（上海人工智能实验室）；Shanghai Jiao Tong University（上海交通大学）；University of Surrey（萨里大学）；University of Electronic Science and Technology of China（电子科技大学）；Tongji University（同济大学）
Tumor lesion segmentation is one of the most important tasks in medical image analysis. In clinical practice, Fluorodeoxyglucose Positron-Emission Tomography~(FDG-PET) is a widely used technique to identify and quantify metabolically active tumors. However, since FDG-PET scans only provide metabolic information, healthy tissue or benign disease with irregular glucose consumption may be mistaken for cancer. To handle this challenge, PET is commonly combined with Computed Tomography~(CT), with the CT used to obtain the anatomic structure of the patient. The combination of PET-based metabolic and…
Multiple sclerosis (MS) is a demyelinating disease of the central nervous system (CNS). A reliable measure of the tissue myelin content is therefore essential for the understanding of the physiopathology of MS, tracking progression and assessing treatment efficacy. Positron emission tomography (PET) with $[^{11} \mbox{C}] \mbox{PIB}$ has been proposed as a promising biomarker for measuring myelin content changes in-vivo in MS. However, PET imaging is expensive and invasive due to the injection of a radioactive tracer. On the contrary, magnetic resonance imaging (MRI) is a non-invasive, widely …
Erasmus MC（伊拉斯姆斯医学中心）；TU Delft（代尔夫特理工大学）；University of Copenhagen（哥本哈根大学）
Localization of focal vascular lesions on brain MRI is an important component of research on the etiology of neurological disorders. However, manual annotation of lesions can be challenging, time-consuming and subject to observer bias. Automated detection methods often need voxel-wise annotations for training. We propose a novel approach for automated lesion detection that can be trained on scans only annotated with a dot per lesion instead of a full segmentation. From the dot annotations and their corresponding intensity images we compute various distance maps (DMs), indicating the distance t…
University of Electronic Science and Technology of China（电子科技大学）
With a large influx of dermoscopy images and a growing shortage of dermatologists, automatic dermoscopic image analysis plays an essential role in skin cancer diagnosis. In this paper, a new deep fully convolutional neural network (FCNN) is proposed to automatically segment melanoma out of skin images by end-to-end learning with only pixels and labels as inputs. Our proposed FCNN is capable of using both local and global information to segment melanoma by adopting skipping layers. The public benchmark database consisting of 150 validation images, 600 test images and 2000 training images in the…
Sliding Window FastEdit: A Framework for Lesion Annotation in Whole-body PET Images
HIDSS4Health - Helmholtz Information and Data Science School for Health（亥姆霍兹信息与健康数据科学学院）；Institute for AI in Medicine (IKIM), University Hospital Essen（埃森大学医院医学人工智能研究所）
Comprehensive framework for evaluation of deep neural networks in detection and quantification of lymphoma from PET/CT images: clinical insights, pitfalls, and observer agreement analyses
University of British Columbia（英属哥伦比亚大学）；BC Cancer Research Institute（BC癌症研究所）；Microsoft AI for Good Lab（微软AI公益实验室）；Pomeranian Medical University（波美拉尼亚医科大学）；BC Children’s Hospital（BC儿童医院）；St. Mary’s Hospital（圣玛丽医院）；BC Cancer（BC癌症中心）
Multimodal Interactive Lung Lesion Segmentation: A Framework for Annotating PET/CT Images based on Physiological and Anatomical Cues
HIDSS4Health - Helmholtz Information and Data Science School for Health（亥姆霍兹信息与健康数据科学学院（HIDSS4Health））；Institute for AI in Medicine (IKIM), University Hospital Essen（埃森大学医院医学人工智能研究所（IKIM））
University of Girona（赫罗纳大学）；Université Clermont Auvergne（克莱蒙奥弗涅大学）
Automatic segmentation of skin lesion is considered a crucial step in Computer Aided Diagnosis (CAD) for melanoma diagnosis. Despite its significance, skin lesion segmentation remains a challenging task due to their diverse color, texture, and indistinguishable boundaries and forms an open problem. Through this study, we present a new and automatic semantic segmentation network for robust skin lesion segmentation named Dermoscopic Skin Network (DSNet). In order to reduce the number of parameters to make the network lightweight, we used depth-wise separable convolution in lieu of standard convo…
Early detection of melanoma is difficult for the human eye but a crucial step towards reducing its death rate. Computerized detection of these melanoma and other skin lesions is necessary. The central research question in this paper is "How to segment skin lesion images using a neural network with low available data?". This question is divided into three sub questions regarding best performing network structure, training data and training method. First theory associated with these questions is discussed. Literature states that U-net CNN structures have excellent performances on the segmentatio…
The autoPET3 Challenge: Automated Lesion Segmentation in Whole-Body PET/CT $\unicode{x2013}$ Multitracer Multicenter Generalization
Department of Radiology, LMU University Hospital, LMU Munich（莱比锡大学医院放射科，莱比锡大学）；Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）；University Hospital Tübingen, Department of Radiology（图宾根大学医院放射科）；Department of Radiology, Stanford University（斯坦福大学放射科）；German Cancer Research Center (DKFZ)（德国癌症研究中心（DKFZ））；Pattern Analysis and Learning Group, Department of Radiation Oncology, Heidelberg University Hospital（海德堡大学医院放射肿瘤学部模式分析与学习组）；Faculty of Mathematics and Computer Science, Heidelberg University（海德堡大学数学与计算机科学学院）；Institute for AI in Medicine (IKIM), University Hospital Essen (AöR)（医学人工智能研究所（IKIM），埃森大学医院（AöR））；Department of Nuclear Medicine, University Hospital Essen (AöR)（核医学部，埃森大学医院（AöR））；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）；Department of Computer Science and Engineering, The Chinese University of Hong Kong（香港中文大学计算机科学与工程系）；Department of Electronic Engineering, The Chinese University of Hong Kong（香港中文大学电子工程系）；Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；HIDSS4Health - Helmholtz Information and Data Science School for Health（HIDSS4Health - 海德堡信息与数据科学健康学校）；Department of Nuclear Medicine, LMU University Hospital, LMU Munich（莱比锡大学医院核医学部，莱比锡大学）；Comprehensive Pneumology Center (CPC-M), Member of the German Center for Lung Research (DZL)（综合肺科中心（CPC-M），德国肺癌研究中心（DZL）成员）；relAI – Konrad Zuse School of Excellence in Reliable AI（relAI - 卡诺德·祖斯可靠性人工智能卓越学校）；Cluster of Excellence iFIT (EXC 2180) "Image Guided and Functionally Instructed Tumor Therapies", University of Tübingen（卓越中心iFIT（EXC 2180）"图像引导和功能指导肿瘤治疗"，图宾根大学）
