Following recent advancements in computer-aided detection and diagnosis systems for colonoscopy, the automated reporting of colonoscopy procedures is set to further revolutionize clinical practice. A crucial yet underexplored aspect in the development of these systems is the creation of computer vision models capable of autonomously segmenting full-procedure colonoscopy videos into anatomical sections and procedural phases. In this work, we aim to create the first open-access dataset for this task and propose a state-of-the-art approach, benchmarked against competitive models. We annotated the publicly available REAL-Colon dataset, consisting of 2.7 million frames from 60 complete colonoscopy videos, with frame-level labels for anatomical locations and colonoscopy phases across nine categories. We then present ColonTCN, a learning-based architecture that employs custom temporal convolutional blocks designed to efficiently capture long temporal dependencies for the temporal segmentation of colonoscopy videos. We also propose a dual k-fold cross-validation evaluation protocol for this benchmark, which includes model assessment on unseen, multi-center data.ColonTCN achieves state-of-the-art performance in classification accuracy while maintaining a low parameter count when evaluated using the two proposed k-fold cross-validation settings, outperforming competitive models. We report ablation studies to provide insights into the challenges of this task and highlight the benefits of the custom temporal convolutional blocks, which enhance learning and improve model efficiency. We believe that the proposed open-access benchmark and the ColonTCN approach represent a significant advancement in the temporal segmentation of colonoscopy procedures, fostering further open-access research to address this clinical need.
Computer Vision Center（计算机视觉中心）；Universitat Autonoma de Barcelona（巴塞罗那自治大学）；Montreal Institute for Learning Algorithms（蒙特利尔学习算法研究所）；Université de Montréal（蒙特利尔大学）；École Polytechnique de Montréal（蒙特利尔理工学院）；Hospital Clinic（临床医院）；Universidad de Barcelona（巴塞罗那大学）；Imagia Inc.（Imagia公司）
Colorectal cancer (CRC) is the third cause of cancer death worldwide. Currently, the standard approach to reduce CRC-related mortality is to perform regular screening in search for polyps and colonoscopy is the screening tool of choice. The main limitations of this screening procedure are polyp miss-rate and inability to perform visual assessment of polyp malignancy. These drawbacks can be reduced by designing Decision Support Systems (DSS) aiming to help clinicians in the different stages of the procedure by providing endoluminal scene segmentation. Thus, in this paper, we introduce an extend…
Indira Gandhi National Open University（英迪拉·甘地国立开放大学）
Colorectal cancer is one of fatal cancer worldwide. Colonoscopy is the standard treatment for examination, localization, and removal of colorectal polyps. However, it has been shown that the miss-rate of colorectal polyps during colonoscopy is between 6 to 27%. The use of an automated, accurate, and real-time polyp segmentation during colonoscopy examinations can help the clinicians to eliminate missing lesions and prevent further progression of colorectal cancer. The ``Medico automatic polyp segmentation challenge'' provides an opportunity to study polyp segmentation and build a fast segmenta…
University of Bergen（卑尔根大学）；SimulaMet（西穆拉梅特）；Nepal Medical College（尼泊尔医学院）；Kathmandu University（加德满都大学）；UiT The Arctic University of Norway（挪威北极大学）；University of Oslo（奥斯陆大学）；Oslo Metropolitan University（奥斯陆城市大学）
Polyps are the predecessors to colorectal cancer which is considered as one of the leading causes of cancer-related deaths worldwide. Colonoscopy is the standard procedure for the identification, localization, and removal of colorectal polyps. Due to variability in shape, size, and surrounding tissue similarity, colorectal polyps are often missed by the clinicians during colonoscopy. With the use of an automatic, accurate, and fast polyp segmentation method during the colonoscopy, many colorectal polyps can be easily detected and removed. The ``Medico automatic polyp segmentation challenge'' p…
RRTS Dataset: A Benchmark Colonoscopy Dataset from Resource-Limited Settings for Computer-Aided Diagnosis Research
Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, Bangladesh（生物医学工程系，孟加拉国工程大学）；Dhaka Medical College, Dhaka, Bangladesh（达卡医学学院）
SimulaMet（西穆拉梅特研究所）；UIT The Arctic University of Norway（挪威北极大学）；University of Oxford（牛津大学）；Oslo Metropolitan University（奥斯陆城市大学）
Colonoscopy is the gold standard for examination and detection of colorectal polyps. Localization and delineation of polyps can play a vital role in treatment (e.g., surgical planning) and prognostic decision making. Polyp segmentation can provide detailed boundary information for clinical analysis. Convolutional neural networks have improved the performance in colonoscopy. However, polyps usually possess various challenges, such as intra-and inter-class variation and noise. While manual labeling for polyp assessment requires time from experts and is prone to human error (e.g., missed lesions)…
PolypDB: A Curated Multi-Center Dataset for Development of AI Algorithms in Colonoscopy
Northwestern University（西北大学）；Sahlgrenska University Hospital（萨尔格伦斯卡大学医院）；The University of Gothenburg（哥德堡大学）；Harvard University（哈佛大学）；University Hospital Würzburg（维尔茨堡大学医院）；Hanoi Medical University（河内医科大学）；The Institute of Gastroenterology and Hepatology, Hanoi, Vietnam（越南河内胃肠病与肝病研究所）；Ho Chi Minh University Medical Center（胡志明市大学医疗中心）
本文发布涵盖三国三中心、五种成像模态的 3934 张息肉图像数据集 PolypDB，并提供分割、检测与联邦学习基准，以支持结肠镜 AI 算法开发。
Southeast University（东南大学）；The first affiliated hospital of Nanjing medical university（南京医科大学第一附属医院）；Centre de Recherche en Information Biomédicale Sino-Français (CRIBs)（中法生物医学信息研究中心（CRIBs））；University of Western Ontario（西安大略大学）
Reliable automatic classification of colonoscopy images is of great significance in assessing the stage of colonic lesions and formulating appropriate treatment plans. However, it is challenging due to uneven brightness, location variability, inter-class similarity, and intra-class dissimilarity, affecting the classification accuracy. To address the above issues, we propose a Fourier-based Frequency Complex Network (FFCNet) for colon disease classification in this study. Specifically, FFCNet is a novel complex network that enables the combination of complex convolutional networks with frequenc…
We present a neural network architecture for medical image segmentation of diabetic foot ulcers and colonoscopy polyps. Diabetic foot ulcers are caused by neuropathic and vascular complications of diabetes mellitus. In order to provide a proper diagnosis and treatment, wound care professionals need to extract accurate morphological features from the foot wounds. Using computer-aided systems is a promising approach to extract related morphological features and segment the lesions. We propose a convolution neural network called HarDNet-DFUS by enhancing the backbone and replacing the decoder of …
Stony Brook University（石溪大学）；Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）
Haustral folds are colon wall protrusions implicated for high polyp miss rate during optical colonoscopy procedures. If segmented accurately, haustral folds can allow for better estimation of missed surface and can also serve as valuable landmarks for registering pre-treatment virtual (CT) and optical colonoscopies, to guide navigation towards the anomalies found in pre-treatment scans. We present a novel generative adversarial network, FoldIt, for feature-consistent image translation of optical colonoscopy videos to virtual colonoscopy renderings with haustral fold overlays. A new transitive …
Knowledge Extraction and Distillation from Large-Scale Image-Text Colonoscopy Records Leveraging Large Language and Vision Models
School of Basic Medical Sciences, Fudan University（复旦大学基础医学院）；Shanghai Key Laboratory of MICCAI（上海市MICCAI重点实验室）；Data Science Institute, Imperial College London（伦敦帝国理工学院数据科学研究所）；Shanghai Collaborative Innovation Centre of Endoscopy（上海市内镜微创技术协同创新中心）；Endoscopy Centre and Endoscopy Research Institute, Zhongshan Hospital, Fudan University（复旦大学附属中山医院内镜中心及内镜研究所）；Academy for Engineering and Technology, Fudan University（复旦大学工程与技术学院）；School of Computer Science and Engineering, Nanjing University of Science and Technology（南京理工大学计算机科学与工程学院）；Department of Computer Science and Engineering, Hong Kong University of Science and Technology（香港科技大学计算机科学与工程学系）
Hanoi University of Science and Technology（河内科技大学）；Hanoi Medical University（河内医科大学）；The Institute of Gastroenterology and Hepatology（胃肠病学与肝病学研究所）；Vietnam National University of Agriculture（越南国立农业大学）
Colorectal cancer is among the most common malignancies and can develop from high-risk colon polyps. Colonoscopy is an effective screening tool to detect and remove polyps, especially in the case of precancerous lesions. However, the missing rate in clinical practice is relatively high due to many factors. The procedure could benefit greatly from using AI models for automatic polyp segmentation, which provide valuable insights for improving colon polyp detection. However, precise segmentation is still challenging due to variations of polyps in size, shape, texture, and color. This paper propos…
Interpretability-guided Data Augmentation for Robust Segmentation in Multi-centre Colonoscopy Data
The Netherlands Cancer Institute（荷兰癌症研究所）；GROW School for Oncology and Developmental Biology, Maastricht University Medical Center（马斯特里赫特大学医学中心GROW肿瘤与发育生物学学院）
Colorectal cancer is the third most common cause of cancer death worldwide. Optical colonoscopy is the gold standard for detecting colorectal cancer; however, about 25 percent of polyps are missed during the procedure. A vision-based autonomous endorobot can improve colonoscopy procedures significantly through systematic, complete screening of the colonic mucosa. The reliable robot navigation needed requires a three-dimensional understanding of the environment and lumen tracking to support autonomous tasks. We propose a novel multi-task model that simultaneously predicts dense depth and lumen …
Indian Statistical Institute（印度统计研究所）；Østfold University College（东福尔德大学学院）；SimulaMet；UiT The Arctic University of Norway（挪威北极大学）；University of Oxford（牛津大学）
Colonoscopy is a gold standard procedure but is highly operator-dependent. Efforts have been made to automate the detection and segmentation of polyps, a precancerous precursor, to effectively minimize missed rate. Widely used computer-aided polyp segmentation systems actuated by encoder-decoder have achieved high performance in terms of accuracy. However, polyp segmentation datasets collected from varied centers can follow different imaging protocols leading to difference in data distribution. As a result, most methods suffer from performance drop and require re-training for each specific dat…
SimulaMet；UiT The Arctic University of Norway（挪威北极大学）；Oslo Metropolitan University（奥斯陆城市大学）；Institute of Biomedical Engineering, University of Oxford（牛津大学生物医学工程研究所）；Bærum Hospital（贝鲁姆医院）；Augere Medical AS（Augere Medical 公司）；Sahlgrenska University Hospital-Mölndal Hospital（萨尔格伦斯卡大学医院-默恩达尔医院）；Sahlgrenska Academy, University of Gothenburg（哥德堡大学萨尔格伦斯卡学院）
Deep learning in gastrointestinal endoscopy can assist to improve clinical performance and be helpful to assess lesions more accurately. To this extent, semantic segmentation methods that can perform automated real-time delineation of a region-of-interest, e.g., boundary identification of cancer or precancerous lesions, can benefit both diagnosis and interventions. However, accurate and real-time segmentation of endoscopic images is extremely challenging due to its high operator dependence and high-definition image quality. To utilize automated methods in clinical settings, it is crucial to de…
University of Saskatchewan（萨斯喀彻温大学）；University of Stanford（斯坦福大学）
Colorectal cancer is the third most common cancer-related death after lung cancer and breast cancer worldwide. The risk of developing colorectal cancer could be reduced by early diagnosis of polyps during a colonoscopy. Computer-aided diagnosis systems have the potential to be applied for polyp screening and reduce the number of missing polyps. In this paper, we compare the performance of different deep learning architectures as feature extractors, i.e. ResNet, DenseNet, InceptionV3, InceptionResNetV2 and SE-ResNeXt in the encoder part of a U-Net architecture. We validated the performance of p…
Computerized detection of colonic polyps remains an unsolved issue because of the wide variation in the appearance, texture, color, size, and presence of the multiple polyp-like imitators during colonoscopy. In this paper, we propose a deep convolutional neural network based model for the computerized detection of polyps within colonoscopy images. The proposed model comprises 16 convolutional layers with 2 fully connected layers, and a Softmax layer, where we implement a unique approach using different convolutional kernels within the same hidden layer for deeper feature extraction. We applied…
University of Lincoln（林肯大学）；Lingnan Normal University（岭南师范学院）
Besides the complex nature of colonoscopy frames with intrinsic frame formation artefacts such as light reflections and the diversity of polyp types/shapes, the publicly available polyp segmentation training datasets are limited, small and imbalanced. In this case, the automated polyp segmentation using a deep neural network remains an open challenge due to the overfitting of training on small datasets. We proposed a simple yet effective polyp segmentation pipeline that couples the segmentation (FCN) and classification (CNN) tasks. We find the effectiveness of interactive weight transfer betwe…
AI-Assisted Colonoscopy: Polyp Detection and Segmentation using Foundation Models
TECNALIA, Basque Research and Technology Alliance (BRTA)（泰克纳利亚，巴斯克研究与技术联盟（BRTA））；Universidad Carlos III de Madrid（马德里卡洛斯三世大学）；Artificial Intelligence in Science Institute (AISI) at University of California Irvine（加州大学欧文分校科学人工智能研究所）；Instituto de Investigación Sanitaria Gregorio Marañón（格雷戈里奥·马拉尼翁健康研究所）；Jesús Usón Minimally Invasive Surgery Centre（赫苏斯·乌松微创手术中心）；University of the Basque Country（巴斯克大学）
Indira Gandhi National Open University（英迪拉·甘地国立开放大学）；Larkin Community Hospital Palm Springs Campus（拉金社区医院棕榈泉院区）；Long Island Jewish Valley Stream（长岛犹太谷溪医院）；Feinberg School of Medicine, Northwestern University（西北大学范伯格医学院）
Colorectal cancer (CRC) is one of the most common causes of cancer and cancer-related mortality worldwide. Performing colon cancer screening in a timely fashion is the key to early detection. Colonoscopy is the primary modality used to diagnose colon cancer. However, the miss rate of polyps, adenomas and advanced adenomas remains significantly high. Early detection of polyps at the precancerous stage can help reduce the mortality rate and the economic burden associated with colorectal cancer. Deep learning-based computer-aided diagnosis (CADx) system may help gastroenterologists to identify po…
University of Kansas（堪萨斯大学）；Ryerson University（瑞尔森大学）
Colonoscopy is a procedure to detect colorectal polyps which are the primary cause for developing colorectal cancer. However, polyp segmentation is a challenging task due to the diverse shape, size, color, and texture of polyps, shuttle difference between polyp and its background, as well as low contrast of the colonoscopic images. To address these challenges, we propose a feature enhancement network for accurate polyp segmentation in colonoscopy images. Specifically, the proposed network enhances the semantic information using the novel Semantic Feature Enhance Module (SFEM). Furthermore, ins…
Beijing University of Posts and Telecommunications（北京邮电大学）
The automatic and objective medical diagnostic model can be valuable to achieve early cancer detection, and thus reducing the mortality rate. In this paper, we propose a highly efficient multi-level malignant tissue detection through the designed adversarial CAC-UNet. A patch-level model with a pre-prediction strategy and a malignancy area guided label smoothing is adopted to remove the negative WSIs, with which to lower the risk of false positive detection. For the selected key patches by multi-model ensemble, an adversarial context-aware and appearance consistency UNet (CAC-UNet) is designed…
Research Institute for Signals, Systems and Computational Intelligence, sinc(i)（信号、系统与计算智能研究所）；CONICET（国家科学技术研究委员会）；Universidad Nacional del Litoral（国立滨海大学）
In this work we address the problem of landmark-based segmentation for anatomical structures. We propose HybridGNet, an encoder-decoder neural architecture which combines standard convolutions for image feature encoding, with graph convolutional neural networks to decode plausible representations of anatomical structures. We benchmark the proposed architecture considering other standard landmark and pixel-based models for anatomical segmentation in chest x-ray images, and found that HybridGNet is more robust to image occlusions. We also show that it can be used to construct landmark-based segm…
University of Cambridge（剑桥大学）；Cancer Research UK Cambridge Centre（英国癌症研究中心剑桥中心）
Background: Colonoscopy remains the gold-standard screening for colorectal cancer. However, significant miss rates for polyps have been reported, particularly when there are multiple small adenomas. This presents an opportunity to leverage computer-aided systems to support clinicians and reduce the number of polyps missed. Method: In this work we introduce the Focus U-Net, a novel dual attention-gated deep neural network, which combines efficient spatial and channel-based attention into a single Focus Gate module to encourage selective learning of polyp features. The Focus U-Net further incorp…
University of Oxford（牛津大学）；Oxford National Institute for Health Research Biomedical Research Centre（牛津国家健康研究所生物医学研究中心）；Arab Academy for Science and Technology（阿拉伯科学技术学院）；SimulaMet；UiT The Arctic University of Norway（挪威北极大学）；Middle East Technical University（中东技术大学）；City University of Hong Kong（香港城市大学）；Universitat Pompeu Fabra（庞培法布拉大学）
Polyps are well-known cancer precursors identified by colonoscopy. However, variability in their size, location, and surface largely affect identification, localisation, and characterisation. Moreover, colonoscopic surveillance and removal of polyps (referred to as polypectomy ) are highly operator-dependent procedures. There exist a high missed detection rate and incomplete removal of colonic polyps due to their variable nature, the difficulties to delineate the abnormality, the high recurrence rates, and the anatomical topography of the colon. There have been several developments in realisin…
Action segmentation as a milestone towards building automatic systems to understand untrimmed videos has received considerable attention in the recent years. It is typically being modeled as a sequence labeling problem but contains intrinsic and sufficient differences than text parsing or speech processing. In this paper, we introduce a novel hybrid temporal convolutional and recurrent network (TricorNet), which has an encoder-decoder architecture: the encoder consists of a hierarchy of temporal convolutional kernels that capture the local motion changes of different actions; the decoder is a …
Stony Brook University（石溪大学）；Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）
Automated analysis of optical colonoscopy (OC) video frames (to assist endoscopists during OC) is challenging due to variations in color, lighting, texture, and specular reflections. Previous methods either remove some of these variations via preprocessing (making pipelines cumbersome) or add diverse training data with annotations (but expensive and time-consuming). We present CLTS-GAN, a new deep learning model that gives fine control over color, lighting, texture, and specular reflection synthesis for OC video frames. We show that adding these colonoscopy-specific augmentations to the traini…
RIGS-Refiner: Risk-Guided Recursive Refinement in Prediction Space for Colonoscopy Polyp Segmentation
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；South China University of Technology（华南理工大学）；CyPhi( Ψ Φ \Psi\Phi ) AI Research Lab, School of IT, Monash University Malaysia（马来西亚莫纳什大学信息技术学院CyPhi( Ψ Φ \Psi\Phi )人工智能研究实验室）
SimulaMet；UiT The Arctic University of Norway（挪威北极大学）；University of Oxford（牛津大学）；Oxford NIHR Biomedical Research Centre（牛津NIHR生物医学研究中心）；Oslo Metropolitan University（奥斯陆城市大学）
Computer-aided detection, localisation, and segmentation methods can help improve colonoscopy procedures. Even though many methods have been built to tackle automatic detection and segmentation of polyps, benchmarking of state-of-the-art methods still remains an open problem. This is due to the increasing number of researched computer vision methods that can be applied to polyp datasets. Benchmarking of novel methods can provide a direction to the development of automated polyp detection and segmentation tasks. Furthermore, it ensures that the produced results in the community are reproducible…
Inception Institute of Artificial Intelligence（人工智能起源研究所）；Wuhan University（武汉大学）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）
Colonoscopy is an effective technique for detecting colorectal polyps, which are highly related to colorectal cancer. In clinical practice, segmenting polyps from colonoscopy images is of great importance since it provides valuable information for diagnosis and surgery. However, accurate polyp segmentation is a challenging task, for two major reasons: (i) the same type of polyps has a diversity of size, color and texture; and (ii) the boundary between a polyp and its surrounding mucosa is not sharp. To address these challenges, we propose a parallel reverse attention network (PraNet) for accur…
Validating polyp and instrument segmentation methods in colonoscopy through Medico 2020 and MedAI 2021 Challenges
Northwestern University（西北大学）；Jadavpur University（贾达普大学）；Technische Universität Hamburg（汉堡工业大学）；SimulaMet（西穆拉梅特研究所）；Julius-Maximilian University of Würzburg（维尔茨堡大学）；Australian National University（澳大利亚国立大学）；Gachon University（嘉泉大学）；University of Oxford（牛津大学）；University of Bergen（卑尔根大学）；University of Oslo（奥斯陆大学）；Swedish Medical Center（瑞典医疗中心）；National University of Computer and Emerging Sciences（国家计算机与新兴科学大学）；University of Science, VNU-HCM（胡志明市国家大学科学大学）
University College London（伦敦大学学院）；Scuola Superiore Sant’Anna（圣安娜高等研究院）；Universitat Autònoma de Barcelona（巴塞罗那自治大学）；Toshiba Corporate Research and Development Center（东芝企业研发中心）；The Royal Infirmary of Edinburgh（爱丁堡皇家医院）；University of Turin（都灵大学）
Early diagnosis is essential for the successful treatment of bowel cancers including colorectal cancer (CRC) and capsule endoscopic imaging with robotic actuation can be a valuable diagnostic tool when combined with automated image analysis. We present a deep learning rooted detection and segmentation framework for recognizing lesions in colonoscopy and capsule endoscopy images. We restructure established convolution architectures, such as VGG and ResNets, by converting them into fully-connected convolution networks (FCNs), fine-tune them and study their capabilities for polyp segmentation and…
ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Models
Shenzhen Research Institute of Big Data（深圳大数据研究院）；Shenzhen Health Development Research and Data Management Center（深圳市卫生健康发展研究和数据管理中心）；The Chinese University of Hong Kong（香港中文大学）；Sun Yat-sen University（中山大学）
SALI: Short-term Alignment and Long-term Interaction Network for Colonoscopy Video Polyp Segmentation
Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology（华中科技大学武汉光电国家研究中心）；School of Engineering and Science, Huazhong University of Science and Technology（华中科技大学工程科学学院）；Huazhong University of Science and Technology Tongji Medical College（华中科技大学同济医学院）
DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy
CyPhi AI Lab, Monash University, Malaysia Campus, Malaysia Department of Electronic \& Computer Engineering, Hong Kong University of Science \& Technology, Hong Kong, P.R. China Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, P.R. China Harbin Institute of Technology, Harbin, P.R. China
SegCol Challenge: Semantic Segmentation for Tools and Fold Edges in Colonoscopy data
UCL Hawkes Institute, University College London（伦敦大学学院霍克斯学院）；Department of Computer Science, University College London（伦敦大学学院计算机科学系）；Medtronic（美敦力）；Department of Computer Science, University Liverpool（利物浦大学计算机科学系）
Polyp segmentation within colonoscopy video frames using deep learning models has the potential to automate the workflow of clinicians. This could help improve the early detection rate and characterization of polyps which could progress to colorectal cancer. Recent state-of-the-art deep learning polyp segmentation models have combined the outputs of Fully Convolutional Network architectures and Transformer Network architectures which work in parallel. In this paper we propose modifications to the current state-of-the-art polyp segmentation model FCBFormer. The transformer architecture of the F…
Isfahan University of Technology（伊斯法罕理工大学）；University of Michigan（密歇根大学）
Colonoscopy video frames might be contaminated by bright spots with unsaturated values known as specular reflection. Detection and removal of such reflections could enhance the quality of colonoscopy images and facilitate diagnosis procedure. In this paper we propose a novel two-phase method for this purpose, consisting of detection and removal phases. In the detection phase, we employ both HSV and RGB color space information for segmentation of specular reflections. We first train a non-linear SVM for selecting a color space based on image statistical features extracted from each channel of t…
Xi’an Jiaotong-Liverpool University（西交利物浦大学）；University of Liverpool（利物浦大学）
Colonoscopy, currently the most efficient and recognized colon polyp detection technology, is necessary for early screening and prevention of colorectal cancer. However, due to the varying size and complex morphological features of colonic polyps as well as the indistinct boundary between polyps and mucosa, accurate segmentation of polyps is still challenging. Deep learning has become popular for accurate polyp segmentation tasks with excellent results. However, due to the structure of polyps image and the varying shapes of polyps, it easy for existing deep learning models to overfitting the c…
Colorectal cancer (CRC) is the second leading cause of cancer-related death worldwide. Excision of polyps during colonoscopy helps reduce mortality and morbidity for CRC. Powered by deep learning, computer-aided diagnosis (CAD) systems can detect regions in the colon overlooked by physicians during colonoscopy. Lacking high accuracy and real-time speed are the essential obstacles to be overcome for successful clinical integration of such systems. While literature is focused on improving accuracy, the speed parameter is often ignored. Toward this critical need, we intend to develop a novel real…
Instituto de Ingeniería Eléctrica, Universidad de la República（共和国大学电气工程研究所）；Duke University（杜克大学）
Computer tomographic colonography, combined with computer-aided detection, is a promising emerging technique for colonic polyp analysis. We present a complete pipeline for polyp detection, starting with a simple colon segmentation technique that enhances polyps, followed by an adaptive-scale candidate polyp delineation and classification based on new texture and geometric features that consider both the information in the candidate polyp location and its immediate surrounding area. The proposed system is tested with ground truth data, including flat and small polyps which are hard to detect ev…
Colonoscopy is widely recognised as the gold standard procedure for the early detection of colorectal cancer (CRC). Segmentation is valuable for two significant clinical applications, namely lesion detection and classification, providing means to improve accuracy and robustness. The manual segmentation of polyps in colonoscopy images is time-consuming. As a result, the use of deep learning (DL) for automation of polyp segmentation has become important. However, DL-based solutions can be vulnerable to overfitting and the resulting inability to generalise to images captured by different colonosc…
CCIS-Diff: A Generative Model with Stable Diffusion Prior for Controlled Colonoscopy Image Synthesis
School of Software Engineering, Xi'an Jiaotong University（西安交通大学软件工程学院）；Tsinghua Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)（广东省人工智能与数字经济实验室（深圳））
