SS-CTML: Self-Supervised Cross-Task Mutual Learning for CT Image Reconstruction
School of Biomedical Engineering, Guangzhou Medical University(广州医科大学生物医学工程学院);Sun Yat-sen Memorial Hospital, Sun Yat-sen University(中山大学孙逸仙纪念医院);School of Biomedical Engineering, Southern Medical University(南方医科大学生物医学工程学院);School of Life Science and Technology, Xi’an Jiaotong University(西安交通大学生命科学与技术学院);Fourth Affiliated Hospital, Guangzhou Medical University(广州医科大学附属第四医院)
Gaofeng Chen, Yaoduo Zhang, Li Huang, Pengfei Wang, Wenyu Zhang, Dong Zeng, Jianhua Ma, Ji He
Supervised deep-learning (SDL) techniques with paired training datasets have been widely studied for X-ray computed tomography (CT) image reconstruction. However, due to the difficulties of obtaining paired training datasets in clinical routine, the SDL methods are still away from common uses in clinical practices. In recent years, self-supervised deep-learning (SSDL) techniques have shown great potential for the studies of CT image reconstruction. In this work, we propose a self-supervised cross-task mutual learning (SS-CTML) framework for CT image reconstruction. Specifically, a sparse-view scanned and a limited-view scanned sinogram data are first extracted from a full-view scanned sinogram data, which results in three individual reconstruction tasks, i.e., the full-view CT (FVCT) reconstruction, the sparse-view CT (SVCT) reconstruction, and limited-view CT (LVCT) reconstruction. Then, three neural networks are constructed for the three reconstruction tasks. Considering that the ultimate goals of the three tasks are all to reconstruct high-quality CT images, we therefore construct a set of cross-task mutual learning objectives for the three tasks, in which way, the three neural networks can be self-supervised optimized by learning from each other. Clinical datasets are adopted to evaluate the effectiveness of the proposed framework. Experimental results demonstrate that the SS-CTML framework can obtain promising CT image reconstruction performance in terms of both quantitative and qualitative measurements.
Incremental Cross-view Mutual Distillation for Self-supervised Medical CT Synthesis
Xidian University(西安电子科技大学);Northwestern Polytechnical University(西北工业大学);Hefei Comprehensive National Science Center(合肥综合性国家科学中心);Nankai University(南开大学);City University of Hong Kong(香港城市大学)
CMD: Self-supervised 3D Action Representation Learning with Cross-modal Mutual Distillation
University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)
Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentation
Digital Medical Research Center, School of Basic Medical Science, Fudan University(复旦大学基础医学院数字医学研究中心);Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention(上海市医学影像计算与计算机辅助介入重点实验室)
Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning
College of Computer Science, Sichuan University(四川大学计算机学院);Sichuan University-Pittsburgh Institute(四川大学匹兹堡研究院);Department of Pathology West China Hospital, Sichuan University(四川大学华西医院病理科部门);Institute of Clinical Pathology, West China Hospital, Sichuan University(四川大学华西医院临床病理研究所)
I$^2$MD: 3D Action Representation Learning with Inter- and Intra-modal Mutual Distillation
University of Science and Technology of China(中国科学技术大学);The University of Adelaide(阿德莱德大学);Hefei Comprehensive National Science Center(合肥综合性国家科学中心);Shanghai Artificial Intelligent Laboratory(上海人工智能实验室)
Weakly-supervised Knowledge Graph Alignment with Adversarial Learning
Montréal Institute for Learning Algorithms (MILA)(蒙特利尔学习算法研究所(MILA));University of Montréal(蒙特利尔大学);HEC Montréal(蒙特利尔高等商学院);Canadian Institute for Advanced Research (CIFAR)(加拿大高等研究院(CIFAR))
Dual-Task Mutual Learning for Semi-Supervised Medical Image Segmentation
Beihang University(北京航空航天大学);Hefei Innovation Research Institute, Beihang University(北京航空航天大学合肥创新研究院);Beijing Advanced Innovation Centre for Biomedical Engineering(北京生物医学工程高精尖创新中心);Beijing Advanced Innovation Centre for Big Data-Based Precision Medicine(北京大数据精准医疗高精尖创新中心)
Uncertainty-Guided Mutual Consistency Learning for Semi-Supervised Medical Image Segmentation
Beihang University(北京航空航天大学);Hefei Innovation Research Institute, Beihang University(北京航空航天大学合肥创新研究院);Beijing Advanced Innovation Centre for Biomedical Engineering(北京生物医学工程高精尖创新中心)
S$^2$ME: Spatial-Spectral Mutual Teaching and Ensemble Learning for Scribble-supervised Polyp Segmentation
The Chinese University of Hong Kong(香港中文大学);National University of Singapore(新加坡国立大学);Hubei University of Technology(湖北工业大学);University College London(伦敦大学学院)
M$^3$HL: Mutual Mask Mix with High-Low Level Feature Consistency for Semi-Supervised Medical Image Segmentation
Shanghai Key Laboratory of Intelligent Sensing and Recognition(上海智能感知与识别重点实验室);Shanghai Jiao Tong University(上海交通大学);Department of Endocrinology and Metabolism, Renji Hospital, School of Medicine, Shanghai Jiao Tong University(内分泌与代谢科,仁济医院,医学院,上海交通大学);Center for Digital Innovation, Tongji University(同济大学数字创新中心)
Mutual Evidential Deep Learning for Medical Image Segmentation
Key Laboratory of High Confidence Software Technologies (MOE) School of Computer Science Peking University(高可信软件技术重点实验室(MOE)计算机科学学院,北京大学);College of Computer and Information Science School of Software Southwest University(计算机与信息科学学院 软件学院 西南大学);Department of Computer and Information Science University of Macau(计算机与信息科学系 澳门大学)