In this paper, we present offline-to-online knowledge distillation (OOKD) for video instance segmentation (VIS), which transfers a wealth of video knowledge from an offline model to an online model for consistent prediction. Unlike previous methods that having adopting either an online or offline model, our single online model takes advantage of both models by distilling offline knowledge. To transfer knowledge correctly, we propose query filtering and association (QFA), which filters irrelevant queries to exact instances. Our KD with QFA increases the robustness of feature matching by encoding object-centric features from a single frame supplemented by long-range global information. We also propose a simple data augmentation scheme for knowledge distillation in the VIS task that fairly transfers the knowledge of all classes into the online model. Extensive experiments show that our method significantly improves the performance in video instance segmentation, especially for challenging datasets including long, dynamic sequences. Our method also achieves state-of-the-art performance on YTVIS-21, YTVIS-22, and OVIS datasets, with mAP scores of 46.1%, 43.6%, and 31.1%, respectively.
Uncertainty-Aware Retinal Vessel Segmentation via Ensemble Distillation
University of Ibadan(伊巴迪安大学);African Institute for Mathematical Sciences(非洲数学科学研究所);University College London(伦敦大学学院);Hertie Institute for Brain Health(海德研究所)
Cross-Image Relational Knowledge Distillation for Semantic Segmentation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Horizon Robotics(地平线机器人);Wuhan University(武汉大学)
Multi-Dataset Cross-Domain Knowledge Distillation for Unified Medical Image Segmentation, Classification, and Detection
Faculty of Mathematics and Computer Science, University of Bucharest(布加勒斯特大学数学与计算机科学学院);Gheorghe Mihoc-Caius Iacob Institute of Mathematical Statistics and Applied Mathematics of the Romanian Academy(罗马尼亚科学院格奥尔基·米霍茨-凯奥斯·伊阿科夫学院数学统计与应用数学研究所)
Displacement Preserving Relational Distillation for Robust Medical Segmentation
Bowling Green State University(鲍灵格林州立大学);The University of Findlay(芬德利大学);University of Alabama at Birmingham(阿拉巴马大学伯明翰分校);University of Toronto(多伦多大学);University of Houston - Clear Lake(休斯顿大学清水湖分校);UTHealth Houston(德克萨斯大学健康科学中心休斯顿分校)
ReCo-KD: Region- and Context-Aware Knowledge Distillation for Efficient 3D Medical Image Segmentation
McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston (UTHealth Houston)(麦威廉生物医学信息学学院,德克萨斯大学健康科学中心休斯顿分校(UTHealth休斯顿))
School of Computer Science, Wuhan University(武汉大学计算机学院);School of Computer Science, The University of Sydney(悉尼大学计算机学院);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院)
Generalizable Knowledge Distillation from Vision Foundation Models for Semantic Segmentation
School of Artificial Intelligence, Xidian University, China(西安电子科技大学人工智能学院);Department of Information Engineering and Computer Science, University of Trento, Italy(特伦托大学信息工程与计算机科学系);Department of Automation, Tsinghua University, China(清华大学自动化系);School of Computer Science and Information Engineering, Hefei University of Technology, China(合肥工业大学计算机科学与信息工程学院)
Weighted Knowledge Distillation for Semi-Supervised Segmentation of Maxillary Sinus in Panoramic X-ray Images
Division of Electronics and Information Engineering, College of Engineering, Jeonbuk National University(全罗国立大学电子与信息工程系);Manufacturing AI Research Center, Korea Institute of Industrial Technology (KITECH)(韩国工业技术研究院制造人工智能研究中心);KITECH School, University of Science and Technology, Cheonan(科技大学校KITECH学院);The Graduate School of Advanced Imaging Science, Multimedia & Film, Chung-Ang University(Chung-Ang大学高级影像科学研究生院,多媒体与电影);Department of Oral and Maxillofacial Radiology and Wonkwang Dental Research Institute, College of Dentistry, Wonkwang University(Wonkwang大学口腔颌面放射科及Wonkwang牙科研究所)
Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation
Shanghai Jiao Tong University School of Medicine(上海交通大学医学院);Shanghai University(上海大学);Sun Yat-sen University(中山大学);The Hong Kong University of Science and Technology(香港科技大学);East China Normal University(华东师范大学);Shanghai Jiao Tong University(上海交通大学)
Shape-intensity knowledge distillation for robust medical image segmentation
National Engineering Research Center for Multimedia Software(国家多媒体软件工程技术研究中心);School of Computer Science, Wuhan University(武汉大学计算机学院);Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University(武汉大学多媒体与网络通信工程湖北省重点实验室);Medical Artificial Intelligence Research Institute of Renmin Hospital, Wuhan University(武汉大学人民医院医学人工智能研究院)
Henan University of Chinese Medicine(河南中医药大学);Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
CCSD: Cross-Modal Compositional Self-Distillation for Robust Brain Tumor Segmentation with Missing Modalities
Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University(上海智能自主系统研究院,同济大学);College of Biomedical Engineering, Fudan University(生物医学工程学院,复旦大学);School of Medicine, Tongji University(医学院,同济大学);College of Information Engineering, China Jiliang University(信息工程学院,中国嘉兴大学)
CoCo DistillNet: a Cross-layer Correlation Distillation Network for Pathological Gastric Cancer Segmentation
Beijing University of Posts and Telecommunications(北京邮电大学);Center for Research on Intelligent Perception and Computing, NLPR, CASIA(中国科学院自动化研究所模式识别国家重点实验室);Shandong University of Science and Technology(山东科技大学);Artificial Intelligence Research, CAS (CAS-AIR)(中国科学院人工智能研究院)
A Knowledge Distillation framework for Multi-Organ Segmentation of Medaka Fish in Tomographic Image
RPTU Kaiserslautern-Landau(莱茵兰-普法尔茨州凯泽斯劳滕-兰道应用技术大学);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);Heidelberg University(海德堡大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI))