Recent temporal action segmentation approaches need frame annotations during training to be effective. These annotations are very expensive and time-consuming to obtain. This limits their performances when only limited annotated data is available. In contrast, we can easily collect a large corpus of in-domain unannotated videos by scavenging through the internet. Thus, this paper proposes an approach for the temporal action segmentation task that can simultaneously leverage knowledge from annotated and unannotated video sequences. Our approach uses multi-stream distillation that repeatedly refines and finally combines their frame predictions. Our model also predicts the action order, which is later used as a temporal constraint while estimating frames labels to counter the lack of supervision for unannotated videos. In the end, our evaluation of the proposed approach on two different datasets demonstrates its capability to achieve comparable performance to the full supervision despite limited annotation.
Learnable Prompting SAM-induced Knowledge Distillation for Semi-supervised Medical Image Segmentation
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);Institute of High-Performance Computing, Agency for Science, Technology and Research(新加坡科技研究局高性能计算研究所);School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院)
Deep Semi-supervised Knowledge Distillation for Overlapping Cervical Cell Instance Segmentation
The Chinese University of Hong Kong(香港中文大学);Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院广东省计算机视觉与虚拟现实技术重点实验室)
TAMISeg: Text-Aligned Multi-scale Medical Image Segmentation with Semantic Encoder Distillation
Department of Data Science and AI, Monash University(蒙纳士大学数据科学与人工智能系);College of Computer Science, Chongqing University(重庆大学计算机学院);Chongqing University Central Hospital, School of Medicine(重庆大学附属中心医院医学院)
Weighted Knowledge Distillation for Semi-Supervised Segmentation of Maxillary Sinus in Panoramic X-ray Images
Division of Electronics and Information Engineering, College of Engineering, Jeonbuk National University(全罗国立大学电子与信息工程系);Manufacturing AI Research Center, Korea Institute of Industrial Technology (KITECH)(韩国工业技术研究院制造人工智能研究中心);KITECH School, University of Science and Technology, Cheonan(科技大学校KITECH学院);The Graduate School of Advanced Imaging Science, Multimedia & Film, Chung-Ang University(Chung-Ang大学高级影像科学研究生院,多媒体与电影);Department of Oral and Maxillofacial Radiology and Wonkwang Dental Research Institute, College of Dentistry, Wonkwang University(Wonkwang大学口腔颌面放射科及Wonkwang牙科研究所)
Self Correspondence Distillation for End-to-End Weakly-Supervised Semantic Segmentation
NLPR, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所模式识别国家重点实验室);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Task-Specific Knowledge Distillation from the Vision Foundation Model for Enhanced Medical Image Segmentation
Shanghai Jiao Tong University School of Medicine(上海交通大学医学院);Shanghai University(上海大学);Sun Yat-sen University(中山大学);The Hong Kong University of Science and Technology(香港科技大学);East China Normal University(华东师范大学);Shanghai Jiao Tong University(上海交通大学)
PA-Seg: Learning from Point Annotations for 3D Medical Image Segmentation using Contextual Regularization and Cross Knowledge Distillation
University of Electronic Science and Technology of China(电子科技大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);West China Hospital, Sichuan University(四川大学华西医院)
Triple-View Knowledge Distillation for Semi-Supervised Semantic Segmentation
School of Computer Science and Technology, Hangzhou Dianzi University(杭州电子科技大学计算机科学与技术学院);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东人工智能与数字经济实验室);School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);PengCheng Laboratory(鹏城实验室);College of Computer Science, Zhejiang University(浙江大学计算机学院)
RS-MTDF: Multi-Teacher Distillation and Fusion for Remote Sensing Semi-Supervised Semantic Segmentation
School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院);School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件工程学院);Ministry of Education Key Lab of Intelligent Network Security, Xi’an Jiaotong University(西安交通大学教育部长江网络安全重点实验室);School of Mathematics and Statistics, Xi’an Jiaotong University(西安交通大学数学与统计学学院);Pazhou Laboratory (Huangpu)(黄埔实验室)
Feasibility of Indoor Frame-Wise Lidar Semantic Segmentation via Distillation from Visual Foundation Model
1 Department of Earth Observation Science, Faculty of Geo-Information Science;Earth Observation (ITC), University of Twente, 7522 NB Enschede, The Netherlands
HDC: Hierarchical Distillation for Multi-level Noisy Consistency in Semi-Supervised Fetal Ultrasound Segmentation
University of Information Technology(信息科技大学);Ho Chi Minh University of Technology(胡志明市技术大学);University of Science(科学大学);Vietnam National University(越南国家大学);Boston University(波士顿大学);Taipei Medical University(台北医学大学);Posts and Telecommunications Institute of Technology(邮电技术学院);New Mexico State University(新墨西哥州立大学)
Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillation
The Chinese University of Hong Kong(香港中文大学);Department of Computer Science and Engineering, The Chinese University of Hong Kong(香港中文大学计算机科学与工程学系);Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology(广东省计算机视觉与虚拟现实技术重点实验室);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)