In this paper, we discuss a different type of semi-supervised setting: a coarse level of labeling is available for all observations but the model has to learn a fine level of latent annotation for each one of them. Problems in this setting are likely to be encountered in many domains such as text categorization, protein function prediction, image classification as well as in exploratory scientific studies such as medical and genomics research. We consider this setting as simultaneously performed supervised classification (per the available coarse labels) and unsupervised clustering (within each one of the coarse labels) and propose a novel output layer modification called auto-clustering output layer (ACOL) that allows concurrent classification and clustering based on Graph-based Activity Regularization (GAR) technique. As the proposed output layer modification duplicates the softmax nodes at the output layer for each class, GAR allows for competitive learning between these duplicates on a traditional error-correction learning framework to ultimately enable a neural network to learn the latent annotations in this partially supervised setup. We demonstrate how the coarse label supervision impacts performance and helps propagate useful clustering information between sub-classes. Comparative tests on three of the most popular image datasets MNIST, SVHN and CIFAR-100 rigorously demonstrate the effectiveness and competitiveness of the proposed approach.
Semi-Automatic Data Annotation guided by Feature Space Projection
Institute of Computing, University of Campinas(坎皮纳斯大学计算研究所);Department of Information and Computing Sciences, Faculty of Science, Utrecht University(乌得勒支大学理学院信息与计算科学系)
Automatic brain tumor segmentation in 2D intra-operative ultrasound images using magnetic resonance imaging tumor annotations
Department of Health Research(健康研究系);SINTEF Digital(SINTEF数字);Department of Physics(物理系);Norwegian University of Science and Technology (NTNU)(挪威科学与技术大学(NTNU));Department of Circulation and Medical Imaging(循环与医学成像系);St. Olavs hospital(圣奥拉夫医院);Department of Neuromedicine and Movement Science(神经医学与运动科学系)
Annotation-efficient deep learning for automatic medical image segmentation
Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院保罗·C·劳特伯生物医学成像研究中心);Peng Cheng Laboratory(鹏城实验室);Pazhou Laboratory(琶洲实验室);Guangdong General Hospital, Guangdong Academy of Medical Sciences(广东省人民医院(广东省医学科学院));Renmin Hospital of Wuhan University(武汉大学人民医院);School of Electronic and Computer Engineering, Shenzhen Graduate School, Peking University(北京大学深圳研究生院电子与计算机工程学院);Brain Cognition and Brain Disease Institute, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院脑认知与脑疾病研究所);ETS Montreal(蒙特利尔高等技术学院)
Pick-and-Learn: Automatic Quality Evaluation for Noisy-Labeled Image Segmentation
Department of Electronic Engineering, Tsinghua University, Beijing, China(中国北京清华大学电子工程系);Institute for Precision Medicine, Tsinghua University, Beijing, China(中国北京清华大学精准医学研究院)
Binomial Checkpointing for Arbitrary Programs with No User Annotation
School of Electrical and Computer Engineering, Purdue University(普渡大学电气与计算机工程学院);Dept of Computer Science, National University of Ireland Maynooth(爱尔兰国立梅努斯大学计算机科学系)