University of Electronic Science and Technology of China(电子科技大学);National Key Lab on Communication, University of Electronic Science and Technology of China(电子科技大学通信抗干扰技术国家级重点实验室);NVIDIA Semiconductor Technology (Shanghai) Co., Ltd.(英伟达半导体科技(上海)有限公司)
The Teacher-Student (T-S) framework is widely utilized in the classification tasks, through which the performance of one neural network (the student) can be improved by transferring knowledge from another trained neural network (the teacher). Since the transferring knowledge is related to the network capacities and structures between the teacher and the student, how to define efficient knowledge remains an open question. To address this issue, we design a novel transferring knowledge, the Self-Attention based Inter-Class Correlation (ICC) map in the output layer, and propose our T-S framework, Inter-Class Correlation Transfer (ICCT).
Adaptive Knowledge Transferring with Switching Dual-Student Framework for Semi-Supervised Medical Image Segmentation
North Carolina A&T State University(北卡罗来纳农工州立大学);Carnegie Mellon University(卡内基梅隆大学);Ho Chi Minh University of Technology(胡志明市理工大学);University of Pittsburgh(匹兹堡大学);University of Alabama at Birmingham(阿拉巴马大学伯明翰分校)
HUNTER: Unsupervised Human-centric 3D Detection via Transferring Knowledge from Synthetic Instances to Real Scenes
ShanghaiTech University(上海科技大学);University of Chinese Academy of Sciences(中国科学院大学);Innovation Academy for Microsatellites, Chinese Academy of Sciences(中国科学院微小卫星创新研究院);The University of Hong Kong(香港大学);The Chinese University of Hong Kong(香港中文大学)
Transferring Cross-domain Knowledge for Video Sign Language Recognition
The Australian National University(澳大利亚国立大学);Australian Centre for Robotic Vision (ACRV)(澳大利亚机器人视觉中心);University of Technology Sydney(悉尼科技大学);DATA61-CSIRO(澳大利亚联邦科学与工业研究组织数据61研究所)
TRKT: Weakly Supervised Dynamic Scene Graph Generation with Temporal-enhanced Relation-aware Knowledge Transferring
Wangxuan Institute of Computer Technology, Peking University(北京大学王轩计算机技术研究所);Tencent Inc.(腾讯公司);Baidu Inc.(百度公司);National Institute of Health Data Science, Peking University(北京大学健康数据科学国家研究院)