Several machine learning tasks require to represent the data using only a sparse set of interest points. An ideal detector is able to find the corresponding interest points even if the data undergo a transformation typical for a given domain. Since the task is of high practical interest in computer vision, many hand-crafted solutions were proposed. In this paper, we ask a fundamental question: can we learn such detectors from scratch? Since it is often unclear what points are "interesting", human labelling cannot be used to find a truly unbiased solution. Therefore, the task requires an unsupervised formulation. We are the first to propose such a formulation: training a neural network to rank points in a transformation-invariant manner. Interest points are then extracted from the top/bottom quantiles of this ranking. We validate our approach on two tasks: standard RGB image interest point detection and challenging cross-modal interest point detection between RGB and depth images. We quantitatively show that our unsupervised method performs better or on-par with baselines.
School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);School of Information Science and Technology, ShanghaiTech University(上海交通大学信息科学与技术学院);School of Biomedical Engineering and the National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy (NERCAMRT), Shanghai Jiao Tong University(上海交通大学生物医学工程学院和先进磁共振诊断与治疗国家工程研究中心)
Low-Rank Velocity Fields as a Structural Prior for Unsupervised 4D Medical Image Interpolation
Southern University of Science and Technology(南方科技大学);Shenzhen University of Advanced Technology(深圳先进技术研究院);Shenzhen University Medical School(深圳大学医学院);Shenzhen University(深圳大学);Research Institute of Trustworthy Autonomous Systems(可信自主系统研究院)
Unsupervised Patch-GAN with Targeted Patch Ranking for Fine-Grained Novelty Detection in Medical Imaging
the Southern University of Science and Technology(南方科技大学);University of Oxford(牛津大学);Tsinghua University(清华大学);University of Warwick(华威大学);Northwest University(西北大学);Peng Cheng Lab(鹏城实验室)