Few-Shot Anomaly Detection via Category-Agnostic Registration Learning
College of Information Communications, National University of Defense Technology（国防科技大学信息通信学院）；Cooperative Medianet Innovation Center, Shanghai Jiao Tong University（上海交通大学协同媒体网络创新中心）；National University of Singapore（新加坡国立大学）；King’s College London（伦敦国王学院）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）
Chaoqin Huang, Haoyan Guan, Aofan Jiang, Ya Zhang, Michael Spratling, Xinchao Wang, Yanfeng Wang
Most existing anomaly detection (AD) methods require a dedicated model for each category. Such a paradigm, despite its promising results, is computationally expensive and inefficient, thereby failing to meet the requirements for realworld applications. Inspired by how humans detect anomalies, by comparing a query image to known normal ones, this article proposes a novel few-shot AD (FSAD) framework. Using a training set of normal images from various categories, registration, aiming to align normal images of the same categories, is leveraged as the proxy task for self-supervised category-agnostic representation learning. At test time, an image and its corresponding support set, consisting of a few normal images from the same category, are supplied, and anomalies are identified by comparing the registered features of the test image to its corresponding support image features. Such a setup enables the model to generalize to novel test categories. It is, to our best knowledge, the first FSAD method that requires no model fine-tuning for novel categories: enabling a single model to be applied to all categories. Extensive experiments demonstrate the effectiveness of the proposed method. Particularly, it improves the current state-of-the-art (SOTA) for FSAD by 11.3% and 8.3% on the MVTec and MPDD benchmarks, respectively. The source code is available at https://github.com/Haoyan-Guan/CAReg.
Shanghai Jiao Tong University（上海交通大学）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）；National University of Singapore（新加坡国立大学）；King’s College London（伦敦国王学院）
This paper considers few-shot anomaly detection (FSAD), a practical yet under-studied setting for anomaly detection (AD), where only a limited number of normal images are provided for each category at training. So far, existing FSAD studies follow the one-model-per-category learning paradigm used for standard AD, and the inter-category commonality has not been explored. Inspired by how humans detect anomalies, i.e., comparing an image in question to normal images, we here leverage registration, an image alignment task that is inherently generalizable across categories, as the proxy task, to tr…
Absolute-Unified Multi-Class Anomaly Detection via Class-Agnostic Distribution Alignment
School of Information & Electronics, Beijing Institute of Technology（北京理工大学信息与电子学院）；School of Medical Technology, Beijing Institute of Technology（北京理工大学医学技术学院）
GCR: Geometry-Consistent Routing for Task-Agnostic Continual Anomaly Detection
Tsinghua University Shenzhen International Graduate School（清华大学深圳国际研究生院）；Ratel Soft；Affiliated Fifth Hospital, Wenzhou Medical University（温州医学院附属第五医院）；Chinese Medicine Guangdong Laboratory（广东中医药实验室）
ResAD++: Towards Class Agnostic Anomaly Detection via Residual Feature Learning
School of Information Science and Electronic Engineering, Shanghai Jiao Tong University（上海交通大学信息科学与电子工程学院）；School of Information Science and Technology, Beijing Forestry University（北京林业大学信息科学与技术学院）
Unsupervised training of keypoint-agnostic descriptors for flexible retinal image registration
Grupo VARPA, Instituto de Investigacion Biomédica de A Coruña (INIBIC), Universidade da Coruña（VARPA组，阿维拉生物医学研究所（INIBIC），科鲁纳大学）；Departamento de Ciencias de la Computación y Tecnologías de la Información, Universidade da Coruña（计算机科学与信息技术部门，科鲁纳大学）
TokenCLIP: Token-wise Prompt Learning for Zero-shot Anomaly Detection
Zhejiang University（浙江大学）；Tencent YouTu Lab（腾讯YouTu实验室）；Singapore Management University（新加坡管理学院）；Qilu University of Technology (Shandong Academy of Sciences)（青岛科技大学（山东科学院））
Detecting anomalies in musculoskeletal radiographs is of paramount importance for large-scale screening in the radiology workflow. Supervised deep networks take for granted a large number of annotations by radiologists, which is often prohibitively very time-consuming to acquire. Moreover, supervised systems are tailored to closed set scenarios, e.g., trained models suffer from overfitting to previously seen rare anomalies at training. Instead, our approach's rationale is to use task agnostic pretext tasks to leverage unlabeled data based on a cross-sample similarity measure. Besides, we formu…
Modality-Agnostic Structural Image Representation Learning for Deformable Multi-Modality Medical Image Registration
DAMO Academy, Alibaba Group（阿里巴巴达摩院）；Hupan Lab（湖畔实验室）；College of Computer Science and Technology, Zhejiang University, China（浙江大学计算机科学与技术学院）；Shengjing Hospital of China Medical University, China（中国医科大学附属盛京医院）
Learning Event Completeness for Weakly Supervised Video Anomaly Detection
School of Computer Science；Technology, Tongji University, Shanghai, China.；Department of R\&D Data, Microsoft Asia-Pacific Technology CO Ltd, Shanghai, China.
Detecting anomalies is one fundamental aspect of a safety-critical software system, however, it remains a long-standing problem. Numerous branches of works have been proposed to alleviate the complication and have demonstrated their efficiencies. In particular, self-supervised learning based methods are spurring interest due to their capability of learning diverse representations without additional labels. Among self-supervised learning tactics, contrastive learning is one specific framework validating their superiority in various fields, including anomaly detection. However, the primary objec…
Uncertainty Estimation for Pretrained Medical Image Registration Models via Transformation Equivariance
Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）；The Hawkes Institute, University College London（霍克斯研究所，伦敦大学学院）；AI Laboratory, Massachusetts Institute of Technology（人工智能实验室，麻省理工学院）
Anatomy-aware and acquisition-agnostic joint registration with SynthMorph
Athinoula A. Martinos Center for Biomedical Imaging（阿西努拉·A·马蒂诺斯生物医学成像中心）；Department of Radiology, Massachusetts General Hospital（麻省总医院放射科）；Department of Radiology, Harvard Medical School（哈佛医学院放射科）；Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology（麻省理工学院计算机科学与人工智能实验室）
IMPACT: A Generic Semantic Loss for Multimodal Medical Image Registration
Univ. Rennes, CLCC Eugene Marquis, INSERM, LTSI - UMR 1099（里昂大学、CLCC Eugene Marquis、INSERM、LTSI - UMR 1099）；CSIRO Australian e-Health Research Centre（澳大利亚e-Health研究中心）；CHU Rennes, Department of Cardio-Thoracic and Vascular Surgery（里昂大学医院、心胸和血管外科部门）
Wellcome Centre for Human Neuroimaging, UCL（伦敦大学学院惠康人类神经影像中心）；UCL Institute of Neurology（伦敦大学学院神经病学研究所）
We describe a diffeomorphic registration algorithm that allows groups of images to be accurately aligned to a common space, which we intend to incorporate into the SPM software. The idea is to perform inference in a probabilistic graphical model that accounts for variability in both shape and appearance. The resulting framework is general and entirely unsupervised. The model is evaluated at inter-subject registration of 3D human brain scans. Here, the main modeling assumption is that individual anatomies can be generated by deforming a latent 'average' brain. The method is agnostic to imaging …
Surrogate Supervision for Robust and Generalizable Deformable Image Registration
Department of Electrical and Computer Engineering, Vanderbilt University（维斯尼尔大学电气与计算机工程系）；Department of Radiology and Radiological Science, Johns Hopkins Medical School（约翰霍普金斯医学学校放射学与放射科学系）；Image Analysis and Communications Laboratory in the Department of Electrical and Computer Engineering, Johns Hopkins University（约翰霍普金斯大学电气与计算机工程系图像分析与通信实验室）；Center for Cognitive Medicine, Department of Psychiatry and Behavioral Science, Vanderbilt University Medical Center（维斯尼尔大学医学中心认知医学中心）；University of Pittsburgh, School of Medicine（匹兹堡大学医学院）
Uppsala University（乌普萨拉大学）；Elekta Instrument AB（医科达仪器有限公司）
Our anatomy is in constant motion. With modern MR imaging it is possible to record this motion in real-time during an ongoing radiation therapy session. In this paper we present an image registration method that exploits the sequential nature of 2D MR images to estimate the corresponding displacement field. The method employs several discriminative correlation filters that independently track specific points. Together with a sparse-to-dense interpolation scheme we can then estimate of the displacement field. The discriminative correlation filters are trained online, and our method is modality …
