The implementation of automatic image registration is still difficult in various applications. In this paper, an automatic image registration approach through line-support region segmentation and geometrical outlier removal (ALRS-GOR) is proposed. This new approach is designed to address the problems associated with the registration of images with affine deformations and inconsistent content, such as remote sensing images with different spectral content or noise interference, or map images with inconsistent annotations. To begin with, line-support regions, namely a straight region whose points share roughly the same image gradient angle, are extracted to address the issues of inconsistent content existing in images. To alleviate the incompleteness of line segments, an iterative strategy with multi-resolution is employed to preserve global structures that are masked at full resolution by image details or noise. Then, Geometrical Outlier Removal (GOR) is developed to provide reliable feature point matching, which is based on affineinvariant geometrical classifications for corresponding matches initialized by SIFT. The candidate outliers are selected by comparing the disparity of accumulated classifications among all matches, instead of conventional methods which only rely on local geometrical relations. Various image sets have been considered in this paper for the evaluation of the proposed approach, including aerial images with simulated affine deformations, remote sensing optical and synthetic aperture radar images taken at different situations (multispectral, multisensor, and multitemporal), and map images with inconsistent annotations. Experimental results demonstrate the superior performance of the proposed method over the existing approaches for the whole data set.
Mutual information (MI) is a popular similarity measure for image registration, whereby good registration can be achieved by maximizing the compactness of the clusters in the joint histogram. However, MI is sensitive to the "outlier" objects that appear in one image but not the other, and also suffers from local and biased maxima. We propose a novel joint saliency map (JSM) to highlight the corresponding salient structures in the two images, and emphatically group those salient structures into the smoothed compact clusters in the weighted joint histogram. This strategy could solve both the out…
Reliable feature point matching is a vital yet challenging process in feature-based image registration. In this paper,a robust feature point matching algorithm called Recovery and Filtering Vertex Trichotomy Matching (RFVTM) is proposed to remove outliers and retain sufficient inliers for remote sensing images. A novel affine invariant descriptor called vertex trichotomy descriptor is proposed on the basis of that geometrical relations between any of vertices and lines are preserved after affine transformations, which is constructed by mapping each vertex into trichotomy sets. The outlier remo…
Shanghai Jiao Tong University（上海交通大学）；University College London（伦敦大学学院）；Shanghai Renji Hospital, School of Medicine, Shanghai Jiaotong University（上海交通大学医学院附属上海仁济医院）；University of the West of England（西英格兰大学）
For nonrigid image registration, matching the particular structures (or the outliers) that have missing correspondence and/or local large deformations, can be more difficult than matching the common structures with small deformations in the two images. Most existing works depend heavily on the outlier segmentation to remove the outlier effect in the registration. Moreover, these works do not handle simultaneously the missing correspondences and local large deformations. In this paper, we defined the nonrigid image registration as a local adaptive kernel regression which locally reconstruct the…
RetinaRegNet: A Zero-Shot Approach for Retinal Image Registration
University of Florida（佛罗里达大学）；Stanford University（斯坦福大学）；University of Iowa（爱荷华大学）；University of California, Santa Cruz（加州大学圣克鲁兹分校）；Intelligent Clinical Care Center, University of Florida（佛罗里达大学智能临床护理中心）
Australian Institute for Machine Learning（澳大利亚机器学习研究所）；University of Adelaide（阿德莱德大学）；South Australian Health and Medical Research Institute（南澳大利亚健康与医学研究所）
Many applications in image-guided surgery and therapy require fast and reliable non-linear, multi-modal image registration. Recently proposed unsupervised deep learning-based registration methods have demonstrated superior performance compared to iterative methods in just a fraction of the time. Most of the learning-based methods have focused on mono-modal image registration. The extension to multi-modal registration depends on the use of an appropriate similarity function, such as the mutual information (MI). We propose guiding the training of a deep learning-based registration method with MI…
Disentangling Progress in Medical Image Registration: Beyond Trend-Driven Architectures towards Domain-Specific Strategies
Technical University of Munich（慕尼黑技术大学）；Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）；Imperial College London（伦敦帝国理工学院）；University of Pennsylvania（宾夕法尼亚大学）；National University of Singapore（新加坡国立大学）
Robert Gordon University（罗伯特戈登大学）；Universitat Rovira i Virgili（罗维拉-威尔吉利大学）
Image registration is a research field in which images must be compared and aligned independently of the point of view or camera characteristics. In some applications (such as forensic biometrics, satellite photography or outdoor scene identification) classical image registration systems fail due to one of the images compared represents a tiny piece of the other image. For instance, in forensics palmprint recognition, it is usual to find only a small piece of the palmprint, but in the database, the whole palmprint has been enrolled. The main reason of the poor behaviour of classical image regi…
A Hybrid Deep Feature-Based Deformable Image Registration Method for Pathology Images
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；School of Mathematics, Sun Yat-sen University（中山大学数学学院）；Stanford University（斯坦福大学）；Guangdong Medical University（广东医科大学）；Xiaohe Healthcare ByteDance（字节跳动小河医疗）
National Aerospace University（国立航空航天大学）；University of Rennes 1（雷恩第一大学）
This paper focuses on potential accuracy of remote sensing images registration. We investigate how this accuracy can be estimated without ground truth available and used to improve registration quality of mono- and multi-modal pair of images. At the local scale of image fragments, the Cramer-Rao lower bound (CRLB) on registration error is estimated for each local correspondence between coarsely registered pair of images. This CRLB is defined by local image texture and noise properties. Opposite to the standard approach, where registration accuracy is only evaluated at the output of the registr…
Federal University of Santa Catarina（圣卡塔琳娜联邦大学）；University of Caxias do Sul（南卡希亚斯大学）
In this paper, a new video super-resolution reconstruction (SRR) method with improved robustness to outliers is proposed. Although the R-LMS is one of the SRR algorithms with the best reconstruction quality for its computational cost, and is naturally robust to registration inaccuracies, its performance is known to degrade severely in the presence of innovation outliers. By studying the proximal point cost function representation of the R-LMS iterative equation, a better understanding of its performance under different situations is attained. Using statistical properties of typical innovation …
Shanghai Jiao Tong University（上海交通大学）；University of the West of England（西英格兰大学）；University College London（伦敦大学学院）
Joint saliency map (JSM) [1] was developed to assign high joint saliency values to the corresponding saliency structures (called Joint Saliency Structures, JSSs) but zero or low joint saliency values to the outliers (or mismatches) that are introduced by missing correspondence or local large deformations between the reference and moving images to be registered. JSM guides the local structure matching in nonrigid registration by emphasizing these JSSs' sparse deformation vectors in adaptive kernel regression of hierarchical sparse deformation vectors for iterative dense deformation reconstructi…
Surrogate Supervision for Robust and Generalizable Deformable Image Registration
Department of Electrical and Computer Engineering, Vanderbilt University（维斯尼尔大学电气与计算机工程系）；Department of Radiology and Radiological Science, Johns Hopkins Medical School（约翰霍普金斯医学学校放射学与放射科学系）；Image Analysis and Communications Laboratory in the Department of Electrical and Computer Engineering, Johns Hopkins University（约翰霍普金斯大学电气与计算机工程系图像分析与通信实验室）；Center for Cognitive Medicine, Department of Psychiatry and Behavioral Science, Vanderbilt University Medical Center（维斯尼尔大学医学中心认知医学中心）；University of Pittsburgh, School of Medicine（匹兹堡大学医学院）
MORPH-LER: Log-Euclidean Regularization for Population-Aware Image Registration
Karlert School of Computing, University of Utah（犹他大学卡尔尔特计算学院）；Scientific Computing and Imaging Institute, University of Utah（犹他大学科学计算与成像研究所）；Biomedical Engineering Department, University of Utah（犹他大学生物医学工程系）
University College London（伦敦大学学院）；Inria（法国国家信息与自动化研究所）；Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）；Massachusetts Institute of Technology（麻省理工学院）
Joint registration of a stack of 2D histological sections to recover 3D structure (``3D histology reconstruction'') finds application in areas such as atlas building and validation of \emph{in vivo} imaging. Straightforward pairwise registration of neighbouring sections yields smooth reconstructions but has well-known problems such as ``banana effect'' (straightening of curved structures) and ``z-shift'' (drift). While these problems can be alleviated with an external, linearly aligned reference (e.g., Magnetic Resonance (MR) images), registration is often inaccurate due to contrast difference…
Pixel-based Global Motion Estimation (GME) has always struggled to simultaneously reject outliers, avoid local minima and run quickly. There are many robust cost functions that perform well in terms of rejecting outliers, but they can yield unstable results during long image sequences as a result of their inability to adjust to changes in image content. In this letter, we propose a parameterised student-t cost function that can interpolate between two cost functions that are amongst the most widely in image registration problems, the L2 norm and the Cauchy-Lorentzian function. We also propose …
