The computation of the geometric transformation between a reference and a target image, known as registration or alignment, corresponds to the projection of the target image onto the transformation manifold of the reference image (the set of images generated by its geometric transformations). It, however, often takes a nontrivial form such that the exact computation of projections on the manifold is difficult. The tangent distance method is an effective algorithm to solve this problem by exploiting a linear approximation of the manifold. As theoretical studies about the tangent distance algorithm have been largely overlooked, we present in this work a detailed performance analysis of this useful algorithm, which can eventually help its implementation. We consider a popular image registration setting using a multiscale pyramid of lowpass filtered versions of the (possibly noisy) reference and target images, which is particularly useful for recovering large transformations. We first show that the alignment error has a nonmonotonic variation with the filter size, due to the opposing effects of filtering on both manifold nonlinearity and image noise. We then study the convergence of the multiscale tangent distance method to the optimal solution. We finally examine the performance of the tangent distance method in image classification applications. Our theoretical findings are confirmed by experiments on image transformation models involving translations, rotations and scalings. Our study is the first detailed study of the tangent distance algorithm that leads to a better understanding of its efficacy and to the proper selection of its design parameters.
A DeepONet joint Neural Tangent Kernel Hybrid Framework for Physics-Informed Inverse Source Problems and Robust Image Reconstruction
Shenzhen MSU-BIT University(深圳MSU-BIT大学);China Media Group(中国传媒集团);School of Mathematics and Statistics, Beijing Institute of Technology(北京理工大学数学与统计学院)
K-Tangent Spaces on Riemannian Manifolds for Improved Pedestrian Detection
NICTA, PO Box 6020, St Lucia, QLD 4067, Australia(澳大利亚国家信息与通信技术研究院,地址:澳大利亚昆士兰州圣卢西亚,邮编 4067,邮政信箱 6020);University of Queensland, School of ITEE, QLD 4072, Australia(澳大利亚昆士兰大学信息技术与电气工程学院,地址:澳大利亚昆士兰州,邮编 4072)
Geodesics with Unified Tangent-constrained Priors and Curvature Regularization
Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences)(山东省人工智能研究院,齐鲁工业大学(山东省科学院));Yuanshen Rehabilitation Institute, Shanghai Jiao Tong University School of Medicine(元身康复研究院,上海交通大学医学院);School of Control Science and Engineering, Shandong University(控制科学与工程学院,山东大学);Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University, Shandong Academy of Medical Sciences(放疗科,山东省肿瘤医院及研究院,山东第一医科大学,山东省医学科学院);CEREMADE, Université Paris Dauphine, Université-PSL, CNRS, UMR 7534(CEREMADE,巴黎大学Dauphine,Université-PSL,CNRS,UMR 7534)
Deep Learning for Breast Cancer Classification: Enhanced Tangent Function
Charles Sturt University(查尔斯特大学);University of Western Sydney(西悉尼大学);Kent Institute Australia(肯特学院);Asia Pacific International College(亚太国际学院);Australian Institute of Higher Education(澳大利亚高等教育学院);Al Iraqia University(伊拉克大学);University of Kurdistan Hewler(库尔德斯坦赫勒大学);AL Nisour University College(阿尔尼苏尔大学学院)