The success of many computer vision tasks lies in the ability to exploit the interdependency between different image modalities such as intensity and depth. Fusing corresponding information can be achieved on several levels, and one promising approach is the integration at a low level. Moreover, sparse signal models have successfully been used in many vision applications. Within this area of research, the so called co-sparse analysis model has attracted considerably less attention than its well-known counterpart, the sparse synthesis model, although it has been proven to be very useful in various image processing applications. In this paper, we propose a co-sparse analysis model that is able to capture the interdependency of two image modalities. It is based on the assumption that a pair of analysis operators exists, so that the co-supports of the corresponding bimodal image structures are correlated. We propose an algorithm that is able to learn such a coupled pair of operators from registered and noise-free training data. Furthermore, we explain how this model can be applied to solve linear inverse problems in image processing and how it can be used for image registration tasks. This paper extends the work of some of the authors by two major contributions. Firstly, a modification of the learning process is proposed that a priori guarantees unit norm and zero-mean of the rows of the operator. This accounts for the intuition that contrast in image modalities carries the most information. Secondly, the model is used in a novel bimodal image registration algorithm which estimates the transformation parameters of unregistered images of different modalities.
Sparse 3D Point-cloud Map Upsampling and Noise Removal as a vSLAM Post-processing Step: Experimental Evaluation
Peoples’ Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(RUDN大学));Federal Research Center ”Computer Science and Control” of Russian Academy of Sciences(俄罗斯科学院计算机科学与控制联邦研究中心);National Research University Higher School of Economics(国立研究型大学高等经济学院)
Efficient Neighbourhood Consensus Networks via Submanifold Sparse Convolutions
École Normale Supérieure(巴黎高等师范学院);CNRS(法国国家科学研究中心);PSL Research University(巴黎文理研究大学);Czech Technical University in Prague(捷克布拉格技术大学);Inria(法国国家信息与自动化研究所);DeepMind
Optimizing Sparse Convolution on GPUs with CUDA for 3D Point Cloud Processing in Embedded Systems
Brion Technologies, an ASML Company(Brion Technologies(ASML旗下公司));School of Mechanical Engineering and Automation, Northeastern University(东北大学机械工程与自动化学院)
该研究针对嵌入式系统中的 3D 点云处理,指出点云稀疏且无规则网格所带来的计算挑战,并聚焦于利用 CUDA 优化 GPU 上的稀疏卷积。
OG-PCL: Efficient Sparse Point Cloud Processing for Human Activity Recognition
Key Laboratory of Underwater Acoustic Signal Processing of Ministry of Education, Southeast University, Nanjing, 211189, China(教育部水下声学信号处理重点实验室,东南大学,南京)
A neuromorphic model of the insect visual system for natural image processing
School of Natural Sciences, Macquarie University(麦考瑞大学自然科学学院);QUT Centre for Robotics, Queensland University of Technology(昆士兰科技大学机器人中心);College of Medicine and Public Health, Flinders University(弗林德斯大学医学院与公共卫生学院)