arXiv 2103.090852021-03eess.IVcs.LG

Exact Sparse Orthogonal Dictionary Learning

Kai Liu, Yongjian Zhao, Hua Wang

备注：: need more revisions

英文摘要：

Over the past decade, learning a dictionary from input images for sparse modeling has been one of the topics which receive most research attention in image processing and compressed sensing. Most existing dictionary learning methods consider an over-complete dictionary, such as the K-SVD method, which may result in high mutual incoherence and therefore has a negative impact in recognition. On the other side, the sparse codes are usually optimized by adding the $\ell_0$ or $\ell_1$-norm penalty, but with no strict sparsity guarantee. In this paper, we propose an orthogonal dictionary learning model which can obtain strictly sparse codes and orthogonal dictionary with global sequence convergence guarantee. We find that our method can result in better denoising results than over-complete dictionary based learning methods, and has the additional advantage of high computation efficiency.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Row-Sparse Discriminative Deep Dictionary Learning for Hyperspectral Image Classification

In recent studies in hyperspectral imaging, biometrics and energy analytics, the framework of deep dictionary learning has shown promise. Deep dictionary learning outperforms other traditional deep learning tools when training data is limited; therefore hyperspectral imaging is one such example that benefits from this framework. Most of the prior studies were based on the unsupervised formulation; and in all cases, the training algorithm was greedy and hence sub-optimal. This is the first work that shows how to learn the deep dictionary learning problem in a joint fashion. Moreover, we propose…

2019-12-11cs.LGeess.IV

Reconstruction of Compressively Sensed Images using Convex Tikhonov Sparse Dictionary Learning and Adaptive Spectral Filtering

Sparse representation using over-complete dictionaries have shown to produce good quality results in various image processing tasks. Dictionary learning algorithms have made it possible to engineer data adaptive dictionaries which have promising applications in image compression and image enhancement. The most common sparse dictionary learning algorithms use the techniques of matching pursuit and K-SVD iteratively for sparse coding and dictionary learning respectively. While this technique produces good results, it requires a large number of iterations to converge to an optimal solution. In th…

2019-11-07eess.IV

Sparse Subspace Clustering Friendly Deep Dictionary Learning for Hyperspectral Image Classification

Delhi Technical University（德里技术大学）；Indraprastha Institute of Information Technology Delhi（德里因陀罗普拉斯塔信息技术学院）

Subspace clustering techniques have shown promise in hyperspectral image segmentation. The fundamental assumption in subspace clustering is that the samples belonging to different clusters/segments lie in separable subspaces. What if this condition does not hold? We surmise that even if the condition does not hold in the original space, the data may be nonlinearly transformed to a space where it will be separable into subspaces. In this work, we propose a transformation based on the tenets of deep dictionary learning (DDL). In particular, we incorporate the sparse subspace clustering (SSC) los…

2021-11-27cs.CVcs.LGeess.IV

Sparse Coding on Cascaded Residuals

Australian National University（澳大利亚国立大学）；Data61/CSIRO（Data61/联邦科学与工业研究组织）

This paper seeks to combine dictionary learning and hierarchical image representation in a principled way. To make dictionary atoms capturing additional information from extended receptive fields and attain improved descriptive capacity, we present a two-pass multi-resolution cascade framework for dictionary learning and sparse coding. The cascade allows collaborative reconstructions at different resolutions using the same dimensional dictionary atoms. Our jointly learned dictionary comprises atoms that adapt to the information available at the coarsest layer where the support of atoms reaches…

2019-11-07cs.CVcs.LGeess.IV

Weighted Hierarchical Sparse Representation for Hyperspectral Target Detection

Northwestern Polytechnical University（西北工业大学）；School of Computer Science（计算机科学学院）；Center for OPTical IMagery Analysis and Learning (OPTIMAL)（光学影像分析与学习中心（OPTIMAL））

Hyperspectral target detection has been widely studied in the field of remote sensing. However, background dictionary building issue and the correlation analysis of target and background dictionary issue have not been well studied. To tackle these issues, a \emph{Weighted Hierarchical Sparse Representation} for hyperspectral target detection is proposed. The main contributions of this work are listed as follows. 1) Considering the insufficient representation of the traditional background dictionary building by dual concentric window structure, a hierarchical background dictionary is built cons…

2021-05-11cs.CVeess.IV

Convolutional Dictionary Regularizers for Tomographic Inversion

There has been a growing interest in the use of data-driven regularizers to solve inverse problems associated with computational imaging systems. The convolutional sparse representation model has recently gained attention, driven by the development of fast algorithms for solving the dictionary learning and sparse coding problems for sufficiently large images and data sets. Nevertheless, this model has seen very limited application to tomographic reconstruction problems. In this paper, we present a model-based tomographic reconstruction algorithm using a learnt convolutional dictionary as a reg…

2019-02-18eess.IV

更多相关论文收起更多论文

Convolutional Dictionary Learning: A Comparative Review and New Algorithms

Los Alamos National Laboratory（洛斯阿拉莫斯国家实验室）

Convolutional sparse representations are a form of sparse representation with a dictionary that has a structure that is equivalent to convolution with a set of linear filters. While effective algorithms have recently been developed for the convolutional sparse coding problem, the corresponding dictionary learning problem is substantially more challenging. Furthermore, although a number of different approaches have been proposed, the absence of thorough comparisons between them makes it difficult to determine which of them represents the current state of the art. The present work both addresses…

2018-09-05cs.LGeess.IVstat.ML

探索稀疏恢复对图像超分辨率质量的影响

Exploring the Effect of Sparse Recovery on the Quality of Image Superresolution

Fresno City College（弗雷斯诺城市学院）

本文研究稀疏恢复算法选择对基于耦合字典的图像超分辨率重建质量的影响，并通过实验寻找最佳稀疏恢复算法。

2023-08-04cs.CVcs.LGeess.IV

Efficient and Parallel Separable Dictionary Learning

University Politehnica Bucharest（布加勒斯特理工大学）；University of Bucharest（布加勒斯特大学）

Separable, or Kronecker product, dictionaries provide natural decompositions for 2D signals, such as images. In this paper, we describe a highly parallelizable algorithm that learns such dictionaries which reaches sparse representations competitive with the previous state of the art dictionary learning algorithms from the literature but at a lower computational cost. We highlight the performance of the proposed method to sparsely represent image and hyperspectral data, and for image denoising.

2021-12-01cs.LGcs.NAeess.IV

A reconstruction method for binary limited-data tomography using a dictionary-based sparse shape recovery

Binary tomography is concerned with reconstructing a binary image from a very small number or other limited CT projection data. This problem itself not only possesses several medical imaging applications but also can be considered a model of general inverse problems to recover the object shape from limited measured data. Several approaches such as the Mumford-Shah method and various level-set methods have been investigated, but most of them lead to a non-convex optimization due to the difficulty to handle the binary constraint. We propose a new method based on a convex optimization inspired by…

2022-08-14eess.IVeess.SP

基于深度学习的字典学习与层析图像重建

Deep learning based dictionary learning and tomographic image reconstruction

KTH Royal Institute of Technology（瑞典皇家理工学院）；Philips Research（飞利浦研究院）

本文提出一种结合稀疏信号处理与深度学习的临床低剂量层析图像重建方法，将字典学习解释为分布对齐过程并证明其类似变分自编码器，在CT重建中取得与先进方法相当的竞争力。

2021-08-26cs.CVcs.LGcs.NE

联合稀疏表示与耦合字典学习在多源异构图像伪彩色融合中的应用

Joint Sparse Representations and Coupled Dictionary Learning in Multi-Source Heterogeneous Image Pseudo-color Fusion

提出基于耦合字典学习与联合稀疏表示的SAR和多光谱图像伪彩色融合方法，通过Brovey预处理和字典学习构建掩膜，实验证明视觉与定量指标优越。

2023-10-15eess.IVeess.SP

通过组稀疏卷积字典学习实现用于图像去噪的快速且可解释的非局部神经网络

Fast and Interpretable Nonlocal Neural Networks for Image Denoising via Group-Sparse Convolutional Dictionary Learning

本文将 CDLNet 的 ℓ1 先验扩展为加权组稀疏先验，提出由稀疏数组算术实现的滑动窗口非局部注意力，在保持可解释性和竞争力去噪性能的同时，推理速度提升逾一个数量级。

2023-06-02eess.IVeess.SP