Given a dataset, the task of learning a transform that allows sparse representations of the data bears the name of dictionary learning. In many applications, these learned dictionaries represent the data much better than the static well-known transforms (Fourier, Hadamard etc.). The main downside of learned transforms is that they lack structure and therefore they are not computationally efficient, unlike their classical counterparts. These posse several difficulties especially when using power limited hardware such as mobile devices, therefore discouraging the application of sparsity techniques in such scenarios. In this paper we construct orthogonal and non-orthogonal dictionaries that are factorized as a product of a few basic transformations. In the orthogonal case, we solve exactly the dictionary update problem for one basic transformation, which can be viewed as a generalized Givens rotation, and then propose to construct orthogonal dictionaries that are a product of these transformations, guaranteeing their fast manipulation. We also propose a method to construct fast square but non-orthogonal dictionaries that are factorized as a product of few transforms that can be viewed as a further generalization of Givens rotations to the non-orthogonal setting. We show how the proposed transforms can balance very well data representation performance and computational complexity. We also compare with classical fast and learned general and orthogonal transforms.
Research Center for Logic, Optimization and Security (LOS)(逻辑、优化与安全研究中心(LOS));Faculty of Mathematics and Computer Science, University of Bucharest(布加勒斯特大学数学与计算机科学学院)
Two-layer Residual Sparsifying Transform Learning for Image Reconstruction
University of Michigan - Shanghai Jiao Tong University Joint Institute, Shanghai Jiao Tong University(上海交通大学密西根学院);Michigan State University(密歇根州立大学);Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室)
Multi-layer Residual Sparsifying Transform (MARS) Model for Low-dose CT Image Reconstruction
University of Michigan - Shanghai Jiao Tong University Joint Institute, Shanghai Jiao Tong University(密歇根大学-上海交通大学联合学院,上海交通大学);Michigan State University(密歇根州立大学)
Department of Electrical Engineering and Computer Science, University of Michigan(密歇根大学电气工程与计算机科学系);Institute of Mathematical Science, Claremont Graduate University(克莱蒙特研究生大学数学科学研究所);Department of Mathematics, University of California Los Angeles(加利福尼亚大学洛杉矶分校数学系)
Sparse-View X-Ray CT Reconstruction Using $\ell_1$ Prior with Learned Transform
Shanghai Jiao Tong University(上海交通大学);University of Michigan - Shanghai Jiao Tong University Joint Institute(上海交通大学密西根学院);The University of Michigan(密歇根大学)