arXiv 2203.021662022-03-04eess.IVcs.CVeess.SP

Convolutional Analysis Operator Learning by End-To-End Training of Iterative Neural Networks

Physikalisch-Technische Bundesanstalt（德国联邦物理技术研究院）；Charité - Universitätsmedizin Berlin（柏林夏里特医学院）；King’s College London（伦敦国王学院）；Technical University of Berlin（柏林工业大学）；University of Innsbruck（因斯布鲁克大学）

Andreas Kofler, Christian Wald, Tobias Schaeffter, Markus Haltmeier, Christoph Kolbitsch

备注：: Accepted at ISBI 2022

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

The concept of sparsity has been extensively applied for regularization in image reconstruction. Typically, sparsifying transforms are either pre-trained on ground-truth images or adaptively trained during the reconstruction. Thereby, learning algorithms are designed to minimize some target function which encodes the desired properties of the transform. However, this procedure ignores the subsequently employed reconstruction algorithm as well as the physical model which is responsible for the image formation process. Iterative neural networks - which contain the physical model - can overcome these issues. In this work, we demonstrate how convolutional sparsifying filters can be efficiently learned by end-to-end training of iterative neural networks. We evaluated our approach on a non-Cartesian 2D cardiac cine MRI example and show that the obtained filters are better suitable for the corresponding reconstruction algorithm than the ones obtained by decoupled pre-training.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Deep Iterative Residual Convolutional Network for Single Image Super-Resolution

University of Udine（乌迪内大学）

Deep convolutional neural networks (CNNs) have recently achieved great success for single image super-resolution (SISR) task due to their powerful feature representation capabilities. The most recent deep learning based SISR methods focus on designing deeper / wider models to learn the non-linear mapping between low-resolution (LR) inputs and high-resolution (HR) outputs. These existing SR methods do not take into account the image observation (physical) model and thus require a large number of network's trainable parameters with a great volume of training data. To address these issues, we pro…

2020-09-07cs.CVeess.IV

RBSRICNN: Raw Burst Super-Resolution through Iterative Convolutional Neural Network

University of Udine（乌迪内大学）

Modern digital cameras and smartphones mostly rely on image signal processing (ISP) pipelines to produce realistic colored RGB images. However, compared to DSLR cameras, low-quality images are usually obtained in many portable mobile devices with compact camera sensors due to their physical limitations. The low-quality images have multiple degradations i.e., sub-pixel shift due to camera motion, mosaick patterns due to camera color filter array, low-resolution due to smaller camera sensors, and the rest information are corrupted by the noise. Such degradations limit the performance of current …

2021-11-10cs.CVcs.LGeess.IV

Convolutional Dictionary Learning by End-To-End Training of Iterative Neural Networks

Physikalisch-Technische Bundesanstalt（德国联邦物理技术研究院）；Charité - Universitätsmedizin Berlin（柏林夏里特医学院）；University of Innsbruck（因斯布鲁克大学）

Sparsity-based methods have a long history in the field of signal processing and have been successfully applied to various image reconstruction problems. The involved sparsifying transformations or dictionaries are typically either pre-trained using a model which reflects the assumed properties of the signals or adaptively learned during the reconstruction - yielding so-called blind Compressed Sensing approaches. However, by doing so, the transforms are never explicitly trained in conjunction with the physical model which generates the signals. In addition, properly choosing the involved regul…

2022-06-09cs.LGeess.IVeess.SP

A Convolutional Forward and Back-Projection Model for Fan-Beam Geometry

University of Florida（佛罗里达大学）

Iterative methods for tomographic image reconstruction have great potential for enabling high quality imaging from low-dose projection data. The computational burden of iterative reconstruction algorithms, however, has been an impediment in their adoption in practical CT reconstruction problems. We present an approach for highly efficient and accurate computation of forward model for image reconstruction in fan-beam geometry in X-ray CT. The efficiency of computations makes this approach suitable for large-scale optimization algorithms with on-the-fly, memory-less, computations of the forward …

2019-07-24cs.CVcs.DCeess.IV

STPDnet: Spatial-temporal convolutional primal dual network for dynamic PET image reconstruction

Zhejiang University（浙江大学）；University of Florida（佛罗里达大学）

Dynamic positron emission tomography (dPET) image reconstruction is extremely challenging due to the limited counts received in individual frame. In this paper, we propose a spatial-temporal convolutional primal dual network (STPDnet) for dynamic PET image reconstruction. Both spatial and temporal correlations are encoded by 3D convolution operators. The physical projection of PET is embedded in the iterative learning process of the network, which provides the physical constraints and enhances interpretability. The experiments of real rat scan data have shown that the proposed method can achie…

2023-03-08cs.CVeess.IV

CRNet: Image Super-Resolution Using A Convolutional Sparse Coding Inspired Network

Wuhan University（武汉大学）

Convolutional Sparse Coding (CSC) has been attracting more and more attention in recent years, for making full use of image global correlation to improve performance on various computer vision applications. However, very few studies focus on solving CSC based image Super-Resolution (SR) problem. As a consequence, there is no significant progress in this area over a period of time. In this paper, we exploit the natural connection between CSC and Convolutional Neural Networks (CNN) to address CSC based image SR. Specifically, Convolutional Iterative Soft Thresholding Algorithm (CISTA) is introdu…

2019-08-03cs.CVeess.IV

更多相关论文收起更多论文

Deep Convolutional Sparse Coding Networks for Image Fusion

Xi’an Jiaotong University（西安交通大学）

Image fusion is a significant problem in many fields including digital photography, computational imaging and remote sensing, to name but a few. Recently, deep learning has emerged as an important tool for image fusion. This paper presents three deep convolutional sparse coding (CSC) networks for three kinds of image fusion tasks (i.e., infrared and visible image fusion, multi-exposure image fusion, and multi-modal image fusion). The CSC model and the iterative shrinkage and thresholding algorithm are generalized into dictionary convolution units. As a result, all hyper-parameters are learned …

2020-05-18cs.CVcs.MMeess.IV

学习迭代网络：一个算子学习的视角

Learned iterative networks: An operator learning perspective

Research Unit of Mathematical Sciences, University of Oulu（奥卢大学数学科学研究所）；Department of Computer Science, University College London（伦敦大学学院计算机科学系）；Department of Mathematics, KTH - Royal Institute of Technology（瑞典皇家理工学院数学系）

本文从算子学习角度统一了学习迭代网络，探讨了其计算方式与学习问题，分析了线性和非线性逆问题，并通过数值实验总结了核心方法。

2026-06-28cs.LGcs.NAeess.IV

Multi-Channel Convolutional Analysis Operator Learning for Dual-Energy CT Reconstruction

University of Dundee（邓迪大学）；University Hospital Poitiers（普瓦捷大学医院）

Objective. Dual-energy computed tomography (DECT) has the potential to improve contrast, reduce artifacts and the ability to perform material decomposition in advanced imaging applications. The increased number or measurements results with a higher radiation dose and it is therefore essential to reduce either number of projections per energy or the source X-ray intensity, but this makes tomographic reconstruction more ill-posed. Approach. We developed the multi-channel convolutional analysis operator learning (MCAOL) method to exploit common spatial features within attenuation images at differ…

2022-03-10cs.CVcs.LGcs.NA

卷积分析算子学习：加速与收敛

Convolutional Analysis Operator Learning: Acceleration and Convergence

The University of Michigan（密歇根大学）；the University of Hawai’i at Mānoa（夏威夷大学马诺阿分校）

本文提出卷积分析算子学习（CAOL）框架及BPEG-M算法，通过正交性约束和多样性正则化学习稀疏化正则化器，显著加速收敛并提升稀疏视图CT重建质量。

2019-09-11cs.CVcs.LGeess.IV

Graph Convolutional Networks for Model-Based Learning in Nonlinear Inverse Problems

Marquette University（马凯特大学）；University of Oulu（奥卢大学）；University College London（伦敦大学学院）

The majority of model-based learned image reconstruction methods in medical imaging have been limited to uniform domains, such as pixelated images. If the underlying model is solved on nonuniform meshes, arising from a finite element method typical for nonlinear inverse problems, interpolation and embeddings are needed. To overcome this, we present a flexible framework to extend model-based learning directly to nonuniform meshes, by interpreting the mesh as a graph and formulating our network architectures using graph convolutional neural networks. This gives rise to the proposed iterative Gra…

2021-07-08cs.LGcs.NAcs.NE

Region Growing with Convolutional Neural Networks for Biomedical Image Segmentation

North Carolina State University（北卡罗来纳州立大学）

In this paper we present a methodology that uses convolutional neural networks (CNNs) for segmentation by iteratively growing predicted mask regions in each coordinate direction. The CNN is used to predict class probability scores in a small neighborhood of the center pixel in a tile of an image. We use a threshold on the CNN probability scores to determine whether pixels are added to the region and the iteration continues until no new pixels are added to the region. Our method is able to achieve high segmentation accuracy and preserve biologically realistic morphological features while levera…

2020-09-23cs.LGeess.IV