首页/论文/2202.00676

arXiv 2202.006762022-02-01eess.IVcs.CVcs.LG

A deep residual learning implementation of Metamorphosis

Télécom Paris, Institut Polytechnique de Paris（巴黎理工学院巴黎电信学院）；CNRS（法国国家科学研究中心）

Matthis Maillard, Anton François, Joan Glaunès, Isabelle Bloch, Pietro Gori

备注：: ISBI 2022

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

In medical imaging, most of the image registration methods implicitly assume a one-to-one correspondence between the source and target images (i.e., diffeomorphism). However, this is not necessarily the case when dealing with pathological medical images (e.g., presence of a tumor, lesion, etc.). To cope with this issue, the Metamorphosis model has been proposed. It modifies both the shape and the appearance of an image to deal with the geometrical and topological differences. However, the high computational time and load have hampered its applications so far. Here, we propose a deep residual learning implementation of Metamorphosis that drastically reduces the computational time at inference. Furthermore, we also show that the proposed framework can easily integrate prior knowledge of the localization of topological changes (e.g., segmentation masks) that can act as spatial regularization to correctly disentangle appearance and shape changes. We test our method on the BraTS 2021 dataset, showing that it outperforms current state-of-the-art methods in the alignment of images with brain tumors.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Metamorphic image registration using a semi-Lagrangian scheme

Université de Paris（巴黎大学）；Télécom Paris（巴黎电信学院）；IPParis（巴黎理工学院）

In this paper, we propose an implementation of both Large Deformation Diffeomorphic Metric Mapping (LDDMM) and Metamorphosis image registration using a semi-Lagrangian scheme for geodesic shooting. We propose to solve both problems as an inexact matching providing a single and unifying cost function. We demonstrate that for image registration the use of a semi-Lagrangian scheme is more stable than a standard Eulerian scheme. Our GPU implementation is based on PyTorch, which greatly simplifies and accelerates the computations thanks to its powerful automatic differentiation engine. It will be f…

2021-06-16cs.CV

Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blocks

Simon Fraser University（西蒙弗雷泽大学）；Google Inc.（谷歌公司）；Tencent Technologies（腾讯科技）

Recently deep learning-based image compression has shown the potential to outperform traditional codecs. However, most existing methods train multiple networks for multiple bit rates, which increase the implementation complexity. In this paper, we propose a new variable-rate image compression framework, which employs generalized octave convolutions (GoConv) and generalized octave transposed-convolutions (GoTConv) with built-in generalized divisive normalization (GDN) and inverse GDN (IGDN) layers. Novel GoConv- and GoTConv-based residual blocks are also developed in the encoder and decoder net…

2020-12-31cs.CVcs.LGeess.IV

Learned Variable-Rate Image Compression with Residual Divisive Normalization

Simon Fraser University（西蒙弗雷泽大学）；Google Inc.（谷歌公司）；Tencent Technologies（腾讯科技）

Recently it has been shown that deep learning-based image compression has shown the potential to outperform traditional codecs. However, most existing methods train multiple networks for multiple bit rates, which increases the implementation complexity. In this paper, we propose a variable-rate image compression framework, which employs more Generalized Divisive Normalization (GDN) layers than previous GDN-based methods. Novel GDN-based residual sub-networks are also developed in the encoder and decoder networks. Our scheme also uses a stochastic rounding-based scalable quantization. To furthe…

2019-12-11cs.CVeess.IV

Denoising of 3D MR images using a voxel-wise hybrid residual MLP-CNN model to improve small lesion diagnostic confidence

Fudan University（复旦大学）；Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University（复旦大学类脑智能科学与技术研究院）；Huashan Hospital, Fudan University（复旦大学附属华山医院）

Small lesions in magnetic resonance imaging (MRI) images are crucial for clinical diagnosis of many kinds of diseases. However, the MRI quality can be easily degraded by various noise, which can greatly affect the accuracy of diagnosis of small lesion. Although some methods for denoising MR images have been proposed, task-specific denoising methods for improving the diagnosis confidence of small lesions are lacking. In this work, we propose a voxel-wise hybrid residual MLP-CNN model to denoise three-dimensional (3D) MR images with small lesions. We combine basic deep learning architecture, MLP…

2022-09-28cs.CVeess.IV

FC$^2$N: Fully Channel-Concatenated Network for Single Image Super-Resolution

UESTC（电子科技大学）；Northeastern University（东北大学）；Sichuan University of Science and Engineering（四川轻化工大学）

Most current image super-resolution (SR) methods based on convolutional neural networks (CNNs) use residual learning in network structural design, which favors to effective back propagation and hence improves SR performance by increasing model scale. However, residual networks suffer from representational redundancy by introducing identity paths that impede the full exploitation of model capacity. Besides, blindly enlarging network scale can cause more problems in model training, even with residual learning. In this paper, a novel fully channel-concatenated network (FC$^2$N) is presented to ma…

2021-05-05cs.CVeess.IV

深度残差CNN用于多类别胸部感染诊断

Deep Residual CNN for Multi-Class Chest Infection Diagnosis

Hana Academy Seoul（韩娜首尔学院）；Korea Science Academy of KAIST（韩国科学技术院附属韩国科学学院）；Sungkyunkwan University（成均馆大学）

本研究开发并评估了一种深度残差CNN，用于基于胸部X射线图像的多类别胸部感染诊断，在合并数据集上达到93%的总体准确率，并指出纤维化类别性能差异及未来优化方向。

2023-11-17cs.CVcs.LGeess.IV

更多相关论文收起更多论文

ResViT: Residual vision transformers for multi-modal medical image synthesis

Bilkent University（比尔肯特大学）；National Magnetic Resonance Research Center (UMRAM)（国家磁共振研究中心（UMRAM））；Sabuncu Brain Research Center（萨本库脑研究中心）

Generative adversarial models with convolutional neural network (CNN) backbones have recently been established as state-of-the-art in numerous medical image synthesis tasks. However, CNNs are designed to perform local processing with compact filters, and this inductive bias compromises learning of contextual features. Here, we propose a novel generative adversarial approach for medical image synthesis, ResViT, that leverages the contextual sensitivity of vision transformers along with the precision of convolution operators and realism of adversarial learning.} ResViT's generator employs a cent…

2022-03-06cs.CVeess.IV

2.5D Deep Learning for CT Image Reconstruction using a Multi-GPU implementation

While Model Based Iterative Reconstruction (MBIR) of CT scans has been shown to have better image quality than Filtered Back Projection (FBP), its use has been limited by its high computational cost. More recently, deep convolutional neural networks (CNN) have shown great promise in both denoising and reconstruction applications. In this research, we propose a fast reconstruction algorithm, which we call Deep Learning MBIR (DL-MBIR), for approximating MBIR using a deep residual neural network. The DL-MBIR method is trained to produce reconstructions that approximate true MBIR images using a 16…

2018-12-20eess.IV

Robust Deep Compressive Sensing with Recurrent-Residual Structural Constraints

Duke University（杜克大学）；Amazon（亚马逊）

Existing deep compressive sensing (CS) methods either ignore adaptive online optimization or depend on costly iterative optimizer during reconstruction. This work explores a novel image CS framework with recurrent-residual structural constraint, termed as R$^2$CS-NET. The R$^2$CS-NET first progressively optimizes the acquired samplings through a novel recurrent neural network. The cascaded residual convolutional network then fully reconstructs the image from optimized latent representation. As the first deep CS framework efficiently bridging adaptive online optimization, the R$^2$CS-NET integr…

2022-07-15cs.AIcs.CVeess.IV

A Lumen Segmentation Method in Ureteroscopy Images based on a Deep Residual U-Net architecture

Politecnico di Milano（米兰理工大学）；CNRS-Université de Strasbourg（法国国家科学研究中心-斯特拉斯堡大学）；University of Calabria（卡拉布里亚大学）；Istituto Italiano di Tecnologia（意大利技术研究院）；Università Politecnica delle Marche（马尔凯理工大学）；Istituto Europeo di Oncologia（欧洲肿瘤研究所）

Ureteroscopy is becoming the first surgical treatment option for the majority of urinary affections. This procedure is performed using an endoscope which provides the surgeon with the visual information necessary to navigate inside the urinary tract. Having in mind the development of surgical assistance systems, that could enhance the performance of surgeon, the task of lumen segmentation is a fundamental part since this is the visual reference which marks the path that the endoscope should follow. This is something that has not been analyzed in ureteroscopy data before. However, this task pre…

2021-01-13cs.CVeess.IV

LadderNet: Multi-path networks based on U-Net for medical image segmentation

U-Net has been providing state-of-the-art performance in many medical image segmentation problems. Many modifications have been proposed for U-Net, such as attention U-Net, recurrent residual convolutional U-Net (R2-UNet), and U-Net with residual blocks or blocks with dense connections. However, all these modifications have an encoder-decoder structure with skip connections, and the number of paths for information flow is limited. We propose LadderNet in this paper, which can be viewed as a chain of multiple U-Nets. Instead of only one pair of encoder branch and decoder branch in U-Net, a Ladd…

2019-08-28cs.CVeess.IV

Vision-Based Lane-Changing Behavior Detection Using Deep Residual Neural Network

Accurate lane localization and lane change detection are crucial in advanced driver assistance systems and autonomous driving systems for safer and more efficient trajectory planning. Conventional localization devices such as Global Positioning System only provide road-level resolution for car navigation, which is incompetent to assist in lane-level decision making. The state of art technique for lane localization is to use Light Detection and Ranging sensors to correct the global localization error and achieve centimeter-level accuracy, but the real-time implementation and popularization for …

2019-11-08cs.CVeess.IV

面向 Radiance 格式高动态范围图像的闪电般快速双层无损编码

Lightning-Fast Dual-Layer Lossless Coding for Radiance Format High Dynamic Range Images

本文提出一种基于 Radiance 格式尾数与指数信息的快速双层无损 HDRI 编码方法，通过简单线性回归尾数估计器降低残差能量，在平均比特率和编码时间上均显著优于现有方法。

2023-09-20eess.IV