arXiv 2201.006012022-01-03eess.IVphysics.optics

Generative adversarial network for super-resolution imaging through a fiber

Wei Li, Ksenia Abrashitova, Gerwin Osnabrugge, Lyubov V. Amitonova

DOI：: 10.1103/PhysRevApplied.18.034075

英文摘要：

A multimode fiber represents the ultimate limit in miniaturization of imaging endoscopes. Here we propose a fiber imaging approach employing compressive sensing with a data-driven machine learning framework. We implement a generative adversarial network for image reconstruction without relying on a sample sparsity constraint. The proposed method outperforms the conventional compressive imaging algorithms in terms of image quality and noise robustness. We experimentally demonstrate speckle-based imaging below the diffraction limit at a sub-Nyquist speed through a multimode fiber.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

利用输入偏振与深度学习实现多模光纤最优成像

Towards optimal multimode fiber imaging by leveraging input polarization and deep learning

该研究探究输入光偏振态对多模光纤散斑图像重建保真度的影响，设计CGAN实现不同偏振下的图像重建，在特定条件下SSIM超0.9，为高分辨率低侵入多模光纤内窥镜研发提供基础。

2024-03-13eess.IVphysics.optics

Estimation of Tissue Oxygen Saturation from RGB images and Sparse Hyperspectral Signals based on Conditional Generative Adversarial Network

Imperial College London（伦敦帝国学院）；University College London（伦敦大学学院）

Purpose: Intra-operative measurement of tissue oxygen saturation (StO2) is important in the detection of ischemia, monitoring perfusion and identifying disease. Hyperspectral imaging (HSI) measures the optical reflectance spectrum of the tissue and uses this information to quantify its composition, including StO2. However, real-time monitoring is difficult due to the capture rate and data processing time. Methods: An endoscopic system based on a multi-fiber probe was previously developed to sparsely capture HSI data (sHSI). These were combined with RGB images, via a deep neural network, to gen…

2019-05-16cs.CVeess.IV

Alternative Data Augmentation for Industrial Monitoring using Adversarial Learning

University of Augsburg（奥格斯堡大学）；Fraunhofer IGCV（弗劳恩霍夫铸造、复合材料与加工技术研究所）

Visual inspection software has become a key factor in the manufacturing industry for quality control and process monitoring. Semantic segmentation models have gained importance since they allow for more precise examination. These models, however, require large image datasets in order to achieve a fair accuracy level. In some cases, training data is sparse or lacks of sufficient annotation, a fact that especially applies to highly specialized production environments. Data augmentation represents a common strategy to extend the dataset. Still, it only varies the image within a narrow range. In t…

2022-05-09cs.CVeess.IV

A reusable pipeline for large-scale fiber segmentation on unidirectional fiber beds using fully convolutional neural networks

Berkeley Institute for Data Science, University of California, Berkeley（加州大学伯克利分校伯克利数据科学研究所）；Lawrence Berkeley National Laboratory（劳伦斯伯克利国家实验室）

Fiber-reinforced ceramic-matrix composites are advanced materials resistant to high temperatures, with application to aerospace engineering. Their analysis depends on the detection of embedded fibers, with semi-supervised techniques usually employed to separate fibers within the fiber beds. Here we present an open computational pipeline to detect fibers in ex-situ X-ray computed tomography fiber beds. To separate the fibers in these samples, we tested four different architectures of fully convolutional neural networks. When comparing our neural network approach to a semi-supervised one, we obt…

2021-01-15cs.CVeess.IV

用于食管癌诊断的新型末端可扩张光纤探头的深度学习图像超分辨率研究

Deep learning-based image super-resolution of a novel end-expandable optical fiber probe for application in esophageal cancer diagnostics

本研究针对食管癌内镜筛查视野受限问题，提出新型末端可扩张光纤探头结合DL-SR方法，经模拟实验与病理读片验证，可提升图像质量且判读效果与高分辨率图像相当，助力高效食管癌筛查。

2023-10-03eess.IV

SuperDTI: Ultrafast diffusion tensor imaging and fiber tractography with deep learning

University at Buffalo, State University of New York（纽约州立大学布法罗分校）；New York University School of Medicine（纽约大学医学院）；Peking Union Medical College Hospital（北京协和医院）；Peking Union Medical College（北京协和医学院）；Chinese Academy of Medical Sciences（中国医学科学院）；SIAT, CAS（中国科学院深圳先进技术研究院）；Virginia Tech（弗吉尼亚理工大学）

Purpose: To propose a deep learning-based reconstruction framework for ultrafast and robust diffusion tensor imaging and fiber tractography. Methods: We propose SuperDTI to learn the nonlinear relationship between diffusion-weighted images (DWIs) and the corresponding tensor-derived quantitative maps as well as the fiber tractography. Super DTI bypasses the tensor fitting procedure, which is well known to be highly susceptible to noise and motion in DWIs. The network is trained and tested using datasets from Human Connectome Project and patients with ischemic stroke. SuperDTI is compared again…

2021-03-24cs.LGeess.IVphysics.med-ph

更多相关论文收起更多论文

Manifold-Aware CycleGAN for High-Resolution Structural-to-DTI Synthesis

ETS Montreal（蒙特利尔高等技术学院）

Unpaired image-to-image translation has been applied successfully to natural images but has received very little attention for manifold-valued data such as in diffusion tensor imaging (DTI). The non-Euclidean nature of DTI prevents current generative adversarial networks (GANs) from generating plausible images and has mainly limited their application to diffusion MRI scalar maps, such as fractional anisotropy (FA) or mean diffusivity (MD). Even if these scalar maps are clinically useful, they mostly ignore fiber orientations and therefore have limited applications for analyzing brain fibers. H…

2020-09-18cs.CVeess.IV

Time Efficient Training of Progressive Generative Adversarial Network using Depthwise Separable Convolution and Super Resolution Generative Adversarial Network

Generative Adversarial Networks have been employed successfully to generate high-resolution augmented images of size 1024^2. Although the augmented images generated are unprecedented, the training time of the model is exceptionally high. Conventional GAN requires training of both Discriminator as well as the Generator. In Progressive GAN, which is the current state-of-the-art GAN for image augmentation, instead of training the GAN all at once, a new concept of progressing growing of Discriminator and Generator simultaneously, was proposed. Although the lower stages such as 4x4 and 8x8 train ra…

2022-02-24cs.CVeess.IV

FOD-Swin-Net：使用基于Transformer的深度模型实现纤维取向分布的角超分辨率

FOD-Swin-Net: angular super resolution of fiber orientation distribution using a transformer-based deep model

School of Electrical and Computer Engineering, Universidade Estadual de Campinas（坎皮纳斯州立大学电气与计算机工程学院）

本研究提出基于Transformer的深度模型FOD-Swin-Net，通过从快速采集的DW-MRI数据中实现自动角超分辨率，将32方向单壳FOD重建提升至与288方向多壳重建相当的水平，显著减少初始采集所需方向数且性能优于现有技术。

2024-02-19cs.CVcs.LGeess.IV

ESRGAN+ : Further Improving Enhanced Super-Resolution Generative Adversarial Network

Université d'Antananarivo（塔那那利佛大学）

Enhanced Super-Resolution Generative Adversarial Network (ESRGAN) is a perceptual-driven approach for single image super resolution that is able to produce photorealistic images. Despite the visual quality of these generated images, there is still room for improvement. In this fashion, the model is extended to further improve the perceptual quality of the images. We have designed a novel block to replace the one used by the original ESRGAN. Moreover, we introduce noise inputs to the generator network in order to exploit stochastic variation. The resulting images present more realistic textures…

2020-07-15cs.LGeess.IV

Image Super-Resolution Using a Wavelet-based Generative Adversarial Network

In this paper, we consider the problem of super-resolution recons-truction. This is a hot topic because super-resolution reconstruction has a wide range of applications in the medical field, remote sensing monitoring, and criminal investigation. Compared with traditional algorithms, the current super-resolution reconstruction algorithm based on deep learning greatly improves the clarity of reconstructed pictures. Existing work like Super-Resolution Using a Generative Adversarial Network (SRGAN) can effectively restore the texture details of the image. However, experimentally verified that the …

2019-07-24cs.CVeess.IV

3N-GAN: Semi-Supervised Classification of X-Ray Images with a 3-Player Adversarial Framework

Saratoga High School（萨拉托加高中）

The success of deep learning for medical imaging tasks, such as classification, is heavily reliant on the availability of large-scale datasets. However, acquiring datasets with large quantities of labeled data is challenging, as labeling is expensive and time-consuming. Semi-supervised learning (SSL) is a growing alternative to fully-supervised learning, but requires unlabeled samples for training. In medical imaging, many datasets lack unlabeled data entirely, so SSL can't be conventionally utilized. We propose 3N-GAN, or 3 Network Generative Adversarial Networks, to perform semi-supervised c…

2021-09-22cs.CVcs.LGeess.IV