arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.07756cs.CV
收藏

用于高分辨率真实感图像平移的多曲线平移器

Multi-Curve Translator for High-Resolution Photorealistic Image Translation

Zhejiang University(浙江大学)

Yuda Song, Hui Qian, Xin Du

摘要:

主要的图像到图像转换方法是基于全卷积网络,它提取和转换图像的特征,然后重建图像。然而,当处理高分辨率图像时,它们具有不可接受的计算成本。为此,我们提出了多曲线转换器(MCT),它不仅预测相应的输入像素的翻译像素,而且为他们的相邻像素。如果将高分辨率图像下采样到其低分辨率版本,则丢失的像素是剩余像素的相邻像素。因此,MCT使得只向网络提供下采样图像来执行全分辨率图像的映射成为可能,这可以显着降低计算成本。此外,MCT是一种插件方法,它利用现有的基础模型,只需要替换它们的输出层。实验表明,MCT变体可以实时处理4K图像,并在各种逼真的图像到图像转换任务中实现与基础模型相当甚至更好的性能。

英文摘要:

The dominant image-to-image translation methods are based on fully convolutional networks, which extract and translate an image's features and then reconstruct the image. However, they have unacceptable computational costs when working with high-resolution images. To this end, we present the Multi-Curve Translator (MCT), which not only predicts the translated pixels for the corresponding input pixels but also for their neighboring pixels. And if a high-resolution image is downsampled to its low-resolution version, the lost pixels are the remaining pixels' neighboring pixels. So MCT makes it possible to feed the network only the downsampled image to perform the mapping for the full-resolution image, which can dramatically lower the computational cost. Besides, MCT is a plug-in approach that utilizes existing base models and requires only replacing their output layers. Experiments demonstrate that the MCT variants can process 4K images in real-time and achieve comparable or even better performance than the base models on various photorealistic image-to-image translation tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑