arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2005.06723eess.IVcs.CV
收藏

基于上下文的图像外绘的增强残差网络

Enhanced Residual Networks for Context-based Image Outpainting

Worcester Polytechnic Institute(伍斯特理工学院)

Przemek Gardias, Eric Arthur, Huaming Sun

摘要:

尽管人类在预测图像边界之外存在的内容方面表现良好,但深度模型很难通过保留的信息来理解上下文和外推。这项任务被称为图像外画,涉及生成图像边界的逼真扩展。目前的模型使用生成式对抗网络来生成结果,这些结果缺乏局部图像特征的一致性,并且看起来很假。我们提出了两种方法来改善这个问题:使用本地和全局的编码器,并在网络的编码部分内添加残差块。我们的模型和基线的L1损失,均方误差(MSE)损失和定性差异的比较表明,我们的模型能够自然地扩展对象边界,并产生更内部一致的图像相比,目前的方法,但产生较低的保真度图像。

英文摘要:

Although humans perform well at predicting what exists beyond the boundaries of an image, deep models struggle to understand context and extrapolation through retained information. This task is known as image outpainting and involves generating realistic expansions of an image's boundaries. Current models use generative adversarial networks to generate results which lack localized image feature consistency and appear fake. We propose two methods to improve this issue: the use of a local and global discriminator, and the addition of residual blocks within the encoding section of the network. Comparisons of our model and the baseline's L1 loss, mean squared error (MSE) loss, and qualitative differences reveal our model is able to naturally extend object boundaries and produce more internally consistent images compared to current methods but produces lower fidelity images.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑