arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1706.08260cs.CV
收藏

深度语义感知的照片调整

Deep Semantics-Aware Photo Adjustment

Yonsei University(延世大学)

Seonghyeon Nam, Seon Joo Kim

摘要:

自动照片调整是模仿专业摄影师的照片修图风格,自动将照片调整为学习的风格。已经有许多尝试使用低级颜色统计来全局地对色调和颜色调整进行建模。此外,空间变化的照片调整方法进行了研究,利用高层次的功能和语义标签地图。这些方法是语义感知的,因为颜色映射依赖于高级语义上下文。然而,它们的性能仅限于预先计算的手工特征,并且难以反映用户对调整的偏好。在本文中,我们提出了一个深度神经网络,模型的语义感知的照片调整。所提出的网络利用双线性模型,即颜色和上下文特征的乘法相互作用。作为上下文特征,我们提出了语义调整图,它发现了根据场景上下文应用的固有照片修图。所提出的方法是使用场景解析任务的鲁棒损失进行训练的。实验结果表明,该方法在定量和定性上都优于现有方法。所提出的方法还提供了一种方法来修饰的照片,通过自己的喜好,给定制的调整地图。

英文摘要:

Automatic photo adjustment is to mimic the photo retouching style of professional photographers and automatically adjust photos to the learned style. There have been many attempts to model the tone and the color adjustment globally with low-level color statistics. Also, spatially varying photo adjustment methods have been studied by exploiting high-level features and semantic label maps. Those methods are semantics-aware since the color mapping is dependent on the high-level semantic context. However, their performance is limited to the pre-computed hand-crafted features and it is hard to reflect user's preference to the adjustment. In this paper, we propose a deep neural network that models the semantics-aware photo adjustment. The proposed network exploits bilinear models that are the multiplicative interaction of the color and the contexual features. As the contextual features we propose the semantic adjustment map, which discovers the inherent photo retouching presets that are applied according to the scene context. The proposed method is trained using a robust loss with a scene parsing task. The experimental results show that the proposed method outperforms the existing method both quantitatively and qualitatively. The proposed method also provides users a way to retouch the photo by their own likings by giving customized adjustment maps.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑