arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2112.08930cs.CVcs.AIcs.LGcs.MMstat.ML
收藏

Intelli-Paint:开发类人绘画代理

Intelli-Paint: Towards Developing Human-like Painting Agents

Adobe Research(Adobe 研究院);Australian National University(澳大利亚国立大学)

Jaskirat Singh, Cameron Smith, Jose Echevarria, Liang Zheng

摘要:

精心设计的艺术作品的生成通常是相当耗时的,并且假设人类画家的高度熟练。为了促进人类绘画过程,已经在教导机器如何“像人一样绘画”,然后使用训练的代理作为人类用户的绘画辅助工具方面进行了大量的研究工作。然而,目前在这个方向上的研究往往依赖于一个渐进的基于网格的划分策略,其中代理划分成连续的更精细的网格的整体图像,然后进行并行绘制每个。这不可避免地导致人类用户不容易理解的人工绘画序列。为了解决这个问题,我们提出了一种新的绘画方法,它学习生成输出画布,同时表现出更像人类的绘画风格。拟议的绘制管道Intelli-Paint包括1)渐进分层策略,允许代理首先绘制自然背景场景表示,然后以渐进方式添加每个前景对象。2)我们还介绍了一种新的顺序笔触指导策略,帮助绘画代理转移其注意力在不同的图像区域之间的语义感知的方式。3)最后,我们提出了一种笔触正则化策略,它允许减少所需笔触总数的60-80%,而不会在生成的画布质量上产生任何可感知的差异。通过定量和定性的结果,我们表明,由此产生的代理不仅在输出画布生成效率提高,而且还表现出更自然的绘画风格,这将更好地帮助人类用户通过数字艺术品表达他们的想法。

英文摘要:

The generation of well-designed artwork is often quite time-consuming and assumes a high degree of proficiency on part of the human painter. In order to facilitate the human painting process, substantial research efforts have been made on teaching machines how to "paint like a human", and then using the trained agent as a painting assistant tool for human users. However, current research in this direction is often reliant on a progressive grid-based division strategy wherein the agent divides the overall image into successively finer grids, and then proceeds to paint each of them in parallel. This inevitably leads to artificial painting sequences which are not easily intelligible to human users. To address this, we propose a novel painting approach which learns to generate output canvases while exhibiting a more human-like painting style. The proposed painting pipeline Intelli-Paint consists of 1) a progressive layering strategy which allows the agent to first paint a natural background scene representation before adding in each of the foreground objects in a progressive fashion. 2) We also introduce a novel sequential brushstroke guidance strategy which helps the painting agent to shift its attention between different image regions in a semantic-aware manner. 3) Finally, we propose a brushstroke regularization strategy which allows for ~60-80% reduction in the total number of required brushstrokes without any perceivable differences in the quality of the generated canvases. Through both quantitative and qualitative results, we show that the resulting agents not only show enhanced efficiency in output canvas generation but also exhibit a more natural-looking painting style which would better assist human users express their ideas through digital artwork.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑