arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.21865cs.GRcs.CVcs.HC

从草图到场景:基于标记草图的可重光照服装重建

From Sketch to Scene: Relightable Garment Reconstruction from Marked Sketches

Koç University(科奇大学);University of Manchester(曼彻斯特大学)

Ahmet Neçirvan Doğan, Eren Acar Başaran, Metin Sezgin, Zahra Montazeri

AI总结:

该研究提出了一种基于带高光、阴影标记的服装草图与文本提示的系统,可生成带方向光的可重光照3D服装网格,解决了现有草图转3D无法保留创作意图的问题。

摘要:

草图是人们表达视觉创意最自然的方式之一。与当前大多数生成系统依赖的文本提示不同,草图能直接捕捉空间结构与创作意图,包括设计师希望高光和阴影出现的位置。然而现有的草图转3D流程并未纳入这种创作意图:它们会将绘制的明暗效果以深色颜料的形式烘焙到纹理中,且光线无法移动。我们提出了一个系统,该系统将带有稀疏标注(星号代表高光、月亮符号代表阴影)的粗略服装草图,以及一段描述纹理的简短文本提示,转换为带有明确方向光的纹理化3D网格,形成一个生成后可重光照和编辑的场景。这两个符号是针对艺术学生开展的启发式研究中最常出现的建议。系统会从标记草图中预测场景的方向光,并单独预测一个位移场,该位移场会使表面弯曲,从而让带有月亮标记的区域在该光线下处于阴影中,而非在纹理中被绘制成深色。

英文摘要:

Sketching is one of the most natural ways for people to express visual ideas. Unlike the text prompts that most generative systems rely on today, a sketch captures spatial structure and intent directly, including where a designer wants highlights and shadows to appear. Yet current sketch-to-3D pipelines have no input for that intent: they bake the drawn shading into the texture as dark paint, and the light cannot be moved. We propose a system that transforms a rough garment sketch, marked with sparse annotations (a star for a highlight and a moon for a shadow), and a short text prompt describing the texture, into a textured 3D mesh with an explicit directional light, as a scene that can be relit and edited after generation. The two symbols are the most frequent proposals in an elicitation study with art students. From the marked sketch the system predicts the scene's directional light and, separately, a displacement field that bends the surface so that the moon-marked regions fall into shadow under that light, rather than being painted dark in the texture.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

相关深度报道

↑