PEGAsus: 几何与外观的3D个性化
PEGAsus: 3D Personalization of Geometry and Appearance
AI总结:
PEGAsus通过几何与外观层面的概念学习,实现个性化3D形状生成,支持灵活的概念提取与合成,优于现有方法。
摘要:
我们提出了PEGAsus,一个能够通过在几何和外观层面学习形状概念来生成个性化3D形状的新框架。首先,我们将3D形状个性化公式化为从参考形状中提取可重用的、类别无关的几何和外观属性,并将这些属性与文本结合以生成新的形状。其次,我们设计了一种渐进优化策略,以在几何和外观层面学习形状概念,将形状概念学习过程解耦。第三,我们将方法扩展到区域层面的概念学习,使能够灵活提取概念,具有上下文感知和上下文无关的损失。广泛的实验结果表明,PEGAsus能够有效从广泛参考形状中提取属性,并灵活地将这些概念与文本结合以合成新形状。这使能够对形状生成进行细粒度控制,并支持在挑战性的跨类别场景中创建多样化的个性化结果。定量和定性实验均表明,我们的方法优于现有最先进的解决方案。
英文摘要:
We present PEGAsus, a new framework capable of generating Personalized 3D shapes by learning shape concepts at both Geometry and Appearance levels. First, we formulate 3D shape personalization as extracting reusable, category-agnostic geometric and appearance attributes from reference shapes, and composing these attributes with text to generate novel shapes. Second, we design a progressive optimization strategy to learn shape concepts at both the geometry and appearance levels, decoupling the shape concept learning process. Third, we extend our approach to region-wise concept learning, enabling flexible concept extraction, with context-aware and context-free losses. Extensive experimental results show that PEGAsus is able to effectively extract attributes from a wide range of reference shapes and then flexibly compose these concepts with text to synthesize new shapes. This enables fine-grained control over shape generation and supports the creation of diverse, personalized results, even in challenging cross-category scenarios. Both quantitative and qualitative experiments demonstrate that our approach outperforms existing state-of-the-art solutions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。