Text-driven 3D stylization is a complex and crucial task in the fields of computer vision (CV) and computer graphics (CG), aimed at transforming a bare mesh to fit a target text. Prior methods adopt text-independent multilayer perceptrons (MLPs) to predict the attributes of the target mesh with the supervision of CLIP loss. However, such text-independent architecture lacks textual guidance during predicting attributes, thus leading to unsatisfactory stylization and slow convergence. To address these limitations, we present X-Mesh, an innovative text-driven 3D stylization framework that incorporates a novel Text-guided Dynamic Attention Module (TDAM). The TDAM dynamically integrates the guidance of the target text by utilizing text-relevant spatial and channel-wise attentions during vertex feature extraction, resulting in more accurate attribute prediction and faster convergence speed. Furthermore, existing works lack standard benchmarks and automated metrics for evaluation, often relying on subjective and non-reproducible user studies to assess the quality of stylized 3D assets. To overcome this limitation, we introduce a new standard text-mesh benchmark, namely MIT-30, and two automated metrics, which will enable future research to achieve fair and objective comparisons. Our extensive qualitative and quantitative experiments demonstrate that X-Mesh outperforms previous state-of-the-art methods.
DiffStyler: Controllable Dual Diffusion for Text-Driven Image Stylization
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Kuaishou Technology(快手科技)
ProxyBuild: Text-Guided Structured 3D Building Generation with Mesh-Anchored Procedural Proxies
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Pengcheng Laboratory(鹏城实验室);Harbin Institute of Technology(哈尔滨工业大学);Harbin Institute of Technology, Suzhou Research Institute(哈尔滨工业大学苏州研究院)
RAGMesh with FaME-G2E: Long-Form Text-Driven 3D Face Generation and Editing
Beihang University(北京航空航天大学);Pengcheng Laboratory(鹏城实验室);Shanxi University of Finance and Economics(山西财经大学);North China University of Technology(北方工业大学);Cardiff University(卡迪夫大学);Beijing Institute of Technology(北京理工大学)
Soulstyler: Using Large Language Model to Guide Image Style Transfer for Target Object
College of Computer Science and Technology, Harbin Engineering University(哈尔滨工程大学计算机科学与技术学院);Modeling and Emulation in E-Government National Engineering Laboratory(电子政务建模仿真国家工程实验室)
DreamMesh: Jointly Manipulating and Texturing Triangle Meshes for Text-to-3D Generation
School of Computer Science, Fudan University(复旦大学计算机科学学院);HiDream.ai Inc.(HiDream.ai公司);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海智能视觉计算协同创新中心)