TaoFlowForge：通过级联流匹配实现渐进式原生网格生成
TaoFlowForge: Progressive Native Mesh Generation via Cascaded Flow Matching
- Taobao3D Team, Alibaba Group（阿里巴巴集团淘宝3D团队）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
TaoFlowForge提出级联流匹配的网格生成方法，分解顶点生成与连通性预测，结合数据整理，实现生产就绪网格，性能超越现有开源方法。
AI中文摘要：
3D内容生成技术显著推进了设计师的工作，以及3D打印和游戏行业。然而，生成轻量级、可编辑且拓扑干净、可直接用于生产的艺术内容仍然困难。为实现这一目标，我们提出了TaoFlowForge，一个生成生产就绪网格的艺术网格基础模型。具体而言，TaoFlowForge将网格生成过程分解为顶点生成及其连通性预测（即边）。我们将顶点生成表述为一个两阶段的从粗到细的过程，并整合了多种有效的损失函数以进一步增强其性能。在连通性预测阶段，我们提出了一种简单而有效的方法来估计顶点之间的连通性亲和力，并额外预测每个顶点的法线，这决定了面的正确朝向。此外，我们构建了一个大规模数据集，结合了手工制作的3D资产和公开的高质量拓扑数据集。基于此，采用精心设计的数据整理流程来过滤原始数据集，仅保留高质量拓扑数据用于模型训练。我们的模型在组合数据集上训练，并在分布外的手工制作3D资产集和公开数据集上测试。在图像条件生成下，TaoFlowForge优于自回归方法，并在开源网格拓扑生成器中取得了最先进的结果。我们将发布所有代码和权重，以及部分测试数据集。
英文摘要：
3D content generation technology has significantly advanced the work of designers, as well as the 3D printing and gaming industries. However, it remains difficult to produce lightweight, editable, and topologically clean artistic content that is directly production-ready. To achieve this, we present TaoFlowForge, an artistic mesh foundation model that generates production-ready meshes. Specifically, TaoFlowForge decomposes the mesh generation process into vertices generation and their connectivity prediction, i.e., edges. We formulate vertices generation as a two-stage coarse-to-fine process and incorporate several effective loss functions to further enhance its performance. In the connectivity prediction stage, we propose a simple yet effective method for estimating the connectivity affinity between vertices and additionally predict per-vertex normals, which determines the correct orientation of faces. Besides, we construct a large-scale dataset combining hand-crafted 3D assets with public high-quality topology datasets. Based on this, a carefully designed data curation pipeline is employed to filter the raw dataset, retaining only high-quality topology data for model training. Our model is trained on the combined dataset and tested on both out-of-distribution hand-crafted set of 3D assets and public datasets. Under image-conditioned generation, TaoFlowForge outperforms autoregressive methods and achieves state-of-the-art results among open-source mesh topology generators. We will release all the code and weights together with a portion of our test dataset.
