ForgeDreamer: 工业文本到3D生成的多专家LoRA与跨视图超图
ForgeDreamer: Industrial Text-to-3D Generation with Multi-Expert LoRA and Cross-View Hypergraph
AI总结:
本文提出ForgeDreamer框架,通过多专家LoRA集合和跨视图超图增强方法,解决工业文本到3D生成中的领域适应与几何推理问题,提升语义泛化和几何精度。
摘要:
当前文本到3D生成方法在自然场景中表现优异,但在工业应用中面临两大挑战:领域适应困难,传统LoRA融合导致跨类知识干扰;几何推理不足,成对一致性约束无法捕捉高阶结构依赖。本文提出ForgeDreamer框架,通过多专家LoRA集合机制整合多个类别特定LoRA模型,实现跨类泛化并消除知识干扰;基于增强语义理解,开发跨视图超图几何增强方法,同时捕捉多视角结构依赖。这些组件协同提升语义理解,增强几何推理,超图建模确保制造级一致性。在定制工业数据集上的实验表明,相比最先进方法,语义泛化和几何精度均有显著提升。代码见https://github.com/Junhaocai27/ForgeDreamer
英文摘要:
Current text-to-3D generation methods excel in natural scenes but struggle with industrial applications due to two critical limitations: domain adaptation challenges where conventional LoRA fusion causes knowledge interference across categories, and geometric reasoning deficiencies where pairwise consistency constraints fail to capture higher-order structural dependencies essential for precision manufacturing. We propose a novel framework named ForgeDreamer addressing both challenges through two key innovations. First, we introduce a Multi-Expert LoRA Ensemble mechanism that consolidates multiple category-specific LoRA models into a unified representation, achieving superior cross-category generalization while eliminating knowledge interference. Second, building on enhanced semantic understanding, we develop a Cross-View Hypergraph Geometric Enhancement approach that captures structural dependencies spanning multiple viewpoints simultaneously. These components work synergistically improved semantic understanding, enables more effective geometric reasoning, while hypergraph modeling ensures manufacturing-level consistency. Extensive experiments on a custom industrial dataset demonstrate superior semantic generalization and enhanced geometric fidelity compared to state-of-the-art approaches. Code is available at https://github.com/Junhaocai27/ForgeDreamer
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。