arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.22294cs.CV
收藏

一种用于大规模3D检索和受控4D生成的三级对齐框架

A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generation

Philip Xu

AI总结:

Uni4D通过三级对齐框架实现大规模3D检索与可控4D生成,提升多模态动态理解与应用

摘要:

我们介绍了Uni4D,一种基于结构化三级对齐的统一框架,用于大规模开放词汇3D检索和受控4D生成,涉及文本、3D模型和图像模态。基于Align3D 130数据集,Uni4D采用3D文本多头注意力和搜索模型,通过改进的语义对齐优化文本到3D检索。该框架进一步通过三个组件加强跨模态对齐:精确的文本到3D检索、多视角3D到图像对齐以及图像到文本对齐,以生成时间一致的4D资产。实验结果表明,Uni4D实现了高质量的3D检索和可控的4D生成,推动了动态多模态理解和实际应用。

英文摘要:

We introduce Uni4D, a unified framework for large scale open vocabulary 3D retrieval and controlled 4D generation based on structured three level alignment across text, 3D models, and image modalities. Built upon the Align3D 130 dataset, Uni4D employs a 3D text multi head attention and search model to optimize text to 3D retrieval through improved semantic alignment. The framework further strengthens cross modal alignment through three components: precise text to 3D retrieval, multi view 3D to image alignment, and image to text alignment for generating temporally consistent 4D assets. Experimental results demonstrate that Uni4D achieves high quality 3D retrieval and controllable 4D generation, advancing dynamic multimodal understanding and practical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑