arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.02288cs.CV

LabBuilder: 基于协议的可交互且安全的3D实验室布局生成

LabBuilder: Protocol-Grounded 3D Layout Generation for Interactable and Safe Laboratory

Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Wuhan University(武汉大学);Beihang University(北航);Peking University(北京大学);Tsinghua University(清华大学);Shanghai Jiaotong University(上海交通大学);The Chinese University of Hong Kong(香港中文大学)
Jianbao Cao, Zhangrui Zhao, Bohan Feng, Zixuan Hu, Rui Li, Haiyuan Wan, Chenxi Li, Jingyuan Li, Wenzhe Cai, Lei Bai, Wanli Ouyang, Lingyu Duan, Di Huang, Mintin… 展开作者

Jianbao Cao, Zhangrui Zhao, Bohan Feng, Zixuan Hu, Rui Li, Haiyuan Wan, Chenxi Li, Jingyuan Li, Wenzhe Cai, Lei Bai, Wanli Ouyang, Lingyu Duan, Di Huang, Minting Pan, Sha Zhang, Xinzhu Ma, Shixiang Tang, Dongzhan Zhou

AI总结:

提出LabBuilder系统,通过协议引导和约束感知优化,从文本描述生成安全且可执行的3D实验室布局,显著优于现有方法。

摘要:

自动化实验室有望加速科学发现,但其部署受限于设计安全且可执行环境的难度。虽然基于模拟器的设计提供了可扩展性,但现有的3D场景生成方法主要针对家庭环境,优化视觉合理性而忽略了科学实验所需的协议基础和布局级安全约束。我们提出了LabBuilder,一个端到端系统,从简洁的文本规范生成并验证3D实验室布局。它通过三个紧密耦合的组件运行:LabForge首先整理一个包含注释资产和化学知识的元数据集,将自然语言规范转化为结构化协议;基于这些协议,LabGen通过迭代的、约束感知的优化策略合成实验室布局;最后,LabTouchstone评估生成的布局作为统一基准。大量实验表明,LabBuilder显著优于现有最先进方法,生成的实验室环境在建模的几何、化学安全和导航约束下既真实又有效。

英文摘要:

Automated laboratories hold the promise of accelerating scientific discovery, yet their deployment is bottlenecked by the difficulty of designing safe and executable environments. While simulator-based design offers scalability, existing 3D scene generation methods are primarily tailored for household settings, optimizing for visual plausibility while neglecting the protocol grounding and layout-level safety constraints essential for scientific experimentation. We present LabBuilder, an end-to-end system that generates and verifies 3D laboratory layouts from concise textual specifications. It operates through three tightly coupled components: LabForge first curates a meta-dataset of annotated assets and chemical knowledge, translating natural language specifications into structured protocols; building on these protocols, LabGen synthesizes laboratory layouts via an iterative, constraint-aware optimization strategy; finally, LabTouchstone evaluates the resulting layouts as a unified benchmark. Extensive experiments demonstrate that LabBuilder significantly outperforms existing state-of-the-art methods, producing laboratory environments that are realistic and valid under modeled geometric, chemical-safety, and navigation constraints.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑