arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.12231cs.CV

PUGS:基于高斯溅射的零样本物理理解

PUGS: Zero-shot Physical Understanding with Gaussian Splatting

School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));MGI Tech(华大科技);Chulalongkorn University(朱拉隆功大学);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院);Lightwheel AI(智驾科技)

Yinghao Shuai, Ran Yu, Yuantao Chen, Zijian Jiang, Xiaowei Song, Nan Wang, Jv Zheng, Jianzhu Ma, Meng Yang, Zhicheng Wang, Wenbo Ding, Hao Zhao

AI总结:

针对机器人在真实场景中难预测物体物理属性的问题,提出基于高斯溅射的零样本物理理解框架PUGS,通过重建与推理阶段的四项新技术,在ABO-500基准上取得最优结果,可助力现实抓取任务。

摘要:

当前机器人系统能够很好地理解物体的类别与位姿,但在真实场景中理解质量、摩擦力、硬度等物理属性仍然颇具挑战。我们提出了一种新方法,采用高斯溅射表示重建三维物体,并以零样本方式预测多种物理属性。在重建阶段,我们提出两项技术:用于提升形状质量的几何感知正则化损失函数,以及增强区域相似性的区域感知特征对比损失函数。在推理阶段则设计了另外两项新技术:基于特征的属性传播模块,以及适配高斯表示的体积积分模块。我们的框架名为基于高斯溅射的零样本物理理解,即PUGS。在ABO-500质量预测标准基准测试中,PUGS取得了全新的最优结果。我们开展了大量定量消融实验与定性可视化分析,以验证所设计模块的作用机制。研究表明,该方法能够助力解决具有挑战性的现实世界抓取任务。我们的代码、数据与模型可在https://github.com/EverNorif/PUGS获取。

英文摘要:

Current robotic systems can understand the categories and poses of objects well. But understanding physical properties like mass, friction, and hardness, in the wild, remains challenging. We propose a new method that reconstructs 3D objects using the Gaussian splatting representation and predicts various physical properties in a zero-shot manner. We propose two techniques during the reconstruction phase: a geometry-aware regularization loss function to improve the shape quality and a region-aware feature contrastive loss function to promote region affinity. Two other new techniques are designed during inference: a feature-based property propagation module and a volume integration module tailored for the Gaussian representation. Our framework is named as zero-shot physical understanding with Gaussian splatting, or PUGS. PUGS achieves new state-of-the-art results on the standard benchmark of ABO-500 mass prediction. We provide extensive quantitative ablations and qualitative visualization to demonstrate the mechanism of our designs. We show the proposed methodology can help address challenging real-world grasping tasks. Our codes, data, and models are available at https://github.com/EverNorif/PUGS

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑