arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2604.09415cs.CVcs.AIcs.LGcs.RO
收藏

PhysInOne:一套视觉物理学习与推理系统

PhysInOne: Visual Physics Learning and Reasoning in One Suite

vLAR Group(vLAR 研究组);The Hong Kong Polytechnic University(香港理工大学);Syai Singapore(Syai 新加坡);Meta
Siyuan Zhou, Hejun Wang, Hu Cheng, Jinxi Li, Dongsheng Wang, Junwei Jiang, Yixiao Jin, Jiayue Huang, Shiwei Mao, Shangjia Liu, Yafei Yang, Hongkang Song, Shenxi… 展开作者

Siyuan Zhou, Hejun Wang, Hu Cheng, Jinxi Li, Dongsheng Wang, Junwei Jiang, Yixiao Jin, Jiayue Huang, Shiwei Mao, Shangjia Liu, Yafei Yang, Hongkang Song, Shenxing Wei, Zihui Zhang, Peng Huang, Shijie Liu, Zhengli Hao, Hao Li, Yitian Li, Wenqi Zhou, Zhihan Zhao, Zongqi He, Hongtao Wen, Shouwang Huang, Peng Yun, Bowen Cheng, Pok Kazaf Fu, Wai Kit Lai, Jiahao Chen, Kaiyuan Wang, Zhixuan Sun, Ziqi Li, Haochen Hu, Di Zhang, Chun Ho Yuen, Bing Wang, Zhihua Wang, Chuhang Zou, Bo Yang

AI总结:

PhysInOne通过大规模合成数据提升AI系统对物理现象的理解,包含200万视频和15万动态3D场景,涵盖71种基本物理现象,用于物理感知视频生成、未来帧预测、物理属性估计和运动转移等应用。

摘要:

我们提出了PhysInOne,一个大规模合成数据集,解决AI系统在物理基础训练数据稀缺的问题。与现有仅限数百或数千示例的数据集不同,PhysInOne提供200万视频,覆盖153,810个动态3D场景,包含71种基本物理现象。与以往工作不同,我们的场景包含多物体交互和复杂背景,具有全面的真实标注,包括3D几何、语义、动态运动、物理属性和文本描述。我们展示了PhysInOne在四个新兴应用中的有效性:物理感知视频生成、长期/短期未来帧预测、物理属性估计和运动转移。实验表明,微调基础模型在PhysInOne上显著增强了物理合理性,同时暴露了建模复杂物理动态和估计内在属性的关键差距。作为同类最大数据集,PhysInOne比先前工作大数个数量级,为推进物理基础世界模型在生成、模拟和具身AI中的发展建立了新基准。

英文摘要:

We present PhysInOne, a large-scale synthetic dataset addressing the critical scarcity of physically-grounded training data for AI systems. Unlike existing datasets limited to merely hundreds or thousands of examples, PhysInOne provides 2 million videos across 153,810 dynamic 3D scenes, covering 71 basic physical phenomena in mechanics, optics, fluid dynamics, and magnetism. Distinct from previous works, our scenes feature multiobject interactions against complex backgrounds, with comprehensive ground-truth annotations including 3D geometry, semantics, dynamic motion, physical properties, and text descriptions. We demonstrate PhysInOne's efficacy across four emerging applications: physics-aware video generation, long-/short-term future frame prediction, physical property estimation, and motion transfer. Experiments show that fine-tuning foundation models on PhysInOne significantly enhances physical plausibility, while also exposing critical gaps in modeling complex physical dynamics and estimating intrinsic properties. As the largest dataset of its kind, orders of magnitude beyond prior works, PhysInOne establishes a new benchmark for advancing physics-grounded world models in generation, simulation, and embodied AI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑