arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2607.08751cs.RO

DexVerse:用于多任务、多实体灵巧操作的模块化基准测试

DexVerse: A Modular Benchmark for Multi-Task, Multi-Embodiment Dexterous Manipulation

UNC-Chapel Hill(北卡罗来纳大学教堂山分校);The University of Hong Kong(香港大学);UC Berkeley(加州大学伯克利分校)
Yunchao Yao, Zhuxiu Xu, Tianqi Zhang, Zixian Liu, Sikai Li, Zhenyu Wei, Feng Chen, Dihong Huang, Kechang Wan, Chenyang Ma, Shuqi Zhao, Shenghua Gao, Masayoshi T… 展开作者

Yunchao Yao, Zhuxiu Xu, Tianqi Zhang, Zixian Liu, Sikai Li, Zhenyu Wei, Feng Chen, Dihong Huang, Kechang Wan, Chenyang Ma, Shuqi Zhao, Shenghua Gao, Masayoshi Tomizuka, Yi Ma, Mingyu Ding

AI总结:

DexVerse是用于多任务、多实体灵巧操作的模块化基准测试,含100个任务,支持多种机器人手臂和手,可扩展且提供视觉变化等。通过对多种方法的基准测试,揭示任务泛化和视觉运动鲁棒性挑战,为通用灵巧操作提供测试平台。

摘要:

构建通用灵巧操作策略需要超越孤立任务的基准测试,以系统评估跨多种交互模式、感官条件和机器人实体的策略。现有基准测试在任务和数据多样性、实体覆盖范围或可控视觉变化方面存在局限。我们提出了DexVerse,一个用于灵巧操作的大规模模块化基准测试。它包含100个任务,支持3种机器人手臂和6种灵巧手,可扩展新任务等。提供可配置视觉变化、VR远程操作界面和3180个演示。通过对代表性方法的基准测试,揭示了任务泛化和视觉运动鲁棒性的重大挑战,使其成为通用灵巧操作的有前景的测试平台。

英文摘要:

Building general-purpose dexterous manipulation policies requires benchmarks that go beyond isolated tasks to systematically evaluate policies across diverse interaction modes, sensory conditions, and robot embodiments. However, existing benchmarks remain limited in task and data diversity, embodiment coverage, or controllable visual variation, hindering studies of cross-task and cross-embodiment generalization. We present DexVerse, a large-scale and modular benchmark for dexterous manipulation. DexVerse includes 100 tasks spanning a broad range of manipulation skills, including object grasping and relocation, articulated-object interaction, functional tool use, bimanual coordination, non-prehensile control, contact-rich behaviors, multi-goal execution, and long-horizon multi-stage task completion. It supports 3 robot arms and 6 dexterous hands, and is extensible to new tasks, assets, and embodiments. To evaluate visuomotor generalization, DexVerse provides configurable visual variations in textures, background, lighting, and camera viewpoints. We further provide a VR-based teleoperation interface and 3,180 demonstrations with synchronized proprioceptive, RGB, depth, point-cloud, and state observations. We benchmark representative methods, including Diffusion Policy, DP3, OpenVLA, and $π_{0.5}$, across 19 tasks. Results reveal substantial challenges in task generalization and visuomotor robustness, establishing DexVerse as a promising testbed for general-purpose dexterous manipulation. Project page: https://ycyao216.github.io/DexVerse.site

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑