2606.08828
2026-06-09
cs.RO
新提交
Video2Sim2Real: Full-Stack Autonomous Dexterous Skill Acquisition from a Single Human Video
Video2Sim2Real:从单个人类视频实现全栈自主灵巧技能获取
Yunhai Han, Jianuo Qiu, Linhao Bai, Ziyu Xiao, Zihang Zeng, Yangcen Liu, Zhaodong Yang, Shalin Jain, Wenrui Ma, Jiaqi Fu, Yuqian Zheng, Manisha Natarajan, Muhammad Zubair Irshad, Kenneth Shaw, Matthew Gombolay, Zsolt Kira, Harish Ravichandar
发表机构
*
Georgia Institute of Technology(佐治亚理工学院)
;
University of Pennsylvania(宾夕法尼亚大学)
;
Toyota Research Institute(丰田研究所)
;
Carnegie Mellon University(卡内基梅隆大学)
AI总结
提出Video2Sim2Real框架,从单个人类操作视频中重建数字孪生并提取运动先验,通过物体关键帧优化机器人配置,结合残差强化学习与碰撞感知规划,实现从仿真到真实世界的灵巧技能迁移。