arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2611.06724cs.ROcs.AIcs.CVcs.LG
收藏

基础模型时代的灵巧机械手:硬件、数据、跨形态迁移、学习与评估的全栈综述

Dexterous Robotic Hands in the Foundation-Model Era: A Full-Stack Survey of Hardware, Data, Cross-Embodiment Transfer, Learning, and Evaluation

Xi’an Jiaotong University(西安交通大学)

Ji Pei

AI总结:

本综述梳理2024-2026年灵巧机械手相关研究,划分五个层级,明确人类数据价值、形态约束等结论,提出十一个开放问题及可衡量全栈进展的方案。

摘要:

灵巧机械手正日益与大规模人类数据及基础模型相结合,但硬件、表征学习与评估领域的进展常被单独评估。本综述涵盖2024年1月至2026年11月初的相关工作,同时纳入早期研究以梳理技术谱系。我们将文献划分为五个相互关联的层级:硬件、数据采集与整理、跨形态迁移、学习与基础模型、评估与应用。人类手-物体理解与触觉感知构成两个贯穿各层级的视角。系统级架构、对比表格及五个案例分析串联起各层级的设计选择。我们区分了研究内实验对比与异构语料统计、厂商规格及企业报告结果。得出三项结论:第一,人类数据的价值取决于运动学、视觉与接触对齐,而非仅记录量;第二,共享动作表征与基础策略无法消除形态特定的力、延迟及接触约束;第三,任务完成不足以确立物理正确性或部署就绪性。目前,形态差异较大的机械手之间接触丰富技能的零样本迁移、长期可靠性及跨传感器触觉泛化的证据仍有限。我们识别出十一个开放问题,并提出报告接口与受控对比,可使全栈进展更具可衡量性。本综述为结构化叙事综合,而非性能汇总排名或详尽系统综述。

英文摘要:

Dexterous robotic hands are increasingly coupled to large-scale human data and foundation models, yet progress in hardware, representation learning and evaluation is often assessed separately. This survey reviews work from January 2024 to early November 2026, with earlier studies included to establish technical lineages. We organize the literature into five interdependent layers: hardware; data collection and curation; cross-embodiment transfer; learning and foundation models; and evaluation and applications. Human hand-object understanding and tactile sensing provide two cross-cutting perspectives. A system-level architecture, comparative tables and five case analyses connect design choices across these layers. We distinguish within-study experimental comparisons from heterogeneous corpus statistics, vendor specifications and company-reported results. Three conclusions emerge. First, the value of human data depends on kinematic, visual and contact alignment, not recording volume alone. Second, shared action representations and foundation policies do not remove embodiment-specific constraints on force, latency and contact. Third, task completion is insufficient to establish physical correctness or deployment readiness. Evidence remains limited for zero-shot transfer of contact-rich skills between morphologically different hands, long-duration reliability, and cross-sensor tactile generalization. We identify eleven open problems and propose reporting interfaces and controlled comparisons that can make full-stack progress more measurable. The review is a structured narrative synthesis rather than a pooled performance ranking or an exhaustive systematic review.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑