EgoThumb:用于自主抓取与握持辅助的视觉驱动额外 robotic 拇指
EgoThumb: A Vision-Driven Supernumerary Robotic Thumb for Autonomous Grasp and Holding Assistance
AI总结:
提出开源视觉驱动额外 robotic 拇指 EgoThumb,通过前臂布置驱动装置与视觉模仿学习策略,实现稳健自主抓取,泛化性强且硬件软件全开源。
摘要:
额外 robotic 手指可增强人类灵巧性,使单手完成通常需要双手协调的复杂“握持与操作”任务。然而现有设备常受限于笨重硬件,仅能与大型物体交互,且依赖缺乏环境上下文的明确手部动作触发。为解决这些挑战,我们提出 EgoThumb——一款完全开源的视觉驱动额外 robotic 拇指。EgoThumb 采用紧凑的双肌腱驱动手指,其驱动装置被重新布置在前臂,减少远端重量的同时实现精确的主动关节控制。该系统利用视觉模仿学习策略,将掌心朝向相机的自我中心图像直接映射为连续关节位置。通过从捕捉手部与目标物体的视觉线索中隐式解码人类意图,EgoThumb 实现了稳健的自主操作,并在不同用户与环境中具有强泛化性。所有硬件设计与软件实现均完全开源,详见此 https URL。
英文摘要:
Supernumerary robotic fingers augment human dexterity by enabling a single hand to perform complex "hold-and-manipulate" tasks that typically require bimanual coordination. However, existing devices are often hindered by bulky hardware that limits interaction to large objects and rely on explicit hand motion triggers that lack environmental context. To address these challenges, we present EgoThumb, a fully open-source, vision-driven supernumerary robotic thumb. EgoThumb features a compact, dual tendon-driven finger whose actuation is relocated to the forearm, reducing distal weight while enabling precise active joint control. The system utilizes a visual imitation learning policy that maps egocentric images from a palm-facing camera directly to continuous joint positions. By implicitly decoding human intent from visual cues capturing both the hand and the object of interest, EgoThumb achieves robust autonomous manipulation and strong generalization across diverse users and environments. All hardware designs and software implementations are fully open-sourced at https://ego-thumb.github.io.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。