arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

PalmSpace:通过统一触摸建模实现多功能手掌交互空间

PalmSpace: Towards a Versatile On-Palm Interaction Space through Unified Touch Modeling

Chentao Li, Mingze Gao, Runze Sun, Zhaoguo Wang, Jianjiang Feng, Jie Zhou

arXiv 2610.10370首次发表:更新:

发表机构

Tsinghua University; Academy of Arts & Design, Tsinghua University; BNRist(清华大学; 清华大学美术学院; 北京信息科学与技术国家研究中心)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

PalmSpace提出腕戴式红外系统,通过统一触摸建模实现手掌上的模式感知绝对输入,无需校准,达到6.7毫米定位误差和98.9%接触检测准确率,支持精确指向、拖拽及多指控制。

AI 中文摘要

随着智能眼镜和轻量级MR设备变得越来越实用,输入仍然是一个关键挑战。裸露的手掌是一个始终可用、具有触觉和本体感觉可访问的表面,但它既没有明确的坐标系,也没有嵌入式的触摸感应。先前的掌上系统通常暴露孤立的触摸事件、离散区域、连续轨迹或特定任务的姿态,限制了手掌通过通用输入表示来支持精确选择和姿态操作的能力。我们提出了PalmSpace,一种腕戴式红外系统,无需用户感知校准即可在裸露手掌上提供模式感知、身体参考的绝对输入。在交互层面,PalmSpace联合表示接触发生、交互模式和手掌参考的绝对位置;在模型层面,它通过共享的实时表示学习这些耦合输出。在17名参与者的留一参与者评估中,PalmSpace实现了6.7毫米的平均定位误差、98.9%的接触检测准确率和96.7%的四类交互状态识别F1分数。用户研究进一步展示了绝对指向和拖拽、无需注视的数字输入以及包括滚动和基于捏合的地图操作在内的代表性多指控制。这些结果表明,形态可变的手掌可以作为一个可迁移的、模式感知的交互表面。

英文摘要

As smart glasses and lightweight MR devices become increasingly practical, input remains a key challenge. The bare palm is an always-available, tactile, and proprioceptively accessible surface, but it has neither an explicit coordinate system nor embedded touch sensing. Prior on-palm systems typically expose isolated touch events, discrete regions, continuous trajectories, or task-specific gestures, limiting the palm's ability to support precise selection and gesture manipulation through a common input representation. We present PalmSpace, a wrist-worn infrared system that exposes mode-aware, body-referenced absolute input on the bare palm without per-user sensing calibration. At the interaction level, PalmSpace jointly represents contact occurrence, interaction mode, and palm-referenced absolute location; at the model level, it learns these coupled outputs through a shared real-time representation. In leave-one-participant-out evaluation with 17 participants, PalmSpace achieved 6.7 mm mean localization error, 98.9% contact detection accuracy, and 96.7% F1 for four-class interaction-state recognition. User studies further demonstrated absolute pointing and dragging, eyes-free digit input, and representative multi-finger controls including scrolling and pinch-based map manipulation. These results show that a morphologically variable bare palm can function as a transferable, mode-aware interaction surface.

CommentsPreprint. Initial version

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑