arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.08217cs.HC
收藏

WristSonic:使用主动声学感知在智能手表上实现细粒度的手脸交互

WristSonic: Enabling Fine-grained Hand-Face Interactions on Smartwatches Using Active Acoustic Sensing

Saif Mahmud, Kian Mahmoodi, Chi-Jung Lee, Francois Guimbretiere, Cheng Zhang

AI总结:

提出WristSonic腕戴式主动声学感知系统,利用扬声器和麦克风捕捉超声波反射,结合Transformer网络,在低功耗且注重隐私的条件下实现了21种手脸交互动作的细粒度检测,两项用户研究宏观F1分数达93.08%和82.65%。

摘要:

手脸交互在许多日常任务中起着关键作用,能够深入了解用户的习惯、行为、意图和表情。然而,现有的可穿戴感知系统由于依赖多种传感器或对隐私敏感的基于视觉的方法,在日常环境中追踪这些交互时常常面临困难。为了解决这些挑战,我们提出了WristSonic,一种腕戴式主动声学感知系统,该系统利用扬声器和麦克风捕捉来自手部、手臂和面部动作的超声波反射,从而以最小的干扰实现细粒度的手脸交互检测。通过发送和分析超声波,WristSonic利用基于Transformer的神经网络架构区分各种手势,例如轻拍太阳穴、刷牙和点头。该方法使用单个低功耗、注重隐私的可穿戴设备,实现了对21种不同动作的稳健识别。通过在受控和半自然环境中对15名参与者进行的两项用户研究,WristSonic展示了高效性,分别取得了93.08%和82.65%的宏观F1分数。

英文摘要:

Hand-face interactions play a key role in many everyday tasks, providing insights into user habits, behaviors, intentions, and expressions. However, existing wearable sensing systems often struggle to track these interactions in daily settings due to their reliance on multiple sensors or privacy-sensitive, vision-based approaches. To address these challenges, we propose WristSonic, a wrist-worn active acoustic sensing system that uses speakers and microphones to capture ultrasonic reflections from hand, arm, and face movements, enabling fine-grained detection of hand-face interactions with minimal intrusion. By transmitting and analyzing ultrasonic waves, WristSonic distinguishes a wide range of gestures, such as tapping the temple, brushing teeth, and nodding, using a Transformer-based neural network architecture. This approach achieves robust recognition of 21 distinct actions with a single, low-power, privacy-conscious wearable. Through two user studies with 15 participants in controlled and semi-in-the-wild settings, WristSonic demonstrates high efficacy, achieving macro F1-scores of 93.08% and 82.65%, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑