arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2608.11871cs.HC

ATOM:面向与物体无关的有形交互的几何感知微手势

ATOM: Geometry-Aware Microgesture towards Object-Agnostic Tangible Interaction

Yinqiao Wang, Hao Xu, Qixuan Liu, Shengdong Zhao, Pheng-Ann Heng, Chi-Wing Fu

首次发表
浏览论文内容

中文总结 AI 辅助

本文提出ATOM框架,结合指尖感知检测流程与可用性优先级方法,开发AR系统将日常物体转为有形交互界面,在烹饪物体切换实验及10种物体研究中表现优于基线,验证了其通用性与交互潜力。

中文摘要 AI 辅助

本文提出了ATOM,一个支持与物体无关的有形微手势交互的集成框架。我们的目标是支持在不同日常物体上进行微手势交互,该框架能自动利用每个物体的几何可供性。我们构建了一种指尖感知的检测流程,利用生成式2D和3D模型进行几何增强与优化。随后,我们引入了一种基于可用性的方法,根据检测到的元素对交互的人体工程学适配度进行优先级排序。在此基础上,我们进一步开发了一套AR系统,将日常手持物体转化为支持0D、1D和2D微手势交互的有形用户界面。在不同形状和尺寸的日常烹饪物体间切换时,ATOM在任务完成度、可用性(SUS)和工作量(NASA-TLX)方面均优于消融基线。针对10种物体的进一步研究表明,ATOM在物体和抓握方式上具有通用性,凸显了其在现实世界AR场景中实现流畅、与物体无关的有形交互的潜力。

英文摘要

This paper presents ATOM, an integrated framework towards agnostic and tangible object interactions with microgestures. Our goal is to support microgesture interactions across different everyday objects, with the capability to automatically leverage the geometric affordance of each object. We formulate a fingertip-aware detection pipeline to leverage generative 2D and 3D models for geometry enhancement and refinement. We then introduce a usability-based method to prioritize the detected elements based on their ergonomic suitability for interactions. Building on this foundation, we further develop an AR system to transform everyday handheld objects into tangible user interfaces with 0D, 1D, and 2D microgesture interactions. Across transitions among everyday cooking objects of varying shapes and sizes, ATOM outperformed ablation baselines in task completion, usability (SUS), and workload (NASA-TLX). A further study with 10 objects demonstrates ATOM's generalizability across objects and grasps, highlighting its potential towards fluid, object-agnostic tangible interaction in real-world AR scenarios.

补充信息

↑