MicroCam:利用智能手机显微镜相机进行情境感知的接触表面感知
MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing
AI总结:
MicroCam利用智能手机的IMU和显微镜相机感知接触表面,通过持续学习优化深度神经网络,实现高精度、鲁棒的情境感知应用。
摘要:
本研究的主要焦点是手机与其周围表面之间隐蔽而细微的日常接触交互。此类交互有望促进移动情境感知,涵盖诸如分发药物更新、智能切换模式(如静音模式)或启动命令(如关闭闹钟)等方面。我们介绍了MicroCam,一种基于接触的感知系统,该系统利用智能手机的IMU数据来检测手机放置的常规状态,并利用内置显微镜相机捕捉精细的表面细节。特别是,我们收集了一个自然数据集,以在实地获取真实的表面纹理用于训练和测试。此外,我们基于持续学习优化了算法中的深度神经网络组件,以准确区分物体类别(如桌子)和材料成分(如木材)。实验结果凸显了所提方法的卓越准确性、鲁棒性和泛化能力。最后,我们围绕原型进行了全面讨论,涵盖系统性能及潜在应用和场景等主题。
英文摘要:
The primary focus of this research is the discreet and subtle everyday contact interactions between mobile phones and their surrounding surfaces. Such interactions are anticipated to facilitate mobile context awareness, encompassing aspects such as dispensing medication updates, intelligently switching modes (e.g., silent mode), or initiating commands (e.g., deactivating an alarm). We introduce MicroCam, a contact-based sensing system that employs smartphone IMU data to detect the routine state of phone placement and utilizes a built-in microscope camera to capture intricate surface details. In particular, a natural dataset is collected to acquire authentic surface textures in situ for training and testing. Moreover, we optimize the deep neural network component of the algorithm, based on continual learning, to accurately discriminate between object categories (e.g., tables) and material constituents (e.g., wood). Experimental results highlight the superior accuracy, robustness and generalization of the proposed method. Lastly, we conducted a comprehensive discussion centered on our prototype, encompassing topics such as system performance and potential applications and scenarios.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。