EyeEcho:眼镜上的连续低功耗面部表情追踪
EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses
AI总结:
EyeEcho利用眼镜上的扬声器和麦克风发射并接收不可听声学信号,以低功耗实现连续面部表情追踪,仅需少量训练数据即可在多种现实场景中达到高精度,并可部署于商用智能手机。
摘要:
本文介绍了EyeEcho,一种最小侵扰的声学感知系统,旨在使眼镜能够持续监测面部表情。它利用安装在眼镜上的两对扬声器和麦克风,向面部发射编码的不可听声学信号,捕捉与面部表情相关的细微皮肤形变。反射信号通过定制的机器学习流水线进行处理,以估计完整的面部运动。EyeEcho以83.3 Hz的频率采样,功耗相对较低,为167 mW。我们涉及12名参与者的用户研究表明,仅需四分钟的训练数据,EyeEcho就能在不同的现实场景中实现高精度的追踪性能,包括坐着、行走以及重新佩戴设备之后。此外,一项涉及10名参与者的半自然场景研究进一步验证了EyeEcho在参与者从事各种日常活动时的自然场景中的性能。最后,我们展示了EyeEcho部署在商用现成(COTS)智能手机上的潜力,提供实时的面部表情追踪。
英文摘要:
In this paper, we introduce EyeEcho, a minimally-obtrusive acoustic sensing system designed to enable glasses to continuously monitor facial expressions. It utilizes two pairs of speakers and microphones mounted on glasses, to emit encoded inaudible acoustic signals directed towards the face, capturing subtle skin deformations associated with facial expressions. The reflected signals are processed through a customized machine-learning pipeline to estimate full facial movements. EyeEcho samples at 83.3 Hz with a relatively low power consumption of 167 mW. Our user study involving 12 participants demonstrates that, with just four minutes of training data, EyeEcho achieves highly accurate tracking performance across different real-world scenarios, including sitting, walking, and after remounting the devices. Additionally, a semi-in-the-wild study involving 10 participants further validates EyeEcho's performance in naturalistic scenarios while participants engage in various daily activities. Finally, we showcase EyeEcho's potential to be deployed on a commercial-off-the-shelf (COTS) smartphone, offering real-time facial expression tracking.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。