arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.13173cs.CV

PureGaze: Purifying Gaze Feature for Generalizable Gaze Estimation

State Key Laboratory of VR Technology and Systems, School of CSE, Beihang University(北京航空航天大学计算机科学与工程学院虚拟现实技术与系统国家重点实验室);Peng Cheng Laboratory(鹏城实验室)

Yihua Cheng, Yiwei Bao, Feng Lu

英文摘要:

Gaze estimation methods learn eye gaze from facial features. However, among rich information in the facial image, real gaze-relevant features only correspond to subtle changes in eye region, while other gaze-irrelevant features like illumination, personal appearance and even facial expression may affect the learning in an unexpected way. This is a major reason why existing methods show significant performance degradation in cross-domain/dataset evaluation. In this paper, we tackle the cross-domain problem in gaze estimation. Different from common domain adaption methods, we propose a domain generalization method to improve the cross-domain performance without touching target samples. The domain generalization is realized by gaze feature purification. We eliminate gaze-irrelevant factors such as illumination and identity to improve the cross-domain performance. We design a plug-and-play self-adversarial framework for the gaze feature purification. The framework enhances not only our baseline but also existing gaze estimation methods directly and significantly. To the best of our knowledge, we are the first to propose domain generalization methods in gaze estimation. Our method achieves not only state-of-the-art performance among typical gaze estimation methods but also competitive results among domain adaption methods. The code is released in https://github.com/yihuacheng/PureGaze.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑