Follow My Eye: Using Gaze to Supervise Computer-Aided Diagnosis
- Shanghai Jiao Tong University（上海交通大学）
- University of Georgia（佐治亚大学）
- ShanghaiTech University（上海科技大学）
- Shanghai United Imaging Intelligence Co., Ltd.（上海联影智能医疗科技有限公司）
机构由 AI 辅助整理，请以论文原文为准。
英文摘要：
When deep neural network (DNN) was first introduced to the medical image analysis community, researchers were impressed by its performance. However, it is evident now that a large number of manually labeled data is often a must to train a properly functioning DNN. This demand for supervision data and labels is a major bottleneck in current medical image analysis, since collecting a large number of annotations from experienced experts can be time-consuming and expensive. In this paper, we demonstrate that the eye movement of radiologists reading medical images can be a new form of supervision to train the DNN-based computer-aided diagnosis (CAD) system. Particularly, we record the tracks of the radiologists' gaze when they are reading images. The gaze information is processed and then used to supervise the DNN's attention via an Attention Consistency module. To the best of our knowledge, the above pipeline is among the earliest efforts to leverage expert eye movement for deep-learning-based CAD. We have conducted extensive experiments on knee X-ray images for osteoarthritis assessment. The results show that our method can achieve considerable improvement in diagnosis performance, with the help of gaze supervision.
