This work describes a computer vision system that enables pervasive mapping and monitoring of human attention. The key contribution is that our methodology enables full 3D recovery of the gaze pointer, human view frustum and associated human centered measurements directly into an automatically computed 3D model in real-time. We apply RGB-D SLAM and descriptor matching methodologies for the 3D modeling, localization and fully automated annotation of ROIs (regions of interest) within the acquired 3D model. This innovative methodology will open new avenues for attention studies in real world environments, bringing new potential into automated processing for human factors technologies.
Resolving Ambiguity in Gaze-Facilitated Visual Assistant Interaction Paradigm
Key Laboratory of Pervasive Computing, Tsinghua University（清华大学普适计算重点实验室）；The University of New South Wales（新南威尔士大学）；SKLSDE Lab, Beihang University（北航SKLSDE实验室）
Boosting Gaze Object Prediction via Pixel-level Supervision from Vision Foundation Model
Xi’an University of Architecture and Technology（西安建筑科技大学）；School of Automation, Northwestern Polytechnical University（西北工业大学自动化学院）；School of Intelligence Science and Technology, Peking University（北京大学智能科学与技术学院）
TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Types
The Visual Experience Dataset: Over 200 Recorded Hours of Integrated Eye Movement, Odometry, and Egocentric Video
Barnard College, Columbia University（哥伦比亚大学巴纳德学院）；Bates College（贝茨学院）；North Dakota State University（北达科他州立大学）；University of Nevada, Reno（内华达大学里诺分校）；Magic Leap；Technical University of Munich（慕尼黑工业大学）；Unmanned Ground Systems（无人地面系统公司）；Smith-Kettlewell Eye Research Institute（史密斯-凯特威尔眼科研究所）
Multiview Multi-Person Human Mesh Recovery Under Large Scenes with Occlusions
Guangdong Provincial Key Laboratory of Visual Media and Multidimensional Intelligence, College of Computer Science and Software Engineering, Shenzhen University（广东省视觉媒体与多维智能重点实验室，深圳大学计算机科学与软件学院）；City University of Hong Kong（香港城市大学）
