Can we infer intentions from a person's actions? As an example problem, here we consider how to decipher what a person is searching for by decoding their eye movement behavior. We conducted two psychophysics experiments where we monitored eye movements while subjects searched for a target object. We defined the fixations falling on \textit{non-target} objects as "error fixations". Using those error fixations, we developed a model (InferNet) to infer what the target was. InferNet uses a pre-trained convolutional neural network to extract features from the error fixations and computes a similarity map between the error fixations and all locations across the search image. The model consolidates the similarity maps across layers and integrates these maps across all error fixations. InferNet successfully identifies the subject's goal and outperforms competitive null models, even without any object-specific training on the inference task.
Few-Shot Generative Model Adaption via Identity Injection and Preservation
School of Cyberspace Security, Hangzhou Dianzi University(杭州电子科技大学网络安全学院);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件工程学院);Lishui University and Lishui Institute of Hangzhou Dianzi University(丽水大学和杭州电子科技大学丽水研究所);School of Faculty of Applied Science, Macao Polytechnic University(澳门理工学院应用科学学院);School of Communication Engineering, Hangzhou Dianzi University(杭州电子科技大学通信工程学院)
OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Rendering
The Hong Kong Polytechnic University(香港理工大学);Center for Artificial Intelligence and Robotics, HKISI CAS(中国科学院香港创新研究院人工智能与机器人创新中心);State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA(中国科学院自动化研究所多模态人工智能系统全国重点实验室);OPPO Research(OPPO研究院)
Finding any Waldo: zero-shot invariant and efficient visual search
Children’s Hospital, Harvard Medical School(哈佛大学医学院儿童医院);National University of Singapore(新加坡国立大学);Agency for Science, Technology and Research (A*STAR)(科技研究局(A*STAR));University of Minnesota Twin Cities(明尼苏达大学双城分校)
Rethinking of Pedestrian Attribute Recognition: A Reliable Evaluation under Zero-Shot Pedestrian Identity Setting
University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);CAS Center for Excellence in Brain Science and Intelligence Technology(中国科学院脑科学与智能技术卓越创新中心)
ID-Animator: Zero-Shot Identity-Preserving Human Video Generation
University of Science and Technology of China(中国科学技术大学);Hefei Institute of Physical Science, Chinese Academy of Sciences(中国科学院合肥物质科学研究院);LightSpeed Studios, Tencent(腾讯天美工作室)
OPT: One-shot Pose-Controllable Talking Head Generation
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China 2 School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China(1 中国科学院信息工程研究所,北京,中国 2 中国科学院大学网络空间安全学院,北京,中国)
VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual intervention
Hong Kong University of Science and Technology(香港科技大学);Peking University(北京大学);University of Hong Kong(香港大学);NUS(南洋理工大学);University of Central Florida(佛罗里达大学);Everlyn AI
Diff-PC: Identity-preserving and 3D-aware Controllable Diffusion for Zero-shot Portrait Customization
School of Electronic Science and Engineering, Nanjing University(南京大学电子科学与工程学院);School of Business, Hohai University(河海大学商学院);School of Artificial Intelligence, Nanjing University of Information Science and Technology(南京信息工程大学人工智能学院)
CusEnhancer: A Zero-Shot Scene and Controllability Enhancement Method for Photo Customization via ResInversion
College of Computer Science and Technology, East China University of Science and Technology(计算机科学与技术学院,东华大学);Carnegie Mellon University(卡内基梅隆大学);Microsoft(微软公司)
Learning Disentangled Representation for One-shot Progressive Face Swapping
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);University of Macau(澳门大学);University of California, Merced(加州大学默塞德分校);Yonsei University(延世大学)
Dual Variational Generation for Low-Shot Heterogeneous Face Recognition
NLPR & CRIPAC, CASIA(中国科学院自动化研究所 国家模式识别实验室与模式识别国家重点实验室与智能感知与计算研究中心);University of Chinese Academy of Sciences(中国科学院大学);Center for Excellence in Brain Science and Intelligence Technology, CAS(中国科学院脑科学与智能技术卓越创新中心)
I Seek You in Videos: Identity-Conditioned Queries for Person-Centric Video Reasoning
Beijing Jiaotong University(北京交通大学);HUJING Digital Media & Entertainment Group(汇晶数字媒体与娱乐集团);MAIS Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS)
Enhancing Visual Representation for Text-based Person Searching
Metrological Verification and Testing Institute of Jiaxing(嘉兴市计量检定测试所);School of Artificial Intelligence, Zhejiang Sci-Tech University(浙江理工大学人工智能学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);College of Information Science and Engineering, Jiaxing University(嘉兴学院信息科学与工程学院)
StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamics
Independent Researcher(独立研究员);Australia National University(澳大利亚国立大学);Central South University(中南大学);University of New South Wales(新南威尔士大学);Vertex Lab(Vertex实验室);National University of Singapore(新加坡国立大学);University of Technology Sydney(悉尼科技大学)