Evaluation of Visual Processing Should Be Human-Centered, Not Metric-Centered
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院);The University of Hong Kong(香港大学);INSAIT, Sofia University ``St. Kliment Ohridski''(INSAIT,索菲亚大学『圣克莱孟·奥赫里迪斯』);Shenzhen Loop Area Institute(深圳河套学院);The Chinese University of Hong Kong(香港中文大学);University of the Chinese Academy of Sciences(中国科学院大学);Fudan University(复旦大学);Shenzhen University of Advanced Technology(深圳先进技术大学);Shanghai AI Laboratory(上海人工智能实验室)
This position paper argues that the evaluation of modern visual processing systems should no longer be driven primarily by single-metric image quality assessment benchmarks, particularly in the era of generative and perception-oriented methods. Image restoration exemplifies this divergence: while objective IQA metrics enable reproducible, scalable evaluation, they have increasingly drifted apart from human perception and user preferences. We contend that this mismatch risks constraining innovation and misguiding research progress across visual processing tasks. Rather than rejecting metrics altogether, this paper calls for a rebalancing of evaluation paradigms, advocating a more human-centered, context-aware, and fine-grained approach to assessing the visual models' outcomes.
Visual Text Meets Low-level Vision: A Comprehensive Survey on Visual Text Processing
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
Unifying Image Processing as Visual Prompting Question Answering
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Macau(澳门大学);ARC Lab, Tencent PCG(腾讯平台与内容事业群ARC实验室)
HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligence
Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳));Shenzhen University(深圳大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Pengcheng Laboratory(鹏城实验室);Tongji University(同济大学);Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学);University of Trento(特伦托大学);Huawei(华为)
Human Gaze Boosts Object-Centered Representation Learning
Goethe University Frankfurt(法兰克福大学);The Hessian Center AI(黑森人工智能中心);Frankfurt Institute for Advanced Studies(法兰克福高等研究院);Xidian-FIAS international Joint Research Center(西安电子科技大学-法兰克福高等研究院国际联合研究中心)
Towards Escaping from Language Bias and OCR Error: Semantics-Centered Text Visual Question Answering
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);School of Information and Communication Engineering, Communication University of China(中国传媒大学信息与通信工程学院);Heilongjiang Network Space Research Center(黑龙江省网络空间研究中心)
Human-centered evaluation of data visualization understanding in vision-language models
Department of Psychology at Stanford University(斯坦福大学心理学系);Department of Linguistics at Stanford University(斯坦福大学语言学系);Department of Communication at University of California, Los Angeles(加州大学洛杉矶分校传播系)
Visual Text Processing: A Comprehensive Review and Unified Evaluation
VCIP & TMCC & DISSec, College of Computer Science, Nankai University(VCIP与TMCC与DISSec,计算机科学学院,南开大学);Department of Information Engineering and Computer Science, University of Trento(信息工程与计算机科学系,特伦托大学);Institute of Information Engineering, Chinese Academy of Sciences(信息工程研究所,中国科学院);School of Cyber Security, University of Chinese Academy of Sciences(网络安全学院,中国科学院大学);Department of Electrical and Computer Engineering, Northeastern University(电气与计算机工程系,东北大学);School of Software Engineering, Huazhong University of Science and Technology(软件工程学院,华中科技大学);School of Electronic and Information Engineering, South China University of Technology(电子与信息工程学院,华南理工大学)
RUArt: A Novel Text-Centered Solution for Text-Based Visual Question Answering
University of Science and Technology Beijing(北京科技大学);Tencent Technology (Shenzhen) Company Limited(腾讯科技(深圳)有限公司);USTB-EEasyTech Joint Laboratory of Artificial Intelligence(北京科技大学-EEasyTech人工智能联合实验室);School of Computer and Communication Engineering, University of Science and Technology Beijing(北京科技大学计算机与通信工程学院);Department of Computer Science and Technology, School of Computer and Communication Engineering, University of Science and Technology Beijing(北京科技大学计算机与通信工程学院计算机科学与技术系);Department of Industrial Design, School of Mechanical Engineering, University of Science and Technology Beijing(北京科技大学机械工程学院工业设计系);Institute of Artificial Intelligence, University of Science and Technology Beijing(北京科技大学人工智能研究院)
University of Montreal(蒙特利尔大学);Univ. Lille(里尔大学);CNRS(法国国家科学研究中心);Centrale Lille(里尔中央理工学院);Inria(法国国家信息与自动化研究所);UMR 9189 CRIStAL(法国国家科学研究中心计算机、信号与自动化研究所);Criteo;Google Brain(谷歌大脑);DeepMind;CIFAR(加拿大高等研究院)
A neuromorphic model of the insect visual system for natural image processing
School of Natural Sciences, Macquarie University(麦考瑞大学自然科学学院);QUT Centre for Robotics, Queensland University of Technology(昆士兰科技大学机器人中心);College of Medicine and Public Health, Flinders University(弗林德斯大学医学院与公共卫生学院)
Towards Interpreting Visual Information Processing in Vision-Language Models
Nanyang Technological University(南洋理工大学);University of Oxford(牛津大学);Tel Aviv University(特拉维夫大学);MILA(蒙特利尔人工智能研究院);ERA-Krueger AI Safety Lab(ERA-Krueger人工智能安全实验室)
Knowledge-based Visual Question Answer with Multimodal Processing, Retrieval and Filtering
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS);Alibaba Cloud Computing(阿里巴巴云计算)
Rapid Visual Categorization is not Guided by Early Salience-Based Selection
Department of Electrical Engineering and Computer Science, York University(约克大学电气工程与计算机科学系);York University(约克大学);Toronto(多伦多(注:这里是城市名,按要求不提取,但原文中的机构是York University的部门,需保留部门名))
Brain2Text Decoding Model Reveals the Neural Mechanisms of Visual Semantic Processing
Ministry of Education Center for Studies of Psychological Application(教育部心理应用研究中心);Center for Studies of Psychological Application(心理应用研究中心);Key Laboratory of Brain, Cognition and Education Sciences(脑认知与教育科学重点实验室);School of Psychology(心理学学院);Guangdong Key Laboratory of Mental Health and Cognitive Science(广东省心理健康与认知科学重点实验室)