We study the perception of color illusions by vision-language models. Color illusion, where a person's visual system perceives color differently from actual color, is well-studied in human vision. However, it remains underexplored whether vision-language models (VLMs), trained on large-scale human data, exhibit similar perceptual biases when confronted with such color illusions. We propose an automated framework for generating color illusion images, resulting in RCID (Realistic Color Illusion Dataset), a dataset of 19,000 realistic illusion images. Our experiments show that all studied VLMs exhibit perceptual biases similar human vision. Finally, we train a model to distinguish both human perception and actual pixel differences.
Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective
SKLCCSE, the School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院软件安全技术与工程北京市重点实验室);the School of Cyber Science and Technology, Sun Yat-sen University(中山大学网络空间科学与技术学院);Henan University of Science and Technology(河南科技大学);the School of Computing, National University of Singapore(新加坡国立大学计算学院);College of Computing & Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
Spatial Colour Mixing Illusions as a Perception Stress Test for Vision-Language Models
National University of Science and Technology POLITEHNICA Bucharest(波兰布加勒斯特技术大学);IDSIA, The Dalle Molle Institute for Artificial Intelligence(达摩信息技术研究所)
Beyond Shortcuts: Mitigating Visual Illusions in Frozen VLMs via Qualitative Reasoning
Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(人工智能研究院,合肥国家科学中心);Anhui Polytechnic University(安徽理工大学);Hefei University of Technology(合肥工业大学);Anhui University(安徽大学);IGS, Imperial College London(帝国理工学院伦敦分校)
UHR-Micro: Diagnosing and Mitigating the Resolution Illusion in Earth Observation VLMs
National Key Laboratory of Science and Technology on Space-Born Intelligent Information Processing(国家空间智能信息处理科技重点实验室);Beijing Institute of Technology(北京理工大学);School of Computer Science(计算机学院);Wuhan University(武汉大学);Zhongguancun Academy(中关村学院);State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing(测绘遥感信息工程国家重点实验室);Hong Kong Polytechnic University(香港理工大学)
College of Science and Engineering (CSE), Flinders University(弗林德斯大学科学与工程学院);Faculty of Mechatronics, Dept of Science and Engineering, Karaj Branch, Islamic Azad University (KIAU)(伊斯兰阿扎德大学卡拉季分校机电工程学院)
National Laboratory of Pattern Recognition, CASIA(中国科学院自动化研究所模式识别国家重点实验室);Center for Research on Intelligent Perception and Computing, CASIA(中国科学院自动化研究所智能感知与计算研究中心);University of Chinese Academy of Sciences(中国科学院大学)