Previously, Barlow and Attneave hypothesised a link between biological vision and information maximisation. Following Shannon, information was defined using the probability of natural images. Several physiological and psychophysical phenomena have been derived from principles like info-max, efficient coding, or optimal denoising. However, it remains unclear how this link is expressed in mathematical terms from image probability. Classical derivations were subjected to strong assumptions on the probability models and on the behaviour of the sensors. Moreover, the direct evaluation of the hypothesis was limited by the inability of classical image models to deliver accurate estimates of the probability. Here, we directly evaluate image probabilities using a generative model for natural images, and analyse how probability-related factors can be combined to predict the sensitivity of state-of-the-art subjective image quality metrics, a proxy for human perception. We use information theory and regression analysis to find a simple model that when combining just two probability-related factors achieves 0.77 correlation with subjective metrics. This probability-based model is validated in two ways: through direct comparison with the opinion of real observers in a subjective quality experiment, and by reproducing basic trends of classical psychophysical facts such as the Contrast Sensitivity Function, the Weber-law, and contrast masking.
Learning GAN-based Foveated Reconstruction to Recover Perceptually Important Image Features
Università della Svizzera italiana(瑞士意大利语区大学);West Pomeranian University of Technology(西波美拉尼亚工业大学);University of Groningen(格罗宁根大学);Max Planck Institute for Informatics(马克斯·普朗克信息学研究所)
Nankai University(南开大学);Inception Institute of Artificial Intelligence(起源人工智能研究院);Xiamen University(厦门大学);Cardiff University(卡迪夫大学);Peng Cheng Lab(鹏城实验室)
PIGUIQA: A Physical Imaging Guided Perceptual Framework for Underwater Image Quality Assessment
Chongqing Research Institute of Harbin Institute of Technology(哈尔滨工业大学重庆研究所);Harbin Institute of Technology(哈尔滨工业大学);Faculty of Computing(计算机学院);School of Computer Science(计算机科学学院);University of Macau(澳门大学);Institute for Infocomm Research(信息与通信研究所以)
CSV: Image Quality Assessment Based on Color, Structure, and Visual System
Center for Signal and Information Processing(信号与信息处理中心);School of Electrical and Computer Engineering(电气与计算机工程学院);Georgia Institute of Technology(佐治亚理工学院)
Google, Inc.(谷歌公司);Center for Neural Science(神经科学中心);New York University(纽约大学);Image Processing Laboratory(图像处理实验室);Universitat de València(瓦伦西亚大学);Howard Hughes Medical Institute(霍华德·休斯医学研究所);Courant Institute of Mathematical Sciences(库朗数学科学研究所)
Perceptual Quality-based Model Training under Annotator Label Uncertainty
Georgia Institute of Technology(佐治亚理工学院);Center for Energy and Geo Processing (CeGP)(能源与地球处理中心);School of Electrical and Computer Engineering(电气与计算机工程学院)
Evaluating Vision-Language Models for Image Quality Assessment using Psychophysical Data
School of Engineering, University of Galway(Galway大学工程学院);State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University(浙江大学极端光信息获取国家重点实验室)
Assessing the ability of generative adversarial networks to learn canonical medical image statistics
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Center for Devices and Radiological Health, Food and Drug Administration(美国食品药品监督管理局设备与放射健康中心)
Perceptual Video Coding for Machines via Satisfied Machine Ratio Modeling
National Engineering Research Center of Visual Technology, School of Computer Science, Peking University(北京大学计算机学院视觉技术国家工程研究中心);University of Chinese Academy of Sciences(中国科学院大学);Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Peng Cheng Laboratory(鹏城实验室)
Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba
Imperial College London(帝国理工学院);Royal Brompton Hospital(皇家布朗普顿医院);College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区生物医学工程学院);Human Phenome Institute, Fudan University(复旦大学人类表型组研究院);Inselspital, University of Bern(伯尔尼大学因塞尔医院);Technical University of Munich(慕尼黑工业大学)