Characterizing universal object representations across vision models
Vision and Computational Cognition Group（视觉与计算认知组）；Max Planck Institute（马克斯·普朗克研究所）；Justus-Liebig-University Giessen（吉森约瑟夫·李贝大学）；Machine Learning Core（机器学习核心）；Department of Cognitive Science（认知科学系）；National Institute of Mental Health（国家心理健康研究所）；Johns Hopkins University（约翰霍普金斯大学）
Florian P. Mahner, Johannes Roth, Ka Chun Lam, Michael F. Bonner, Francisco Pereira, Martin N. Hebart
Deep neural networks trained with different architectures, objectives, and datasets have been reported to converge on similar visual representations. However, what remains unknown is which visual properties models actually converge on and which factors may underlie this convergence. To address this, we decompose the object similarity structure of 162 diverse vision models into a small set of non-negative dimensions. To determine universal versus model-specific dimensions, we then estimate how often each dimension reappears across models. In contrast to model-specific dimensions, universal dimensions are more interpretable and more strongly driven by conceptual image properties, indicating the relevance of interpretability and semantic content as implicit factors driving universality across models. Differences in architecture, objective function, training data, model size, and model performance do not explain the emergence of universal dimensions. However, models with more universal dimensions also better predict macaque IT activity and human similarity judgments, suggesting that universality reflects representations relevant to biological vision. These findings have important implications for understanding the emergent representations underlying deep neural network models and their alignment with biological vision.
CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countries
University of Macau（澳门大学）；Georgia Institute of Technology（佐治亚理工学院）；Microsoft Research（微软研究院）；Squirrel AI（松鼠AI）；Lehigh University（理海大学）；William & Mary（威廉玛丽学院）
Toward Universal and Transferable Jailbreak Attacks on Vision-Language Models
School of Computing and Information Systems, The University of Melbourne, Australia（墨尔本大学计算机与信息系）；School of Computing and Information Systems, Singapore Management University, Singapore（新加坡管理大学计算机与信息系）；School of Information Technology, Deakin University, Australia（德肯大学信息科技系）；Institute of Trustworthy Embodied AI, Fudan University, China（复旦大学可信具身人工智能研究所）
Consistent Attack: Universal Adversarial Perturbation on Embodied Vision Navigation
Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua-Bosch Joint Center for Machine Learning, Institute for Artificial Intelligence, Tsinghua University, Beijing 100084, China（计算机科学与技术系，北京信息科学国家研究中心，清华-博世联合机器学习中心，人工智能研究院，清华大学，北京）
Hierarchical Refinement of Universal Multimodal Attacks on Vision-Language Models
School of Electrical Engineering and Computer Science, the University of Queensland（电气工程与计算机科学学院，昆士兰大学）；Department of Computer Science, City University of Hong Kong（计算机科学系，香港城市大学）
Calibration-Free Surface Normals Estimation in Vision-Based Tactile Sensing using Universal Photometric Stereo
TU Dresden（德累斯顿工业大学）；TUD Dresden University of Technology（德累斯顿工业大学）；Centre for Tactile Internet with Human-in-the-Loop (CeTI)（人在环触觉互联网中心（CeTI））；DKFZ（德国癌症研究中心）；University Hospital Carl Gustav Carus（卡尔·古斯塔夫·卡鲁斯大学医院）；Helmholtz-Zentrum Dresden-Rossendorf (HZDR)（德累斯顿-罗森多夫亥姆霍兹中心（HZDR））
FreqDINO++: A Frequency-Guided Multi-Task Routing Vision Foundation Model for Universal Ultrasound Analysis
University of Nottingham Ningbo China（宁波诺丁汉大学）；University of Nottingham（诺丁汉大学）；University of Lincoln（林肯大学）；Jinan University（暨南大学）；The Hong Kong Polytechnic University（香港理工大学）
Unifying Vision, Text, and Layout for Universal Document Processing
University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校）；Microsoft Azure Cognitive Services Research（微软Azure认知服务研究院）；Microsoft Azure Visual Document Intelligence（微软Azure视觉文档智能部门）
GiT: Towards Generalist Vision Transformer through Universal Language Interface
Peking University（北京大学）；Max Planck Institute for Informatics（马克斯·普朗克信息学研究所）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；ETH Zurich（苏黎世联邦理工学院）
Universal Pose Pretraining for Generalizable Vision-Language-Action Policies
Tencent Robotics X（腾讯机器人X）；Futian Laboratory（福田实验室）；The Hong Kong University of Science and Technology（香港科学与技术大学）；Fudan University（复旦大学）；Shanghai Innovation Institute（上海创新研究院）
When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Models
ROSE Lab, Interdisciplinary Graduate Programme, Nanyang Technological University（罗思实验室，跨学科研究生项目，南洋理工大学）；ROSE Lab, School of Electrical and Electronic Engineering, Nanyang Technological University（罗思实验室，电子与电气工程学院，南洋理工大学）；CCDS, Nanyang Technological University（CCDS，南洋理工大学）；DSO National Laboratories（国防科学局实验室）
Universal Camouflage Attack on Vision-Language Models for Autonomous Driving
School of Cyber Science and Technology, SUN YAT-SEN UNIVERSITY（中山大学计算机科学与技术学院）；School of Computing, National University of Singapore（新加坡国立大学计算机学院）；Key Laboratory of Education Informatization for Nationalities, Yunnan Normal University（云南师范大学民族教育信息化重点实验室）；SCSE, Beihang University（北航软件学院）
X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models
Shanghai Jiao Tong University（上海交通大学）；Shanghai AI Laboratory（上海人工智能实验室）；Tsinghua University（清华大学）；The Chinese University of Hong Kong（香港中文大学）；CPII under InnoHK（创新香港科技促进会）；MThreads AI
mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoning
Shenyang Institute of Computing Technology, Chinese Academy of Sciences（中国科学院沈阳计算技术研究所）；Beijing Wenge Technology Co., Ltd（北京文格科技有限公司）；University of Chinese Academy of Sciences（中国科学院大学）
EchoVLM: Dynamic Mixture-of-Experts Vision-Language Model for Universal Ultrasound Intelligence
School of iOPEN, Northwestern Polytechnical University（iOPEN学院，西北工业大学）；The First Affiliated Hospital of Sun Yat-Sen University（中山大学附属第一医院）；College of Mechanical Engineering, Tongji University（同济大学机械工程学院）
PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptation
Institute of Data Science, National Cheng Kung University（成功大学数据科学研究所）；Graduate Institute of Communication Engineering, National Taiwan University（台湾大学通讯工程学系）；NVIDIA（英伟达公司）
Thermal Topology Collapse: Universal Physical Patch Attacks on Infrared Vision Systems
China University of Petroleum-Beijing at Karamay（中国石油大学（北京）克拉玛依校区）；University of Electronic Science and Technology of China（电子科技大学）；College of Intelligence and Computing, Tianjin University（天津大学智能与计算学部）；School of Software, Shandong University（山东大学软件学院）；Shanghai Jiaotong University（上海交通大学）
UCDR-Adapter: Exploring Adaptation of Pre-Trained Vision-Language Models for Universal Cross-Domain Retrieval
Zhejiang University（浙江大学）；Carnegie Mellon University（卡内基梅隆大学）；University of Washington（华盛顿大学）；Dalian University of Technology（大连理工大学）；DAMO Academy, Alibaba Group（阿里巴巴达摩院）；Microsoft Research（微软研究院）
Shared representations in brains and models reveal a two-route cortical organization during scene perception
Department of Cognition, Development and Education Psychology, Faculty of Psychology, University of Barcelona（认知、发展与教育心理学系，心理学学院，巴塞罗那大学）；Institute of Neurosciences, University of Barcelona（神经科学研究所，巴塞罗那大学）；Bellvitge Institute for Biomedical Research（Bellvitge生物医学研究 institute）
Universal computational thermal imaging overcoming the ghosting effect
Department of Electronic and Information Engineering, School of Engineering and Research Center for Industries of the Future, Westlake University（西湖大学工学院电子信息工程系与未来产业研究中心）；State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University（武汉大学测绘遥感信息工程国家重点实验室）；Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences（中国科学院长春光学精密机械与物理研究所）；Department of Physics, School of Science, Westlake University（西湖大学理学院物理系）；Institute of Natural Sciences, Westlake Institute for Advanced Study（西湖高等研究院自然科学研究所）
