Pretrained language models have been shown to encode relational information, such as the relations between entities or concepts in knowledge-bases -- (Paris, Capital, France). However, simple relations of this type can often be recovered heuristically and the extent to which models implicitly reflect topological structure that is grounded in world, such as perceptual structure, is unknown. To explore this question, we conduct a thorough case study on color. Namely, we employ a dataset of monolexemic color terms and color chips represented in CIELAB, a color space with a perceptually meaningful distance metric.
Using two methods of evaluating the structural alignment of colors in this space with text-derived color term representations, we find significant correspondence. Analyzing the differences in alignment across the color spectrum, we find that warmer colors are, on average, better aligned to the perceptual color space than cooler ones, suggesting an intriguing connection to findings from recent work on efficient communication in color naming. Further analysis suggests that differences in alignment are, in part, mediated by collocationality and differences in syntactic usage, posing questions as to the relationship between color perception and usage and context.
Perceptual Structure in the Absence of Grounding for LLMs: The Impact of Abstractedness and Subjectivity in Color Language
Rakuten Institute of Technology（乐天技术研究所）；Rakuten Group, Inc（乐天集团）；National Institute of Advanced Industrial Science and Technology（日本产业技术综合研究所）；Graduate School of Engineering, The University of Tokyo（东京大学大学院工学系研究科）
Wuhan University（武汉大学）；Insta360 Research（Insta360研究院）；Department of EECS, University of California, Merced（加州大学默塞德分校电子工程与计算机科学系）；Nanyang Technological University（南洋理工大学）；Institute of Automation of the Chinese Academy of Sciences（中国科学院自动化研究所）
VTPerception-R1: Enhancing Multimodal Reasoning via Explicit Visual and Textual Perceptual Grounding
Fudan University（复旦大学）；Shanghai AI Laboratory（上海人工智能实验室）；The University of Hong Kong（香港大学）；Shenzhen University（深圳大学）；University of Science and Technology of China（中国科学技术大学）
GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives
XPeng Inc.（小鹏汽车）；Peking University（北京大学）；The University of Hong Kong（香港大学）；University of California, Berkeley（加州大学伯克利分校）；Princeton University（普林斯顿大学）；National University of Singapore（新加坡国立大学）；Tsinghua University（清华大学）；HKUST (GZ)（香港科技大学（广州））
P$^2$-DPO: Grounding Hallucination in Perceptual Processing via Calibration Direct Preference Optimization
Guangdong Provincial Key Laboratory of Computational AI Models and Cognitive Intelligence, School of Computer Science & Engineering, South China University of Technology（广东省计算人工智能模型与认知智能重点实验室，计算机科学与工程学院，华南理工大学）；Pazhou Lab, Guangzhou, China（琶洲实验室，广州，中国）；Engineering Research Center of the Ministry of Education on Health Intelligent Perception and Paralleled Digital-Human, Guangzhou, China（教育部健康智能感知与并行数字人工程研究中心，广州，中国）
UniPercept: Towards Unified Perceptual-Level Image Understanding across Aesthetics, Quality, Structure, and Texture
University of Science and Technology of China（中国科学技术大学）；Shanghai AI Laboratory（上海人工智能实验室）；Peking University（北京大学）；Shanghai Jiao Tong University（上海交通大学）；Tsinghua University（清华大学）；Nanjing University（南京大学）；Sun Yat-sen University（中山大学）；Tele-AI Website（Tele-AI网站）
HiVG: Hierarchical Multimodal Fine-grained Modulation for Visual Grounding
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；Pengcheng Laboratory（鹏城实验室）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Harbin Institute of Technology (Shenzhen)（哈尔滨工业大学（深圳））
B2N3D: Progressive Learning from Binary to N-ary Relationships for 3D Object Grounding
School of Automation Science and Engineering, South China University of Technology（自动化科学与工程学院，华南理工大学）；ByteDance Seed（字节跳动种子）；Show Lab, National University of Singapore（Show Lab，新加坡国立大学）
From Alignment to Synthesis: Contrastive Volumetric Grounding for Text-to-CT Generation
Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Università Campus Bio-Medico di Roma（人工智能与计算机系统单位，工程系，罗马生物医学大学）；Department of Diagnostics and Intervention, Biomedical Engineering and Radiation Physics, Umeå University（诊断与干预部门，生物医学工程与放射物理学，乌梅拉大学）
EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models
X-Humanoid；Fudan University（复旦大学）；University of Science and Technology of China（中国科学技术大学）；University of Manchester（曼彻斯特大学）；Monash University（墨尔本大学）；Celonis AI；University of New South Wales（新南威尔士大学）
Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；University of Chinese Academy of Sciences（中国科学院大学）；CAS Center for Excellence in Brain Science and Intelligence Technology（中国科学院脑科学与智能技术卓越创新中心）；The Chinese University of Hong Kong（香港中文大学）
TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformer
University of Science and Technology of China（中国科学技术大学）；Institute of Artificial Intelligence, Hefei Comprehensive National Science Center（合肥综合性国家科学中心人工智能研究院）；Microsoft（微软）；JD Explore Academy（京东探索研究院）；Amazon（亚马逊）；University of Sydney（悉尼大学）；Shanghai Artificial Intelligent Laboratory（上海人工智能实验室）
RefBench-PRO: Perceptual and Reasoning Oriented Benchmark for Referring Expression Comprehension
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence（国家人机混合增强智能重点实验室）；National Engineering Research Center for Visual Information and Applications（国家视觉信息与应用工程技术研究中心）；Institute of Artificial Intelligence and Robotics（人工智能与机器人研究院）；Xi’an Jiaotong University（西安交通大学）；Institute of Artificial Intelligence (TeleAI)（人工智能研究院（TeleAI））；China Telecom（中国电信）；Shanghai Jiao Tong University（上海交通大学）；University of Science and Technology Beijing（北京科技大学）
