Conceptual spaces represent entities in terms of their primitive semantic features. Such representations are highly valuable but they are notoriously difficult to learn, especially when it comes to modelling perceptual and subjective features. Distilling conceptual spaces from Large Language Models (LLMs) has recently emerged as a promising strategy, but existing work has been limited to probing pre-trained LLMs using relatively simple zero-shot strategies. We focus in particular on the task of ranking entities according to a given conceptual space dimension. Unfortunately, we cannot directly fine-tune LLMs on this task, because ground truth rankings for conceptual space dimensions are rare. We therefore use more readily available features as training data and analyse whether the ranking capabilities of the resulting models transfer to perceptual and subjective features. We find that this is indeed the case, to some extent, but having at least some perceptual and subjective features in the training data seems essential for achieving the best results.
Exploring the Implicit Semantic Ability of Multimodal Large Language Models: A Pilot Study on Entity Set Expansion
Shenzhen International Graduate School Tsinghua University(清华大学深圳国际研究生院);Peng Cheng Laboratory(鹏城实验室);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳));Seoul National University(首尔大学)
School of Mathematics, Northwest University(西北大学数学学院);Shanghai Institute for Mathematics and Interdisciplinary Sciences(上海数学与交叉科学研究院);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Cheriton School of Computer Science, University of Waterloo(滑铁卢大学切尔顿计算机科学学院)