From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Task
Faculty of Exact and Natural Sciences, University of Buenos Aires(布宜诺斯艾利斯大学精确与自然科学学院);National Scientific and Technical Research Council (CONICET)(国家科学技术研究委员会(CONICET))
Understanding how large language models (LLMs) represent and reason about spatial information is crucial for building robust agentic systems that can navigate real and simulated environments. In this work, we investigate the influence of different text-based spatial representations on LLM performance and internal activations in a grid-world navigation task. By evaluating models of various sizes on a task that requires navigating toward a goal, we examine how the format used to encode spatial information impacts decision-making. Our experiments reveal that cartesian representations of space consistently yield higher success rates and path efficiency, with performance scaling markedly with model size. Moreover, probing LLaMA-3.1-8B revealed subsets of internal units, primarily located in intermediate layers, that robustly correlate with spatial features, such as the position of the agent in the grid or action correctness, regardless of how that information is represented, and are also activated by unrelated spatial reasoning tasks. This work advances our understanding of how LLMs process spatial information and provides valuable insights for developing more interpretable and robust agentic AI systems.
Perspective-Shifted Neuro-Symbolic World Models: A Framework for Socially-Aware Robot Navigation
Institute for Systems and Robotics, Instituto Superior Técnico, Universidade de Lisboa(系统机器人研究所,理工学院,里斯本大学);LAAS-CNRS, Artificial and Natural Intelligence Toulouse Institute (ANITI)(LAAS-CNRS,图卢兹人工智能研究所(ANITI))