Embodied-AI agents must reason about how objects move and interact in 3-D space over time, yet existing smaller frontier Large Language Models (LLMs) still mis-handle fine-grained spatial relations, metric distances, and temporal orderings. We introduce the general framework Formally Explainable Spatio-Temporal Scenes (FESTS) that injects verifiable spatio-temporal supervision into an LLM by compiling natural-language queries into Spatial Regular Expression (SpRE) -- a language combining regular expression syntax with S4u spatial logic and extended here with universal and existential quantification. The pipeline matches each SpRE against any structured video log and exports aligned (query, frames, match, explanation) tuples, enabling unlimited training data without manual labels. Training a 3-billion-parameter model on 27k such tuples boosts frame-level F1 from 48.5% to 87.5%, matching GPT-4.1 on complex spatio-temporal reasoning while remaining two orders of magnitude smaller, and, hence, enabling spatio-temporal intelligence for Video LLM.
Clutter-Robust Vision-Language-Action Models through Object-Centric and Geometry Grounding
University of Arkansas(阿拉巴马大学);National University of Singapore(新加坡国立大学);TU Wien(维也纳技术大学);Max Planck Research School for Intelligent Systems(智能系统马克斯·普朗克研究学校);University of Stuttgart(斯图加特大学);University of Liverpool(利物浦大学)
ST-Booster: An Iterative SpatioTemporal Perception Booster for Vision-and-Language Navigation in Continuous Environments
Robotics and Control Laboratory, the School of Advanced Manufacturing and Robotics, and the State Key Laboratory of Turbulence and Complex Systems, Peking University(机器人与控制实验室、先进制造与机器人学院、湍流与复杂系统国家重点实验室,北京大学);Defense Innovation Institute, Academy of Military Sciences(国防创新研究院,军事科学院);Tianjin Artificial Intelligence Innovation Center(天津人工智能创新中心);Harbin Institute of Technology(哈尔滨工业大学)
Open-Vocabulary Spatio-Temporal Scene Graph for Robot Perception and Teleoperation Planning
HI-Robot Lab, School of Automation Science and Engineering, South China University of Technology(华南理工大学自动化科学与工程学院);Institute of AI Industries, Chinese Academy of Science(中国科学院人工智能产业研究所);School of Computer Science, Central China Normal University(中央财经大学计算机科学学院);School of Computer Science and Informatics, University of Liverpool(利物浦大学计算机科学与信息学院)
WaterVG: Waterway Visual Grounding based on Text-Guided Vision and mmWave Radar
Institute of Deep Perception Tech, JITRI(JITRI深度感知技术研究所);School of Advanced Technology, Xi’an Jiaotong-Liverpool University(西交利物浦大学先进技术学院);Faculty of Science and Engineering, University of Liverpool(利物浦大学科学与工程学院);Thrust of Artificial Intelligence and Thrust of Intelligent Transportation, HKUST (Guangzhou)(香港科技大学(广州)人工智能学科及智能交通学科)