STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence
Fudan University(复旦大学);Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Shanghai Innovation Institute(上海创新研究院);Beihang University(北京航空航天大学);Shanghai Jiao Tong University(上海交通大学)
Despite rapid progress in Multi-modal Large Language Models and Large Audio-Language Models, existing audio benchmarks largely test semantics that can be recovered from text captions, masking deficits in fine-grained perceptual reasoning. We formalize audio 4D intelligence that is defined as reasoning over sound dynamics in time and 3D space, and introduce STAR-Bench to measure it. STAR-Bench combines a Foundational Acoustic Perception setting (six attributes under absolute and relative regimes) with a Holistic Spatio-Temporal Reasoning setting that includes segment reordering for continuous and discrete processes and spatial tasks spanning static localization, multi-source relations, and dynamic trajectories. Our data curation pipeline uses two methods to ensure high-quality samples. For foundational tasks, we use procedurally synthesized and physics-simulated audio. For holistic data, we follow a four-stage process that includes human annotation and final selection based on human performance. Unlike prior benchmarks where caption-only answering reduces accuracy slightly, STAR-Bench induces far larger drops (-31.5\% temporal, -35.2\% spatial), evidencing its focus on linguistically hard-to-describe cues. Evaluating 19 models reveals substantial gaps compared with humans and a capability hierarchy: closed-source models are bottlenecked by fine-grained perception, while open-source models lag across perception, knowledge, and reasoning. Our STAR-Bench provides critical insights and a clear path forward for developing future models with a more robust understanding of the physical world.
CoSTALA: Compositional Spatio-Temporal Audio-Language Alignment via Multi-Grain Hierarchical Contrastive Learning
Xi’an Jiaotong Liverpool University(西交利物浦大学);MiLM Plus, Xiaomi Inc.(小米公司MiLM Plus);University of Oulu(奥卢大学);Institute of Acoustics, Chinese Academy of Sciences(中国科学院声学研究所)
AudioBench: A Universal Benchmark for Audio Large Language Models
Institute for Infocomm Research (I 2 R), A*STAR, Singapore(信息通信研究所(I2R),A*STAR,新加坡);Centre for Frontier AI Research (CFAR), A*STAR(前沿人工智能研究中心(CFAR),A*STAR)
Words at Play: Benchmarking Audio Pun Understanding in Large Audio-Language Models
School of Computer Science, University of Auckland(奥克兰大学计算机科学学院);Singapore University of Technology and Design(新加坡科技设计大学);School of Electronic Engineering and Computer Science, Queen Mary University of London(伦敦大学玛丽女王学院电子工程与计算机科学学院);School of Statistics and Data Science, Nankai University(南开大学统计与数据科学学院)
AudioMarathon: A Comprehensive Benchmark for Long-Context Audio Understanding and Efficiency in Audio LLMs
Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室);Northeastern University(东北大学);Carnegie Mellon University(卡内基梅隆大学);University of Chinese Academy of Sciences(中国科学院大学);Tsinghua University(清华大学);Sun Yat-sen University(中山大学)
CMDAR: A Chinese Multi-scene Dynamic Audio Reasoning Benchmark with Diverse Challenges
College of Computer Science and Artificial Intelligence, Fudan University(计算机科学与人工智能学院,复旦大学);Shanghai Jiao Tong University(上海交通大学);IEIT Systems Co Ltd(IEIT系统有限公司)
University of Washington(华盛顿大学);Stanford University(斯坦福大学);The Ohio State University(俄亥俄州立大学);Carnegie Mellon University(卡内基梅隆大学);University of Waterloo(多伦多大学)
The Sonar Moment: Benchmarking Audio-Language Models in Audio Geo-Localization
The State Key Laboratory of Complex and Critical Software Environment, Beihang University(复杂与关键软件环境国家重点实验室,北航);Shanghai AI Laboratory(上海人工智能实验室);The Key Laboratory of Data Science and Intelligent Computing, International Innovation Institute, Beihang University(数据科学与智能计算重点实验室,国际创新研究院,北航)
ChildVox: A Speech, Audio, and Large Audio-Language Model Benchmark in Understanding and Characterizing Sound across Childhood
University of Southern California(南加州大学);The Ohio State University(俄亥俄州立大学);University of California, Los Angeles(加州大学洛杉矶分校);Harvard University(哈佛大学);Boston University(波士顿大学);University of Miami(迈阿密大学)
ChronosAudio: A Comprehensive Long-Audio Benchmark for Evaluating Audio-Large Language Models
Nanyang Technological University(南洋理工大学);Independent Researcher(独立研究者);United Arab Emirates University(阿联酋大学);North China Electric Power University(华北电力大学);Southwest Jiaotong University(西南交通大学);Squirrel AI Learning(Squirrel AI学习)
SEAR: Spoofing Evidence-Grounded Audio Reasoning Benchmark for Audio Language Models
University of Surrey(萨里大学);Singapore University of Technology and Design(新加坡科技设计大学);Guangxi University(广西大学);Shenzhen University of Advanced Technology(深圳先进技术大学)
Carleton University(卡尔顿大学);Durham University(杜伦大学);Stanford University(斯坦福大学);Aarhus University(奥胡斯大学);Indian Institute of Technology, Kharagpur(印度理工学院,卡里格普);Harvard University(哈佛大学)
JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronization
Zhejiang University(浙江大学);National University of Singapore(新加坡国立大学);University of Science and Technology of China(中国科学技术大学);University of Rochester(罗切斯特大学);Nanyang Technological University(南洋理工大学)
AQUA-Bench: Beyond Finding Answers to Knowing When There Are None in Audio Question Answering
Graduate Institute of Communication Engineering, National Taiwan University, Taiwan(台湾国立台湾大学通信工程研究所);Artificial Intelligence Center of Research Excellence (AI-CoRE), National Taiwan University, Taiwan(台湾国立台湾大学人工智能研究中心)