We present a novel particle filtering algorithm for tracking a moving sound source using a microphone array. If there are N microphones in the array, we track all $N \choose 2$ delays with a single particle filter over time. Since it is known that tracking in high dimensions is rife with difficulties, we instead integrate into our particle filter a model of the low dimensional manifold that these delays lie on. Our manifold model is based off of work on modeling low dimensional manifolds via random projection trees [1]. In addition, we also introduce a new weighting scheme to our particle filtering algorithm based on recent advancements in online learning. We show that our novel TDOA tracking algorithm that integrates a manifold model can greatly outperform standard particle filters on this audio tracking task.
The Sonar Moment: Benchmarking Audio-Language Models in Audio Geo-Localization
The State Key Laboratory of Complex and Critical Software Environment, Beihang University(复杂与关键软件环境国家重点实验室,北航);Shanghai AI Laboratory(上海人工智能实验室);The Key Laboratory of Data Science and Intelligent Computing, International Innovation Institute, Beihang University(数据科学与智能计算重点实验室,国际创新研究院,北航)
Unifying Speech Editing Detection and Content Localization via Prior-Enhanced Audio LLMs
Key Laboratory of Aerospace Information Security(航空信息安全与可信计算重点实验室);School of Cyber Science and Engineering(网络安全工程学院);Wuhan University(武汉大学);Independent Researcher(独立研究员);School of Computer Science and Technology(计算机科学与技术学院);Anhui University(安徽大学);Communication University of China(中国通信大学);Beihang University(北京航空航天大学)
From General-Purpose Audio Tagging to Spatially Grounded Sound Event Localization and Detection
DISIM Department, University of L’Aquila(拉奎拉大学DISIM系);ESAT Department, KU Leuven(布鲁塞尔自由大学ESAT系);CNIT, Research Unit of L’Aquila, Italy(意大利拉奎拉CNIT研究中心);ESAT - STADIUS Department, KU Leuven(布鲁塞尔自由大学ESAT-STADIUS系)
Learning to Unify Audio, Visual and Text for Audio-Enhanced Multilingual Visual Answer Localization
Systems Engineering Institute(系统工程研究所);Xi’an Jiaotong University(西安交通大学);Shenzhen Institute of Advanced Technology(深圳先进技术研究院);Chinese Academy of Sciences(中国科学院)
DOA-Aware Audio-Visual Self-Supervised Learning for Sound Event Localization and Detection
Graduate School of Informatics, Kyoto University(京都大学情报学研究科);National Institute of Advanced Industrial Science and Technology(独立行政法人产业技术综合研究所);Faculty of Science and Engineering, Doshisha University(同志社大学理工学部)