We overview current problems of audio retrieval and time-series subsequence matching. We discuss the usage of subsequence matching approaches in audio data processing, especially in automatic speech recognition (ASR) area and we aim at improving performance of the retrieval process. To overcome the problems known from the time-series area like the occurrence of implementation bias and data bias we present a Subsequence Matching Framework as a tool for fast prototyping, building, and testing similarity search subsequence matching applications. The framework is build on top of MESSIF (Metric Similarity Search Implementation Framework) and thus the subsequence matching algorithms can exploit advanced similarity indexes in order to significantly increase their query processing performance. To prove our concept we provide a design of query-by-example spoken term detection type of application with the usage of phonetic posteriograms and subsequence matching approach.
Longest Filled Common Subsequence for Song Identification from Degraded Audio via Construct--Merge--Solve--Adapt Optimization
Faculty of Natural Sciences and Mathematics, University of Banja Luka, Bosnia and Herzegovina(自然科学与数学学院,波斯尼亚和黑塞哥维那巴尼亚卢卡大学);University of Nova Gorica, Nova Gorica, Slovenia(诺瓦戈里察大学,斯洛文尼亚诺瓦戈里察);Artificial Intelligence Research Institute (IIIA-CSIC), UAB, Barcelona, Spain(人工智能研究 institute(IIIA-CSIC),巴塞罗那大学(UAB),西班牙巴塞罗那);Faculty of Mathematics, University of Belgrade, Serbia(数学学院,贝尔格莱德大学,塞尔维亚);Jožef Stefan Institute, Ljubljana, Slovenia(约泽夫·斯特凡研究所,斯洛文尼亚卢布尔雅那);Institute of Information Sciences (IZUM), Maribor, Slovenia(信息科学研究所(IZUM),斯洛文尼亚马里博)
Investigating the Viability of Employing Multi-modal Large Language Models in the Context of Audio Deepfake Detection
Indian Institute of Technology, Ropar, India(印度理工学院罗帕尔分校);Machine Intelligence Group, Birla Institute of Technology and Science, Pilani, Hyderabad Campus, India(比拉理工科学院帕利尼 Hyderabad 分校机器智能小组);Monash University, Melbourne, Australia(墨尔本大学)
Zero-Shot Fake Video Detection by Audio-Visual Consistency
School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);Center for Speech and Language Technologies, BNRist, Tsinghua University(清华大学BNR实验室语音与语言技术中心)
Reverse the auditory processing pathway: Coarse-to-fine audio reconstruction from fMRI
Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology(脑认知与类脑智能技术重点实验室);State Key Laboratory of Multimodal Artificial Intelligence Systems(多模态人工智能系统国家重点实验室);School of Future Technology, University of Chinese Academy of Sciences(中国科学院大学未来技术学院)
Exploring Audio Cues for Enhanced Test-Time Video Model Adaptation
Artificial Intelligence Research Institute, Shenzhen MSU-BIT University and Guangdong-Hong Kong-Macao Joint Laboratory for Emotional Intelligence and Pervasive Computing(人工智能研究院、深圳MSU-BIT大学及粤港澳大湾区情感智能与普适计算联合实验室);School of Software Engineering, South China University of Technology(华南理工大学软件学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
Emotional Expression Detection in Spoken Language Employing Machine Learning Algorithms
University of Information Technology & Sciences(信息技术与科学大学);Southeast University(东南大学);Endicott College, Woosong University(又松大学恩迪科特学院);Daffodil International University(水仙国际大学);Jahangirnagar University(贾汉吉尔纳加尔大学)