AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

2025-10-09 至 2025-10-09 共收录 6 篇信号源：cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 音频语音多模态 6 篇

2403.16276 2025-10-09 cs.CV cs.AI 84%

Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding

Yolo Yunlong Tang, Daiki Shimada, Jing Bi, Mingqian Feng, Hang Hua, Chenliang Xu

专题命中音频语音多模态：audio-visual(title,abstract)；multimodal(abstract)；分类 cs.CV、cs.AI

Comments Accepted to AAAI 2025

2508.07839 2025-10-09 cs.RO 78%

Touch Speaks, Sound Feels: A Multimodal Approach to Affective and Social Touch from Robots to Humans

Qiaoqiao Ren, Tony Belpaeme

机构 * Faculty of Engineering and Architecture, IDLab-AIRO, Ghent University – imec, Technologiepark 126, 9052 Gent, Belgium（工程与建筑学院，IDLab-AIRO，根特大学–imec，Technologiepark 126，9052 Gent，比利时）

专题命中音频语音多模态：multimodal(title,abstract)

2510.06872 2025-10-09 cs.HC 78%

Prototyping Multimodal GenAI Real-Time Agents with Counterfactual Replays and Hybrid Wizard-of-Oz

Frederic Gmeiner, Kenneth Holstein, Nikolas Martelaro

专题命中音频语音多模态：multimodal(title,abstract)

Comments 18 pages, 5 figures, 4 tables

2510.07293 2025-10-09 cs.SD cs.AI cs.CL eess.AS 67%

AudioMarathon: A Comprehensive Benchmark for Long-Context Audio Understanding and Efficiency in Audio LLMs

Peize He, Zichen Wen, Yubo Wang, Yuxuan Wang, Xiaoqian Liu, Jiajie Huang, Zehui Lei, Zhuangcheng Gu, Xiangqi Jin, Jiabing Yang, Kai Li, Zhifei Liu, Weijia Li, Cunxiang Wang, Conghui He, Linfeng Zhang

机构 * Shanghai Jiao Tong University（上海交通大学）； Shanghai AI Laboratory（上海人工智能实验室）； Northeastern University（东北大学）； Carnegie Mellon University（卡内基梅隆大学）； University of Chinese Academy of Sciences（中国科学院大学）； Tsinghua University（清华大学）； Sun Yat-sen University（中山大学）

专题命中音频语音多模态：multimodal(abstract)；分类 cs.CL、cs.AI、eess.AS

Comments 26 pages, 23 figures, the code is available at \url{https://github.com/DabDans/AudioMarathon}

2509.16765 2025-10-09 cs.CL cs.AI cs.SD eess.AS 67%

The Sound of Syntax: Finetuning and Comprehensive Evaluation of Language Models for Speech Pathology

Fagun Patel, Duc Q. Nguyen, Sang T. Truong, Jody Vaynshtok, Sanmi Koyejo, Nick Haber

机构 * Stanford University（斯坦福大学）； National University of Singapore（新加坡国立大学）； Sound Speech and Hearing Clinic（语音与听力诊所）

专题命中音频语音多模态：multimodal(abstract)；分类 cs.CL、cs.AI、eess.AS

Comments EMNLP 2025 Oral Presentation

2510.07299 2025-10-09 eess.AS cs.SD 57%

Comparison of Speech Tasks in Human Expert and Machine Detection of Parkinson's Disease

Peter Plantinga, Roozbeh Sattari, Karine Marcotte, Carla Di Gironimo, Madeleine Sharp, Liziane Bouvier, Maiya Geddes, Ingrid Verduyckt, Étienne de Villers-Sidani, Mirco Ravanelli, Denise Klein

机构 * McGill University（麦吉尔大学）； CRBLM ； Mila Quebec AI Institute（魁北克人工智能研究所）； Université de Montréal（蒙特利尔大学）； Nouvelle Voix（新声音）； Montreal Neurological Institute（蒙特利尔神经科学研究所）； Concordia University（Concordia大学）

专题命中音频语音多模态：multimodal(abstract)；分类 eess.AS

Comments Accepted to SMASH 2025