AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

2025-11-17 至 2025-11-17 共收录 6 篇信号源：cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 音频语音多模态 6 篇

2511.11124 2025-11-17 cs.CL cs.AI cs.CV cs.MM cs.SD 85%

AV-Dialog: Spoken Dialogue Models with Audio-Visual Input

Tuochao Chen, Bandhav Veluri, Hongyu Gong, Shyamnath Gollakota

机构 * Paul G. Allen School of Computer Science & Engineering, University of Washington（华盛顿大学保罗·G·阿伦计算机科学与工程学院）； Meta AI Research（Meta AI研究院）

专题命中音频语音多模态：audio-visual(title,abstract)；multimodal(abstract)；分类 cs.CV、cs.CL、cs.AI

2511.11106 2025-11-17 cs.MM cs.CV cs.SD 73%

AccKV: Towards Efficient Audio-Video LLMs Inference via Adaptive-Focusing and Cross-Calibration KV Cache Optimization

Zhonghua Jiang, Kui Chen, Kunxi Li, Keting Yin, Yiyun Zhou, Zhaode Wang, Chengfei Lv, Shengyu Zhang

专题命中音频语音多模态：multimodal(abstract)；audio-visual(abstract)；分类 cs.CV、cs.MM

2511.09915 2025-11-17 cs.CL cs.MM cs.SD 73%

HI-TransPA: Hearing Impairments Translation Personal Assistant

Zhiming Ma, Shiyu Gan, Junhao Zhao, Xianming Li, Qingyun Pan, Peidong Wang, Mingjun Pan, Yuhao Mo, Jiajie Cheng, Chengxin Chen, Zhonglun Cao, Chonghan Liu, Shi Cheng

机构 * SmartFlowAI Research（SmartFlowAI研究院）； Tongji University（同济大学）； CMIC Guangzhou（广州CMIC）； BUPT Beijing（北京邮电大学）； Northeastern University Shenyang（沈阳东北大学）； Peking University（北京大学）； Qiyuan Tech Beijing（北京启元科技）

专题命中音频语音多模态：multimodal(abstract)；audio-visual(abstract)；分类 cs.CL、cs.MM

2511.10913 2025-11-17 cs.SD cs.AI cs.CR cs.MM eess.AS 67%

Synthetic Voices, Real Threats: Evaluating Large Text-to-Speech Models in Generating Harmful Audio

Guangke Chen, Yuhui Wang, Shouling Ji, Xiapu Luo, Ting Wang

机构 * Stony Brook University（石英布鲁克大学）； Zhejiang University（浙江大学）； The Hong Kong Polytechnic University（香港理工大学）

专题命中音频语音多模态：cross-modal(abstract)；分类 cs.AI、cs.MM、eess.AS

2511.06606 2025-11-17 eess.AS cs.AI 62%

SPUR: A Plug-and-Play Framework for Integrating Spatial Audio Understanding and Reasoning into Large Audio-Language Models

S Sakshi, Vaibhavi Lokegaonkar, Neil Zhang, Ramani Duraiswami, Sreyan Ghosh, Dinesh Manocha, Lie Lu

机构 * University of Maryland, College Park, USA（马里兰大学 College Park 分校）； Dolby Laboratories（杜比实验室）

专题命中音频语音多模态：multimodal(abstract)；分类 cs.AI、eess.AS

Comments Project: https://sakshi113.github.io/spur/

2510.27102 2025-11-17 cs.SD cs.AI eess.AS 62%

Expressive Range Characterization of Open Text-to-Audio Models

Jonathan Morse, Azadeh Naderi, Swen Gaudl, Mark Cartwright, Amy K. Hoover, Mark J. Nelson

专题命中音频语音多模态：multimodal(abstract)；分类 cs.AI、eess.AS

Comments Accepted at the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE 2025)