AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

2025-11-04 至 2025-11-04 共收录 7 篇信号源：cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 音频语音多模态 7 篇

2510.23763 2025-11-04 cs.RO cs.CL cs.CV 86%

RoboOmni: Proactive Robot Manipulation in Omni-modal Context

Siyin Wang, Jinlan Fu, Feihong Liu, Xinzhe He, Huangxuan Wu, Junhao Shi, Kexin Huang, Zhaoye Fei, Jingjing Gong, Zuxuan Wu, Yu-Gang Jiang, See-Kiong Ng, Tat-Seng Chua, Xipeng Qiu

机构 * Fudan University（复旦大学）； Shanghai Innovation Institute（上海创新研究院）； National University of Singapore（新加坡国立大学）

专题命中音频语音多模态：omni-modal(title,abstract)；multimodal(abstract)；cross-modal(abstract)；分类 cs.CV、cs.CL

2511.01299 2025-11-04 eess.AS 85%

Towards General Auditory Intelligence: Large Multimodal Models for Machine Listening and Speaking

Siyin Wang, Zengrui Jin, Changli Tang, Qiujia Li, Bo Li, Chen Chen, Yuchen Hu, Wenyi Yu, Yixuan Li, Jimin Zhuang, Yudong Yang, Mingqiu Wang, Michael Han, Yifan Ding, Junwen Bai, Tom Ouyang, Shuo-yiin Chang, Xianzhao Chen, Xiaohai Tian, Jun Zhang, Lu Lu, Guangzhi Sun, Zhehuai Chen, Ji Wu, Bowen Zhou, Yuxuan Wang, Tara Sainath, Yonghui Wu, Chao Zhang

专题命中音频语音多模态：multimodal(title,abstract)；cross-modal(abstract)；audio-visual(abstract)；分类 eess.AS

Comments 22 pages, 11 figures

2510.25760 2025-11-04 cs.CV 79%

Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks

Xu Zheng, Zihao Dongfang, Lutao Jiang, Boyuan Zheng, Yulong Guo, Zhenquan Zhang, Giuliano Albanese, Runyi Yang, Mengjiao Ma, Zixin Zhang, Chenfei Liao, Dingcheng Zhen, Yuanhuiyi Lyu, Yuqian Fu, Bin Ren, Linfeng Zhang, Danda Pani Paudel, Nicu Sebe, Luc Van Gool, Xuming Hu

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.CV

2511.01670 2025-11-04 cs.CL cs.AI 62%

SeaLLMs-Audio: Large Audio-Language Models for Southeast Asia

Chaoqun Liu, Mahani Aljunied, Guizhen Chen, Hou Pong Chan, Weiwen Xu, Yu Rong, Wenxuan Zhang

机构 * DAMO Academy, Alibaba Group（达摩院，阿里巴巴集团）

专题命中音频语音多模态：multimodal(abstract)；分类 cs.CL、cs.AI

Comments 10 pages

2511.01261 2025-11-04 cs.SD cs.AI eess.AS 62%

Speech-DRAME: A Framework for Human-Aligned Benchmarks in Speech Role-Play

Jiatong Shi, Jionghao Han, Yichen Lu, Santiago Pascual, Pengfei Wu, Chenye Cui, Shinji Watanabe, Chao Weng, Cong Zhou

机构 * Carnegie Mellon University（卡内基梅隆大学）； Anuttacon（安纳塔康）

专题命中音频语音多模态：multimodal(abstract)；分类 cs.AI、eess.AS

Comments 67 pages

2510.01176 2025-11-04 cs.GR cs.CV cs.LG cs.SD 57%

Audio Driven Real-Time Facial Animation for Social Telepresence

Jiye Lee, Chenghui Li, Linh Tran, Shih-En Wei, Jason Saragih, Alexander Richard, Hanbyul Joo, Shaojie Bai

机构 * Seoul National University（首尔国立大学）； Codec Avatars Lab, Meta（Meta语义编码实验室）

专题命中音频语音多模态：multimodal(abstract)；分类 cs.CV

Comments SIGGRAPH Asia 2025. Project page: https://jiyewise.github.io/projects/AudioRTA

2511.00611 2025-11-04 math.OC 50%

From Generality to Specificity: Prior-Driven Optimal Sparse Transformation in Compressed Sensing

Zhihan Zhu, Yanhao Zhang, Yong Xia

专题命中音频语音多模态：multimodal(abstract)

Comments 47 pages, 10 figures, 1 table