多模态大模型

Intelligent Carrier Allocation: A Cross-Modal Reasoning Framework for Adaptive Multimodal Steganography

Abhirup Das, Pranav Dudani, Shruti Sharma, Ravi Kumar C.

专题命中 音频语音多模态 ：multimodal(title,abstract)；cross-modal(title,abstract)；分类 cs.MM

Comments 8 pages, 10 figures

Robust Multi-modal Task-oriented Communications with Redundancy-aware Representations

Jingwen Fu, Ming Xiao, Zhonghao Lyu, Mikael Skoglund, Celimuge Wu

机构 * School of Electrical Engineering and Computer Science (EECS), KTH Royal Institute of Technology（电气工程与计算机科学学院（EECS），皇家理工学院） ； Department of Computer and Network Engineering, The University of Electro-Communications（计算机与网络工程系，东京电讯大学） 纠错

专题命中 音频语音多模态 ：multi-modal(title,abstract)；cross-modal(abstract)；分类 cs.MM

MCAD: Multimodal Context-Aware Audio Description Generation For Soccer

Lipisha Chaudhary, Trisha Mittal, Subhadra Gopalakrishnan, Ifeoma Nwogu, Jaclyn Pytlarz

机构 * University at Buffalo, SUNY（布法罗大学，SUNY） ； Dolby Laboratories Inc.（杜比实验室公司） 纠错

专题命中 音频语音多模态 ：multimodal(title,abstract)；分类 cs.MM

Two-stage Audio-Visual Target Speaker Extraction System for Real-Time Processing On Edge Device

Zixuan Li, Xueliang Zhang, Lei Miao, Zhipeng Yan, Ying Sun, Chong Zhu

机构 * College of Computer Science, Inner Mongolia University, China（内蒙古大学计算机科学学院） ； Lenovo, China（联想公司） 纠错

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

Fairness-Aware Few-Shot Learning for Audio-Visual Stress Detection

Anushka Sanjay Shelke, Aditya Sneh, Arya Adyasha, Haroon R. Lone

专题命中 音频语音多模态 ：audio-visual(title,abstract)

MERaLiON-SER: Robust Speech Emotion Recognition Model for English and SEA Languages

Hardik B. Sailor, Aw Ai Ti, Chen Fang Yih Nancy, Chiu Ying Lay, Ding Yang, He Yingxu, Jiang Ridong, Li Jingtao, Liao Jingyi, Liu Zhuohan, Lu Yanfeng, Ma Yi, Manas Gupta, Muhammad Huzaifah Bin Md Shahrin, Nabilah Binte Md Johan, Nattadaporn Lertcheva, Pan Chunlei, Pham Minh Duc, Siti Maryam Binte Ahmad Subaidi, Siti Umairah Binte Mohammad Salleh, Sun Shuo, Tarun Kumar Vangani, Wang Qiongqiong, Won Cheng Yi Lewis, Wong Heng Meng Jeremy, Wu Jinyang, Zhang Huayun, Zhang Longyin, Zou Xunlong

机构 * MERaLiON Team Institute for Infocomm Research (I 2 R), A*STAR, Singapore（MERaLiON团队信息与通信研究所（I 2 R），A*STAR，新加坡） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.AI

Comments https://huggingface.co/MERaLiON/MERaLiON-SER-v1

IFEval-Audio: Benchmarking Instruction-Following Capability in Audio-based Large Language Models

Yiming Gao, Bin Wang, Chengwei Wei, Shuo Sun, AiTi Aw

机构 * Nanyang Technological University (NTU)（南洋理工大学） ； MiroMind（米罗Mind） ； Institute for Infocomm Research (I 2 R)（信息与通信研究院） ； A*STAR（科技研究局） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Comments Link: https://github.com/AudioLLMs/AudioBench/tree/main/IFEval-Audio