多模态大模型

Large Language Models for Depression Recognition in Spoken Language Integrating Psychological Knowledge

Yupei Li, Shuaijie Shao, Manuel Milling, Björn W. Schuller

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Journal ref Frontiers in Computer Science, Volume 7, 2025

Visuo-Acoustic Hand Pose and Contact Estimation

Yuemin Mao, Uksang Yoo, Yunchao Yao, Shahram Najam Syed, Luca Bondi, Jonathan Francis, Jean Oh, Jeffrey Ichnowski

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 cs.CV

MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligence

Sonal Kumar, Šimon Sedláček, Vaibhavi Lokegaonkar, Fernando López, Wenyi Yu, Nishit Anand, Hyeonggon Ryu, Lichang Chen, Maxim Plička, Miroslav Hlaváček, William Fineas Ellingwood, Sathvik Udupa, Siyuan Hou, Allison Ferner, Sara Barahona, Cecilia Bolaños, Satish Rahi, Laura Herrera-Alarcón, Satvik Dixit, Siddhi Patil, Soham Deshmukh, Lasha Koroshinadze, Yao Liu, Leibny Paola Garcia Perera, Eleni Zanou, Themos Stafylakis, Joon Son Chung, David Harwath, Chao Zhang, Dinesh Manocha, Alicia Lozano-Diez, Santosh Kesiraju, Sreyan Ghosh, Ramani Duraiswami

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Can Large Language Models (LLMs) Describe Pictures Like Children? A Comparative Corpus Study

Hanna Woloszyn, Benjamin Gagl

机构 * Self-Learning Systems Lab, Faculty of Human Sciences, Department of Special Education and Rehabilitation（自主学习系统实验室，人文科学学院，特殊教育与康复系） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Cryfish: On deep audio analysis with Large Language Models

Anton Mitrofanov, Sergei Novoselov, Tatiana Prisyach, Vladislav Marchevskiy, Arseniy Karelin, Nikita Khmelev, Dmitry Dutov, Stepan Malykh, Igor Agafonov, Aleksandr Nikitin, Oleg Petrov

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Journal ref Proc. Interspeech 2025

FantasyTalking2: Timestep-Layer Adaptive Preference Optimization for Audio-Driven Portrait Animation

MengChao Wang, Qiang Wang, Fan Jiang, Mu Xu

机构 * Project Leader（项目负责人） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Comments https://fantasy-amap.github.io/fantasy-talking2/

Advances in Speech Separation: Techniques, Challenges, and Future Trends

Kai Li, Guo Chen, Wendi Sang, Yi Luo, Zhuo Chen, Shuai Wang, Shulin He, Zhong-Qiu Wang, Andong Li, Zhiyong Wu, Xiaolin Hu

机构 * Department of Computer Science and Technology, Tsinghua University（计算机科学与技术系，清华大学） ； School of Computer Technology and Application, Qinghai University（计算机技术与应用学院，青海大学） ； ByteDance（字节跳动） ； Nanjing University（南京大学） ； Southern University of Science and Technology（南方科技大学） ； Institute of Acoustics, Chinese Academy of Sciences（中国科学院声学研究所） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments 34 pages, 10 figures

Ensembling Synchronisation-based and Face-Voice Association Paradigms for Robust Active Speaker Detection in Egocentric Recordings

Jason Clarke, Yoshihiko Gotoh, Stefan Goetze

机构 * Speech and Hearing (SPandH), School of Computer Science, The University of Sheffield, UK（语音与听力（SPandH）、计算机科学学院、谢菲尔德大学、英国） ； South Westphalia University of Applied Sciences, Iserlohn, Germany（西南弗兰肯应用科学大学、伊塞尔洛恩、德国） 纠错

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 cs.MM

Comments Accepted to SPECOM 2025, 13 pages, 4 figures. To appear in the Proceedings of the 27th International Conference on Speech and Computer (SPECOM) 2025, October 13-14, 2025, Szeged, Hungary

Text as Any-Modality for Zero-Shot Classification by Consistent Prompt Tuning

Xiangyu Wu, Feng Yu, Yang Yang, Jianfeng Lu

机构 * Nanjing University of Science 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted for publication at ACMMM 2025

DAFMSVC: One-Shot Singing Voice Conversion with Dual Attention Mechanism and Flow Matching

Wei Chen, Binzhu Sha, Dan Luo, Jing Yang, Zhuo Wang, Fan Fan, Zhiyong Wu

机构 * Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院） ； Huawei Technologies Co., Ltd.（华为技术有限公司） 纠错

专题命中 音频语音多模态 ：any-to-any(abstract)；分类 cs.AI

Comments Accepted by INTERSPEECH 2025

UniTalker: Conversational Speech-Visual Synthesis

Yifan Hu, Rui Liu, Yi Ren, Xiang Yin, Haizhou Li

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments 15 pages, 8 figures, Accepted by ACM MM 2025

Overview of Automatic Speech Analysis and Technologies for Neurodegenerative Disorders: Diagnosis and Assistive Applications

Shakeel A. Sheikh, Md. Sahidullah, Ina Kodrasi

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments Published in IEEE Journal of Selected Topics in Signal Processing

Journal ref https://ieeexplore.ieee.org/abstract/document/11086511/

Emotion Detection Using Conditional Generative Adversarial Networks (cGAN): A Deep Learning Approach

Anushka Srivastava

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments 3 pages, 2 tables, submitted for arXiv preprint

Learning Personalised Human Internal Cognition from External Expressive Behaviours for Real Personality Recognition

Xiangyu Kong, Hengde Zhu, Haoqin Sun, Zhihao Guo, Jiayan Gu, Xinyi Ni, Wei Zhang, Shizhe Liu, Siyang Song

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments 10 pages, 4 figures

Identifying Hearing Difficulty Moments in Conversational Audio

Jack Collins, Adrian Buzea, Chris Collier, Alejandro Ballesta Rosen, Julian Maclaren, Richard F. Lyon, Simon Carlile

机构 * Google Research Australia（谷歌澳大利亚研究） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Text-Driven Voice Conversion via Latent State-Space Modeling

Wen Li, Sofia Martinez, Priyanka Shah

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 eess.AS

Comments arXiv admin note: This paper has been withdrawn by arXiv due to disputed and unverifiable authorship and affiliation

Uncovering the role of semantic and acoustic cues in normal and dichotic listening

Sai Samrat Kankanala, Akshara Soman, Sriram Ganapathy

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments 10 Pages, 6 Figures

VeS: Teaching Pixels to Listen Without Supervision

Sajay Raj

机构 * Indian Institute of Technology, Madras（印度理工学院马德拉斯分校） 纠错

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments 6 pages, 1 figure, 1 table. Code and models are released

RedactOR: An LLM-Powered Framework for Automatic Clinical Data De-Identification

Praphul Singh, Charlotte Dzialo, Jangwon Kim, Sumana Srivatsa, Irfan Bulu, Sri Gadde, Krishnaram Kenthapadi

机构 * Oracle Health & AI（Oracle健康与人工智能） 纠错

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.AI

Comments Accepted to ACL 2025 Industry Track. To appear

Learning Gentle Grasping Using Vision, Sound, and Touch

Ken Nakahara, Roberto Calandra

机构 * Learning, Adaptive Systems, and Robotics (LASR) Lab, TU Dresden（图腾德斯登技术大学学习、自适应系统与机器人实验室） ； Center for Tactile Internet with Human-in-the-Loop (CeTI)（人机协同触觉互联网中心） 纠错

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 8 pages. Accepted by 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Hear Your Code Fail, Voice-Assisted Debugging for Python

Sayed Mahbub Hasan Amiri, Md. Mainul Islam, Mohammad Shakhawat Hossen, Sayed Majhab Hasan Amiri, Mohammad Shawkat Ali Mamun, Sk. Humaun Kabir, Naznin Akter

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Comments 35 pages, 20 figures

psifx -- Psychological and Social Interactions Feature Extraction Package

Guillaume Rochette, Mathieu Rochat, Matthew J. Vowels

机构 * UNIL ； ETH Zurich（苏黎世联邦理工学院） ； Institute of Neuroinformatics（神经信息学研究所） ； Kivira Health（Kivira健康） 纠错

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CL

Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Study

Guanyu Hou, Jiaming He, Yinhang Zhou, Ji Guo, Yitong Qiao, Rui Zhang, Wenbo Jiang

机构 * University of Electronic Science and Technology of China（电子科技大学） ； Chengdu University of Technology（成都理工大学） ； Sun Yat-Sen University（中山大学） 纠错

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CL

"I am bad": Interpreting Stealthy, Universal and Robust Audio Jailbreaks in Audio-Language Models

Isha Gupta, David Khachaturov, Robert Mullins

机构 * ETH Zürich（苏黎世联邦理工学院） ； University of Cambridge（剑桥大学） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Evaluating Pointing Gestures for Target Selection in Human-Robot Collaboration

Noora Sassali, Roel Pieters

机构 * Cognitive Robotics group, Unit of Automation Technology and Mechanical Engineering, Tampere University（认知机器人组、自动化技术与机械工程单位、塔尔库大学） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted by the 2025 34th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). Preprint

Graph Linearization Methods for Reasoning on Graphs with Large Language Models

Christos Xypolopoulos, Guokan Shang, Xiao Fei, Giannis Nikolentzos, Hadi Abdine, Iakovos Evdaimon, Michail Chatzianastasis, Giorgos Stamou, Michalis Vazirgiannis

机构 * Ecole Polytechnique（巴黎高等理工学院） ； MBZUAI（马克斯·普朗克人工智能研究所） ； NTUA（希腊国家技术研究中心） ； University of Peloponnese（希腊皮洛斯大学） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

ClearerVoice-Studio: Bridging Advanced Speech Processing Research and Practical Deployment

Shengkui Zhao, Zexu Pan, Bin Ma

机构 * Tongyi Lab（通义实验室） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments accepted by Interspeech 2025, 5 pages, 5 tables

SLAP: Siamese Language-Audio Pretraining Without Negative Samples for Music Understanding

Julien Guinot, Alain Riou, Elio Quinton, György Fazekas

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments Accepted to ISMIR 2025

Pseudo Labels-based Neural Speech Enhancement for the AVSR Task in the MISP-Meeting Challenge

Longjie Luo, Shenghui Lu, Lin Li, Qingyang Hong

机构 * School of Electronic Science and Engineering（电子科学与工程学院） ； School of Informatics（信息学院） 纠错

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments Accepted by InterSpeech 2025

Hybrid-Sep: Language-queried audio source separation via pre-trained Model Fusion and Adversarial Diffusion Training

Jianyuan Feng, Guangzheng Li, Yangfei Xu

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 eess.AS

Comments Submitted to WASAA 2025