多模态大模型

KunquDB: An Attempt for Speaker Verification in the Chinese Opera Scenario

Huali Zhou, Yuke Lin, Dong Liu, Ming Li

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Comments Accepted by ICPR 2024

An Overlooked Role of Context-Sensitive Dendrites

Mohsin Raza, Ahsan Adeel

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.AI

SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement

Zhongshu Hou, Tong Lei, Qinwen Hu, Zhanzhong Cao, Ming Tang, Jing Lu

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 eess.AS

HSDreport: Heart Sound Diagnosis with Echocardiography Reports

Zihan Zhao, Pingjie Wang, Liudan Zhao, Yuchen Yang, Ya Zhang, Kun Sun, Xin Sun, Xin Zhou, Yu Wang, Yanfeng Wang

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

NeuralMultiling: A Novel Neural Architecture Search for Smartphone based Multilingual Speaker Verification

Aravinda Reddy PN, Raghavendra Ramachandra, K. Sreenivasa Rao, Pabitra Mitra

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Identity-Driven Multimedia Forgery Detection via Reference Assistance

Junhao Xu, Jingjing Chen, Xue Song, Feng Han, Haijun Shan, Yugang Jiang

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.MM

Evaluating and Enhancing Trustworthiness of LLMs in Perception Tasks

Malsha Ashani Mahawatta Dona, Beatriz Cabrero-Daniel, Yinan Yu, Christian Berger

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted in 27th IEEE International Conference on Intelligent Transportation Systems (ITSC) 2024

EmoFace: Audio-driven Emotional 3D Face Animation

Chang Liu, Qunfen Lin, Zijiao Zeng, Ye Pan

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR). IEEE, 2024

Journal ref 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR). IEEE, 2024: 387-397

Survey of Design Paradigms for Social Robots

Rita Frieske, Xiaoyu Mo, Yini Fang, Jay Nieles, Bertram E. Shi

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

The Future is Meta: Metadata, Formats and Perspectives towards Interactive and Personalized AV Content

Alexander Weller, Werner Bleisteiner, Christian Hufnagel, Michael Iber

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.MM

Comments 12 pages, 4 figures, submitted to the Tonmeistertagung 32

E-chat: Emotion-sensitive Spoken Dialogue System with Large Language Models

Hongfei Xue, Yuhao Liang, Bingshen Mu, Shiliang Zhang, Mengzhe Chen, Qian Chen, Lei Xie

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments 5 pages, 3 figures

Multi-Stage Face-Voice Association Learning with Keynote Speaker Diarization

Ruijie Tao, Zhan Shi, Yidi Jiang, Duc-Tuan Truong, Eng-Siong Chng, Massimo Alioto, Haizhou Li

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 eess.AS

Unveiling and Mitigating Bias in Audio Visual Segmentation

Peiwen Sun, Honggang Zhang, Di Hu

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments Accepted by ACM MM 24 (ORAL)

Seal: Advancing Speech Language Models to be Few-Shot Learners

Shuyu Lei, Lingen Liu, Jiaolong Yang, Yasen Jiao, Yuxiang Yang, Yushu Yang, Xiang Guo

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CL

DiveSound: LLM-Assisted Automatic Taxonomy Construction for Diverse Audio Generation

Baihan Li, Zeyu Xie, Xuenan Xu, Yiwei Guo, Ming Yan, Ji Zhang, Kai Yu, Mengyue Wu

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Towards Weakly Supervised Text-to-Audio Grounding

Xuenan Xu, Ziyang Ma, Mengyue Wu, Kai Yu

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Can Textual Semantics Mitigate Sounding Object Segmentation Preference?

Yaoting Wang, Peiwen Sun, Yuanchao Li, Honggang Zhang, Di Hu

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments Accepted by ECCV2024

Ethics of Generating Synthetic MRI Vocal Tract Views from the Face

Muhammad Suhaib Shahid, Gleb E. Yakubov, Andrew P. French

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data

Nahema Marchal, Rachel Xu, Rasmi Elasmar, Iason Gabriel, Beth Goldberg, William Isaac

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.AI

SRC4VC: Smartphone-Recorded Corpus for Voice Conversion Benchmark

Yuki Saito, Takuto Igarashi, Kentaro Seki, Shinnosuke Takamichi, Ryuichi Yamamoto, Kentaro Tachibana, Hiroshi Saruwatari

专题命中 音频语音多模态 ：any-to-any(abstract)；分类 eess.AS

Comments Accepted for INTERSPEECH 2024, corpus project page: https://y-saito.sakura.ne.jp/sython/Corpus/SRC4VC/index.html

Zero-Shot Audio Captioning Using Soft and Hard Prompts

Yiming Zhang, Xuenan Xu, Ruoyi Du, Haohe Liu, Yuan Dong, Zheng-Hua Tan, Wenwu Wang, Zhanyu Ma

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 eess.AS

Comments Submitted to IEEE/ACM Transactions on Audio, Speech and Language Processing

G-VOILA: Gaze-Facilitated Information Querying in Daily Scenarios

Zeyu Wang, Yuanchun Shi, Yuntao Wang, Yuchen Yao, Kun Yan, Yuhan Wang, Lei Ji, Xuhai Xu, Chun Yu

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.AI

Comments 25 pages, 12 figures

NeRFFaceSpeech: One-shot Audio-driven 3D Talking Head Synthesis via Generative Prior

Gihoon Kim, Kwanggyoon Seo, Sihun Cha, Junyong Noh

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments 11 pages, 5 figures

Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance Capture

Yitong Jin, Zhiping Qiu, Yi Shi, Shuangpeng Sun, Chongwu Wang, Donghao Pan, Jiachen Zhao, Zhenghao Liang, Yuan Wang, Xiaobing Li, Feng Yu, Tao Yu, Qionghai Dai

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.MM

Comments SIGGRAPH2024

LLM-AD: Large Language Model based Audio Description System

Peng Chu, Jiang Wang, Andre Abrantes

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Learn2Talk: 3D Talking Face Learns from 2D Talking Face

Yixiang Zhuang, Baoping Cheng, Yao Cheng, Yuntao Jin, Renshuai Liu, Chengyang Li, Xuan Cheng, Jing Liao, Juncong Lin

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

LibriSQA: A Novel Dataset and Framework for Spoken Question Answering with Large Language Models

Zihan Zhao, Yiyang Jiang, Heyang Liu, Yanfeng Wang, Yu Wang

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Vivo : une approche multimodale de la synthese concatenative par corpus dans le cadre d'une oeuvre audiovisuelle immersive

Mateo Fayet

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 eess.AS

Comments in French language

Leveraging Interesting Facts to Enhance User Engagement with Conversational Interfaces

Nikhita Vedula, Giuseppe Castellucci, Eugene Agichtein, Oleg Rokhlenko, Shervin Malmasi

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CL

Comments 10 pages, 1 figure

Task Agnostic Architecture for Algorithm Induction via Implicit Composition

Sahil J. Sindhi, Ignas Budvytis

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.AI

Comments 12 pages, 2 figures, 2024 ICLR Generative Models for Decision Making Workshop