多模态大模型

Multi-Modal Machine Learning for Assessing Gaming Skills in Online Streaming: A Case Study with CS:GO

Longxiang Zhang, Wenping Wang

专题命中 音频语音多模态 ：multi-modal(title,abstract)；分类 cs.CV

MRecGen: Multimodal Appropriate Reaction Generator

Jiaqi Xu, Cheng Luo, Weicheng Xie, Linlin Shen, Xiaofeng Liu, Lu Liu, Hatice Gunes, Siyang Song

专题命中 音频语音多模态 ：multimodal(title,abstract)；分类 cs.CV

Knowledge Distillation for Efficient Audio-Visual Video Captioning

Özkan Çaylı, Xubo Liu, Volkan Kılıç, Wenwu Wang

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

Comments European Signal Processing Conference (EUSIPCO 2023)

Target Active Speaker Detection with Audio-visual Cues

Yidi Jiang, Ruijie Tao, Zexu Pan, Haizhou Li

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

Comments Accepted to INTERSPEECH2023

Audio-Visual Mandarin Electrolaryngeal Speech Voice Conversion

Yung-Lun Chien, Hsin-Hao Chen, Ming-Chi Yen, Shu-Wei Tsai, Hsin-Min Wang, Yu Tsao, Tai-Shih Chi

专题命中 音频语音多模态 ：audio-visual(title)；multimodal(abstract)；分类 eess.AS

Comments Accepted to INTERSPEECH 2023

Audio-Visual Speech Enhancement With Selective Off-Screen Speech Extraction

Tomoya Yoshinaga, Keitaro Tanaka, Shigeo Morishima

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

Comments Accepted by EUSIPCO 2023

SNeL: A Structured Neuro-Symbolic Language for Entity-Based Multimodal Scene Understanding

Silvan Ferreira, Allan Martins, Ivanovitch Silva

专题命中 音频语音多模态 ：multimodal(title,abstract)；分类 cs.AI

Rethinking the visual cues in audio-visual speaker extraction

Junjie Li, Meng Ge, Zexu pan, Rui Cao, Longbiao Wang, Jianwu Dang, Shiliang Zhang

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

Comments Accepted in Interspeech 2023

Audio-Visual Speech Enhancement with Score-Based Generative Models

Julius Richter, Simone Frintrop, Timo Gerkmann

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

Comments Submitted to ITG Conference on Speech Communication

ALO-VC: Any-to-any Low-latency One-shot Voice Conversion

Bohan Wang, Damien Ronssin, Milos Cernak

专题命中 音频语音多模态 ：any-to-any(title,abstract)；分类 eess.AS

Comments Accepted to Interspeech 2023. Some audio samples are available at https://bohan7.github.io/ALO-VC-demo/

Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Model

Héctor Martel, Julius Richter, Kai Li, Xiaolin Hu, Timo Gerkmann

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

Comments Accepted by Interspeech 2023

Masked Audio Text Encoders are Effective Multi-Modal Rescorers

Jinglun Cai, Monica Sunkara, Xilai Li, Anshu Bhatia, Xiao Pan, Sravan Bodapati

专题命中 音频语音多模态 ：multi-modal(title,abstract)；分类 cs.CL

Audio-Visual Dataset and Method for Anomaly Detection in Traffic Videos

Błażej Leporowski, Arian Bakhtiarnia, Nicole Bonnici, Adrian Muscat, Luca Zanella, Yiming Wang, Alexandros Iosifidis

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 cs.CV

AMII: Adaptive Multimodal Inter-personal and Intra-personal Model for Adapted Behavior Synthesis

Jieyeon Woo, Mireille Fares, Catherine Pelachaud, Catherine Achard

专题命中 音频语音多模态 ：multimodal(title,abstract)；分类 eess.AS

Comments 8 pages, 1 figure

Rate-Adaptive Coding Mechanism for Semantic Communications With Multi-Modal Data

Yangshuo He, Guanding Yu, Yunlong Cai

专题命中 音频语音多模态 ：multi-modal(title,abstract)；分类 cs.AI

AVFace: Towards Detailed Audio-Visual 4D Face Reconstruction

Aggelina Chatziagapi, Dimitris Samaras

专题命中 音频语音多模态 ：audio-visual(title)；multimodal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2023. Project page: https://aggelinacha.github.io/AVFace/

Brain Connectivity Features-based Age Group Classification using Temporal Asynchrony Audio-Visual Integration Task

Prerna Singh, Ayush Tripathi, Lalan Kumar, Tapan Kumar Gandhi

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

LIPSFUS: A neuromorphic dataset for audio-visual sensory fusion of lip reading

Antonio Rios-Navarro, Enrique Piñero-Fuentes, Salvador Canas-Moreno, Aqib Javed, Jin Harkin, Alejandro Linares-Barranco

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

Comments Submitted to ISCAS2023, 4 pages, plus references, github link provided

Dance Style Transfer with Cross-modal Transformer

Wenjie Yin, Hang Yin, Kim Baraka, Danica Kragic, Mårten Björkman

专题命中 音频语音多模态 ：cross-modal(title)；multimodal(abstract)；分类 cs.MM

TextMI: Textualize Multimodal Information for Integrating Non-verbal Cues in Pre-trained Language Models

Md Kamrul Hasan, Md Saiful Islam, Sangwu Lee, Wasifur Rahman, Iftekhar Naim, Mohammed Ibrahim Khan, Ehsan Hoque

专题命中 音频语音多模态 ：multimodal(title,abstract)；分类 cs.CL

Self-Supervised Video Forensics by Audio-Visual Anomaly Detection

Chao Feng, Ziyang Chen, Andrew Owens

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 cs.CV

Comments CVPR 2023

Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learning

Weixuan Sun, Jiayi Zhang, Jianyuan Wang, Zheyuan Liu, Yiran Zhong, Tianpeng Feng, Yandong Guo, Yanhao Zhang, Nick Barnes

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 cs.CV

Comments CVPR2023

Dialogue Enhancement and Listening Effort in Broadcast Audio: A Multimodal Evaluation

Matteo Torcoli, Thomas Robotham, Emanuël A. P. Habets

专题命中 音频语音多模态 ：multimodal(title,abstract)；分类 eess.AS

Comments Paper accepted to 14th International Conference on Quality of Multimedia Experience (QoMEX), Lippstadt, Germany, 2022 - version 2 fixes some typos

Multi-modal Expression Recognition with Ensemble Method

Chuanhe Liu, Xinjie Zhang, Xiaolong Liu, Tenggan Zhang, Liyu Meng, Yuchen Liu, Yuanyuan Deng, Wenqiang Jiang

专题命中 音频语音多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

TriAAN-VC: Triple Adaptive Attention Normalization for Any-to-Any Voice Conversion

Hyun Joon Park, Seok Woo Yang, Jin Sob Kim, Wooseok Shin, Sung Won Han

专题命中 音频语音多模态 ：any-to-any(title,abstract)；分类 eess.AS

Comments To appear in ICASSP 2023

A large-scale multimodal dataset of human speech recognition

Yao Ge, Chong Tang, Haobo Li, Zikang Zhang, Wenda Li, Kevin Chetty, Daniele Faccio, Qammer H. Abbasi, Muhammad Imran

专题命中 音频语音多模态 ：multimodal(title,abstract)；分类 eess.AS

Real-Time Audio-Visual End-to-End Speech Enhancement

Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang

专题命中 音频语音多模态 ：audio-visual(title,abstract)；分类 eess.AS

Comments Accepted by ICASSP 2023

The DKU Post-Challenge Audio-Visual Wake Word Spotting System for the 2021 MISP Challenge: Deep Analysis

Haoxu Wang, Ming Cheng, Qiang Fu, Ming Li

专题命中 音频语音多模态 ：audio-visual(title)；multimodal(abstract)；分类 eess.AS

Comments Accepted by ICASSP 2023

Key-Sparse Transformer for Multimodal Speech Emotion Recognition

Weidong Chen, Xiaofeng Xing, Xiangmin Xu, Jichen Yang, Jianxin Pang

专题命中 音频语音多模态 ：multimodal(title,abstract)；分类 eess.AS

Comments This paper was accepted by ICASSP 2022

MM-ALT: A Multimodal Automatic Lyric Transcription System

Xiangming Gu, Longshen Ou, Danielle Ong, Ye Wang

专题命中 音频语音多模态 ：multimodal(title,abstract)；分类 eess.AS

Comments Accepted by ACM Multimedia 2022. Camera ready version and appendix