多模态大模型

Speech and the n-Back task as a lens into depression. How combining both may allow us to isolate different core symptoms of depression

Salvatore Fara, Stefano Goria, Emilia Molimpakis, Nicholas Cummins

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 eess.AS

Comments Submitted to Interspeech 2022

An Artificial Intelligence Browser Architecture (AIBA) For Our Kind and Others: A Voice Name System Speech implementation with two warrants, Wake Neutrality and Value Preservation of Personally Identifiable Information

Brian Subirana

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.AI

HiFi-VC: High Quality ASR-Based Voice Conversion

A. Kashkin, I. Karpukhin, S. Shishkin

专题命中 音频语音多模态 ：any-to-any(abstract)；分类 eess.AS

Comments Submitted to INTERSPEECH 2022

NeuraGen-A Low-Resource Neural Network based approach for Gender Classification

Shankhanil Ghosh, Chhanda Saha, Naagamani Molakathaala

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 eess.AS

Self-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenes

Zengjie Song, Yuxi Wang, Junsong Fan, Tieniu Tan, Zhaoxiang Zhang

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments Camera-ready, CVPR 2022. Code: https://github.com/zjsong/SSPL

Demo of the Linguistic Field Data Management and Analysis System -- LiFE

Siddharth Singh, Ritesh Kumar, Shyam Ratan, Sonal Sinha

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CL

Comments Accepted in the 19th International Conference on Natural Language Processing (ICON-2021)

Audio visual character profiles for detecting background characters in entertainment media

Rahul Sharma, Shrikanth Narayanan

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments submitted to ICIP 2022

A Perceptual Measure for Evaluating the Resynthesis of Automatic Music Transcriptions

Federico Simonetta, Federico Avanzini, Stavros Ntalampiras

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments Accepted by Multimedia Tools and Applications (2022); supplementary materials are in the latex sources

Self-supervised Transformer for Deepfake Detection

Hanqing Zhao, Wenbo Zhou, Dongdong Chen, Weiming Zhang, Nenghai Yu

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Revisiting Over-Smoothness in Text to Speech

Yi Ren, Xu Tan, Tao Qin, Zhou Zhao, Tie-Yan Liu

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments Accepted by ACL 2022

Unsupervised Audio-Caption Aligning Learns Correspondences between Individual Sound Events and Textual Phrases

Huang Xie, Okko Räsänen, Konstantinos Drossos, Tuomas Virtanen

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 eess.AS

Comments Accepted at ICASSP 2022

Audio Retrieval with Natural Language Queries: A Benchmark Study

A. Sophia Koepke, Andreea-Maria Oncescu, João F. Henriques, Zeynep Akata, Samuel Albanie

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 eess.AS

Comments Submitted to Transactions on Multimedia. arXiv admin note: substantial text overlap with arXiv:2105.02192

Journal ref IEEE Transactions on Multimedia 2022

The slurk Interaction Server Framework: Better Data for Better Dialog Models

Jana Götze, Maike Paetzel-Prüsmann, Wencke Liermann, Tim Diekmann, David Schlangen

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Comments submitted to LREC 2022

Voice-assisted Image Labelling for Endoscopic Ultrasound Classification using Neural Networks

Ester Bonmati, Yipeng Hu, Alexander Grimwood, Gavin J. Johnson, George Goodchild, Margaret G. Keane, Kurinchi Gurusamy, Brian Davidson, Matthew J. Clarkson, Stephen P. Pereira, Dean C. Barratt

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Submitted to IEEE TMI

Selective Listening by Synchronizing Speech with Lips

Zexu Pan, Ruijie Tao, Chenglin Xu, Haizhou Li

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Comments Accepted by TASLP

A wearable sensor vest for social humanoid robots with GPGPU, IoT, and modular software architecture

Mohsen Jafarzadeh, Stephen Brooks, Shimeng Yu, Balakrishnan Prabhakaran, Yonas Tadesse

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.AI

Comments This is the preprint version. The final version is published in Robotics and Autonomous Systems, Volume 139, 2021, Page 103536, ISSN 0921-8890, https://doi.org/10.1016/j.robot.2020.103536

Journal ref Robotics and Autonomous Systems, vol 139, page 103536, year 2021

Semantics-Consistent Representation Learning for Remote Sensing Image-Voice Retrieval

Hailong Ning, Bin Zhao, Yuan Yuan

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 cs.MM

Novel Hybrid DNN Approaches for Speaker Verification in Emotional and Stressful Talking Environments

Ismail Shahin, Ali Bou Nassif, Nawel Nemmour, Ashraf Elnagar, Adi Alhudhaif, Kemal Polat

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Comments 23 pages, 13 figures

Journal ref Published in Neural Computing and Applications. Vol. 33, issue 23, June 2021, pp. 16033-16055

A Review of Web Infodemic Analysis and Detection Trends across Multi-modalities using Deep Neural Networks

Chahat Raj, Priyanka Meel

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CL

Comments 47 pages

Deep Spoken Keyword Spotting: An Overview

Iván López-Espejo, Zheng-Hua Tan, John Hansen, Jesper Jensen

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Position-based Contributive Embeddings for Aspect-Based Sentiment Analysis

Zijian Zhang, Chenxin Zhang, Jiangfeng Li, Qinpei Zhao

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Comments 5 pages, 3 figures. Submitted to ICASSP 2022

Joint Learning of Visual-Audio Saliency Prediction and Sound Source Localization on Multi-face Videos

Minglang Qiao, Yufan Liu, Mai Xu, Xin Deng, Bing Li, Weiming Hu, Ali Borji

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 21 pages, 15 figures

Multi-channel Multi-frame ADL-MVDR for Target Speech Separation

Zhuohuang Zhang, Yong Xu, Meng Yu, Shi-Xiong Zhang, Lianwu Chen, Donald S. Williamson, Dong Yu

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Comments Accepted by IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP); Demos available at https://zzhang68.github.io/mcmf-adl-mvdr/

Personalized breath based biometric authentication with wearable multimodality

Manh-Ha Bui, Viet-Anh Tran, Cuong Pham

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments 7 pages (2 columns), 5 tables, 7 figures, submitted to ACM Multimedia 2020

Don't Separate, Learn to Remix: End-to-End Neural Remixing with Joint Optimization

Haici Yang, Shivani Firodiya, Nicholas J. Bryan, Minje Kim

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Neural Pitch-Shifting and Time-Stretching with Controllable LPCNet

Max Morrison, Zeyu Jin, Nicholas J. Bryan, Juan-Pablo Caceres, Bryan Pardo

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Comments Submitted to ICASSP 2022

Learning Acoustic Scattering Fields for Dynamic Interactive Sound Propagation

Zhenyu Tang, Hsien-Yu Meng, Dinesh Manocha

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Journal ref 2021 IEEE Virtual Reality and 3D User Interfaces (VR) (pp. 835-844)

Edge AI without Compromise: Efficient, Versatile and Accurate Neurocomputing in Resistive Random-Access Memory

Weier Wan, Rajkumar Kubendran, Clemens Schaefer, S. Burc Eryilmaz, Wenqiang Zhang, Dabin Wu, Stephen Deiss, Priyanka Raina, He Qian, Bin Gao, Siddharth Joshi, Huaqiang Wu, H. -S. Philip Wong, Gert Cauwenberghs

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.AI

Comments 34 pages, 14 figures, 1 table

Audio2Gestures: Generating Diverse Gestures from Speech Audio with Conditional Variational Autoencoders

Jing Li, Di Kang, Wenjie Pei, Xuefei Zhe, Ying Zhang, Zhenyu He, Linchao Bao

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 cs.CV

Generating Music and Generative Art from Brain activity

Ricardo Andres Diaz Rincon

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.AI