多模态大模型 - arXivDaily 专题

1912.02671 2021-02-23 eess.AS cs.LG eess.IV 79%

Audio-Visual Target Speaker Enhancement on Multi-Talker Environment using Event-Driven Cameras

Ander Arriandiaga, Giovanni Morrone, Luca Pasa, Leonardo Badino, Chiara Bartolozzi

专题命中音频语音多模态：audio-visual(title,abstract)；分类 eess.AS

Comments Accepted at ISCAS 2021

2011.00030 2021-02-12 eess.AS 79%

A Curated Dataset of Urban Scenes for Audio-Visual Scene Analysis

Shanshan Wang, Annamaria Mesaros, Toni Heittola, Tuomas Virtanen

专题命中音频语音多模态：audio-visual(title,abstract)；分类 eess.AS

Comments accepted by ICASSP 2021

2010.04556 2021-02-04 eess.AS cs.LG eess.IV 79%

Audio-Visual Speech Inpainting with Deep Learning

Giovanni Morrone, Daniel Michelsanti, Zheng-Hua Tan, Jesper Jensen

专题命中音频语音多模态：audio-visual(title,abstract)；分类 eess.AS

Comments Accepted at ICASSP 2021

2012.15470 2021-01-01 cs.CV 79%

Audio-Visual Floorplan Reconstruction

Senthil Purushwalkam, Sebastian Vicenc Amengual Gari, Vamsi Krishna Ithapu, Carl Schissler, Philip Robinson, Abhinav Gupta, Kristen Grauman

专题命中音频语音多模态：audio-visual(title)；multi-modal(abstract)；分类 cs.CV

2012.14891 2021-01-01 cs.CV cs.LG 79%

Detecting Hate Speech in Multi-modal Memes

Abhishek Das, Japsimar Singh Wahi, Siyao Li

专题命中音频语音多模态：multi-modal(title,abstract)；分类 cs.CV

2012.10283 2020-12-21 cs.CV cs.LG 79%

Temporal Bilinear Encoding Network of Audio-Visual Features at Low Sampling Rates

Feiyan Hu, Eva Mohedano, Noel O'Connor, Kevin McGuinness

专题命中音频语音多模态：audio-visual(title,abstract)；分类 cs.CV

Comments 8 pages

1908.02590 2020-12-18 cs.SD cs.LG eess.AS 79%

Audio-visual Speech Enhancement Using Conditional Variational Auto-Encoders

Mostafa Sadeghi, Simon Leglaive, Xavier Alameda-PIneda, Laurent Girin, Radu Horaud

专题命中音频语音多模态：audio-visual(title,abstract)；分类 eess.AS

Comments Submitted to IEEE/ACM Transactions on Audio, Speech, and Language Processing

Journal ref IEEE/ACM Transactions on Audio, Speech and Language Processing, 28, 2020

2012.07467 2020-12-15 eess.AS cs.LG 79%

AV Taris: Online Audio-Visual Speech Recognition

George Sterpu, Naomi Harte

专题命中音频语音多模态：audio-visual(title,abstract)；分类 eess.AS

2012.01311 2020-12-03 cs.CV cs.HC cs.LG cs.RO cs.SD 79%

Top-1 CORSMAL Challenge 2020 Submission: Filling Mass Estimation Using Multi-modal Observations of Human-robot Handovers

Vladimir Iashin, Francesca Palermo, Gökhan Solak, Claudio Coppola

专题命中音频语音多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Code: https://github.com/v-iashin/CORSMAL Docker: https://hub.docker.com/r/iashin/corsmal

2012.01002 2020-12-03 cs.CL cs.LG 79%

Classification of Multimodal Hate Speech -- The Winning Solution of Hateful Memes Challenge

Xiayu Zhong

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.CL

2011.06087 2020-11-13 cs.HC cs.MM 79%

Evoking Places from Spaces. The application of multimodal narrative techniques in the creation of "U Modified"

Gareth W. Young, Siobhán Mannion, Sara Wentworth

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.MM

Comments 5 pages

Journal ref 15th Sound and Music Computing Conference (SMC2018)

2011.02132 2020-11-05 eess.AS 79%

Multi-Modal Transformers Utterance-Level Code-Switching Detection

Krishna D N

专题命中音频语音多模态：multi-modal(title,abstract)；分类 eess.AS

Comments 8 pages, 2 figures

2011.01819 2020-11-04 cs.CV 79%

Learning Representations from Audio-Visual Spatial Alignment

Pedro Morgado, Yi Li, Nuno Vasconcelos

专题命中音频语音多模态：audio-visual(title,abstract)；分类 cs.CV

Comments To appear at Advances in Neural Information Processing Systems (NeurIPS), 2020

2009.05019 2020-11-03 cs.CL cs.LG 79%

Multi-modal embeddings using multi-task learning for emotion recognition

Aparna Khare, Srinivas Parthasarathy, Shiva Sundaram

专题命中音频语音多模态：multi-modal(title,abstract)；分类 cs.CL

Comments To appear in Interspeech,2020

2010.08642 2020-10-20 cs.CL 79%

Multimodal Speech Recognition with Unstructured Audio Masking

Tejas Srinivasan, Ramon Sanabria, Florian Metze, Desmond Elliott

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to NLP Beyond Text workshop, EMNLP 2020

2010.06318 2020-10-14 cs.CV 79%

Audio-Visual Self-Supervised Terrain Type Discovery for Mobile Platforms

Akiyoshi Kurobe, Yoshikatsu Nakajima, Hideo Saito, Kris Kitani

专题命中音频语音多模态：audio-visual(title)；multi-modal(abstract)；分类 cs.CV

2010.04470 2020-10-12 cs.CV 79%

gundapusunil at SemEval-2020 Task 8: Multimodal Memotion Analysis

Sunil Gundapu, Radhika Mamidi

专题命中音频语音多模态：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments 8 pages, 4 figures

2010.02384 2020-10-07 cs.CL 79%

Fine-Grained Grounding for Multimodal Speech Recognition

Tejas Srinivasan, Ramon Sanabria, Florian Metze, Desmond Elliott

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to Findings of EMNLP 2020

2009.05651 2020-10-07 cs.AI cs.LG 79%

Multimodal Depression Severity Prediction from medical bio-markers using Machine Learning Tools and Technologies

Shivani Shimpi, Shyam Thombre, Snehal Reddy, Ritik Sharma, Srijan Singh

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.AI

Comments The paper content has one major problem in a section that is needs more attention and some work, and is agreed by all authors. The change is necessary in terms of correctness and completeness of the paper. Hence, requesting for the withdrawal to allow for the changes

2004.14198 2020-10-06 cs.CL 79%

Multimodal Routing: Improving Local and Global Interpretability of Multimodal Language Analysis

Yao-Hung Hubert Tsai, Martin Q. Ma, Muqiao Yang, Ruslan Salakhutdinov, Louis-Philippe Morency

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.CL

2009.14361 2020-10-01 cs.CL cs.CY 79%

Ethically Collecting Multi-Modal Spontaneous Conversations with People that have Cognitive Impairments

Angus Addlesee, Pierre Albert

专题命中音频语音多模态：multi-modal(title,abstract)；分类 cs.CL

Comments Published at LREC's Workshop on Legal and Ethical Issues in Human Language Technologies 2020

Journal ref LREC Workshop on Legal and Ethical Issues in Human Language Technologies (2020) 15-20

2009.00402 2020-09-02 cs.CV 79%

Multimodal Aggregation Approach for Memory Vision-Voice Indoor Navigation with Meta-Learning

Liqi Yan, Dongfang Liu, Yaoxian Song, Changbin Yu

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 6 figures, 2 tables, accepted at 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2020)

1902.07473 2020-08-07 cs.CV 79%

Dual-modality seq2seq network for audio-visual event localization

Yan-Bo Lin, Yu-Jhe Li, Yu-Chiang Frank Wang

专题命中音频语音多模态：audio-visual(title,abstract)；分类 cs.CV

Comments Accepted in ICASSP 2019

2007.06809 2020-07-22 cs.CV 79%

DeepMSRF: A novel Deep Multimodal Speaker Recognition framework with Feature selection

Ehsan Asali, Farzan Shenavarmasouleh, Farid Ghareh Mohammadi, Prasanth Sengadu Suresh, Hamid R. Arabnia

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.CV

Comments The 24th International Conference on Image Processing, Computer Vision, & Pattern Recognition (IPCV'20: July 27-30, 2020, USA)

2007.09903 2020-07-21 cs.CL 79%

Multimodal Dialogue State Tracking By QA Approach with Data Augmentation

Xiangyang Mou, Brandyn Sigouin, Ian Steenstra, Hui Su

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.CL

Comments AAAI DSTC8 Workshop

2005.14646 2020-06-01 eess.AS 79%

The INESC-ID Multi-Modal System for the ADReSS 2020 Challenge

Anna Pompili, Thomas Rolland, Alberto Abad

专题命中音频语音多模态：multi-modal(title,abstract)；分类 eess.AS

Comments 5 pages, 1 figure. Submitted to INTERSPEECH2020

2005.08335 2020-05-19 eess.AS cs.SD 79%

Multimodal Target Speech Separation with Voice and Face References

Leyuan Qu, Cornelius Weber, Stefan Wermter

专题命中音频语音多模态：multimodal(title)；audio-visual(abstract)；分类 eess.AS

1812.06589 2020-05-14 cs.CV 79%

Arbitrary Talking Face Generation via Attentional Audio-Visual Coherence Learning

Hao Zhu, Huaibo Huang, Yi Li, Aihua Zheng, Ran He

专题命中音频语音多模态：audio-visual(title,abstract)；分类 cs.CV

Comments IJCAI-2020

2004.13236 2020-04-29 cs.CV 79%

Deep Auto-Encoders with Sequential Learning for Multimodal Dimensional Emotion Recognition

Dung Nguyen, Duc Thanh Nguyen, Rui Zeng, Thanh Thi Nguyen, Son N. Tran, Thin Nguyen, Sridha Sridharan, Clinton Fookes

专题命中音频语音多模态：multimodal(title,abstract)；分类 cs.CV

Comments Under Review on Transaction on Multimedia

1909.01067 2020-04-15 cs.LG cs.SD eess.AS stat.ML 79%

Multimodal Deep Learning for Mental Disorders Prediction from Audio Speech Samples

Habibeh Naderi, Behrouz Haji Soleimani, Stan Matwin

专题命中音频语音多模态：multimodal(title,abstract)；分类 eess.AS

Comments arXiv admin note: text overlap with arXiv:1811.09362 by other authors

1. 音频语音多模态 4585 篇

Audio-Visual Target Speaker Enhancement on Multi-Talker Environment using Event-Driven Cameras

A Curated Dataset of Urban Scenes for Audio-Visual Scene Analysis

Audio-Visual Speech Inpainting with Deep Learning

Audio-Visual Floorplan Reconstruction

Detecting Hate Speech in Multi-modal Memes

Temporal Bilinear Encoding Network of Audio-Visual Features at Low Sampling Rates

Audio-visual Speech Enhancement Using Conditional Variational Auto-Encoders

AV Taris: Online Audio-Visual Speech Recognition

Top-1 CORSMAL Challenge 2020 Submission: Filling Mass Estimation Using Multi-modal Observations of Human-robot Handovers

Classification of Multimodal Hate Speech -- The Winning Solution of Hateful Memes Challenge

Evoking Places from Spaces. The application of multimodal narrative techniques in the creation of "U Modified"

Multi-Modal Transformers Utterance-Level Code-Switching Detection

Learning Representations from Audio-Visual Spatial Alignment

Multi-modal embeddings using multi-task learning for emotion recognition

Multimodal Speech Recognition with Unstructured Audio Masking

Audio-Visual Self-Supervised Terrain Type Discovery for Mobile Platforms

gundapusunil at SemEval-2020 Task 8: Multimodal Memotion Analysis

Fine-Grained Grounding for Multimodal Speech Recognition

Multimodal Depression Severity Prediction from medical bio-markers using Machine Learning Tools and Technologies

Multimodal Routing: Improving Local and Global Interpretability of Multimodal Language Analysis

Ethically Collecting Multi-Modal Spontaneous Conversations with People that have Cognitive Impairments

Multimodal Aggregation Approach for Memory Vision-Voice Indoor Navigation with Meta-Learning

Dual-modality seq2seq network for audio-visual event localization

DeepMSRF: A novel Deep Multimodal Speaker Recognition framework with Feature selection

Multimodal Dialogue State Tracking By QA Approach with Data Augmentation

The INESC-ID Multi-Modal System for the ADReSS 2020 Challenge

Multimodal Target Speech Separation with Voice and Face References

Arbitrary Talking Face Generation via Attentional Audio-Visual Coherence Learning

Deep Auto-Encoders with Sequential Learning for Multimodal Dimensional Emotion Recognition

Multimodal Deep Learning for Mental Disorders Prediction from Audio Speech Samples