多模态大模型

Low-dimensional Embodied Semantics for Music and Language

Francisco Afonso Raposo, David Martins de Matos, Ricardo Ribeiro

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments 6 pages, 1 figure, 1 table

DALI: a large Dataset of synchronized Audio, LyrIcs and notes, automatically created using teacher-student machine learning paradigm

Gabriel Meseguer-Brocal, Alice Cohen-Hadria, Geoffroy Peeters

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Journal ref Proceedings of the 19th International Society for Music Information Retrieval Conference, ISMIR, Paris, France, pp. 431-437, 2018

A computational model of early language acquisition from audiovisual experiences of young infants

Okko Räsänen, Khazar Khorrami

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Latent Normalizing Flows for Discrete Sequences

Zachary M. Ziegler, Alexander M. Rush

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Recognition of Advertisement Emotions with Application to Computational Advertising

Abhinav Shukla, Shruti Shriya Gullapuram, Harish Katti, Mohan Kankanhalli, Stefan Winkler, Ramanathan Subramanian

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.AI

Comments Under consideration for publication in IEEE Trans. Affective Computing. arXiv admin note: text overlap with arXiv:1709.01684

Speaker-Independent Speech-Driven Visual Speech Synthesis using Domain-Adapted Acoustic Models

Ahmed Hussen Abdelaziz, Barry-John Theobald, Justin Binder, Gabriele Fanelli, Paul Dixon, Nicholas Apostoloff, Thibaut Weise, Sachin Kajareker

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Comments 9 pages, 2 figures, 2 tables

Do Autonomous Agents Benefit from Hearing?

Abraham Woubie, Anssi Kanervisto, Janne Karttunen, Ville Hautamaki

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.AI

End-to-End Sound Source Separation Conditioned On Instrument Labels

Olga Slizovskaia, Leo Kim, Gloria Haro, Emilia Gomez

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Comments 5 pages, 2 figures, 2 tables, ICASSP 2019

Système d'indexation et de recherche de vidéo intégrant un système gestuel pour les personnes handicapées

Mohamed Hamroun, Mohamed Salim Bouhlel

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.MM

Comments 6 pages, in French. International conference Human-Machine Interaction and Image IHMIM14, May 2014, Hammamet, Tunisia

Static Visual Spatial Priors for DoA Estimation

Pawel Swietojanski, Ondrej Miksik

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 eess.AS

Comments 6 pages, 6 figures, 3 tables

Twins Recognition with Multi Biometric System: Handcrafted-Deep Learning Based Multi Algorithm with Voice-Ear Recognition Based Multi Modal

Cihan Akın, Umit Kacar, Murvet Kirci

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Two-level Attention with Two-stage Multi-task Learning for Facial Emotion Recognition

Xiaohua Wang, Muzi Peng, Lijuan Pan, Min Hu, Chunhua Jin, Fuji Ren

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 10 pages, 4 figures

An audio-only method for advertisement detection in broadcast television content

António Ramires, Diogo Cocharro, Matthew E. P. Davies

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Journal ref Proc. of RecPad-2017, Amadora, Portugal, pp. 21-22, October, 2017

Exploring Textual and Speech information in Dialogue Act Classification with Speaker Domain Adaptation

Xuanli He, Quan Hung Tran, William Havard, Laurent Besacier, Ingrid Zukerman, Gholamreza Haffari

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Comments 5 pages, 2 figurs

Assessing the Contribution of Semantic Congruency to Multisensory Integration and Conflict Resolution

Di Fu, Pablo Barros, German I. Parisi, Haiyan Wu, Sven Magg, Xun Liu, Stefan Wermter

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.AI

Comments Workshop on Crossmodal Learning for Intelligent Robotics at IROS'18, Madrid, Spain

Attention as a Perspective for Learning Tempo-invariant Audio Queries

Matthias Dorfer, Jan Hajič, Gerhard Widmer

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Comments The 2018 Joint Workshop on Machine Learning for Music

EmotiW 2018: Audio-Video, Student Engagement and Group-Level Affect Prediction

Abhinav Dhall, Amanjot Kaur, Roland Goecke, Tom Gedeon

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Dynamic Temporal Alignment of Speech to Lips

Tavi Halperin, Ariel Ephrat, Shmuel Peleg

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Music Style Transfer: A Position Paper

Shuqi Dai, Zheng Zhang, Gus G. Xia

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 eess.AS

Comments In Proceeding of International Workshop on Musical Metacreation (MUME), 2018, Salamanca, Spain

Towards Lipreading Sentences with Active Appearance Models

George Sterpu, Naomi Harte

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 eess.AS

Comments Presented at The 14th International Conference on Auditory-Visual Speech Processing (AVSP 2017)

Investigating Audio, Visual, and Text Fusion Methods for End-to-End Automatic Personality Prediction

Onno Kampman, Elham J. Barezi, Dario Bertero, Pascale Fung

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.AI

Comments Accepted at ACL2018 short paper

An Ensemble Framework of Voice-Based Emotion Recognition System for Films and TV Programs

Fei Tao, Gang Liu, Qingen Zhao

专题命中 音频语音多模态 ：multimodal(abstract)；分类 eess.AS

Seeing Through Noise: Visually Driven Speaker Separation and Enhancement

Aviv Gabbay, Ariel Ephrat, Tavi Halperin, Shmuel Peleg

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments Supplementary video: https://www.youtube.com/watch?v=qmsyj7vAzoI

A Multi-Biometrics for Twins Identification Based Speech and Ear

Cihan Akin, Umit Kacar, Murvet Kirci

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Survey on Emotional Body Gesture Recognition

Fatemeh Noroozi, Ciprian Adrian Corneanu, Dorota Kamińska, Tomasz Sapiński, Sergio Escalera, Gholamreza Anbarjafari

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Towards Deep Modeling of Music Semantics using EEG Regularizers

Francisco Raposo, David Martins de Matos, Ricardo Ribeiro, Suhua Tang, Yi Yu

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 eess.AS

Comments 5 pages, 2 figures

Prosodic Features from Large Corpora of Child-Directed Speech as Predictors of the Age of Acquisition of Words

Lea Frermann, Michael C. Frank

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CL

Look, Listen and Learn

Relja Arandjelović, Andrew Zisserman

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments Appears in: IEEE International Conference on Computer Vision (ICCV) 2017

Towards Score Following in Sheet Music Images

Matthias Dorfer, Andreas Arzt, Gerhard Widmer

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Published In Proceedings of the 17th International Society for Music Information Retrieval Conference (2016)

Fusion of EEG and Musical Features in Continuous Music-emotion Recognition

Nattapong Thammasan, Ken-ichi Fukui, Masayuki Numao

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.AI

Comments The short version of this paper is accepted to appear as an abstract in the proceedings of AAAI-17 (student abstract and poster program)