多模态大模型

A Multi-Biometrics for Twins Identification Based Speech and Ear

Cihan Akin, Umit Kacar, Murvet Kirci

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Survey on Emotional Body Gesture Recognition

Fatemeh Noroozi, Ciprian Adrian Corneanu, Dorota Kamińska, Tomasz Sapiński, Sergio Escalera, Gholamreza Anbarjafari

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Towards Deep Modeling of Music Semantics using EEG Regularizers

Francisco Raposo, David Martins de Matos, Ricardo Ribeiro, Suhua Tang, Yi Yu

专题命中 音频语音多模态 ：cross-modal(abstract)；分类 eess.AS

Comments 5 pages, 2 figures

Prosodic Features from Large Corpora of Child-Directed Speech as Predictors of the Age of Acquisition of Words

Lea Frermann, Michael C. Frank

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CL

Look, Listen and Learn

Relja Arandjelović, Andrew Zisserman

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments Appears in: IEEE International Conference on Computer Vision (ICCV) 2017

Towards Score Following in Sheet Music Images

Matthias Dorfer, Andreas Arzt, Gerhard Widmer

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Published In Proceedings of the 17th International Society for Music Information Retrieval Conference (2016)

Fusion of EEG and Musical Features in Continuous Music-emotion Recognition

Nattapong Thammasan, Ken-ichi Fukui, Masayuki Numao

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.AI

Comments The short version of this paper is accepted to appear as an abstract in the proceedings of AAAI-17 (student abstract and poster program)

An On-line Variational Bayesian Model for Multi-Person Tracking from Cluttered Scenes

Sileye Ba, Xavier Alameda-Pineda, Alessio Xompero, Radu Horaud

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Comments 21 pages, 9 figures, 4 tables

Journal ref Computer Vision and Image Understanding, volume 153, December 2016, pages 64-76

Automatic recognition of child speech for robotic applications in noisy environments

Samuel Fernando, Roger K. Moore, David Cameron, Emily C. Collins, Abigail Millings, Amanda J. Sharkey, Tony J. Prescott

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Comments Submission to Computer Speech and Language, special issue on Interaction Technologies for Children

Engagement Detection in Meetings

Maria Frank, Ghassem Tofighi, Haisong Gu, Renate Fruchter

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CV

Comments The paper has been published on ICCCBE 2016. http://www.see.eng.osaka-u.ac.jp/seeit/icccbe2016/ http://www.see.eng.osaka-u.ac.jp/seeit/icccbe2016/download/Tentative_Time_Table_ICCCBE2016_2016-05-10.pdf

Leveraging Contextual Cues for Generating Basketball Highlights

Vinay Bettadapura, Caroline Pantofaru, Irfan Essa

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.MM

Comments Proceedings of ACM Multimedia 2016

Co-Localization of Audio Sources in Images Using Binaural Features and Locally-Linear Regression

Antoine Deleforge, Radu Horaud, Yoav Schechner, Laurent Girin

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.MM

Comments 15 pages, 8 figures

Journal ref IEEE Transactions on Audio, Speech, and Language Processing 23(4), 718-731, April, 2015

Non-Verbal Communication Analysis in Victim-Offender Mediations

Víctor Ponce-López, Sergio Escalera, Marc Pérez, Oriol Janés, Xavier Baró

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.AI

Comments Please, find the supplementary video material at: http://sunai.uoc.edu/~vponcel/video/VOMSessionSample.mp4

Detecting Interrogative Utterances with Recurrent Neural Networks

Junyoung Chung, Jacob Devlin, Hany Hassan Awadalla

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CL

Comments 6 pages, accepted to NIPS 2015 Workshop on Machine Learning for Spoken Language Understanding and Interaction

Automating Access Control Logics in Simple Type Theory with LEO-II

Christoph Benzmueller

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.AI

Comments ii + 20 pages

Journal ref SEKI Report SR-2008-01 (ISSN 1437-4447), Saarland University, 2008

Visual Speech Recognition

Ahmad B. A. Hassanat

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CV

Comments Speech and Language Technologies (Book), Prof. Ivo Ipsic (Ed.), ISBN: 978-953-307-322-4, InTech (2011)

Activities of Daily Living Indexing by Hierarchical HMM for Dementia Diagnostics

Svebor Karaman, Jenny Benois-Pineau, Jean-François Dartigues, Yann Gaëstel, Rémi Mégret, Julien Pinquier

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.MM

Comments 2011 9th International Workshop on Content-Based Multimedia Indexing (CBMI), Madrid : Spain (2011)

Generating Music from Literature

Hannah Davis, Saif M. Mohammad

专题命中 音频语音多模态 ：audio-visual(abstract)；分类 cs.CL

Journal ref In Proceedings of the EACL Workshop on Computational Linguistics for Literature, April 2014, Gothenburg, Sweden

Prime Implicates and Prime Implicants: From Propositional to Modal Logic

Meghyn Bienvenu

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.AI

Journal ref Journal Of Artificial Intelligence Research, Volume 36, pages 71-128, 2009

Speech Recognition: Increasing Efficiency of Support Vector Machines

Aamir Khan, Muhammad Farhan, Asar Ali

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Comments 5 pages, 11 figures. arXiv admin note: text overlap with arXiv:1201.3720 and arXiv:1204.1177

Journal ref International Journal of Computer Applications 35(7):17-21, December 2011

Toward Natural Gesture/Speech Control of a Large Display

S. Kettebekov, R. Sharma

专题命中 音频语音多模态 ：multimodal(abstract)；分类 cs.CV

Comments Engineering for Human-Computer Interaction (EHCI'01),Toronto, Canada. May 11-14, 2001. Lecture Notes in Computer Science, Springer Verlag. 14 pages

ATLAS: A flexible and extensible architecture for linguistic annotation

Steven Bird, David Day, John Garofolo, John Henderson, Christophe Laprun, Mark Liberman

专题命中 音频语音多模态 ：multi-modal(abstract)；分类 cs.CL

Comments 8 pages, 9 figures

Journal ref Proceedings of the Second International Conference on Language Resources and Evaluation, pp. 1699-1706, Paris: European Language Resources Association, 2000

YuE: Scaling Open Foundation Models for Long-Form Music Generation

Ruibin Yuan, Hanfeng Lin, Shuyue Guo, Ge Zhang, Jiahao Pan, Yongyi Zang, Haohe Liu, Yiming Liang, Wenye Ma, Xingjian Du, Xinrun Du, Zhen Ye, Tianyu Zheng, Zhengxuan Jiang, Yinghao Ma, Minghao Liu, Zeyue Tian, Ziya Zhou, Liumeng Xue, Xingwei Qu, Yizhi Li, Shangda Wu, Tianhao Shen, Ziyang Ma, Jun Zhan, Chunhui Wang, Yatian Wang, Xiaowei Chi, Xinyue Zhang, Zhenzhu Yang, Xiangzhou Wang, Shansong Liu, Lingrui Mei, Peng Li, Junjie Wang, Jianwei Yu, Guojian Pang, Xu Li, Zihao Wang, Xiaohuan Zhou, Lijun Yu, Emmanouil Benetos, Yong Chen, Chenghua Lin, Xie Chen, Gus Xia, Zhaoxiang Zhang, Chao Zhang, Wenhu Chen, Xinyu Zhou, Xipeng Qiu, Roger Dannenberg, Jiaheng Liu, Jian Yang, Wenhao Huang, Wei Xue, Xu Tan, Yike Guo

机构 * HKUST（香港科技大学） ； MAP（多模态艺术投影） 纠错

专题命中 音频语音多模态 ：分类 cs.AI、cs.MM、eess.AS；multimodal(comments)

Comments https://github.com/multimodal-art-projection/YuE

LD-LAudio-V1: Video-to-Long-Form-Audio Generation Extension with Dual Lightweight Adapters

Haomin Zhang, Kristin Qi, Shuxin Yang, Zihao Chen, Chaofan Ding, Xinhan Di

机构 * Giant Network, China（中国巨网） ； Computer Science, University of Massachusetts Boston（马萨诸塞大学波士顿分校计算机科学系） 纠错

专题命中 音频语音多模态 ：分类 cs.CV、cs.AI、eess.AS；audio-visual(comments)

Comments Gen4AVC@ICCV: 1st Workshop on Generative AI for Audio-Visual Content Creation

Long-Term, in-the-Wild Study of Feedback about Speech Intelligibility for K-12 Students Attending Class via a Telepresence Robot

Matthew Rueben, Mohammad Syed, Emily London, Mark Camarena, Eunsook Shin, Yulun Zhang, Timothy S. Wang, Thomas R. Groechel, Rhianna Lee, Maja J. Matarić

专题命中 音频语音多模态 ：multimodal(abstract,journal_ref)

Journal ref Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI '21), October 18-22, 2021, Montreal, QC, Canada. ACM, New York, NY, USA, 10 pages

A Wearable Virtual Touch System for Cars

Gowdham Prabhakar, Priyam Rajkhowa, Pradipta Biswas

专题命中 音频语音多模态 ：multimodal(abstract,comments)

Comments Journal on Multimodal User Interface 2021

You Have a Point There: Object Selection Inside an Automobile Using Gaze, Head Pose and Finger Pointing

Abdul Rafey Aftab, Michael von der Beeck, Michael Feld

专题命中 音频语音多模态 ：multimodal(abstract,journal_ref)

Journal ref In Proceedings of the 2020 International Conference on Multimodal Interaction, pp. 595-603. 2020

ASR-based Features for Emotion Recognition: A Transfer Learning Approach

Noé Tits, Kevin El Haddad, Thierry Dutoit

专题命中 音频语音多模态 ：分类 cs.CL、cs.AI、eess.AS；multimodal(comments)

Comments Accepted to be published in the First Workshop on Computational Modeling of Human Multimodal Language - ACL 2018

Reasoning-Oriented Post-Training and Inference-Time LoRA Rescaling for Audio-Dependent Question Answering

面向推理的后训练与推理时LoRA重缩放：针对音频相关问答任务

Weiteng Hu, Yin Cao, Jun Yang

专题命中 音频语音多模态 ：cross-modal(abstract)

AI总结 该研究针对音频相关问答任务，提出面向推理的LoRA后训练与推理时重缩放方法，在Qwen和MOSS-Audio模型上验证了有效性，提交系统在挑战赛中获总体第三、轻量级系统第二。

Chorus: Harmonizing Context and Sensing Signals for Data-Free Model Customization in IoT

Chorus：谐音上下文和传感信号以实现物联网中的无数据模型定制

Liyu Zhang, Yejia Liu, Kwun Ho Liu, Runxi Huang, Xiaomin Ouyang

专题命中 音频语音多模态 ：cross-modal(abstract)

AI总结 Chorus通过学习上下文表示，在无需目标域数据的情况下，实现对未知部署条件的模型自适应，实验显示其在多种传感任务中性能优于现有方法，且推理延迟接近传感器部署。