Bridging Modalities and Transferring Knowledge: Enhanced Multimodal Understanding and Recognition
弥合模态与知识转移:增强多模态理解和识别
机构 * University of Bristol(布里斯托大学) ; University of Würzburg(乌尔姆大学) ; Processing Speech and Images (PSI)(语音与图像处理组)
专题命中 融合架构与评测 :multimodal fusion(abstract);分类 cs.CV
AI总结 本文提出多模态对齐、翻译、融合和转移方法,提升复杂输入的理解与识别能力,涵盖空间语言、医学文本、知识图谱和动作识别等多个领域。
Comments Ph.D. manuscript; Supervisors/Mentors: Marie-Francine Moens and Tinne Tuytelaars