Towards Language-Independent Face-Voice Association with Multimodal Foundation Models
Department of Computational Linguistics, University of Zurich（苏黎世大学计算语言学系）
Aref Farhadipour, Teodora Vukovic, Volker Dellwo
备注：
This paper presents the system description of the UZH-CL team for the FAME2026 Challenge at ICASSP 2026. Our model achieved second place in the final ranking
This paper describes the UZH-CL system submitted to the FAME2026 Challenge. The challenge focuses on cross-modal verification under unique multilingual conditions, specifically unseen and unheard languages. Our approach investigates two distinct architectures, consisting of a baseline dual-encoder system trained from scratch using contrastive and orthogonal projection losses, and a foundation model approach leveraging ImageBind with LoRA. To address the data scarcity and language constraints of the challenge, we curated an external Arabic dataset from VoxBlink. Our best-performing system, ImageBind-LoRA, demonstrates remarkable cross-lingual generalization: despite being fine-tuned exclusively on Arabic audio, it achieved an EER of 24.73% on the evaluation set (English and German), securing 2nd place in the competition.
XM-ALIGN: Unified Cross-Modal Embedding Alignment for Face-Voice Association
School of Computer Science and Technology, Xinjiang University（新疆大学计算机科学与技术学院）；Xinjiang Multimodal Information Technology Engineering Research Center（新疆多模态信息处理工程技术研究中心）；Urumqi Branch, China Mobile Group Xinjiang Co., Ltd（中国移动新疆乌鲁木齐分公司）；School of Intelligence Science and Technology, Xinjiang University（新疆大学智能科学与技术学院）；Department of Electronic Engineering, Tsinghua University（清华大学电子工程系）
Face-voice Association in Multilingual Environments (FAME) Challenge 2024 Evaluation Plan
University of Engineering and Technology Taxila（拉合尔工程技术大学塔克西拉分校）；Johannes Kepler University Linz（约翰内斯·开普勒大学林茨分校）；Fortemedia Singapore（Fortemedia新加坡公司）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）
Face-Voice Association for Audiovisual Active Speaker Detection in Egocentric Recordings
Speech and Hearing (SPandH) group, School of Computer Science, The University of Sheffield, Sheffield, United Kingdom（语音与听力（SPandH）小组，计算机科学学院，谢菲尔德大学，谢菲尔德，英国）；South Westphalia University of Applied Sciences, Iserlohn, Germany（西南弗劳恩霍夫应用科学大学，伊塞尔洛恩，德国）
Speaker Recognition in Realistic Scenario Using Multimodal Data
University of Engineering and Technology Taxila（塔克西拉工程技术大学）；Swarm Robotics Lab NCRA（国家机器人与自动化研究所群体机器人实验室）；Deutsches Elektronen-Synchrotron DESY（德国电子同步加速器研究所）
Voice EHR: Introducing Multimodal Audio Data for Health
National Institutes of Health（美国国立卫生研究院）；University of Oxford（牛津大学）；University of South Florida（南佛罗里达大学）；Oxford University Clinical Research Unit（牛津大学临床研究组）；University of Tennessee Health Sciences Center（田纳西大学健康科学中心）；Johns Hopkins University（约翰斯·霍普金斯大学）；Johns Hopkins University School of Medicine（约翰斯·霍普金斯大学医学院）；Oxford University Clinical Research Unit Indonesia（牛津大学印度尼西亚临床研究组）；University of Rwanda（卢旺达大学）；King Faisal Hospital（费萨尔国王医院）；National Institute of Allergy and Infectious Diseases（美国国家过敏和传染病研究所）；Uniformed Services University（美国军医大学）
Cross-modal Speaker Verification and Recognition: A Multilingual Perspective
Istituto Italiano di Tecnologia (IIT)（意大利技术研究院）；University of Insubria（因苏布里亚大学）；University of Engineering and Technology Taxila（塔克西拉工程技术大学）；Information Technology University（信息技术大学）
Evaluating Hallucinations in Audio-Visual Multimodal LLMs with Spoken Queries under Diverse Acoustic Conditions
Department of Intelligent Software, Sungkyunkwan University（智能软件系，成均馆大学）；Department of Computer Science and Engineering, Sungkyunkwan University（计算机科学与工程系，成均馆大学）
VIBE: Voice-Induced open-ended Bias Evaluation for Large Audio-Language Models via Real-World Speech
Graduate Institute of Communication Engineering, National Taiwan University, Taiwan（台湾大学通信工程研究所）；NVIDIA, Taiwan（台湾NVIDIA）；Artificial Intelligence Center of Research Excellence, National Taiwan University, Taiwan（台湾大学人工智能卓越研究中心）
Trustworthy Sensor Fusion against Inaudible Command Attacks in Advanced Driver-Assistance System
Macquarie University（麦考瑞大学）；Data61, CSIRO（联邦科学与工业研究组织数据61研究所）；Deakin University（迪肯大学）；University of Technology Sydney（悉尼科技大学）；Shangdong Computer Science Center, Qilu University of Technology（齐鲁工业大学山东省计算中心）
