Coupled tensor decompositions (CTDs) perform data fusion by linking factors from different datasets. Although many CTDs have been already proposed, current works do not address important challenges of data fusion, where: 1) the datasets are often heterogeneous, constituting different "views" of a given phenomena (multimodality); and 2) each dataset can contain personalized or dataset-specific information, constituting distinct factors that are not coupled with other datasets. In this work, we introduce a personalized CTD framework tackling these challenges. A flexible model is proposed where each dataset is represented as the sum of two components, one related to a common tensor through a multilinear measurement model, and another specific to each dataset. Both the common and distinct components are assumed to admit a polyadic decomposition. This generalizes several existing CTD models. We provide conditions for specific and generic uniqueness of the decomposition that are easy to interpret. These conditions employ uni-mode uniqueness of different individual datasets and properties of the measurement model. Two algorithms are proposed to compute the common and distinct components: a semi-algebraic one and a coordinate-descent optimization method. Experimental results illustrate the advantage of the proposed framework compared with the state of the art approaches.
UTI-LLM: A Personalized Articulatory-Speech Therapy Assistance System Based on Multimodal Large Language Model
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China(深圳先进技术研究院,中国科学院,中国);Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, China(生物医学成像科学与系统重点实验室,中国科学院,中国)
Discrete Prompt Tuning via Recursive Utilization of Black-box Multimodal Large Language Model for Personalized Visual Emotion Recognition
Graduate School of Information Science(信息科学研究生学校);Technology, Hokkaido University, Sapporo 060-0814, Japan(技术,北海道大学,札幌060-0814,日本);Office of Institutional Research, Hokkaido University, Sapporo 060-0808, Japan(机构研究办公室,北海道大学,札幌060-0808,日本);Faculty of Information Science(信息科学学院)
Multimodal Conditional MeshGAN for Personalized Aneurysm Growth Prediction
MRC Laboratory of Medical Sciences Imperial College London(医学科学实验室 Imperial College London);Imperial College Healthcare NHS Trust(帝国理工医疗 NHS Trust);Department of Mechanical Engineering University College London(机械工程系 University College London);London Postgraduate School of Surgery NHS England(伦敦外科研究生学校 NHS England);Faculty of Medicine Imperial College London(医学系 Imperial College London);Department of Chemical Engineering Imperial College London(化学工程系 Imperial College London);Department of Brain Sciences&Computing Imperial College London(脑科学与计算系 Imperial College London)
Just Ask for Music (JAM): Multimodal and Personalized Natural Language Music Recommendation
Johannes Kepler University Linz(约翰· Kepler大学林茨);Criteo AI Lab(Criteo人工智能实验室);Deezer Research(Deezer研究);Johannes Kepler University Linz and Linz Institute of Technology(约翰· Kepler大学林茨和林茨技术学院)
Platform of Bioinformatics (PBI), University Lausanne Hospital (CHUV) and Faculty of Biology and Medicine (FBM), University of Lausanne (UNIL)(生物信息平台(PBI)、日内瓦大学医院(CHUV)和生物医学学院(FBM)、日内瓦大学(UNIL));PBI, CHUV and FBM, UNIL(PBI、CHUV和FBM、UNIL);Department of Biomedical Engineering, University of Basel(生物医学工程系、巴塞尔大学);Roche Diagnostics International Ltd.(罗氏诊断国际有限公司);F. Hoffmann - La Roche Ltd., Roche Information Solutions(F. Hoffmann-La Roche有限公司、罗氏信息解决方案)
Large AI Model Empowered Multimodal Semantic Communications
Hunan Normal University(湖南师范大学);Hunan University of Technology and Business(湖南工商大学);Brunel University(布鲁内尔大学);Nanjing University(南京大学);Southeast University(东南大学)
Multimodal Ambivalence/Hesitancy Recognition in Videos for Personalized Digital Health Interventions
LIVIA, Dept. of Systems Engineering, ETS Montreal, Canada(ETS蒙特利尔大学系统工程系LIVIA实验室);LIVIA, Dept. of Software and IT Engineering, ETS Montreal, Canada(ETS蒙特利尔大学软件与信息工程系LIVIA实验室);Dept. of Health, Kinesiology, & Applied Physiology, Concordia University, Montreal, Canada(康科迪亚大学健康、运动科学与应用生理学系);Montreal Behavioural Medicine Centre, CIUSSS Nord-de-l’Ile-de-Montréal, Canada(蒙特利尔行为医学中心,蒙特利尔北岛卫生与社会服务局)
FedAFD: Multimodal Federated Learning via Adversarial Fusion and Distillation
Zhejiang Key Laboratory of Space Information Sensing and Transmission, Hangzhou Dianzi University(浙江空间信息感知与传输重点实验室,杭州电子大学);Laboratory of Complex Systems Modeling and Simulation, School of Computer Science and Technology, Hangzhou Dianzi University(复杂系统建模与仿真实验室,计算机科学与技术学院,杭州电子大学);Alibaba International Digital Commerce Group(阿里巴巴国际数字商业集团);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
Multimodal Integration of Longitudinal Noninvasive Diagnostics for Survival Prediction in Immunotherapy Using Deep Learning
Radboud University(拉德堡德大学);The Netherlands Cancer Institute(荷兰癌症研究所);Maastricht University(马斯特里赫特大学);Oncode Institute(Oncode研究所);Leiden University Medical Center(莱顿大学医学中心);Centre Hospitalier Universitaire Vaudois(沃州大学医院);University of Southern Denmark(南丹麦大学)