多模态大模型

Perception-Enhanced Multitask Multimodal Semantic Communication for UAV-Assisted Integrated Sensing and Communication System

Ziji Guo, Haonan Tong, Zhilong Zhang, Danpu Liu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Journal ref WS21 ICC 2025 Workshop - ISCLAN

Re-Imagining Multimodal Instruction Tuning: A Representation View

Yiyang Liu, James Chenhao Liang, Ruixiang Tang, Yugyung Lee, Majid Rabbani, Sohail Dianat, Raghuveer Rao, Lifu Huang, Dongfang Liu, Qifan Wang, Cheng Han

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Euclid Quick Data Release (Q1) Exploring galaxy properties with a multi-modal foundation model

Euclid Collaboration, M. Siudek, M. Huertas-Company, M. Smith, G. Martinez-Solaeche, F. Lanusse, S. Ho, E. Angeloudi, P. A. C. Cunha, H. Domínguez Sánchez, M. Dunn, Y. Fu, P. Iglesias-Navarro, J. Junais, J. H. Knapen, B. Laloux, M. Mezcua, W. Roster, G. Stevens, J. Vega-Ferrero, N. Aghanim, B. Altieri, A. Amara, S. Andreon, N. Auricchio, H. Aussel, C. Baccigalupi, M. Baldi, S. Bardelli, P. Battaglia, A. Biviano, A. Bonchi, E. Branchini, M. Brescia, J. Brinchmann, S. Camera, G. Cañas-Herrera, V. Capobianco, C. Carbone, J. Carretero, S. Casas, F. J. Castander, M. Castellano, G. Castignani, S. Cavuoti, K. C. Chambers, A. Cimatti, C. Colodro-Conde, G. Congedo, C. J. Conselice, L. Conversi, Y. Copin, F. Courbin, H. M. Courtois, M. Cropper, A. Da Silva, H. Degaudenzi, G. De Lucia, A. M. Di Giorgio, J. Dinis, C. Dolding, H. Dole, F. Dubath, C. A. J. Duncan, X. Dupac, S. Dusini, S. Escoffier, M. Farina, R. Farinelli, F. Faustini, S. Ferriol, F. Finelli, S. Fotopoulou, M. Frailis, E. Franceschi, S. Galeotta, K. George, B. Gillis, C. Giocoli, J. Gracia-Carpio, B. R. Granett, A. Grazian, F. Grupp, S. Gwyn, S. V. H. Haugan, W. Holmes, I. M. Hook, F. Hormuth, A. Hornstrup, K. Jahnke, M. Jhabvala, E. Keihänen, S. Kermiche, A. Kiessling, B. Kubik, M. Kümmel, M. Kunz, H. Kurki-Suonio, Q. Le Boulc'h, A. M. C. Le Brun, D. Le Mignant, S. Ligori, P. B. Lilje, V. Lindholm, I. Lloro, G. Mainetti, D. Maino, E. Maiorano, O. Mansutti, S. Marcin, O. Marggraf, M. Martinelli, N. Martinet, F. Marulli, R. Massey, S. Maurogordato, H. J. McCracken, E. Medinaceli, S. Mei, M. Melchior, Y. Mellier, M. Meneghetti, E. Merlin, G. Meylan, A. Mora, M. Moresco, L. Moscardini, R. Nakajima, C. Neissner, S. -M. Niemi, J. W. Nightingale, C. Padilla, S. Paltani, F. Pasian, K. Pedersen, W. J. Percival, V. Pettorino, S. Pires, G. Polenta, M. Poncet, L. A. Popa, L. Pozzetti, F. Raison, A. Renzi, J. Rhodes, G. Riccio, E. Romelli, M. Roncarelli, R. Saglia, Z. Sakr, A. G. Sánchez, D. Sapone, B. Sartoris, J. A. Schewtschenko, P. Schneider, T. Schrabback, M. Scodeggio, A. Secroun, G. Seidel, M. Seiffert, S. Serrano, P. Simon, C. Sirignano, G. Sirri, L. Stanco, J. Steinwagner, P. Tallada-Crespí, A. N. Taylor, I. Tereno, S. Toft, R. Toledo-Moreo, F. Torradeflot, I. Tutusaus, L. Valenziano, J. Valiviita, T. Vassallo, G. Verdoes Kleijn, A. Veropalumbo, Y. Wang, J. Weller, A. Zacchei, G. Zamorani, F. M. Zerbi, I. A. Zinchenko, E. Zucca, V. Allevato, M. Ballardini, M. Bolzonella, E. Bozzo, C. Burigana, R. Cabanac, A. Cappi, D. Di Ferdinando, J. A. Escartin Vigo, L. Gabarra, J. Martín-Fleitas, S. Matthew, N. Mauri, R. B. Metcalf, A. Pezzotta, M. Pöntinen, C. Porciani, I. Risso, V. Scottez, M. Sereno, M. Tenti, M. Viel, M. Wiesmann, Y. Akrami, I. T. Andika, S. Anselmi, M. Archidiacono, F. Atrio-Barandela, C. Benoist, K. Benson, D. Bertacca, M. Bethermin, L. Bisigello, A. Blanchard, L. Blot, M. L. Brown, S. Bruton, A. Calabro, B. Camacho Quevedo, F. Caro, C. S. Carvalho, T. Castro, Y. Charles, F. Cogato, A. R. Cooray, O. Cucciati, S. Davini, F. De Paolis, G. Desprez, A. Díaz-Sánchez, J. J. Diaz, S. Di Domizio, J. M. Diego, P. -A. Duc, A. Enia, Y. Fang, A. G. Ferrari, P. G. Ferreira, A. Finoguenov, A. Fontana, A. Franco, K. Ganga, J. García-Bellido, T. Gasparetto, V. Gautard, E. Gaztanaga, F. Giacomini, F. Gianotti, G. Gozaliasl, M. Guidi, C. M. Gutierrez, A. Hall, W. G. Hartley, S. Hemmati, C. Hernández-Monteagudo, H. Hildebrandt, J. Hjorth, J. J. E. Kajava, Y. Kang, V. Kansal, D. Karagiannis, K. Kiiveri, C. C. Kirkpatrick, S. Kruk, J. Le Graet, L. Legrand, M. Lembo, F. Lepori, G. Leroy, G. F. Lesci, J. Lesgourgues, L. Leuzzi, T. I. Liaudat, A. Loureiro, J. Macias-Perez, G. Maggio, M. Magliocchetti, E. A. Magnier, F. Mannucci, R. Maoli, C. J. A. P. Martins, L. Maurin, M. Miluzio, P. Monaco, C. Moretti, G. Morgante, C. Murray, K. Naidoo, A. Navarro-Alsina, S. Nesseris, F. Passalacqua, K. Paterson, L. Patrizii, A. Pisani, D. Potter, S. Quai, M. Radovich, S. Sacquegna, M. Sahlén, D. B. Sanders, E. Sarpa, A. Schneider, D. Sciotti, D. Scognamiglio, E. Sellentin, L. C. Smith, K. Tanidis, G. Testera, R. Teyssier, S. Tosi, A. Troja, M. Tucci, C. Valieri, A. Venhola, D. Vergani, G. Verza, P. Vielzeuf, N. A. Walton, J. G. Sorce

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Comments Paper submitted as part of the A&A Special Issue `Euclid Quick Data Release (Q1)', 31 pages, 17 figures

Causal Representation Learning from Multimodal Biomedical Observations

Yuewen Sun, Lingjing Kong, Guangyi Chen, Loka Li, Gongxu Luo, Zijian Li, Yixuan Zhang, Yujia Zheng, Mengyue Yang, Petar Stojanov, Eran Segal, Eric P. Xing, Kun Zhang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

HumanoidPano: Hybrid Spherical Panoramic-LiDAR Cross-Modal Perception for Humanoid Robots

Qiang Zhang, Zhang Zhang, Wei Cui, Jingkai Sun, Jiahang Cao, Yijie Guo, Gang Han, Wen Zhao, Jiaxu Wang, Chenghao Sun, Lingfeng Zhang, Hao Cheng, Yujie Chen, Lin Wang, Jian Tang, Renjing Xu

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)

Comments Technical Report

GeoJEPA: Towards Eliminating Augmentation- and Sampling Bias in Multimodal Geospatial Learning

Theodor Lundqvist, Ludvig Delvret

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 131 pages, 49 figures, 48 tables

Multi-modal Food Recommendation using Clustering and Self-supervised Learning

Yixin Zhang, Xin Zhou, Qianwen Meng, Fanglin Zhu, Yonghui Xu, Zhiqi Shen, Lizhen Cui

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Comments Working paper

Importance-Aware Source-Channel Coding for Multi-Modal Task-Oriented Semantic Communication

Yi Ma, Chunmei Xu, Zhenyu Liu, Siqi Zhang, Rahim Tafazolli

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Comments Accepted by IEEE ICMLCN 2025

Community Detection in Multimodal Data: A Similarity Network Perspective

Aidan Marnane, T. Ian Simpson

专题命中 多模态训练与对齐 ：multimodal(title)；multi-modal(abstract)

Comments 21 pages, 8 figures

Generating with Fairness: A Modality-Diffused Counterfactual Framework for Incomplete Multimodal Recommendations

Jin Li, Shoujin Wang, Qi Zhang, Shui Yu, Fang Chen

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments Accepted by WWW 2025

Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streams

Mahsa Tavakoli, Rohitash Chandra, Fengrui Tian, Cristián Bravo

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Journal ref Applied Soft Computing, Volume 171, March 2025, 112771

Exploring Hierarchical Molecular Graph Representation in Multimodal LLMs

Chengxin Hu, Hao Li, Yihe Yuan, Jing Li, Ivor Tsang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 9 pages, 4 tables, 1 figure, paper under review

HCMRM: A High-Consistency Multimodal Relevance Model for Search Ads

Guobing Gan, Kaiming Gao, Li Wang, Shen Jiang, Peng Jiang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments Accepted by WWW 2025 (Industry Track)

MTPareto: A MultiModal Targeted Pareto Framework for Fake News Detection

Kaiying Yan, Moyang Liu, Yukun Liu, Ruibo Fu, Zhengqi Wen, Jianhua Tao, Xuefei Liu, Guanjun Li

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

NoteLLM-2: Multimodal Large Representation Models for Recommendation

Chao Zhang, Haoxin Zhang, Shiwei Wu, Di Wu, Tong Xu, Xiangyu Zhao, Yan Gao, Yao Hu, Enhong Chen

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments Accepted by KDD'25 ADS track

MixMAS: A Framework for Sampling-Based Mixer Architecture Search for Multimodal Fusion and Learning

Abdelmadjid Chergui, Grigor Bezirganyan, Sana Sellami, Laure Berti-Équille, Sébastien Fournier

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Journal ref 2024 IEEE International Conference on Big Data (BigData), Washington, DC, USA, 2024, pp. 3254-3257

TriMod Fusion for Multimodal Named Entity Recognition in Social Media

Mosab Alfaqeeh

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments Accepted at CASCON

Multi-modal Representation Learning Enables Accurate Protein Function Prediction in Low-Data Setting

Serbülent Ünsal, Sinem Özdemir, Bünyamin Kasap, M. Erşan Kalaycı, Kemal Turhan, Tunca Doğan, Aybar C. Acar

专题命中 多模态训练与对齐 ：multi-modal(title)；multimodal(abstract)

Beyond Graph Convolution: Multimodal Recommendation with Topology-aware MLPs

Junjie Huang, Jiarui Qin, Yong Yu, Weinan Zhang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments AAAI 2025. 11 pages, 9 figures

Chameleon: Foundation Models for Fairness-aware Multi-modal Data Augmentation to Enhance Coverage of Minorities

Mahdi Erfanian, H. V. Jagadish, Abolfazl Asudeh

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Medillustrator: Improving Retrospective Learning in Physicians' Continuous Medical Education via Multimodal Diagnostic Data Alignment and Representation

Yuansong Xu, Jiahe Dong, Yijie Fan, Yuheng Shao, Chang Jiang, Lixia Jin, Yuanwu Cao, Quan Li

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments To be appeard in Proceedings of Chinese CHI 2024

UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptation

Junhong Shen, Tanya Marwah, Ameet Talwalkar

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)

Comments TMLR 2024; ICML 2024 AI for Science Workshop (Spotlight)

MERIT: Multimodal Wearable Vital Sign Waveform Monitoring

Yongyang Tang, Zhe Chen, Ang Li, Tianyue Zheng, Zheng Lin, Jia Xu, Pin Lv, Zhe Sun, Yue Gao

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 8 pages, 10 figures

UniMat: Unifying Materials Embeddings through Multi-modal Learning

Janghoon Ock, Joseph Montoya, Daniel Schweigert, Linda Hung, Santosh K. Suram, Weike Ye

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Unified Bayesian representation for high-dimensional multi-modal biomedical data for small-sample classification

Albert Belenguer-Llorens, Carlos Sevilla-Salcedo, Jussi Tohka, Vanessa Gómez-Verdejo

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Comments 36 pages, 3 figures and 3 tables

Exploring Multi-Modality Dynamics: Insights and Challenges in Multimodal Fusion for Biomedical Tasks

Laura Wenderoth

专题命中 多模态训练与对齐 ：multimodal(title)；multi-modal(abstract)

Unsupervised Multimodal Fusion of In-process Sensor Data for Advanced Manufacturing Process Monitoring

Matthew McKinney, Anthony Garland, Dale Cillessen, Jesse Adamczyk, Dan Bolintineanu, Michael Heiden, Elliott Fowler, Brad L. Boyce

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

A Survey of Multimodal Information Fusion for Smart Healthcare: Mapping the Journey from Data to Wisdom

Thanveer Shaik, Xiaohui Tao, Lin Li, Haoran Xie, Juan D. Velásquez

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments This work has been submitted to the ELSEVIER for possible publication

Multimodal Information Bottleneck for Deep Reinforcement Learning with Multiple Sensors

Bang You, Huaping Liu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 31 pages

Journal ref Neural Networks, 176(2024)

Multimodal Language and Graph Learning of Adsorption Configuration in Catalysis

Janghoon Ock, Srivathsan Badrinarayanan, Rishikesh Magar, Akshay Antony, Amir Barati Farimani

专题命中 多模态训练与对齐 ：multimodal(title)；multi-modal(abstract)

Comments manuscript updated