多模态大模型

PolyRecommender: A Multimodal Recommendation System for Polymer Discovery

Xin Wang, Yunhao Xiao, Rui Qiao

机构 * Department of Mechanical Engineering（机械工程系） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)

Multimodal Item Scoring for Natural Language Recommendation via Gaussian Process Regression with LLM Relevance Judgments

Yifan Liu, Qianfeng Wen, Jiazhou Liang, Mark Zhao, Justin Cui, Anton Korikov, Armin Toroghi, Junyoung Kim, Scott Sanner

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments 16 pages,20 figures

Towards Universal Video Retrieval: Generalizing Video Embedding via Synthesized Multimodal Pyramid Curriculum

Zhuoning Guo, Mingxin Li, Yanzhao Zhang, Dingkun Long, Pengjun Xie, Xiaowen Chu

机构 * Tongyi Lab, Alibaba Group（通义实验室，阿里巴巴集团） 纠错

专题命中 跨模态检索 ：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

CogPlanner: Unveiling the Potential of Agentic Multimodal Retrieval Augmented Generation with Planning

Xiaohan Yu, Zhihan Yang, Chong Chen

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments Accepted by SIGIR-AP 2025

A Multimodal Human Protein Embeddings Database: DeepDrug Protein Embeddings Bank (DPEB)

Md Saiful Islam Sajol, Magesh Rajasekaran, Hayden Gemeinhardt, Adam Bess, Chris Alvin, Supratik Mukhopadhyay

机构 * Computer Science, Louisiana State University（计算机科学，路易斯安那州立大学） ； Computer Science, Furman University（计算机科学，福兰明大学） ； Environmental Sciences and Center for Computation and Technology, Louisiana State University（环境科学与计算技术中心，路易斯安那州立大学） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)

A Statistical Theory of Contrastive Pre-training and Multimodal Generative AI

Kazusato Oko, Licong Lin, Yuhang Cai, Song Mei

专题命中 跨模态检索 ：multimodal(title)；multi-modal(abstract)

Role-Aware Multi-modal federated learning system for detecting phishing webpages

Bo Wang, Imran Khan, Martin White, Natalia Beloff

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments 22 pages, 9 figures

SUMMA: A Multimodal Large Language Model for Advertisement Summarization

Weitao Jia, Shuo Yin, Zhoufutu Wen, Han Wang, Zehui Dai, Kun Zhang, Zhenyu Li, Tao Zeng, Xiaohui Lv

专题命中 跨模态检索 ：multimodal(title,abstract)

Single-Branch Network Architectures to Close the Modality Gap in Multimodal Recommendation

Christian Ganhör, Marta Moscati, Anna Hausberger, Shah Nawaz, Markus Schedl

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments Accepted by ACM Transactions on Recommender Systems (TORS)

Continual Multimodal Contrastive Learning

Xiaohao Liu, Xiaobo Xia, See-Kiong Ng, Tat-Seng Chua

机构 * National University of Singapore（新加坡国立大学） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments Accepted by NeurIPS 2025. Codes are available at https://github.com/Xiaohao-Liu/CMCL

Improving Hospital Risk Prediction with Knowledge-Augmented Multimodal EHR Modeling

Rituparna Datta, Jiaming Cui, Zihan Guan, Vishal G. Reddy, Joshua C. Eby, Gregory Madden, Rupesh Silwal, Anil Vullikanti

机构 * Department of Computer Science, University of Virginia（大学计算机科学系） ； University of Virginia School of Medicine（弗吉尼亚大学医学院） ； Virginia Polytechnic Institute and State University（弗吉尼亚理工学院和州立大学） ； Biocomplexity Institute and Initiative, University of Virginia（大学生物复杂性研究所） ； Division of Infectious Diseases & International Health, University of Virginia School of Medicine（大学感染性疾病与国际卫生分会） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)

Generating Negative Samples for Multi-Modal Recommendation

Yanbiao Ji, Dan Luo, Chang Liu, Shaokai Wu, Jing Tong, Qicheng He, Deyi Ji, Hongtao Lu, Yue Ding

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments Accepted by ACM Multimedia

Refining Contrastive Learning and Homography Relations for Multi-Modal Recommendation

Shouxing Ma, Yawen Zeng, Shiqing Wu, Guandong Xu

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments This paper has been accepted as a full paper at ACM MM 2025

M2IO-R1: An Efficient RL-Enhanced Reasoning Framework for Multimodal Retrieval Augmented Multimodal Generation

Zhiyou Xiao, Qinhan Yu, Binghui Li, Geng Chen, Chong Chen, Wentao Zhang

专题命中 跨模态检索 ：multimodal(title,abstract)

GUI-ReRank: Enhancing GUI Retrieval with Multi-Modal LLM-based Reranking

Kristian Kolthoff, Felix Kretzer, Christian Bartelt, Alexander Maedche, Simone Paolo Ponzetto

专题命中 跨模态检索 ：multi-modal(title)；MLLM(abstract)

CLIProv: A Contrastive Log-to-Intelligence Multimodal Approach for Threat Detection and Provenance Analysis

Jingwen Li, Ru Zhang, Jianyi Liu, Wanguo Zhao

专题命中 跨模态检索 ：multimodal(title,abstract)

Can We Reliably Predict the Fed's Next Move? A Multi-Modal Approach to U.S. Monetary Policy Forecasting

Fiona Xiao Jingyi, Lili Liu

机构 * National University of Singapore（新加坡国立大学） 纠错

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments 9 pages, 15 figures

Multi-Modal Recommendation Unlearning for Legal, Licensing, and Modality Constraints

Yash Sinha, Murari Mandal, Mohan Kankanhalli

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments Extended Version, Accepted at AAAI 2025. 17 pages, 4 figures and 9 tables

Journal ref In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, no. 12, pp. 12541-12549. 2025

Agent-based Condition Monitoring Assistance with Multimodal Industrial Database Retrieval Augmented Generation

Karl Löwenmark, Daniel Strömbergsson, Chang Liu, Marcus Liwicki, Fredrik Sandin

专题命中 跨模态检索 ：multimodal(title,abstract)

Needle: A Generative AI-Powered Multi-modal Database for Answering Complex Natural Language Queries

Mahdi Erfanian, Mohsen Dehghankar, Abolfazl Asudeh

专题命中 跨模态检索 ：multi-modal(title,abstract)

Wireless Agentic AI with Retrieval-Augmented Multimodal Semantic Perception

Guangyuan Liu, Yinqiu Liu, Ruichen Zhang, Hongyang Du, Dusit Niyato, Zehui Xiong, Sumei Sun, Abbas Jamalipour

专题命中 跨模态检索 ：multimodal(title,abstract)

Robust Multimodal Learning via Entropy-Gated Contrastive Fusion

Leon Chlon, Maggie Chlon, MarcAntonio M. Awada

专题命中 跨模态检索 ：multimodal(title,abstract)

Multi-modal contrastive learning adapts to intrinsic dimensions of shared latent variables

Yu Gui, Cong Ma, Zongming Ma

机构 * Department of Statistics, University of Chicago（芝加哥大学统计系） ； Department of Statistics and Data Science, Yale University（耶鲁大学统计学与数据科学系） 纠错

专题命中 跨模态检索 ：multi-modal(title,abstract)

KAP: MLLM-assisted OCR Text Enhancement for Hybrid Retrieval in Chinese Non-Narrative Documents

Hsin-Ling Hsu, Ping-Sheng Lin, Jing-Di Lin, Jengnan Tzeng

专题命中 跨模态检索 ：MLLM(title)；multimodal(abstract)

Quadratic Interest Network for Multimodal Click-Through Rate Prediction

Honghao Li, Hanwei Li, Jing Zhang, Yi Zhang, Ziniu Yu, Lei Sang, Yiwen Zhang

专题命中 跨模态检索 ：multimodal(title,abstract)

UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphs

Yufei He, Yuan Sui, Xiaoxin He, Yue Liu, Yifei Sun, Bryan Hooi

机构 * National University of Singapore（新加坡国立大学） ； Zhejiang University（浙江大学） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments WWW 2025

Media Content Atlas: A Pipeline to Explore and Investigate Multidimensional Media Space using Multimodal LLMs

Merve Cerit, Eric Zelikman, Mu-Jung Cho, Thomas N. Robinson, Byron Reeves, Nilam Ram, Nick Haber

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments Accepted to CHI 2025, in press. See the project page at mediacontentatlas.github.io

PedSleepMAE: Generative Model for Multimodal Pediatric Sleep Signals

Saurav R. Pandey, Aaqib Saeed, Harlin Lee

机构 * Department of Computer Science（计算机科学系） ； Department of Industrial Design（工业设计系） ； School of Data Science and Society（数据科学与社会学院） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)

Journal ref 2024 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI), Houston, TX, USA, 2024, pp. 1-8

BBQRec: Behavior-Bind Quantization for Multi-Modal Sequential Recommendation

Kaiyuan Li, Rui Xiang, Yong Bai, Yongxiang Tang, Yanhua Cheng, Xialong Liu, Peng Jiang, Kun Gai

专题命中 跨模态检索 ：multi-modal(title,abstract)

Retrieval Augmented Generation with Multi-Modal LLM Framework for Wireless Environments

Muhammad Ahmed Mohsin, Ahsan Bilal, Sagnik Bhattacharya, John M. Cioffi

专题命中 跨模态检索 ：multi-modal(title)；multimodal(abstract)

Comments Accepted @ ICC 2025