多模态大模型

Zero-shot Multimodal Document Retrieval via Cross-modal Question Generation

Yejin Choi, Jaewoo Park, Janghan Yoon, Saejin Kim, Jaehyun Jeon, Youngjae Yu

机构 * Yonsei University（延世大学） ； Seoul National University（首尔国立大学） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)；cross-modal(title)；MLLM(abstract)；分类 cs.AI

Test-Time Scaling Strategies for Generative Retrieval in Multimodal Conversational Recommendations

Hung-Chun Hsu, Yuan-Ching Kuo, Chao-Han Huck Yang, Szu-Wei Fu, Hanrong Ye, Hongxu Yin, Yu-Chiang Frank Wang, Ming-Feng Tsai, Chuan-Ju Wang

机构 * Research Center for Information Technology Innovation, Academia Sinica（资讯科技创新研究所以） ； NVIDIA（NVIDIA公司） ； Department of Computer Science, National Chengchi University（国立政治大学计算机科学系） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.AI

M3DMap: Object-aware Multimodal 3D Mapping for Dynamic Environments

Dmitry Yudin

机构 * Moscow Institute of Physics and Technology（莫斯科物理技术学院） ； AIRI 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CV

Comments 29 pages, 3 figures, 13 tables. Preprint of the accepted article in Optical Memory and Neural Network Journal

SoccerRAG: Multimodal Soccer Information Retrieval via Natural Queries

Aleksander Theo Strand, Sushant Gautam, Cise Midoglu, Pål Halvorsen

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.MM

Comments accepted to CBMI 2024 as a regular paper; https://github.com/simula/soccer-rag

Multimodal Medical Endoscopic Image Analysis via Progressive Disentangle-aware Contrastive Learning

Junhao Wu, Yun Li, Junhao Li, Jingliang Bian, Xiaomao Fan, Wenbin Lei, Ruxin Wang

机构 * Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（深圳先进技术研究院，中国科学院） ； First Affiliated Hospital, Sun Yat-sen University（中山大学第一附属医院） ； College of Big Data and Internet, Shenzhen Technology University（深圳技术大学大数据与互联网学院） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)；分类 cs.CV

Comments 12 pages,6 figures, 6 tables

RT-Cache: Training-Free Retrieval for Real-Time Manipulation

Owen Kwon, Abraham George, Alison Bartsch, Amir Barati Farimani

机构 * Carnegie Mellon University（卡内基梅隆大学） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments 8 pages, 6 figures. 2025 IEEE-RAS 24th International Conference on Humanoid Robots

Does GPT-4 surpass human performance in linguistic pragmatics?

Ljubisa Bojic, Predrag Kovacevic, Milan Cabarkapa

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL、cs.AI

Comments 19 pages, 1 figure, 2 tables

Consciousness as a Functor

Sridhar Mahadevan

机构 * Adobe Research and University of Massachusetts, Amherst（Adobe研究院和马萨诸塞大学） 纠错

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.AI

Comments 31 pages

VisR-Bench: An Empirical Study on Visual Retrieval-Augmented Generation for Multilingual Long Document Understanding

Jian Chen, Ming Li, Jihyung Kil, Chenguang Wang, Tong Yu, Ryan Rossi, Tianyi Zhou, Changyou Chen, Ruiyi Zhang

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments Under Review

Demo: Soccer Information Retrieval via Natural Queries using SoccerRAG

Aleksander Theo Strand, Sushant Gautam, Cise Midoglu, Pål Halvorsen

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.MM

Comments accepted to CBMI 2024 as a demonstration; https://github.com/simula/soccer-rag. arXiv admin note: text overlap with arXiv:2406.01273

LGE-Guided Cross-Modality Contrastive Learning for Gadolinium-Free Cardiomyopathy Screening in Cine CMR

Siqing Yuan, Yulin Wang, Zirui Cao, Yueyan Wang, Zehao Weng, Hui Wang, Lei Xu, Zixian Chen, Lei Chen, Zhong Xue, Dinggang Shen

机构 * School of Biomedical Engineering（生物医学工程学院） ； State Key Laboratory of Advanced Medical Materials and Devices（先进医疗材料与设备国家重点实验室） ； ShanghaiTech University（上海科技大学） ； United Imaging Intelligence（联合影像智能） ； Shanghai Clinical Research and Trial Center（上海临床研究与试验中心） ； Capital Medical University（首都医科大学） ； The First Hospital of Lanzhou University（兰州大学第一医院） 纠错

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to MLMI 2025 (MICCAI workshop); camera-ready version

Sparse and Dense Retrievers Learn Better Together: Joint Sparse-Dense Optimization for Text-Image Retrieval

Jonghyun Song, Youngjune Lee, Gyu-Hwung Cho, Ilhyeon Song, Saehun Kim, Yohan Jo

机构 * Graduate School of Data Science, Seoul National University（首尔国立大学数据科学研究生院） ； NAVER Corporation（NAVER公司） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Comments accepted to CIKM 2025 short research paper track