多模态大模型

Into the Unknown: Applying Inductive Spatial-Semantic Location Embeddings for Predicting Individuals' Mobility Beyond Visited Places

Xinglei Wang, Tao Cheng, Stephen Law, Zichao Zeng, Ilya Ilyankou, Junyuan Liu, Lu Yin, Weiming Huang, Natchapon Jongwiriyanurak

机构 * SpaceTimeLab, UCL London UK ； Department of Geography, UCL London UK ； 3DIMPact \& SpaceTimeLab, UCL London UK ； School of Computer Science, University of Surrey Surrey UK ； Institute for Spatial Data Science, University of Leeds Leeds UK ； SpaceTimeLab, UCL ； Department of Geography, UCL ； 3DIMPact \& SpaceTimeLab, UCL ； School of Computer Science, University of Surrey ； Institute for Spatial Data Science, University of Leeds 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Comments 10 pages, 5 figures

Quantifying Memorization and Parametric Response Rates in Retrieval-Augmented Vision-Language Models

Peter Carragher, Abhinand Jha, R Raghav, Kathleen M. Carley

机构 * Carnegie Mellon University（卡内基梅隆大学） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

SocialCredit+

Thabassum Aslam, Anees Aslam

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

ContextRefine-CLIP for EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2025

Jing He, Yiqing Wang, Lingling Li, Kexin Zhang, Puhua Chen

机构 * Intelligent Perception and Image Understanding Lab, Xidian University（西安电子科技大学智能感知与图像理解实验室） 纠错

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challenges

Jintao Liang, Gang Su, Huifeng Lin, You Wu, Rui Zhao, Ziyue Li

机构 * Beijing University of Posts and Telecommunications（北京邮电大学） ； University of Georgia（佐治亚大学） ； South China University of Technology（华南理工大学） ； Technical University of Munich, University of Cologne（慕尼黑技术大学、科隆大学） ； SenseTime Research（商汤科技研究院） ； Qingyuan Research Institute, Shanghai Jiaotong University（青原研究院，上海交通大学） 纠错

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.AI

ADAM: Autonomous Discovery and Annotation Model using LLMs for Context-Aware Annotations

Amirreza Rouhi, Solmaz Arezoomandan, Knut Peterson, Joseph T. Woods, David K. Han

机构 * David S. Hippocampus Department of Computer Science Cranberry-Lemon University（David S. 哈皮科ampus 计算机科学系 Cranberry-Lemon 大学） 纠错

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Galileo: Learning Global & Local Features of Many Remote Sensing Modalities

Gabriel Tseng, Anthony Fuller, Marlena Reil, Henry Herzog, Patrick Beukema, Favyen Bastani, James R. Green, Evan Shelhamer, Hannah Kerner, David Rolnick

机构 * Mila -- Quebec AI Institute（魁北克人工智能研究所） ； McGill University（麦吉尔大学） ； Arizona State University（亚利桑那州立大学） ； Carleton University（卡尔顿大学） ； Allen Institute for AI (Ai2)（人工智能研究所） ； University of British Columbia（不列颠哥伦比亚大学） ； Vector Institute（向量研究所） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Towards Scalable Video Anomaly Retrieval: A Synthetic Video-Text Benchmark

Shuyu Yang, Yilun Wang, Yaxiong Wang, Li Zhu, Zhedong Zheng

机构 * Xi’an Jiaotong University（西安交通大学） ； Hefei University of Technology（合肥工业大学） ； University of Macau（澳门大学） 纠错

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

ChatReID: Open-ended Interactive Person Retrieval via Hierarchical Progressive Tuning for Vision Language Models

Ke Niu, Haiyang Yu, Mengyang Zhao, Teng Fu, Siyang Yi, Wei Lu, Bin Li, Xuelin Qian, Xiangyang Xue

机构 * Fudan University（复旦大学） ； Northwestern Polytechnical University（西北工业大学） 纠错

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

A Cross Branch Fusion-Based Contrastive Learning Framework for Point Cloud Self-supervised Learning

Chengzhi Wu, Qianliang Huang, Kun Jin, Julius Pfrommer, Jürgen Beyerer

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

A Mathematical Perspective On Contrastive Learning

Ricardo Baptista, Andrew M. Stuart, Son Tran

机构 * Stores Foundational AI, Amazon, Palo Alto CA 94301 and Pasadena CA 91125（亚马逊公司、帕洛阿尔托加州94301和帕萨迪纳加州91125） ； Computing and Mathematical Sciences, California Institute of Technology, Pasadena CA 91125（计算与数学科学系，加州理工学院，帕萨迪纳加州91125） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments 44 pages, 15 figures

Sketch Down the FLOPs: Towards Efficient Networks for Human Sketch

Aneeshan Sain, Subhajit Maity, Pinaki Nath Chowdhury, Subhadeep Koley, Ayan Kumar Bhunia, Yi-Zhe Song

机构 * SketchX, CVSSP, University of Surrey, United Kingdom（SketchX、CVSSP、塞夫顿大学、英国） ； Department of Computer Science, University of Central Florida（计算机科学系、中央佛罗里达大学） 纠错

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted at CVPR 2025, Project Page: https://subhajitmaity.me/SketchDownTheFLOPs

How to Upscale Neural Networks with Scaling Law? A Survey and Practical Guidelines

Ayan Sengupta, Yash Goel, Tanmoy Chakraborty

机构 * Indian Institute of Technology Delhi（印度理工学院德里） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Comments 21 pages, 11 tables, 4 figures

Improving Medical Reasoning with Curriculum-Aware Reinforcement Learning

Shaohao Rui, Kaitao Chen, Weijie Ma, Xiaosong Wang

机构 * Shanghai Jiao Tong University（上海交通大学） ； Shanghai Innovation Institute（上海创新研究院） ； Fudan University（复旦大学） ； Shanghai AI Laboratory（上海人工智能实验室） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Bridging Electronic Health Records and Clinical Texts: Contrastive Learning for Enhanced Clinical Tasks

Sara Ketabi, Dhanesh Ramachandram

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Enhancing Channel-Independent Time Series Forecasting via Cross-Variate Patch Embedding

Donghwa Shin, Edwin Zhang

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Comments Added link to code implementation in PDF abstract

SCENIR: Visual Semantic Clarity through Unsupervised Scene Graph Retrieval

Nikolaos Chaidos, Angeliki Dimitriou, Maria Lymperaiou, Giorgos Stamou

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Journal ref ICML 2025

Towards a Foundation Model for Communication Systems

Davide Buffelli, Sowmen Das, Yu-Wei Lin, Sattar Vakili, Chien-Yi Wang, Masoud Attarifar, Pritthijit Nath, Da-shan Shiu

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.AI

SMOTExT: SMOTE meets Large Language Models

Mateusz Bystroński, Mikołaj Hołysz, Grzegorz Piotrowski, Nitesh V. Chawla, Tomasz Kajdanowicz

机构 * Wrocław University of Science and Technology（沃拉夫大学科学与技术学院） ； University of Notre Dame（诺特大学） 纠错

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CL

LLaVA-4D: Embedding SpatioTemporal Prompt into LMMs for 4D Scene Understanding

Hanyu Zhou, Gim Hee Lee

机构 * School of Computing, National University of Singapore（计算学院，新加坡国立大学） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

DC-Seg: Disentangled Contrastive Learning for Brain Tumor Segmentation with Missing Modalities

Haitao Li, Ziyu Li, Yiheng Mao, Zhengyao Ding, Zhengxing Huang

机构 * Zhejiang University（浙江大学） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Bridging Large Language Models and Single-Cell Transcriptomics in Dissecting Selective Motor Neuron Vulnerability

Douglas Jiang, Zilin Dai, Luxuan Zhang, Qiyi Yu, Haoqi Sun, Feng Tian

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalities

Guillaume Astruc, Nicolas Gonthier, Clement Mallet, Loic Landrieu

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Fine-Tuning Video-Text Contrastive Model for Primate Behavior Retrieval from Unlabeled Raw Videos

Giulio Cesare Mastrocinque Santo, Patrícia Izar, Irene Delval, Victor de Napole Gregolin, Nina S. T. Hirata

机构 * Institute of Mathematics and Statistics, University of São Paulo (IME-USP)（数学统计研究所，圣保罗大学） ； Department of Experimental Psychology, Institute of Psychology, University of São Paulo (IP-USP)（心理学实验部门，心理学研究所，圣保罗大学） ； Institute of Biosciences, University of São Paulo (IB-USP)（生物科学研究所，圣保罗大学） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

HiPerRAG: High-Performance Retrieval Augmented Generation for Scientific Insights

Ozan Gokdemir, Carlo Siebenschuh, Alexander Brace, Azton Wells, Brian Hsu, Kyle Hippe, Priyanka V. Setty, Aswathy Ajith, J. Gregory Pauloski, Varuni Sastry, Sam Foreman, Huihuo Zheng, Heng Ma, Bharat Kale, Nicholas Chia, Thomas Gibbs, Michael E. Papka, Thomas Brettin, Francis J. Alexander, Anima Anandkumar, Ian Foster, Rick Stevens, Venkatram Vishwanath, Arvind Ramanathan

机构 * Argonne National Laboratory（阿贡国家实验室） ； The University of Chicago（芝加哥大学） ； NVIDIA Inc.（NVIDIA公司） ； University of Illinois Chicago（伊利诺伊大学芝加哥分校） ； California Institute of Technology（加州理工学院） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Comments This paper has been accepted at the Platform for Advanced Scientific Computing Conference (PASC 25), June 16-18, 2025, Brugg-Windisch, Switzerland

Augmenting Human Cognition through Everyday AR

Xiaoan Liu

机构 * New York University（纽约大学） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Comments 3 pages, 4 figures. Position paper accepted to CHI'25 Workshop 'Everyday AR through AI-in-the-Loop'

A Multi-Granularity Retrieval Framework for Visually-Rich Documents

Mingjun Xu, Zehui Wang, Hengxing Cai, Renxin Zhong

机构 * DP Technology（DP技术） ； School of Intelligent Systems Engineering, Sun Yat-Sen University, Shenzhen, China（中山大学智能系统工程学院，深圳，中国） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

TeDA: Boosting Vision-Lanuage Models for Zero-Shot 3D Object Retrieval via Testing-time Distribution Alignment

Zhichuan Wang, Yang Zhou, Jinhai Xiang, Yulong Wang, Xinwei He

机构 * Huazhong Agricultural University（华中农业大学） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments Accepted by ICMR 2025

Deep Learning with Pretrained 'Internal World' Layers: A Gemma 3-Based Modular Architecture for Wildfire Prediction

Ayoub Jadouli, Chaker El Amrani

机构 * Computer Science and Smart Systems, Faculty of Sciences and Technology, Abdelmalek Essaâdi University（计算机科学与智能系统系，科学与技术学院，阿卜杜勒马利克·埃萨迪大学） 纠错

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

NCL-CIR: Noise-aware Contrastive Learning for Composed Image Retrieval

Peng Gao, Yujian Lee, Zailong Chen, Hui zhang, Xubo Liu, Yiyang Hu, Guquang Jing

机构 * Hong Kong Baptist University（香港 Baptist 大学） ； BNU-HKBU United International College（BNU-HKBU 国际学院） ； University of Wollongong（沃林根大学） ； University of Surrey（萨里大学） 纠错

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Has been accepted by ICASSP2025