多模态大模型

Learning from Gene Names, Expression Values and Images: Contrastive Masked Text-Image Pretraining for Spatial Transcriptomics Representation Learning

Jiahe Qian, Yaoyu Fang, Ziqiao Weng, Xinkun Wang, Lee A. Cooper, Bo Zhou

专题命中 多模态训练与对齐 ：cross-modal(abstract)；image-text(abstract)；分类 cs.CV、cs.AI

Comments 9 pages, 3 figures

MO R-CNN: Multispectral Oriented R-CNN for Object Detection in Remote Sensing Image

Leiyu Wang, Biao Jin, Feng Huang, Liqiong Chen, Zhengyong Wang, Xiaohai He, Honggang Chen

机构 * College of Electronics and Information Engineering, Sichuan University（四川大学电子信息工程学院） ； School of Mechanical Engineering and Automation, Fuzhou University（福州大学机械工程与自动化学院） ； Yunnan Key Laboratory of Software Engineering, Yunnan University（云南软件工程重点实验室） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)；multi-modal(abstract)；分类 cs.CV

Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning

Yana Wei, Liang Zhao, Jianjian Sun, Kangheng Lin, Jisheng Yin, Jingcheng Hu, Yinmin Zhang, En Yu, Haoran Lv, Zejia Weng, Jia Wang, Chunrui Han, Yuang Peng, Qi Han, Zheng Ge, Xiangyu Zhang, Daxin Jiang, Vishal M. Patel

机构 * Johns Hopkins University（约翰霍普金斯大学） ； StepFun ； BUPT（北京邮电大学） ； UCAS（中国科学院大学） ； THU（清华大学） ； HUST（华中科技大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments NeurIPS 2025

A Dual-Modulation Framework for RGB-T Crowd Counting via Spatially Modulated Attention and Adaptive Fusion

Yuhong Feng, Hongtao Chen, Qi Zhang, Jie Chen, Zhaoxi He, Mingzhe Liu, Jianghai Liao

机构 * College of Computer Science（计算机科学学院） ； Software Engineering, Shenzhen University, Shenzhen, China（软件工程，深圳大学，深圳，中国） 纠错

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Submitted to ICASSP 2026

A Unified AI Approach for Continuous Monitoring of Human Health and Diseases from Intensive Care Unit to Home with Physiological Foundation Models (UNIPHY+)

Minxiao Wang, Saurabh Kataria, Juntong Ni, Timothy G. Buchman, Jocelyn Grunwell, Mark Mai, Wei Jin, Matthew Clark, Stephanie Brown, Michael Fundora, Puneet Sharma, Tony Pan, Sam Khan, Timothy Ruchti, Naveen Muthu, Kevin Maher, Sivasubramanium V Bhavani, Xiao Hu

机构 * Emory University（埃默里大学） 纠错

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.AI

MoA-Off: Adaptive Heterogeneous Modality-Aware Offloading with Edge-Cloud Collaboration for Efficient Multimodal LLM Inference

Zheming Yang, Qi Guo, Yunqing Hu, Chang Zhao, Chang Zhang, Jian Zhao, Wen Ji

专题命中 其他多模态 ：multimodal(title,abstract)；MLLM(abstract)；cross-modal(abstract)

Comments 5 pages, 4 figures

Adaptive Graph Convolution and Semantic-Guided Attention for Multimodal Risk Detection in Social Networks

Cuiqianhe Du, Chia-En Chiang, Tianyi Huang, Zikun Cui

专题命中 其他多模态 ：multimodal(title,abstract)

Rational Multi-Modal Transformers for TCR-pMHC Prediction

Jiarui Li, Zixiang Yin, Zhengming Ding, Samuel J. Landry, Ramgopal R. Mettu

专题命中 其他多模态 ：multi-modal(title)

Comments The 16th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB 2025)

Governing Automated Strategic Intelligence

Nicholas Kruus, Madhavendra Thakur, Adam Khoja, Leonhard Nagel, Maximilian Nicholson, Abeer Sharma, Jason Hausenloy, Alberto KoTafoya, Aliya Mukhanova, Alli Katila-Miikkulainen, Harish Chandran, Ivan Zhang, Jessie Chen, Joel Raj, Jord Nguyen, Lai Hsien Hao, Neja Jayasundara, Soham Sen, Sophie Zhang, Ashley Dora Kokui Tamaklo, Bhavya Thakur, Henry Close, Janghee Lee, Nina Sefton, Raghavendra Thakur, Shiv Munagala, Yeeun Kim

专题命中 其他多模态 ：multimodal(abstract)；multimodal foundation model(abstract)；分类 cs.AI

Geometric Mixture Classifier (GMC): A Discriminative Per-Class Mixture of Hyperplanes

Prasanth K K, Shubham Sharma

机构 * The Nilgiris, Tamil Nadu, India - 643005（印度泰米尔纳德邦尼尔吉里斯） ； SunitechAI 纠错

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

Comments 21 pages, 6 figures, 14 tables

Creating General User Models from Computer Use

Omar Shaikh, Shardul Sapkota, Shan Rizvi, Eric Horvitz, Joon Sung Park, Diyi Yang, Michael S. Bernstein

机构 * Stanford University（斯坦福大学） ； Microsoft Research（微软研究院） 纠错

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

Comments 23 pages, 6 figures, 2 tables; see https://generalusermodels.github.io/

ClusterRCA: An End-to-End Approach for Network Fault Localization and Classification for HPC System

Yongqian Sun, Xijie Pan, Xiao Xiong, Lei Tao, Jiaju Wang, Shenglin Zhang, Yuan Yuan, Yuqi Li, Kunlin Jian

机构 * National University of Defense Technology（国防科技大学） ； Huawei（华为） ； Tianjin Key Laboratory of Software Experience（天津软件体验与人机交互重点实验室） ； Haihe Laboratory of Information Technology Application Innovation（海河信息科技应用创新实验室） 纠错

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Conditional Policy Generator for Dynamic Constraint Satisfaction and Optimization

Wook Lee, Frans A. Oliehoek

机构 * Sungkyunkwan University（全州大学） ； Samsung Electronics（三星电子） ； Delft University of Technology（代尔夫特理工大学） 纠错

专题命中 其他多模态 ：multi-modal(abstract)