多模态大模型

Chameleon: Mixed-Modal Early-Fusion Foundation Models

Chameleon Team

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CL

L2COcc: Lightweight Camera-Centric Semantic Scene Completion via Distillation of LiDAR Model

Ruoyu Wang, Yukai Ma, Yi Yao, Sheng Tao, Haoang Li, Zongzhi Zhu, Yong Liu, Xingxing Zuo

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Aligning to What? Limits to RLHF Based Alignment

Logan Barnhart, Reza Akbarian Bafghi, Stephen Becker, Maziar Raissi

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CL

SignRep: Enhancing Self-Supervised Sign Representations

Ryan Wong, Necati Cihan Camgoz, Richard Bowden

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Towards All-in-One Medical Image Re-Identification

Yuan Tian, Kaiyuan Ji, Rongzhao Zhang, Yankai Jiang, Chunyi Li, Xiaosong Wang, Guangtao Zhai

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to CVPR2025

OV-SCAN: Semantically Consistent Alignment for Novel Object Discovery in Open-Vocabulary 3D Object Detection

Adrian Chow, Evelien Riddell, Yimu Wang, Sean Sedwards, Krzysztof Czarnecki

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusion

Chunyang Cheng, Tianyang Xu, Zhenhua Feng, Xiaojun Wu, ZhangyongTang, Hui Li, Zeyang Zhang, Sara Atito, Muhammad Awais, Josef Kittler

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2025 v2

FLOPS: Forward Learning with OPtimal Sampling

Tao Ren, Zishi Zhang, Jinyang Jiang, Guanghao Li, Zeliang Zhang, Mingqian Feng, Yijie Peng

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Comments Published in the Thirteenth International Conference on Learning Representations(ICLR 2025)

TIPS: Text-Image Pretraining with Spatial awareness

Kevis-Kokitsi Maninis, Kaifeng Chen, Soham Ghosh, Arjun Karpur, Koert Chen, Ye Xia, Bingyi Cao, Daniel Salz, Guangxing Han, Jan Dlabal, Dan Gnanapragasam, Mojtaba Seyedhosseini, Howard Zhou, Andre Araujo

专题命中 多模态训练与对齐 ：image-text(abstract)；分类 cs.CV

Comments ICLR2025 camera-ready + appendix

Completion as Enhancement: A Degradation-Aware Selective Image Guided Network for Depth Completion

Zhiqiang Yan, Zhengxue Wang, Kun Wang, Jun Li, Jian Yang

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments CVPR 2025

Semantic Alignment of Unimodal Medical Text and Vision Representations

Maxime Di Folco, Emily Chan, Marta Hasny, Cosmin I. Bercea, Julia A. Schnabel

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Learning 3D Medical Image Models From Brain Functional Connectivity Network Supervision For Mental Disorder Diagnosis

Xingcan Hu, Wei Wang, Li Xiao

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Biological Sequence with Language Model Prompting: A Survey

Jiyue Jiang, Zikang Wang, Yuheng Shan, Heyan Chai, Jiayi Li, Zixian Ma, Xinrui Zhang, Yu Li

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CL

DSPNet: Dual-vision Scene Perception for Robust 3D Question Answering

Jingzhou Luo, Yang Liu, Weixing Chen, Zhen Li, Yaowei Wang, Guanbin Li, Liang Lin

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2025

POI-Enhancer: An LLM-based Semantic Enhancement Framework for POI Representation Learning

Jiawei Cheng, Jingyuan Wang, Yichuan Zhang, Jiahao Ji, Yuanshao Zhu, Zhibo Zhang, Xiangyu Zhao

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Comments AAAI 25

Visual-RFT: Visual Reinforcement Fine-Tuning

Ziyu Liu, Zeyi Sun, Yuhang Zang, Xiaoyi Dong, Yuhang Cao, Haodong Duan, Dahua Lin, Jiaqi Wang

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments project page: https://github.com/Liuziyu77/Visual-RFT

Cross-Attention Fusion of MRI and Jacobian Maps for Alzheimer's Disease Diagnosis

Shijia Zhang, Xiyu Ding, Brian Caffo, Junyu Chen, Cindy Zhang, Hadi Kharrazi, Zheyu Wang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Submitted to MICCAI 2025

A Novel Spatiotemporal Correlation Anomaly Detection Method Based on Time-Frequency-Domain Feature Fusion and a Dynamic Graph Neural Network in Wireless Sensor Network

Miao Ye, Zhibang Jiang, Xingsi Xue, Xingwang Li, Peng Wen, Yong Wang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

How Deep is Love in LLMs' Hearts? Exploring Semantic Size in Human-like Cognition

Yao Yao, Yifei Yang, Xinbei Ma, Dongjie Yang, Zhuosheng Zhang, Zuchao Li, Hai Zhao

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CL

OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference

Xiangyu Zhao, Shengyuan Ding, Zicheng Zhang, Haian Huang, Maosong Cao, Weiyun Wang, Jiaqi Wang, Xinyu Fang, Wenhai Wang, Guangtao Zhai, Haodong Duan, Hua Yang, Kai Chen

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Adaptive Illumination-Invariant Synergistic Feature Integration in a Stratified Granular Framework for Visible-Infrared Re-Identification

Yuheng Jia, Wesley Armour

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

VLEER: Vision and Language Embeddings for Explainable Whole Slide Image Representation

Anh Tien Nguyen, Keunho Byeon, Kyungeun Kim, Jin Tae Kwak

专题命中 多模态训练与对齐 ：image-text(abstract)；分类 cs.CV

Comments Under review

Mitigating Object Hallucination in MLLMs via Data-augmented Phrase-level Alignment

Pritam Sarkar, Sayna Ebrahimi, Ali Etemad, Ahmad Beirami, Sercan Ö. Arık, Tomas Pfister

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Published in ICLR 2025

A Fusion Model for Artwork Identification Based on Convolutional Neural Networks and Transformers

Zhenyu Wang, Heng Song

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

GPT4Image: Large Pre-trained Models Help Vision Models Learn Better on Perception Task

Ning Ding, Yehui Tang, Zhongqian Fu, Chao Xu, Kai Han, Yunhe Wang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments GitHub: https://github.com/huawei-noah/Efficient-Computing/tree/master/GPT4Image/

PointSea: Point Cloud Completion via Self-structure Augmentation

Zhe Zhu, Honghua Chen, Xing He, Mingqiang Wei

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by International Journal of Computer Vision (IJCV). Extension of our ICCV 2023 work: arXiv:2307.08492

DeepInteraction++: Multi-Modality Interaction for Autonomous Driving

Zeyu Yang, Nan Song, Wei Li, Xiatian Zhu, Li Zhang, Philip H. S. Torr

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Journal extension of NeurIPS 2022. arXiv admin note: text overlap with arXiv:2208.11112

Bridging Sensor Gaps via Attention Gated Tuning for Hyperspectral Image Classification

Xizhe Xue, Haokui Zhang, Haizhao Jing, Lijie Tao, Zongwen Bai, Ying Li

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Multi-view Video-Pose Pretraining for Operating Room Surgical Activity Recognition

Idris Hamoud, Vinkle Srivastav, Muhammad Abdullah Jamal, Didier Mutter, Omid Mohareri, Nicolas Padoy

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

FLAG-Trader: Fusion LLM-Agent with Gradient-based Reinforcement Learning for Financial Trading

Guojun Xiong, Zhiyang Deng, Keyi Wang, Yupeng Cao, Haohang Li, Yangyang Yu, Xueqing Peng, Mingquan Lin, Kaleb E Smith, Xiao-Yang Liu, Jimin Huang, Sophia Ananiadou, Qianqian Xie

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI