多模态大模型

Beyond Logit Lens: Contextual Embeddings for Robust Hallucination Detection & Grounding in VLMs

Anirudh Phukan, Divyansh, Harshit Kumar Morj, Vaishnavi, Apoorv Saxena, Koustava Goswami

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CL

Comments Accepted to NAACL 2025 Main

RobuRCDet: Enhancing Robustness of Radar-Camera Fusion in Bird's Eye View for 3D Object Detection

Jingtong Yue, Zhiwei Lin, Xin Lin, Xiaoyu Zhou, Xiangtai Li, Lu Qi, Yongtao Wang, Ming-Hsuan Yang

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by ICLR2025

Incomplete Modality Disentangled Representation for Ophthalmic Disease Grading and Diagnosis

Chengzhi Liu, Zile Huang, Zhe Chen, Feilong Tang, Yu Tian, Zhongxing Xu, Zihong Luo, Yalin Zheng, Yanda Meng

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments 7 Pages, 6 figures

Journal ref AAAI2025

Boosting Private Domain Understanding of Efficient MLLMs: A Tuning-free, Adaptive, Universal Prompt Optimization Framework

Jiang Liu, Bolin Li, Haoyuan Li, Tianwei Lin, Wenqiao Zhang, Tao Zhong, Zhelun Yu, Jinghao Wei, Hao Cheng, Wanggui He, Fangxun Shu, Hao Jiang, Zheqi Lv, Juncheng Li, Siliang Tang, Yueting Zhuang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

L4DR: LiDAR-4DRadar Fusion for Weather-Robust 3D Object Detection

Xun Huang, Ziyu Xu, Hai Wu, Jinlong Wang, Qiming Xia, Yan Xia, Jonathan Li, Kyle Gao, Chenglu Wen, Cheng Wang

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by AAAI2025(Oral)

A Review of BioTree Construction in the Context of Information Fusion: Priors, Methods, Applications and Trends

Zelin Zang, Yongjie Xu, Chenrui Duan, Yue Yuan, Jinlin Wu, Zhen Lei, Stan Z. Li

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Comments 115 pages, 15 figures

CMRNext: Camera to LiDAR Matching in the Wild for Localization and Extrinsic Calibration

Daniele Cattaneo, Abhinav Valada

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to IEEE Transactions on Robotics (T-RO), 2025

From Visuals to Vocabulary: Establishing Equivalence Between Image and Text Token Through Autoregressive Pre-training in MLLMs

Mingxiao Li, Fang Qu, Zhanpeng Chen, Na Su, Zhizhou Zhong, Ziyang Chen, Nan Du, Xiaolong Li

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Referring Remote Sensing Image Segmentation via Bidirectional Alignment Guided Joint Prediction

Tianxiang Zhang, Zhaokun Wen, Bo Kong, Kecheng Liu, Yisi Zhang, Peixian Zhuang, Jiangyun Li

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Towards Interpretable Visuo-Tactile Predictive Models for Soft Robot Interactions

Enrico Donato, Thomas George Thuruthel, Egidio Falotico

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.AI

Comments IEEE RAS EMBS 10th International Conference on Biomedical Robotics and Biomechatronics (BioRob 2024)

Maintaining Structural Integrity in Parameter Spaces for Parameter Efficient Fine-tuning

Chongjie Si, Xuehui Wang, Xue Yang, Zhengqin Xu, Qingyun Li, Jifeng Dai, Yu Qiao, Xiaokang Yang, Wei Shen

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments 2025 ICLR

MATCNN: Infrared and Visible Image Fusion Method Based on Multi-scale CNN with Attention Transformer

Jingjing Liu, Li Zhang, Xiaoyang Zeng, Wanquan Liu, Jianhua Zhang

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Data-Efficient Model for Psychological Resilience Prediction based on Neurological Data

Zhi Zhang, Yan Liu, Mengxia Gao, Yu Yang, Jiannong Cao, Wai Kai Hou, Shirley Li, Sonata Yau, Yun Kwok Wing, Tatia M. C. Lee

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Policy Gradient-Driven Noise Mask

Mehmet Can Yavuz, Yang Yang

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments International Conference on Pattern Recognition (2024) Accepted Paper

Wearable Accelerometer Foundation Models for Health via Knowledge Distillation

Salar Abbaspourazad, Anshuman Mishra, Joseph Futoma, Andrew C. Miller, Ian Shapiro

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.AI

Comments updated format

TsCA: On the Semantic Consistency Alignment via Conditional Transport for Compositional Zero-Shot Learning

Miaoge Li, Jingcai Guo, Richard Yi Da Xu, Dongsheng Wang, Xiaofeng Cao, Zhijie Rao, Song Guo

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments 9 pages, 5 figures

Dynamic Adaptation of LoRA Fine-Tuning for Efficient and Task-Specific Optimization of Large Language Models

Xiaoxuan Liao, Chihang Wang, Shicheng Zhou, Jiacheng Hu, Hongye Zheng, Jia Gao

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CL

Coordinating Ride-Pooling with Public Transit using Reward-Guided Conservative Q-Learning: An Offline Training and Online Fine-Tuning Reinforcement Learning Framework

Yulong Hu, Tingting Dong, Sen Li

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

MAMAF-Net: Motion-Aware and Multi-Attention Fusion Network for Stroke Diagnosis

Aysen Degerli, Pekka Jakala, Juha Pajula, Milla Immonen, Miguel Bordallo Lopez

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Adaptive Few-Shot Learning (AFSL): Tackling Data Scarcity with Stability, Robustness, and Versatility

Rishabh Agrawal

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.AI

TT-BLIP: Enhancing Fake News Detection Using BLIP and Tri-Transformer

Eunjee Choi, Jong-Kook Kim

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments 8 pages, Accepted 27th International Conference on Information Fusion, FUSION 2024

The Goofus & Gallant Story Corpus for Practical Value Alignment

Md Sultan Al Nahian, Tasmia Tasrin, Spencer Frazier, Mark Riedl, Brent Harrison

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.AI

Comments Accepted by International Conference on Machine Learning and Applications (ICMLA) 2024. Main Conference, Long Paper

Cloud Removal With PolSAR-Optical Data Fusion Using A Two-Flow Residual Network

Yuxi Wang, Wenjuan Zhang, Bing Zhang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Training

Xingyi He, Hao Yu, Sida Peng, Dongli Tan, Zehong Shen, Hujun Bao, Xiaowei Zhou

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Project page: https://zju3dv.github.io/MatchAnything/

Text-Guided Coarse-to-Fine Fusion Network for Robust Remote Sensing Visual Question Answering

Zhicheng Zhao, Changfu Zhou, Yu Zhang, Chenglong Li, Xiaoliang Ma, Jin Tang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Unveiling the Potential of Text in High-Dimensional Time Series Forecasting

Xin Zhou, Weiqing Wang, Shilin Qu, Zhiqiang Zhang, Christoph Bergmeir

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Comments Accepted by NeurIPS24 TSALM Workshop

PromptDet: A Lightweight 3D Object Detection Framework with LiDAR Prompts

Kun Guo, Qiang Ling

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

HFMF: Hierarchical Fusion Meets Multi-Stream Models for Deepfake Detection

Anant Mehta, Bryant McArthur, Nagarjuna Kolloju, Zhengzhong Tu

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments This work is accepted to WACV 2025 Workshop on AI for Multimedia Forensics & Disinformation Detection. Code is available at: https://github.com/taco-group/HFMF

A Text-Based Knowledge-Embedded Soft Sensing Modeling Approach for General Industrial Process Tasks Based on Large Language Model

Shuo Tong, Han Liu, Runyuan Guo, Xueqiong Tian, Wenqing Wang, Ding Liu, Youmin Zhang

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.AI

Towards Generalizable Trajectory Prediction Using Dual-Level Representation Learning And Adaptive Prompting

Kaouther Messaoud, Matthieu Cord, Alexandre Alahi

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV