多模态大模型

MEM: Multi-Modal Elevation Mapping for Robotics and Learning

Gian Erni, Jonas Frey, Takahiro Miki, Matias Mattamala, Marco Hutter

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accapted for IROS2023. This work has been submitted to the IEEE for possible publication

MolMix: A Simple Yet Effective Baseline for Multimodal Molecular Representation Learning

Andrei Manolache, Dragos Tantaru, Mathias Niepert

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Comments Machine Learning for Structural Biology Workshop, NeurIPS 2024 v2: Added optimizer references

Gradient-based Jailbreak Images for Multimodal Fusion Models

Javier Rando, Hannah Korevaar, Erik Brinkman, Ivan Evtimov, Florian Tramèr

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Reliable Object Tracking by Multimodal Hybrid Feature Extraction and Transformer-Based Fusion

Hongze Sun, Rui Liu, Wuque Cai, Jun Wang, Yue Wang, Huajin Tang, Yan Cui, Dezhong Yao, Daqing Guo

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments 16 pages, 7 figures, 9 tabes; This work has been submitted for possible publication

DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency

Wenfang Yao, Kejing Yin, William K. Cheung, Jia Liu, Jing Qin

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by AAAI-24

PlaneSAM: Multimodal Plane Instance Segmentation Using the Segment Anything Model

Zhongchen Deng, Zhechen Yang, Chi Chen, Cheng Zeng, Yan Meng, Bisheng Yang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments submitted to Information Fusion

MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment

Wei Ai, Wen Deng, Hongyi Chen, Jiayi Du, Tao Meng, Yuntao Shou

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.AI

Comments 6 pages, 1 figures

MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition

Peihao Xiang, Chaohao Lin, Kaida Wu, Ou Bai

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments Camera-ready Version, Accepted by ICPRS 2024

MMCFND: Multimodal Multilingual Caption-aware Fake News Detection for Low-resource Indic Languages

Shubhi Bansal, Nishit Sushil Singh, Shahid Shafi Dar, Nagendra Kumar

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CL

Multi-modal Fusion based Q-distribution Prediction for Controlled Nuclear Fusion

Shiao Wang, Yifeng Wang, Qingchuan Ma, Xiao Wang, Ning Yan, Qingquan Yang, Guosheng Xu, Jin Tang

专题命中 多模态训练与对齐 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

MMLF: Multi-modal Multi-class Late Fusion for Object Detection with Uncertainty Estimation

Qihang Yang, Yang Zhao, Hong Cheng

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Self-Attention Mechanism in Multimodal Context for Banking Transaction Flow

Cyrile Delestre, Yoann Sola

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Multimodal Representation Learning using Adaptive Graph Construction

Weichen Huang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

PRFusion: Toward Effective and Robust Multi-Modal Place Recognition with Image and Point Cloud Fusion

Sijie Wang, Qiyu Kang, Rui She, Kai Zhao, Yang Song, Wee Peng Tay

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments accepted by IEEE TITS 2024

Robo-MUTUAL: Robotic Multimodal Task Specification via Unimodal Learning

Jianxiong Li, Zhihao Wang, Jinliang Zheng, Xiaoai Zhou, Guanming Wang, Guanglu Song, Yu Liu, Jingjing Liu, Ya-Qin Zhang, Junzhi Yu, Xianyuan Zhan

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments preprint

Multimodal Alignment of Histopathological Images Using Cell Segmentation and Point Set Matching for Integrative Cancer Analysis

Jun Jiang, Raymond Moore, Brenna Novotny, Leo Liu, Zachary Fogarty, Ray Guo, Markovic Svetomir, Chen Wang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments initial version

Survival Prediction in Lung Cancer through Multi-Modal Representation Learning

Aiman Farooq, Deepak Mishra, Santanu Chaudhury

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted in WACV 2025

Math-PUMA: Progressive Upward Multimodal Alignment to Enhance Mathematical Reasoning

Wenwen Zhuang, Xin Huang, Xiantao Zhang, Jin Zeng

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CL

ManiNeg: Manifestation-guided Multimodal Pretraining for Mammography Classification

Xujun Li, Xin Wei, Jing Jiang, Danxiang Chen, Wei Zhang, Jinpeng Li

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

ViKL: A Mammography Interpretation Framework via Multimodal Aggregation of Visual-knowledge-linguistic Features

Xin Wei, Yaling Tao, Changde Du, Gangming Zhao, Yizhou Yu, Jinpeng Li

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

PoIFusion: Multi-Modal 3D Object Detection via Fusion at Points of Interest

Jiajun Deng, Sha Zhang, Feras Dayoub, Wanli Ouyang, Yanyong Zhang, Ian Reid

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments https://djiajunustc.github.io/projects/poifusion

Intraoperative Registration by Cross-Modal Inverse Neural Rendering

Maximilian Fehrentz, Mohammad Farid Azampour, Reuben Dorent, Hassan Rasheed, Colin Galvin, Alexandra Golby, William M. Wells, Sarah Frisken, Nassir Navab, Nazim Haouchine

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted at MICCAI 2024

3DGS-Calib: 3D Gaussian Splatting for Multimodal SpatioTemporal Calibration

Quentin Herau, Moussab Bennehar, Arthur Moreau, Nathan Piasco, Luis Roldao, Dzmitry Tsishkou, Cyrille Migniot, Pascal Vasseur, Cédric Demonceaux

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at IROS 2024 (Oral presentation). Project page: https://qherau.github.io/3DGS-Calib/

ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuning

Pei Deng, Wenqian Zhou, Hanlin Wu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments 5 pages, 2 figures

ATFLRec: A Multimodal Recommender System with Audio-Text Fusion and Low-Rank Adaptation via Instruction-Tuned Large Language Model

Zezheng Qin

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

MSMF: Multi-Scale Multi-Modal Fusion for Enhanced Stock Market Prediction

Jiahao Qin

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.MM

Comments 15 pages, 1 figures, 7 tables

Improving Multimodal Emotion Recognition by Leveraging Acoustic Adaptation and Visual Alignment

Zhixian Zhao, Haifeng Chen, Xi Li, Dongmei Jiang, Lei Xie

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 eess.AS

Unlocking Potential Binders: Multimodal Pretraining DEL-Fusion for Denoising DNA-Encoded Libraries

Chunbin Gu, Mutian He, Hanqun Cao, Guangyong Chen, Chang-yu Hsieh, Pheng Ann Heng

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

DREAM: A Dual Representation Learning Model for Multimodal Recommendation

Kangning Zhang, Yingjie Qin, Jiarui Jin, Yifan Liu, Ruilong Su, Weinan Zhang, Yong Yu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.MM

Comments 10 pages, 11 figures

Influence of Early through Late Fusion on Pancreas Segmentation from Imperfectly Registered Multimodal MRI

Lucas W. Remedios, Han Liu, Samuel W. Remedios, Lianrui Zuo, Adam M. Saunders, Shunxing Bao, Yuankai Huo, Alvin C. Powers, John Virostko, Bennett A. Landman

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments 13.5 pages of manuscript content