多模态信息融合

MIND: Modality-Informed Knowledge Distillation Framework for Multimodal Clinical Prediction Tasks

Alejandro Guerra-Manzanares, Farah E. Shamout

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Comments Published in Transactions on Machine Learning Research (01/2025), https://openreview.net/forum?id=BhOJreYmur&noteId=ymnAhncuez

Journal ref Transactions on Machine Learning Research (TMLR), 01/2025

JoVALE: Detecting Human Actions in Video Using Audiovisual and Language Contexts

Taein Son, Soo Won Seo, Jisong Kim, Seok Hwan Lee, Jun Won Choi

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Comments Accepted to AAAI Conference on Artificial Intelligence 2025, 10 pages, 6 figures

V2X-DGPE: Addressing Domain Gaps and Pose Errors for Robust Collaborative 3D Object Detection

Sichao Wang, Ming Yuan, Chuang Zhang, Qing Xu, Lei He, Jianqiang Wang

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Enhanced Multi-Scale Cross-Attention for Person Image Generation

Hao Tang, Ling Shao, Nicu Sebe, Luc Van Gool

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Comments Accepted to TPAMI, an extended version of a paper published in ECCV2020. arXiv admin note: substantial text overlap with arXiv:2007.09278

Multi-task Visual Grounding with Coarse-to-Fine Consistency Constraints

Ming Dai, Jian Li, Jiedong Zhuang, Xian Zhang, Wankou Yang

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Comments AAAI2025

PromptDet: A Lightweight 3D Object Detection Framework with LiDAR Prompts

Kun Guo, Qiang Ling

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

Optimizing Multitask Industrial Processes with Predictive Action Guidance

Naval Kishore Mehta, Arvind, Shyam Sunder Prasad, Sumeet Saurav, Sanjay Singh

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Enhancing Cross-Dataset Performance of Distracted Driving Detection With Score Softmax Classifier And Dynamic Gaussian Smoothing Supervision

Cong Duan, Zixuan Liu, Jiahao Xia, Minghai Zhang, Jiacai Liao, Libo Cao

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Comments This paper has been accepted for IEEE Transactions on Intelligent Vehicles

CaptAinGlove: Capacitive and Inertial Fusion-Based Glove for Real-Time on Edge Hand Gesture Recognition for Drone Control

Hymalai Bello, Sungho Suh, Daniel Geißler, Lala Ray, Bo Zhou, Paul Lukowicz

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.RO

Journal ref 2024 Springer, Cham

Integrated Sensing and Communication Enabled Cooperative Passive Sensing Using Mobile Communication System

Zhiqing Wei, Haotian Liu, Hujun Li, Wangjun Jiang, Zhiyong Feng, Huici Wu, Ping Zhang

专题命中 融合架构与评测 ：information fusion(abstract)；分类 eess.SP

Comments 16 pages, 11 figures, has published in IEEE Transactions on Mobile Computing

MAGIC++: Efficient and Resilient Modality-Agnostic Semantic Segmentation via Hierarchical Modality Selection

Xu Zheng, Yuanhuiyi Lyu, Lutao Jiang, Jiazhou Zhou, Lin Wang, Xuming Hu

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Exploring Enhanced Contextual Information for Video-Level Object Tracking

Ben Kang, Xin Chen, Simiao Lai, Yang Liu, Yi Liu, Dong Wang

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Comments This paper was accepted by AAAI2025

CATALOG: A Camera Trap Language-guided Contrastive Learning Model

Julian D. Santamaria, Claudia Isaza, Jhony H. Giraldo

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Enriching Multimodal Sentiment Analysis through Textual Emotional Descriptions of Visual-Audio Content

Sheng Wu, Xiaobao Wang, Longbiao Wang, Dongxiao He, Jianwu Dang

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Journal ref AAAI 2025

Biological Brain Age Estimation using Sex-Aware Adversarial Variational Autoencoder with Multimodal Neuroimages

Abd Ur Rehman, Azka Rehman, Muhammad Usman, Abdullah Shahid, Sung-Min Gho, Aleum Lee, Tariq M. Khan, Imran Razzak

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Parametric-ControlNet: Multimodal Control in Foundation Models for Precise Engineering Design Synthesis

Rui Zhou, Yanxia Zhang, Chenyang Yuan, Frank Permenter, Nikos Arechiga, Matt Klenk, Faez Ahmed

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

RetCompletion:High-Speed Inference Image Completion with Retentive Network

Yueyang Cang, Pingge Hu, Xiaoteng Zhang, Xingtong Wang, Yuhang Liu, Li Shi

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Exploring Frequency-Inspired Optimization in Transformer for Efficient Single Image Super-Resolution

Ao Li, Le Zhang, Yun Liu, Ce Zhu

专题命中 融合架构与评测 ：hybrid fusion(abstract)；分类 cs.CV

Comments Extended CRAFT, accepted by TPAMI

On Moving Object Segmentation from Monocular Video with Transformers

Christian Homeyer, Christoph Schnörr

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Comments WICCV2023

Journal ref Proceedings of the IEEE/CVF International Conference on Computer Vision 2023 (880--891)

Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attention

Peng Li, Yuan Liu, Xiaoxiao Long, Feihu Zhang, Cheng Lin, Mengfei Li, Xingqun Qi, Shanghang Zhang, Wenhan Luo, Ping Tan, Wenping Wang, Qifeng Liu, Yike Guo

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Comments NeurIPS2024

in-Car Biometrics (iCarB) Datasets for Driver Recognition: Face, Fingerprint, and Voice

Vedrana Krivokuca Hahn, Jeremy Maceiras, Alain Komaty, Philip Abbet, Sebastien Marcel

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Comments 8 pages, 13 figures, 4 tables

ST-Align: A Multimodal Foundation Model for Image-Gene Alignment in Spatial Transcriptomics

Yuxiang Lin, Ling Luo, Ying Chen, Xushi Zhang, Zihui Wang, Wenxian Yang, Mengsha Tong, Rongshan Yu

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Fast proxy centers for Jeffreys centroids: The Jeffreys-Fisher-Rao and the inductive Gauss-Bregman centers

Frank Nielsen

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Comments 35 pages, 10 figures

Journal ref Entropy 2024, 26(12), 1008

Transformer-Based Classification Outcome Prediction for Multimodal Stroke Treatment

Danqing Ma, Meng Wang, Ao Xiang, Zongqing Qi, Qin Yang

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

CMATH: Cross-Modality Augmented Transformer with Hierarchical Variational Distillation for Multimodal Emotion Recognition in Conversation

Xiaofei Zhu, Jiawei Cheng, Zhou Yang, Zhuo Chen, Qingyang Wang, Jianfeng Yao

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.MM

Toward Robust Incomplete Multimodal Sentiment Analysis via Hierarchical Representation Learning

Mingcheng Li, Dingkang Yang, Yang Liu, Shunli Wang, Jiawei Chen, Shuaibing Wang, Jinjie Wei, Yue Jiang, Qingyao Xu, Xiaolu Hou, Mingyang Sun, Ziyun Qian, Dongliang Kou, Lihua Zhang

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2024

Predictive Dynamic Fusion

Bing Cao, Yinan Xia, Yi Ding, Changqing Zhang, Qinghua Hu

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Comments Accepted by ICML 2024

Multi-modal biometric authentication: Leveraging shared layer architectures for enhanced security

Vatchala S, Yogesh C, Yeshwanth Govindarajan, Krithik Raja M, Vishal Pramav Amirtha Ganesan, Aashish Vinod A, Dharun Ramesh

专题命中 融合架构与评测 ：feature-level fusion(abstract)；分类 cs.CV

eMoE-Tracker: Environmental MoE-based Transformer for Robust Event-guided Object Tracking

Yucheng Chen, Lin Wang

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Comments RGB-event single object tracking

Deep Learning-Driven Microstructure Characterization and Vickers Hardness Prediction of Mg-Gd Alloys

Lu Wang, Hongchan Chen, Bing Wang, Qian Li, Qun Luo, Yuexing Han

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV