多模态大模型

Designing Memory-Augmented AR Agents for Spatiotemporal Reasoning in Personalized Task Assistance

Dongwook Choi, Taeyoon Kwon, Dongil Yang, Hyojun Kim, Jinyoung Yeo

机构 * Language & AGI Lab（语言与人工智能实验室） 纠错

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CL、cs.AI

Comments 7 pages, 2 figures

PADReg: Physics-Aware Deformable Registration Guided by Contact Force for Ultrasound Sequences

Yimeng Geng, Mingyang Zhao, Fan Xu, Guanglin Cao, Gaofeng Meng, Hongbin Liu

机构 * State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences（多模态人工智能系统国家重点实验室，自动化研究所，中国科学院） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院） ； Center for Artificial Intelligence and Robotics, HK Institute of Science & Innovation, Chinese Academy of Sciences（人工智能与机器人中心，香港创新科学院，中国科学院） ； School of Biomedical Engineering and Imaging Sciences, King’s College London（生物医学工程与影像科学学院，伦敦国王学院） 纠错

专题命中 多模态评测 ：multi-modal(abstract)；分类 cs.CV

Comments This work has been submitted to the IEEE for possible publication

Differentiated Information Mining: A Semi-supervised Learning Framework for GNNs

Long Wang, Kai Liu

专题命中 多模态评测 ：multimodal(abstract)

Comments 13 pages, 5 figures, 8 tables

Efficient Agent: Optimizing Planning Capability for Multimodal Retrieval Augmented Generation

Yuechen Wang, Yuming Qiao, Dan Meng, Jun Yang, Haonan Lu, Zhenyu Yang, Xudong Zhang

机构 * OPPO Research Institute（OPPO研究院） ； OPPO AI Center（OPPO人工智能中心） 纠错

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Style transfer between Microscopy and Magnetic Resonance Imaging via Generative Adversarial Network in small sample size settings

Monika Pytlarz, Adrian Onicas, Alessandro Crimi

机构 * Sano – Centre for Computational Personalised Medicine（Sano 个性化医学计算中心） 纠错

专题命中 多模态Agent ：multimodal(abstract)；cross-modal(abstract)；分类 cs.CV

Comments 2023 IEEE International Conference on Image Processing (ICIP)

Journal ref 2023 IEEE International Conference on Image Processing (ICIP), Kuala Lumpur, Malaysia, 2023, pp. 1120-1124

Dynamic Uncertainty-aware Multimodal Fusion for Outdoor Health Monitoring

Zihan Fang, Zheng Lin, Senkang Hu, Yihang Tao, Yiqin Deng, Xianhao Chen, Yuguang Fang

机构 * Hong Kong JC STEM Lab of Smart City and Department of Computer Science, City University of Hong Kong（香港JC STEM实验室及城市大学计算机科学系） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；MLLM(abstract)；分类 cs.AI

Comments 14 pages, 10 figures

DocThinker: Explainable Multimodal Large Language Models with Rule-based Reinforcement Learning for Document Understanding

Wenwen Yu, Zhibo Yang, Yuliang Liu, Xiang Bai

机构 * Huazhong University of Science and Technology（华中科技大学） ； Alibaba Group（阿里巴巴集团） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；MLLM(abstract)；分类 cs.CV

Comments ICCV 2025

LPGNet: A Lightweight Network with Parallel Attention and Gated Fusion for Multimodal Emotion Recognition

Zhining He, Yang Xiao

机构 * Guangzhou University（广州大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 eess.AS

Comments Under peering review

Edge-Based Multimodal Sensor Data Fusion with Vision Language Models (VLMs) for Real-time Autonomous Vehicle Accident Avoidance

Fengze Yang, Bo Yu, Yang Zhou, Xuewen Luo, Zhengzhong Tu, Chenxi Liu

机构 * Department of Civil & Environmental Engineering University of Utah（土木与环境工程系 犹他大学） ； Zachry Department of Civil and Environmental Engineering Texas A&M University（扎克里系 土木与环境工程系 德克萨斯农工大学） ； Department of Computer Science & Engineering Texas A&M University（计算机科学与工程系 德克萨斯农工大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Comments 24 pages, 6 tables, 7 figures

XFMNet: Decoding Cross-Site and Nonstationary Water Patterns via Stepwise Multimodal Fusion for Long-Term Water Quality Forecasting

Ziqi Wang, Hailiang Zhao, Cheng Bao, Wenzhuo Qian, Yuhao Yang, Xueqiang Sun, Shuiguang Deng

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Multi-modal Policies with Physics-informed Representations in Complex Fluid Environments

Haodong Feng, Peiyan Hu, Yue Wang, Dixia Fan

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Where is the Boundary: Multimodal Sensor Fusion Test Bench for Tissue Boundary Delineation

Zacharias Chen, Alexa Cristelle Cahilig, Sarah Dias, Prithu Kolar, Ravi Prakash, Patrick J. Codd

机构 * Duke University（杜克大学） ； Research Triangle High School（研究三角高中） ； North Carolina School of Science and Mathematics（北卡罗来纳科学与数学高中） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 4 pages, 5 figures

Bridging the Visual Gap: Fine-Tuning Multimodal Models with Knowledge-Adapted Captions

Moran Yanuka, Assaf Ben Kish, Yonatan Bitton, Idan Szpektor, Raja Giryes

机构 * Tel Aviv University（特拉维夫大学） ； Google Research（谷歌研究） 纠错

专题命中 多模态训练与对齐 ：multimodal(title)；分类 cs.CV、cs.CL

Comments Accepted to NAACL 2025

Journal ref Proceedings of the 2025 Conference of the North American Chapter of the Association for Computational Linguistics, Human Language Technologies, Long Papers, pp. 10497-10518

Biomedical Signal Processing: EEG and ECG Classification with Discrete Wavelet Transforms, Energy Distribution, and Convolutional Neural Networks

Justin London

专题命中 多模态训练与对齐 ：multimodal(abstract)；multi-modal(abstract)

A Pseudo Global Fusion Paradigm-Based Cross-View Network for LiDAR-Based Place Recognition

Jintao Cheng, Jiehao Luo, Xieyuanli Chen, Jin Wu, Rui Fan, Xiaoyu Tang, Wei Zhang

机构 * School of Electronics and Information Engineering, and Xingzhi College, South China Normal University（电子信息工程学院和星智学院，华南师范大学） ； School of Data Science and Engineering, and Xingzhi College, South China Normal University（数据科学与工程学院和星智学院，华南师范大学） ； College of Intelligence Science and Technology, National University of Defense Technology（智能科学与技术学院，国防科技大学） ； College of Electronics & Information Engineering, Shanghai Research Institute for Intelligent Autonomous Systems, the State Key Laboratory of Intelligent Autonomous Systems, and Frontiers Science Center for Intelligent Autonomous Systems, Tongji University（电子与信息工程学院，上海智能自主系统研究所，智能自主系统国家重点实验室，智能自主系统前沿科学中心，同济大学） ； Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology（电子与计算机工程系，香港科技大学） 纠错

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

ROD: RGB-Only Fast and Efficient Off-road Freespace Detection

Tong Sun, Hongliang Ye, Jilin Mei, Liang Chen, Fangzhou Zhao, Leiqiang Zong, Yu Hu

机构 * Research Center for Intelligent Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences（智能计算系统研究室，计算技术研究所，中国科学院） ； University of Chinese Academy of Sciences（中国科学院大学） ； Astronomical Computing Research Center, Zhejiang Lab（天文计算研究室，浙江实验室） ； Beijing Special Vehicle Academy（北京特种车辆学院） ； School of Computer Science and Technology, University of Chinese Academy of Sciences（计算机科学与技术学院，中国科学院大学） 纠错

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Journal ref ICRA2025

Aligning Beam with Imbalanced Multi-modality: A Generative Federated Learning Approach

Jiahui Liang, Miaowen Wen, Shuoyao Wang, Yuxuan Liang, Shijian Gao

专题命中 多模态训练与对齐 ：multi-modal(abstract)

Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizations

Sanchita S. Kamath, Aziz N. Zeidieh, JooYoung Seo

专题命中 其他多模态 ：multimodal(title,abstract)

Silicon Minds versus Human Hearts: The Wisdom of Crowds Beats the Wisdom of AI in Emotion Recognition

Mustafa Akben, Vinayaka Gude, Haya Ajjan

专题命中 其他多模态 ：multimodal(abstract)；MLLM(abstract)；分类 cs.CV、cs.AI

OE3DIS: Open-Ended 3D Point Cloud Instance Segmentation

Phuc D. A. Nguyen, Minh Luu, Anh Tran, Cuong Pham, Khoi Nguyen

机构 * Movian AI ； Posts & Telecommunications Inst. of Tech（电信技术研究所） 纠错

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments Accepted at ICCVW'25 - OpenSUN3D: 5th Workshop on Open-World 3D Scene Understanding with Foundation Models