arXivDaily arXiv每日学术速递 周一至周五更新

视觉与机器人

多模态信息融合

面向图像、视频、多传感器和跨模态感知的信息融合,包括 Image Fusion、红外可见光、遥感、医学影像、LiDAR/雷达/相机和音视频融合。

共收录 1418 信号源:cs.CV, eess.IV, eess.SP, cs.RO, cs.MM

1. 融合架构与评测 1418 篇

2512.11065 2025-12-17 cs.HC 50%

Immutable Explainability: Fuzzy Logic and Blockchain for Verifiable Affective AI

不可变的可解释性:模糊逻辑与区块链用于可验证的情感人工智能

Marcelo Fransoy, Alejandro Hossian, Hernán Merlino

专题命中 融合架构与评测 :multimodal fusion(abstract)

AI总结 本文提出不可变可解释性架构,结合模糊逻辑与区块链,实现情感AI的透明决策和可信审计。

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.14078 2025-12-17 cs.LG 50%

FusAD: Time-Frequency Fusion with Adaptive Denoising for General Time Series Analysis

FusAD:基于自适应去噪的时间-频率融合用于通用时间序列分析

Da Zhang, Bingyu Li, Zhiyuan Zhao, Feiping Nie, Junyu Gao, Xuelong Li

机构 * School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University(人工智能学院,光学电子研究所(iOPEN),西北工业大学) Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究所(TeleAI),中国电信) Department of Electronic Engineering and Information Science, University of Science and Technology of China(电子工程与信息科学系,中国科学技术大学)

专题命中 融合架构与评测 :information fusion(abstract)

AI总结 FusAD通过自适应时间-频率融合和去噪机制,提升多任务时间序列分析的效率与泛化能力。

Comments Paper has been accepted by ICDE2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.13396 2025-12-16 cs.IR 50%

Automated Information Flow Selection for Multi-scenario Multi-task Recommendation

多场景多任务推荐的自动化信息流选择

Chaohua Yang, Dugang Liu, Shiwei Li, Yuwen Fu, Xing Tang, Weihong Luo, Xiangyu Zhao, Xiuqiang He, Zhong Ming

专题命中 融合架构与评测 :information fusion(abstract)

AI总结 本文提出AutoIFS框架,通过低秩适应和信息流选择网络,解决多场景多任务推荐中信息融合复杂和噪声问题,提升模型性能。

Comments 10 Pages, 6 Figures, WSDM 2026 Accepted

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.07216 2025-12-09 cs.IR cs.LG 50%

MUSE: A Simple Yet Effective Multimodal Search-Based Framework for Lifelong User Interest Modeling

MUSE:一种简单而有效的基于多模态搜索的终身用户兴趣建模框架

Bin Wu, Feifan Yang, Zhangming Chan, Yu-Ran Gu, Jiawei Feng, Chao Yi, Xiang-Rong Sheng, Han Zhu, Jian Xu, Mang Ye, Bo Zheng

机构 * Wuhan University(武汉大学) Alibaba Group(阿里巴巴集团)

专题命中 融合架构与评测 :multimodal fusion(abstract)

AI总结 MUSE通过简单有效的多模态搜索框架,实现超长用户行为序列建模,提升推荐系统指标性能。

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.06259 2025-12-09 cs.SD cs.AI cs.LG 50%

Who Will Top the Charts? Multimodal Music Popularity Prediction via Adaptive Fusion of Modality Experts and Temporal Engagement Modeling

谁会登顶排行榜?通过适应性融合模态专家和时间参与建模的多模态音乐流行度预测

Yash Choudhary, Preeti Rao, Pushpak Bhattacharyya

专题命中 融合架构与评测 :multimodal fusion(abstract)

AI总结 GAMENet通过融合多模态数据和时间参与建模,提升了音乐流行度预测的准确性。

Comments 8 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.18908 2025-12-08 eess.AS 50%

A Survey on Speech Large Language Models for Understanding

语音大语言模型理解综述

Jing Peng, Yucheng Wang, Bohan Li, Yiwei Guo, Hankun Wang, Yangui Fang, Yu Xi, Haoyu Li, Xu Li, Ke Zhang, Shuai Wang, Kai Yu

专题命中 融合架构与评测 :information fusion(abstract)

AI总结 本文综述了语音大语言模型的理解方法,分析其架构并提出解决指令敏感性和语义推理退化问题的方向。

Comments This paper has been ACCEPTED for publication as a SPECIAL ISSUE paper in the IEEE Journal of Selected Topics in Signal Processing

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.01882 2025-12-02 cs.LG 50%

New Spiking Architecture for Multi-Modal Decision-Making in Autonomous Vehicles

多模态决策中自动驾驶车辆的新脉冲架构

Aref Ghoreishee, Abhishek Mishra, Lifeng Zhou, John Walsh, Nagarajan Kandasamy

机构 * Electrical and Computer Engineering Department(电子与计算机工程系)

专题命中 融合架构与评测 :multi-modal fusion(abstract)

AI总结 本文提出了一种基于脉冲神经元的高效多模态决策架构,用于提升自动驾驶车辆的实时决策能力。

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.00563 2025-12-02 cs.SD cs.AI cs.LG 50%

Explainable Multi-Modal Deep Learning for Automatic Detection of Lung Diseases from Respiratory Audio Signals

可解释的多模态深度学习用于从呼吸音频信号自动检测肺部疾病

S M Asiful Islam Saky, Md Rashidul Islam, Md Saiful Arefin, Shahaba Alam

机构 * Albukhary International University(阿尔布胡亚国际大学)

专题命中 融合架构与评测 :multimodal fusion(abstract)

AI总结 本研究提出一种可解释的多模态深度学习框架,通过结合频谱-时间编码器和手工制作的声学特征编码器,利用呼吸音频信号自动检测肺部疾病,实现了高准确率和良好的泛化能力。

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.14209 2025-11-26 cs.AI 50%

Energy-Aware Pattern Disentanglement: A Generalizable Pattern Assisted Architecture for Multi-task Time Series Analysis

节能模式解耦:一种通用的模式辅助架构用于多任务时间序列分析

Xiangkai Ma, Xiaobin Hong, Wenzhong Li, Sanglu Lu

机构 * State Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学)

专题命中 融合架构与评测 :information fusion(abstract)

AI总结 Pets提出了一种通用的模式辅助架构,通过局部能量分析和波动模式融合,提升多任务时间序列分析的泛化能力和性能。

Comments We have updated the abstract, citations and related work. At the same time, we have also updated the latest baseline model

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.17955 2025-11-25 cs.CL 50%

MTikGuard System: A Transformer-Based Multimodal System for Child-Safe Content Moderation on TikTok

MTikGuard系统:一种基于Transformer的多模态系统,用于TikTok上的儿童安全内容审核

Dat Thanh Nguyen, Nguyen Hung Lam, Anh Hoang-Thi Nguyen, Trong-Hop Do

机构 * Faculty of Information Science and Engineering, University of Information Technology(信息科学与工程学院,信息科技大学) Faculty of Software Engineering, University of Information Technology(软件工程学院,信息科技大学) Faculty of Computer Science, University of Information Technology(计算机科学学院,信息科技大学) University of Information Technology, Ho Chi Minh City(信息科技大学,胡志明市) Vietnam National University, Ho Chi Minh City(越南国家大学,胡志明市)

专题命中 融合架构与评测 :multimodal fusion(abstract)

AI总结 MTikGuard系统通过多模态分类框架和扩展数据集,实现TikTok儿童安全内容审核的高准确率和实时部署。

Comments Accepted at PACLIC39

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.17587 2025-11-25 cs.LG cs.AI 50%

Emotion and Intention Guided Multi-Modal Learning for Sticker Response Selection

基于情感与意图引导的多模态学习用于贴纸响应选择

Yuxuan Hu, Jian Chen, Yuhao Wang, Zixuan Li, Jing Xiong, Pengyue Jia, Wei Wang, Chengming Li, Xiangyu Zhao

专题命中 融合架构与评测 :multi-modal fusion(abstract)

AI总结 本文提出EIGML框架,通过联合建模情感与意图,提升贴纸响应选择的准确性和理解深度。

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.10518 2025-11-24 cs.LG 50%

Holographic Knowledge Manifolds: A Novel Pipeline for Continual Learning Without Catastrophic Forgetting in Large Language Models

全息知识流形:一种实现大语言模型持续学习中无灾难性遗忘的新型流程

Justin Arndt

专题命中 融合架构与评测 :multimodal fusion(abstract)

AI总结 全息知识流形通过分形量化等技术实现大语言模型持续学习中零灾难性遗忘,提升知识压缩效率并降低训练成本。

Comments This paper includes significant errors discovered post publication by the author

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.15062 2025-11-20 cs.LG 50%

Interpretable temporal fusion network of multi- and multi-class arrhythmia classification

Yun Kwan Kim

专题命中 融合架构与评测 :information fusion(abstract)

Comments [Doctoral dissertation, Korea University, 2025]

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.14770 2025-11-20 cs.IR cs.AI 50%

ExplainRec: Towards Explainable Multi-Modal Zero-Shot Recommendation with Preference Attribution and Large Language Models

Bo Ma, LuYao Liu, ZeHua Hu, Simon Lau

机构 * Department of Software \& Microelectronics Peking University Beijing, China Department of Software \& Microelectronics Peking University Beijing, China hangli\ Department of Software \& Microelectronics Peking University Beijing, China zehua\ Department of Software \& Microelectronics Peking University Beijing, China xiaofan\ Economic Law School China University of Political Science School of Computer Science Peking University Beijing, China

专题命中 融合架构与评测 :multi-modal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.11750 2025-11-18 cs.LG cs.AI 50%

IDOL: Meeting Diverse Distribution Shifts with Prior Physics for Tropical Cyclone Multi-Task Estimation

Hanting Yan, Pan Mu, Shiqi Zhang, Yuchao Zhu, Jinglin Zhang, Cong Bai

专题命中 融合架构与评测 :multi-modal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.09315 2025-11-13 cs.LG 50%

A Tensor Residual Circuit Neural Network Factorized with Matrix Product Operation

Andi Chen

专题命中 融合架构与评测 :information fusion(abstract)

Comments This is the supplementary material link: https://drive.google.com/file/d/141v7as_sMheOFxYkcqUPtG6F7KD1-50Y/view?usp=sharing

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.01310 2025-11-12 cs.MA 50%

From Pixels to Cooperation Multi Agent Reinforcement Learning based on Multimodal World Models

Sureyya Akin, Kavita Srivastava, Prateek B. Kapoor, Pradeep G. Sethi, Sunita Q. Patel, Rahu Srivastava

专题命中 融合架构与评测 :multimodal fusion(abstract)

Comments We have identified critical issues in the code implementation that severely deviate from Algorithm 1, invalidating all experimental results and conclusions. Despite exhaustive efforts to correct these issues, we find they fundamentally undermine the paper's core claims. To uphold academic integrity and prevent misinformation, we are withdrawing this manuscript

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.03741 2025-11-07 eess.SY cs.SY 50%

Electric Vehicle Charging Load Modeling: A Survey, Trends, Challenges and Opportunities

Xiachong Lin, Arian Prabowo, Imran Razzak, Hao Xue, Matthew Amos, Sam Behrens, Flora D. Salim

专题命中 融合架构与评测 :information fusion(abstract)

Comments 14 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.15748 2025-11-05 cs.AI 50%

Towards Relaxed Multimodal Inputs for Gait-based Parkinson's Disease Assessment

Minlin Zeng, Zhipeng Zhou, Yang Qiu, Martin J. McKeown, Zhiqi Shen

机构 * College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学) Department of Medicine (Neurology), Pacific Parkinsons Research Centre, The University of British Columbia(医学系(神经学),太平洋帕金森研究中心,不列颠哥伦比亚大学)

专题命中 融合架构与评测 :information fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.22237 2025-10-28 eess.AS cs.LG 50%

Bridging the Perceptual-Statistical Gap in Dysarthria Assessment: Why Machine Learning Still Falls Short

Krishna Gurugubelli

机构 * Samsung Research \& Development Institute Bengaluru, India\ .

专题命中 融合架构与评测 :multimodal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.22613 2025-10-28 cs.SE 50%

DynaCausal: Dynamic Causality-Aware Root Cause Analysis for Distributed Microservices

Songhan Zhang, Aoyang Fang, Yifan Yang, Ruiyi Cheng, Xiaoying Tang, Pinjia He

专题命中 融合架构与评测 :multi-modal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.22320 2025-10-28 cs.MA 50%

IFS: Information Flow Structure for Multi-agent Ad Hoc System

Yanqing Fu, Chenrun Wang, Chao Huang, Zhuping Wang

专题命中 融合架构与评测 :information fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.16122 2025-10-22 cs.CL 50%

Text Takes Over: A Study of Modality Bias in Multimodal Intent Detection

Ankan Mullick, Saransh Sharma, Abhik Jana, Pawan Goyal

机构 * IIT Kharagpur, India(印度理工学院Kharagpur) Adobe Research, India(Adobe研究) IIT Bhubaneswar, India(印度理工学院Bhubaneswar)

专题命中 融合架构与评测 :multimodal fusion(abstract)

Comments EMNLP 2025 Main Conference Full Paper

Journal ref EMNLP 2025 Main Conference Full Paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.15953 2025-10-21 cs.CR 50%

Hierarchical Multi-Modal Threat Intelligence Fusion Without Aligned Data: A Practical Framework for Real-World Security Operations

Sisir Doppalapudi

专题命中 融合架构与评测 :multi-modal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.15422 2025-10-20 stat.ML cs.LG 50%

Information Theory in Open-world Machine Learning Foundations, Frameworks, and Future Direction

Lin Wang

机构 * Shenzhen Key Laboratory of Neuropsychiatric Modulation(深圳心理行为调控重点实验室) Shenzhen-Hong Kong Institute of Brain Science(深圳-香港脑科学研究院) Shenzhen Institutes of Advanced Technology(深圳先进技术研究院) Chinese Academy of Sciences(中国科学院)

专题命中 融合架构与评测 :information fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.06938 2025-10-09 quant-ph cs.AI 50%

Expressive and Scalable Quantum Fusion for Multimodal Learning

Tuyen Nguyen, Trong Nghia Hoang, Phi Le Nguyen, Hai L. Vu, Truong Cong Thang

机构 * University of Technology Sydney(悉尼技术大学) The University of Aizu(御所大学) Washington State University(华盛顿州立大学) Hanoi University of Science and Technology(河内科学技术大学) Monash University(莫纳什大学)

专题命中 融合架构与评测 :multimodal fusion(abstract)

Comments 22 pages, 4 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.23631 2025-10-07 cs.HC cs.AI cs.CL 50%

Human Empathy as Encoder: AI-Assisted Depression Assessment in Special Education

Boning Zhao, Xinnuo Li, Yutong Hu

机构 * Tandon School of Engineering New York University New York, USA College of Arts \& Science New York University New York, USA

专题命中 融合架构与评测 :multimodal fusion(abstract)

Comments 7 pages, 6 figures, ACII 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.22962 2025-10-07 cs.LG cond-mat.mtrl-sci physics.chem-ph 50%

Multimodal machine learning with large language embedding model for polymer property prediction

Tianren Zhang, Dai-Bei Yang

机构 * Department of Materials Science and Engineering, University of Delaware, Newark, Delaware 19716, United States(材料科学与工程系,德雷克塞尔大学) Department of Chemistry, University of Pennsylvania, Philadelphia, Pennsylvania 19104, United States(化学系,宾夕法尼亚大学)

专题命中 融合架构与评测 :multimodal fusion(abstract)

Journal ref Chem. Mater. 2025, 37, 7002-7013

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.01780 2025-10-03 cs.CR cs.AI cs.CY cs.LG 50%

Secure Multi-Modal Data Fusion in Federated Digital Health Systems via MCP

Aueaphum Aueawatthanaphisut

机构 * School of Information, Computer, and Communication Technology(信息、计算机与通信技术学院) Sirindhorn International Institute of Technology, Thammasat University(泰国朱拉安吞国际技术学院,泰国 Thammasat 大学)

专题命中 融合架构与评测 :multi-modal fusion(abstract)

Comments 6 pages, 8 figures, 7 equations, 1 algorithm

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.01622 2025-10-03 cs.IR cs.AI cs.CL 50%

LLM4Rec: Large Language Models for Multimodal Generative Recommendation with Causal Debiasing

Bo Ma, Hang Li, ZeHua Hu, XiaoFan Gui, LuYao Liu, Simon Lau

机构 * Department of Software \& Microelectronics Peking University Beijing, China Department of Software \& Microelectronics Peking University Beijing, China hangli\ Department of Software \& Microelectronics Peking University Beijing, China zehua\ Department of Software \& Microelectronics Peking University Beijing, China xiaofan\ Economic Law School China University of Political Science Peking University Changsha, China

专题命中 融合架构与评测 :multimodal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏