arXivDaily arXiv每日学术速递 周一至周五更新

视觉与机器人

多模态信息融合

面向图像、视频、多传感器和跨模态感知的信息融合,包括 Image Fusion、红外可见光、遥感、医学影像、LiDAR/雷达/相机和音视频融合。

2026-01-14 至 2026-01-14 共收录 9 信号源:cs.CV, eess.IV, eess.SP, cs.RO, cs.MM

1. 红外-可见光融合 2 篇

2601.08619 2026-01-14 cs.CV 88%

CtrlFuse: Mask-Prompt Guided Controllable Infrared and Visible Image Fusion

CtrlFuse: 基于掩码提示的可控红外与可见图像融合

Yiming Sun, Yuan Ruan, Qinghua Hu, Pengfei Zhu

专题命中 红外-可见光融合 :image fusion(title,abstract);infrared and visible(title,abstract);分类 cs.CV

AI总结 CtrlFuse通过基于掩码提示的可控融合框架,实现红外与可见图像的交互式动态融合,提升任务性能与融合质量。

Comments 18 pages,22 figures,published to AAAI 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.06400 2026-01-14 cs.CV 57%

Perceptual Region-Driven Infrared-Visible Co-Fusion for Extreme Scene Enhancement

感知驱动的红外可见联合融合用于极端场景增强

Jing Tao, Yonghong Zong, Banglei Guan, Pengju Sun, Taihang Lei, Yang Shanga, Qifeng Yu

机构 * College of Aerospace Science and Engineering, National University of Defense Technology(航天科学与工程学院,国防科技大学) Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation(湖南省图像测量与视觉导航重点实验室) Beijing Institute of Tracking and Telecommunication Technology(北京跟踪与电信技术研究所) National Key Laboratory of Space Integrated Information System(空间一体化信息系统国家重点实验室)

专题命中 红外-可见光融合 :multi-exposure(abstract);分类 cs.CV

AI总结 本文提出一种基于区域感知的红外可见联合融合框架,通过多曝光和多模态成像技术,在极端条件下提升图像清晰度和融合性能。

Comments The paper has been accepted and officially published by OPTICS AND LASER TECHNOLOGY

详情

展开后加载摘要…

URL PDF HTML 收藏

2. 多聚焦/多曝光融合 1 篇

2601.08162 2026-01-14 cs.CV 57%

A Hardware-Algorithm Co-Designed Framework for HDR Imaging and Dehazing in Extreme Rocket Launch Environments

面向极端火箭发射环境的HDR成像与去雾联合设计框架

Jing Tao, Banglei Guan, Pengju Sun, Taihang Lei, Yang Shang, Qifeng Yu

机构 * College of Aerospace Science and Engineering(航空航天科学与工程学院) National University of Defense Technology(国防科技大学) Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation(湖南省图像测量与视觉导航重点实验室)

专题命中 多聚焦/多曝光融合 :multi-exposure(abstract);分类 cs.CV

AI总结 本文提出一种结合定制SVE传感器和物理感知去雾算法的联合设计框架,用于在极端火箭发射环境下实现HDR成像与去雾,提升图像质量以支持机械参数的精确分析。

Comments The paper has been accepted by Acta Mechanica Sinica

详情

展开后加载摘要…

URL PDF HTML 收藏

3. 医学影像融合 2 篇

2601.07871 2026-01-14 q-bio.QM cs.AI cs.CV cs.LG 57%

Imaging-anchored Multiomics in Cardiovascular Disease: Integrating Cardiac Imaging, Bulk, Single-cell, and Spatial Transcriptomics

心血管疾病中的成像锚定多组学:整合心脏成像、批量、单细胞和空间转录组学

Minh H. N. Le, Tuan Vinh, Thanh-Huy Nguyen, Tao Li, Bao Quang Gia Le, Han H. Huynh, Monika Raj, Carl Yang, Min Xu, Nguyen Quoc Khanh Le

机构 * International Ph.D. Program in Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan AIBioMed Research Group, Taipei Medical University, Taipei, Taiwan Medical Sciences Division, University of Oxford, Oxford, United Kingdom Computational Biology Department, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA Department of Computer Science, Emory University, Atlanta, GA, USA Department of Chemistry, Emory University, Atlanta, GA, USA International Master Program for Translational Science, College of Medical Science Technology, Taipei Medical University, Taipei 110, Taiwan In-Service Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV

AI总结 本文提出通过整合心脏成像与多组学数据,推动心血管疾病研究的多模态融合方法,提升疾病诊断和治疗的精准性。

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.00568 2026-01-14 cs.CV cs.AI cs.LG 57%

Generating crossmodal gene expression from cancer histopathology improves multimodal AI predictions

从癌症组织病理学生成跨模态基因表达以提高多模态AI预测

Samiran Dey, Christopher R. S. Banerji, Partha Basuchowdhuri, Sanjoy K. Saha, Deepak Parashar, Tapabrata Chakraborti

机构 * School of Mathematical & Computational Sciences, Indian Association for the Cultivation of Science(数学与计算科学学院,印度科学培养协会) The Alan Turing Institute(艾伦·图灵研究所) Comprehensive Cancer Center, King’s College London(国王学院综合癌症中心) Department of Computer Science and Engineering, Jadavpur University(计算机科学与工程系,贾瓦德pur大学) MRC Biostatistics Unit, University of Cambridge(剑桥大学医学研究委员会生物统计学单位) Department of Biostatistics, Bioinformatics and Biomathematics, Georgetown University(生物统计学、生物信息学与生物数学系,杰斐逊大学) UCL Cancer Institute, Dept of Medical Physics & Biomedical Engineering, University College London(伦敦大学学院癌症研究所,医学物理与生物医学工程系)

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV

AI总结 PathGen通过生成跨模态基因表达提升癌症分级和生存风险预测的多模态AI性能

详情

展开后加载摘要…

URL PDF HTML 收藏

4. 机器人多传感器融合 1 篇

2601.08244 2026-01-14 cs.RO 74%

A brain-inspired information fusion method for enhancing robot GPS outages navigation

一种受大脑启发的信息融合方法,用于增强机器人GPS失灵时的导航

Yaohua Liu, Hengjun Zhang, Binkai Ou

机构 * Guangdong Institute of Intelligence Science and Technology(广东智能科学与技术研究院) School of Electronic Engineering and Automation, Guilin University of Electronic Technology(桂林电子科技大学电子工程与自动化学院) Innovation and Research and Development Department, BoardWare Information System Company Ltd(BoardWare信息系统公司创新与研发部)

专题命中 机器人多传感器融合 :information fusion(title);分类 cs.RO

AI总结 本文提出了一种基于脉冲神经网络的脑启发GPS/INS融合方法,用于提升机器人在GPS失灵时的导航精度和可靠性。

详情

展开后加载摘要…

URL PDF HTML 收藏

5. 融合架构与评测 3 篇

2601.07856 2026-01-14 quant-ph cs.AI cs.LG 85%

Feature Entanglement-based Quantum Multimodal Fusion Neural Network

基于特征纠缠的量子多模态融合神经网络

Yu Wu, Qianli Zhou, Jie Geng, Xinyang Deng, Wen Jiang

专题命中 融合架构与评测 :multimodal fusion(title,abstract);feature-level fusion(abstract);decision-level fusion(abstract)

AI总结 本文提出基于特征纠缠的量子多模态融合神经网络,通过量子计算框架解决多模态学习中的精度、可解释性和复杂性矛盾,实现高效且可解释的多模态融合。

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.08240 2026-01-14 eess.IV cs.CV 62%

Temporal-Enhanced Interpretable Multi-Modal Prognosis and Risk Stratification Framework for Diabetic Retinopathy (TIMM-ProRS)

时间增强的可解释多模态预后和风险分层框架用于糖尿病视网膜病变(TIMM-ProRS)

Susmita Kar, A S M Ahsanul Sarkar Akib, Abdul Hasib, Samin Yaser, Anas Bin Azim

机构 * Department of Robotics, Robo Tech Valley, Dhaka, Bangladesh(机器人系,罗布科技谷,达卡,孟加拉国)

专题命中 融合架构与评测 :multi-modal fusion(abstract);分类 cs.CV、eess.IV

AI总结 TIMM-ProRS通过融合视网膜图像和时间生物标志物,实现糖尿病视网膜病变的多模态和时间动态分析,达到97.8%的准确率,优于现有方法。

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.08764 2026-01-14 cs.IR cs.SD eess.AS 50%

FusID: Modality-Fused Semantic IDs for Generative Music Recommendation

FusID: 多模态融合的语义ID用于生成音乐推荐

Haven Kim, Yupeng Hou, Julian McAuley

机构 * University of California San Diego(加州大学圣地亚哥分校)

专题命中 融合架构与评测 :multimodal fusion(abstract)

AI总结 FusID通过多模态融合、表示学习和产品量化技术,解决生成音乐推荐中跨模态交互和ID冲突问题,提升推荐准确率。

详情

展开后加载摘要…

URL PDF HTML 收藏