多模态信息融合 - arXivDaily 专题

2303.06440 2024-02-27 cs.CV 57%

Xformer: Hybrid X-Shaped Transformer for Image Denoising

Jiale Zhang, Yulun Zhang, Jinjin Gu, Jiahua Dong, Linghe Kong, Xiaokang Yang

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

Comments Accepted to ICLR 2024. Code and models are available at https://github.com/gladzhang/Xformer

2402.15444 2024-02-26 cs.AI cs.CL cs.LG cs.MM 57%

Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion

Yichi Zhang, Zhuo Chen, Lei Liang, Huajun Chen, Wen Zhang

专题命中融合架构与评测：multi-modal fusion(abstract)；分类 cs.MM

Comments Accepted by LREC-COLING 2024

2307.16517 2024-02-08 cs.CV cs.AI 57%

Select2Col: Leveraging Spatial-Temporal Importance of Semantic Information for Efficient Collaborative Perception

Yuntao Liu, Qian Huang, Rongpeng Li, Xianfu Chen, Zhifeng Zhao, Shuyuan Zhao, Yongdong Zhu, Honggang Zhang

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

2401.04750 2024-01-11 cs.CV 57%

DedustNet: A Frequency-dominated Swin Transformer-based Wavelet Network for Agricultural Dust Removal

Shengli Zhang, Zhiyong Tao, Sen Lin

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:2401.04550

2401.02606 2024-01-08 cs.CV 57%

Exploiting Polarized Material Cues for Robust Car Detection

Wen Dong, Haiyang Mei, Ziqi Wei, Ao Jin, Sen Qiu, Qiang Zhang, Xin Yang

专题命中融合架构与评测：multimodal fusion(abstract)；分类 cs.CV

Comments Accepted by AAAI 2024

2312.09154 2023-12-15 cs.CV 57%

CMG-Net: Robust Normal Estimation for Point Clouds via Chamfer Normal Distance and Multi-scale Geometry

Yingrui Wu, Mingyang Zhao, Keqiang Li, Weize Quan, Tianqi Yu, Jianfeng Yang, Xiaohong Jia, Dong-Ming Yan

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

Comments Accepted by AAAI 2024

2312.00452 2023-12-04 cs.CV 57%

Towards Generalizable Referring Image Segmentation via Target Prompt and Visual Coherence

Yajie Liu, Pu Ge, Haoxiang Ma, Shichao Fan, Qingjie Liu, Di Huang, Yunhong Wang

专题命中融合架构与评测：multi-modal fusion(abstract)；分类 cs.CV

Comments 7 pages, 4 figures

2312.00437 2023-12-04 eess.SP 57%

Investigation on data fusion of sun-induced chlorophyll fluorescence and reflectance for photosynthetic capacity of rice

Yu-an Zhou, Li Zhai, Weijun Zhou, Ji Zhou, Haiyan Cen

专题命中融合架构与评测：decision-level fusion(abstract)；分类 eess.SP

2312.00104 2023-12-04 cs.MM 57%

A Metadata Generation System with Semantic Understanding for Video Retrieval in Film Production

Feilin Han, Zhaoxu Meng

专题命中融合架构与评测：information fusion(abstract)；分类 cs.MM

Comments Accepted by 2022 IEEE International Conference on Virtual Reality and Visualization (ICVRV), received Best Paper Award

2309.01728 2023-12-01 cs.CV 57%

Generative-based Fusion Mechanism for Multi-Modal Tracking

Zhangyong Tang, Tianyang Xu, Xuefeng Zhu, Xiao-Jun Wu, Josef Kittler

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

2311.11302 2023-11-21 cs.CV 57%

Exchanging Dual Encoder-Decoder: A New Strategy for Change Detection with Semantic Guidance and Spatial Localization

Sijie Zhao, Xueliang Zhang, Pengfeng Xiao, Guangjun He

专题命中融合架构与评测：feature-level fusion(abstract)；分类 cs.CV

Journal ref IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1-16, 2023, Art no. 4508016

2311.05147 2023-11-10 cs.CV 57%

Dynamic Association Learning of Self-Attention and Convolution in Image Restoration

Kui Jiang, Xuemei Jia, Wenxin Huang, Wenbin Wang, Zheng Wang, Junjun Jiang

专题命中融合架构与评测：hybrid fusion(abstract)；分类 cs.CV

Comments in Chinese language, Journal of Image and Graphics. arXiv admin note: substantial text overlap with arXiv:2207.10455

2311.03606 2023-11-08 cs.CV cs.AI 57%

Multimodal Stress Detection Using Facial Landmarks and Biometric Signals

Majid Hosseini, Morteza Bodaghi, Ravi Teja Bhupatiraju, Anthony Maida, Raju Gottumukkala

专题命中融合架构与评测：feature-level fusion(abstract)；分类 cs.CV

Comments 16 pages, 8 figures

2310.16822 2023-10-26 cs.CL cs.AI cs.MM 57%

Prompt Me Up: Unleashing the Power of Alignments for Multimodal Entity and Relation Extraction

Xuming Hu, Junzhe Chen, Aiwei Liu, Shiao Meng, Lijie Wen, Philip S. Yu

专题命中融合架构与评测：multimodal fusion(abstract)；分类 cs.MM

Comments Accepted to ACM Multimedia 2023

2310.14496 2023-10-24 cs.MM 57%

Redundancy-Adaptive Multimodal Learning for Imperfect Data

Mengxi Chen, Jiangchao Yao, Linyu Xing, Yu Wang, Ya Zhang, Yanfeng Wang

专题命中融合架构与评测：multimodal fusion(abstract)；分类 cs.MM

2308.02416 2023-10-16 eess.SP cs.LG 57%

Local-Global Temporal Fusion Network with an Attention Mechanism for Multiple and Multiclass Arrhythmia Classification

Yun Kwan Kim, Minji Lee, Kunwook Jo, Hee Seok Song, Seong-Whan Lee

专题命中融合架构与评测：information fusion(abstract)；分类 eess.SP

Comments 14 pages, 6 figures

2210.09222 2023-10-13 cs.CV cs.LG 57%

MMTSA: Multimodal Temporal Segment Attention Network for Efficient Human Activity Recognition

Ziqi Gao, Yuntao Wang, Jianguo Chen, Junliang Xing, Shwetak Patel, Xin Liu, Yuanchun Shi

专题命中融合架构与评测：multimodal fusion(abstract)；分类 cs.CV

2309.06612 2023-09-29 cs.LG cs.CV 57%

Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices

Mohamed Imed Eddine Ghebriout, Halima Bouzidi, Smail Niar, Hamza Ouarnoughi

专题命中融合架构与评测：multimodal fusion(abstract)；分类 cs.CV

Comments Accepted to the 15th Asian Conference on Machine Learning (ACML 2023)

2309.15635 2023-09-28 cs.CV 57%

Position and Orientation-Aware One-Shot Learning for Medical Action Recognition from Signal Data

Leiyu Xie, Yuxing Yang, Zeyu Fu, Syed Mohsen Naqvi

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

2210.01346 2023-09-21 cs.CV 57%

ImmFusion: Robust mmWave-RGB Fusion for 3D Human Body Reconstruction in All Weather Conditions

Anjun Chen, Xiangyu Wang, Kun Shi, Shaohao Zhu, Bin Fang, Yingfeng Chen, Jiming Chen, Yuchi Huo, Qi Ye

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

Comments Accepted to ICRA2023, Project Page: https://chen3110.github.io/ImmFusion/index.html

2309.07297 2023-09-15 cs.CV 57%

Multi-Modal Hybrid Learning and Sequential Training for RGB-T Saliency Detection

Guangyu Ren, Jitesh Joshi, Youngjun Cho

专题命中融合架构与评测：hybrid fusion(abstract)；分类 cs.CV

Comments 8 Pages main text, 3 pages supplementary information, 12 figures

2204.07913 2023-09-15 cs.CV 57%

A Survivor in the Era of Large-Scale Pretraining: An Empirical Study of One-Stage Referring Expression Comprehension

Gen Luo, Yiyi Zhou, Jiamu Sun, Xiaoshuai Sun, Rongrong Ji

专题命中融合架构与评测：multi-modal fusion(abstract)；分类 cs.CV

2303.08356 2023-09-07 cs.CV 57%

Leveraging TCN and Transformer for effective visual-audio fusion in continuous emotion recognition

Weiwei Zhou, Jiada Lu, Zhaolong Xiong, Weifeng Wang

专题命中融合架构与评测：multi-modal fusion(abstract)；分类 cs.CV

Comments 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

2309.01383 2023-09-06 cs.CV cs.AI 57%

LoRA-like Calibration for Multimodal Deception Detection using ATSFace Data

Shun-Wen Hsiao, Cheng-Yuan Sun

专题命中融合架构与评测：multimodal fusion(abstract)；分类 cs.CV

Comments 10 pages, 9 figures

2209.12244 2023-08-24 cs.CV 57%

Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detection

Xiang Zhang, Huiyuan Yang, Taoyue Wang, Xiaotian Li, Lijun Yin

专题命中融合架构与评测：multi-modal fusion(abstract)；分类 cs.CV

2308.06702 2023-08-15 eess.SP 57%

Symbol-level Integrated Sensing and Communication enabled Multiple Base Stations Cooperative Sensing

Zhiqing Wei, Ruizhong Xu, Zhiyong Feng, Huici Wu, Ning Zhang, Wangjun Jiang, Xiaoyu Yang

专题命中融合架构与评测：information fusion(abstract)；分类 eess.SP

Comments 15 pages, 17 figures, 2 tables

2308.00400 2023-08-03 cs.CL cs.MM 57%

ZRIGF: An Innovative Multimodal Framework for Zero-Resource Image-Grounded Dialogue Generation

Bo Zhang, Jian Wang, Hui Ma, Bo Xu, Hongfei Lin

专题命中融合架构与评测：multimodal fusion(abstract)；分类 cs.MM

Comments ACM Multimedia 2023 Accpeted, Repo: https://github.com/zhangbo-nlp/ZRIGF

2302.09394 2023-07-31 cs.LG cs.CV 57%

Deep Neural Networks based Meta-Learning for Network Intrusion Detection

Anabia Sohail, Bibi Ayisha, Irfan Hameed, Muhammad Mohsin Zafar, Hani Alquhayz, Asifullah Khan

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

Comments Pages: 15, Figures: 10 and Tables: 9

2307.14008 2023-07-27 cs.CV 57%

Adaptive Frequency Filters As Efficient Global Token Mixers

Zhipeng Huang, Zhizheng Zhang, Cuiling Lan, Zheng-Jun Zha, Yan Lu, Baining Guo

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

Comments Accepted by ICCV2023

2307.08579 2023-07-27 cs.CV 57%

Scale-Aware Modulation Meet Transformer

Weifeng Lin, Ziheng Wu, Jiayu Chen, Jun Huang, Lianwen Jin

专题命中融合架构与评测：information fusion(abstract)；分类 cs.CV

Comments Accepted to ICCV 2023

1. 融合架构与评测 1417 篇

Xformer: Hybrid X-Shaped Transformer for Image Denoising

Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion

Select2Col: Leveraging Spatial-Temporal Importance of Semantic Information for Efficient Collaborative Perception

DedustNet: A Frequency-dominated Swin Transformer-based Wavelet Network for Agricultural Dust Removal

Exploiting Polarized Material Cues for Robust Car Detection

CMG-Net: Robust Normal Estimation for Point Clouds via Chamfer Normal Distance and Multi-scale Geometry

Towards Generalizable Referring Image Segmentation via Target Prompt and Visual Coherence

Investigation on data fusion of sun-induced chlorophyll fluorescence and reflectance for photosynthetic capacity of rice

A Metadata Generation System with Semantic Understanding for Video Retrieval in Film Production

Generative-based Fusion Mechanism for Multi-Modal Tracking

Exchanging Dual Encoder-Decoder: A New Strategy for Change Detection with Semantic Guidance and Spatial Localization

Dynamic Association Learning of Self-Attention and Convolution in Image Restoration

Multimodal Stress Detection Using Facial Landmarks and Biometric Signals

Prompt Me Up: Unleashing the Power of Alignments for Multimodal Entity and Relation Extraction

Redundancy-Adaptive Multimodal Learning for Imperfect Data

Local-Global Temporal Fusion Network with an Attention Mechanism for Multiple and Multiclass Arrhythmia Classification

MMTSA: Multimodal Temporal Segment Attention Network for Efficient Human Activity Recognition

Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices

Position and Orientation-Aware One-Shot Learning for Medical Action Recognition from Signal Data

ImmFusion: Robust mmWave-RGB Fusion for 3D Human Body Reconstruction in All Weather Conditions

Multi-Modal Hybrid Learning and Sequential Training for RGB-T Saliency Detection

A Survivor in the Era of Large-Scale Pretraining: An Empirical Study of One-Stage Referring Expression Comprehension

Leveraging TCN and Transformer for effective visual-audio fusion in continuous emotion recognition

LoRA-like Calibration for Multimodal Deception Detection using ATSFace Data

Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detection

Symbol-level Integrated Sensing and Communication enabled Multiple Base Stations Cooperative Sensing

ZRIGF: An Innovative Multimodal Framework for Zero-Resource Image-Grounded Dialogue Generation

Deep Neural Networks based Meta-Learning for Network Intrusion Detection

Adaptive Frequency Filters As Efficient Global Token Mixers

Scale-Aware Modulation Meet Transformer