多模态信息融合 - arXivDaily 专题

2406.00561 2024-06-04 cs.LG 50%

Learning to Approximate Particle Smoothing Trajectories via Diffusion Generative Models

Ella Tamir, Arno Solin

专题命中融合架构与评测：information fusion(abstract)

2405.19642 2024-05-31 cs.AI 50%

Few-shot fault diagnosis based on multi-scale graph convolution filtering for industry

Mengjie Gan, Penglong Lian, Zhiheng Su, Jiyang Zhang, Jialong Huang, Benhao Wang, Jianxiao Zou, Shicai Fan

专题命中融合架构与评测：information fusion(abstract)

Comments 6 pages, 2 figures, 2 tables, 63rd IEEE Conference on Decision and Control

2405.14545 2024-05-24 q-bio.BM cs.LG 50%

A Cross-Field Fusion Strategy for Drug-Target Interaction Prediction

Hongzhi Zhang, Xiuwen Gong, Shirui Pan, Jia Wu, Bo Du, Wenbin Hu

专题命中融合架构与评测：information fusion(abstract)

2404.13067 2024-04-23 cs.CL cs.AI cs.LG 50%

Towards Efficient Resume Understanding: A Multi-Granularity Multi-Modal Pre-Training Approach

Feihu Jiang, Chuan Qin, Jingshuai Zhang, Kaichun Yao, Xi Chen, Dazhong Shen, Chen Zhu, Hengshu Zhu, Hui Xiong

专题命中融合架构与评测：multi-modal fusion(abstract)

Comments ICME 2024 Accepted

2401.03429 2024-04-23 cs.HC 50%

MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition

Zheng Lian, Licai Sun, Yong Ren, Hao Gu, Haiyang Sun, Lan Chen, Bin Liu, Jianhua Tao

专题命中融合架构与评测：multimodal fusion(abstract)

2402.10381 2024-04-18 cs.IR cs.AI 50%

UMAIR-FPS: User-aware Multi-modal Animation Illustration Recommendation Fusion with Painting Style

Yan Kang, Hao Lin, Mingjian Yang, Shin-Jye Lee

专题命中融合架构与评测：multi-modal fusion(abstract)

Comments Accepted by DASFAA 2024 Research track

2404.06182 2024-04-10 cs.NI 50%

Streamlined Transmission: A Semantic-Aware XR Deployment Framework Enhanced by Generative AI

Wanting Yang, Zehui Xiong, Tony Q. S. Quek, Xuemin Shen

专题命中融合架构与评测：multi-modal fusion(abstract)

Comments Under review with IEEE Network

2312.02184 2024-04-04 cs.IT cs.LG math.IT 50%

Channel-Feedback-Free Transmission for Downlink FD-RAN: A Radio Map based Complex-valued Precoding Network Approach

Jiwei Zhao, Jiacheng Chen, Zeyu Sun, Yuhang Shi, Haibo Zhou, Xuemin, Shen

专题命中融合架构与评测：information fusion(abstract)

Comments Content error, and I don't like to make it public now

2403.13828 2024-03-22 eess.SY cs.SY math.ST stat.TH 50%

Optimal State Estimation in the Presence of Non-Gaussian Uncertainty via Wasserstein Distance Minimization

Himanshu Prabhat, Raktim Bhattacharya

专题命中融合架构与评测：information fusion(abstract)

2304.02830 2024-03-12 math.OC cs.SY eess.SY 50%

A Mixing-Accelerated Primal-Dual Proximal Algorithm for Distributed Nonconvex Optimization

Zichong Ou, Chenyang Qiu, Dandan Wang, Jie Lu

专题命中融合架构与评测：information fusion(abstract)

Comments 8 pages, 2 figures, accepted by ACC2024

2403.03791 2024-03-07 cs.LG cs.AI 50%

KG-TREAT: Pre-training for Treatment Effect Estimation by Synergizing Patient Data with Knowledge Graphs

Ruoqi Liu, Lingfei Wu, Ping Zhang

专题命中融合架构与评测：information fusion(abstract)

Comments AAAI 2024 Main Track

2402.17906 2024-02-29 cs.LG cs.SI 50%

Representation learning in multiplex graphs: Where and how to fuse information?

Piotr Bielak, Tomasz Kajdanowicz

专题命中融合架构与评测：information fusion(abstract)

2402.12183 2024-02-20 cs.AI 50%

MultiFIX: An XAI-friendly feature inducing approach to building models from multimodal data

Mafalda Malafaia, Thalea Schlender, Peter A. N. Bosman, Tanja Alderliesten

专题命中融合架构与评测：multimodal fusion(abstract)

Comments 8 pages, 9 figures

2402.07016 2024-02-13 cs.AI 50%

REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Models

Yinghao Zhu, Changyu Ren, Shiyun Xie, Shukai Liu, Hangyuan Ji, Zixiang Wang, Tao Sun, Long He, Zhoujun Li, Xi Zhu, Chengwei Pan

专题命中融合架构与评测：multimodal fusion(abstract)

2402.01350 2024-02-13 cs.LG cs.DC 50%

pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning

Liping Yi, Han Yu, Chao Ren, Heng Zhang, Gang Wang, Xiaoguang Liu, Xiaoxiao Li

专题命中融合架构与评测：information fusion(abstract)

2402.00491 2024-02-02 cs.AI cs.HC 50%

EXMOS: Explanatory Model Steering Through Multifaceted Explanations and Data Configurations

Aditya Bhattacharya, Simone Stumpf, Lucija Gosak, Gregor Stiglic, Katrien Verbert

专题命中融合架构与评测：hybrid fusion(abstract)

Comments This is a pre-print version only for early release. Please view the conference published version from ACM CHI 2024 to get the latest version of the paper

Journal ref Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA

2401.16960 2024-01-31 cs.CL cs.AI 50%

Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment

Linyao Yang, Hongyang Chen, Xiao Wang, Jing Yang, Fei-Yue Wang, Han Liu

专题命中融合架构与评测：information fusion(abstract)

2401.13298 2024-01-25 cs.CL cs.AI 50%

Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models

Hongzhan Lin, Ziyang Luo, Wei Gao, Jing Ma, Bo Wang, Ruichao Yang

专题命中融合架构与评测：multimodal fusion(abstract)

Comments The first work towards explainable harmful meme detection by harnessing advanced LLMs

Journal ref The ACM Web Conference 2024

2401.00521 2024-01-02 cs.LG cs.AI stat.AP 50%

Multi-spatial Multi-temporal Air Quality Forecasting with Integrated Monitoring and Reanalysis Data

Yuxiao Hu, Qian Li, Xiaodan Shi, Jinyue Yan, Yuntian Chen

专题命中融合架构与评测：information fusion(abstract)

2310.09596 2023-12-27 cs.CL 50%

RethinkingTMSC: An Empirical Study for Target-Oriented Multimodal Sentiment Classification

Junjie Ye, Jie Zhou, Junfeng Tian, Rui Wang, Qi Zhang, Tao Gui, Xuanjing Huang

专题命中融合架构与评测：multimodal fusion(abstract)

2312.14533 2023-12-25 cs.IR cs.AI cs.LG 50%

Multi-view user representation learning for user matching without personal information

Hongliu Cao, Ilias El Baamrani, Eoin Thomas

专题命中融合架构与评测：information fusion(abstract)

2205.00867 2023-12-14 cs.SI 50%

Capturing High-order Structures on Motif-based Graph Nerual Networks

Kejia Zhang

专题命中融合架构与评测：information fusion(abstract)

Comments some metric have problem

2312.06397 2023-12-12 cs.DB cs.IR 50%

MUST: An Effective and Scalable Framework for Multimodal Search of Target Modality

Mengzhao Wang, Xiangyu Ke, Xiaoliang Xu, Lu Chen, Yunjun Gao, Pinpin Huang, Runkai Zhu

专题命中融合架构与评测：hybrid fusion(abstract)

Comments This paper has been accepted by ICDE 2024

2312.05434 2023-12-12 cs.CL 50%

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models

Hongzhan Lin, Ziyang Luo, Jing Ma, Long Chen

专题命中融合架构与评测：multimodal fusion(abstract)

Comments The first work to alleviate the issue of superficial understanding for harmful meme detection by explicitly utilizing commonsense knowledge, from a fresh perspective on harnessing advanced Large Language Models

Journal ref The 2023 Conference on Empirical Methods in Natural Language Processing

2311.11009 2023-11-21 cs.CL 50%

Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition

Dongyuan Li, Yusong Wang, Kotaro Funakoshi, Manabu Okumura

专题命中融合架构与评测：multimodal fusion(abstract)

2308.08991 2023-11-21 cs.SE 50%

Who is the Real Hero? Measuring Developer Contribution via Multi-dimensional Data Integration

Yuqiang Sun, Zhengzi Xu, Chengwei Liu, Yiran Zhang, Yang Liu

专题命中融合架构与评测：information fusion(abstract)

2311.08134 2023-11-15 astro-ph.IM astro-ph.HE 50%

Applying hybrid clustering in pulsar candidate sifting with multi-modality for FAST survey

Zi-Yi You, Yun-Rong Pan, Zhi Ma, Li Zhang, Shuo Xiao, Dan-Dan Zhang, Shi-Jun Dang, Ru-Shuang Zhao, Pei Wang, Ai-Jun Dong, Jia-Tao Jiang, Ji-Bing Leng, Wei-An Li, Si-Yao Li

专题命中融合架构与评测：feature-level fusion(abstract)

2307.06775 2023-11-07 cs.LG cs.AI cs.CL cs.SI 50%

A Novel Site-Agnostic Multimodal Deep Learning Model to Identify Pro-Eating Disorder Content on Social Media

Jonathan Feldman

专题命中融合架构与评测：multimodal fusion(abstract)

2310.10179 2023-10-17 eess.AS cs.SD 50%

Advancing Audio Emotion and Intent Recognition with Large Pre-Trained Models and Bayesian Inference

Dejan Porjazovski, Yaroslav Getman, Tamás Grósz, Mikko Kurimo

专题命中融合架构与评测：multimodal fusion(abstract)

Comments Accepted at ACMM 2023

2305.01523 2023-10-17 cs.LG cs.AI cs.CE 50%

Towards Unified AI Drug Discovery with Multiple Knowledge Modalities

Yizhen Luo, Xing Yi Liu, Kai Yang, Kui Huang, Massimo Hong, Jiahuan Zhang, Yushuai Wu, Zaiqing Nie

专题命中融合架构与评测：multimodal fusion(abstract)

Comments 10 pages, 6 figures

1. 融合架构与评测 1418 篇

Learning to Approximate Particle Smoothing Trajectories via Diffusion Generative Models

Few-shot fault diagnosis based on multi-scale graph convolution filtering for industry

A Cross-Field Fusion Strategy for Drug-Target Interaction Prediction

Towards Efficient Resume Understanding: A Multi-Granularity Multi-Modal Pre-Training Approach

MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition

UMAIR-FPS: User-aware Multi-modal Animation Illustration Recommendation Fusion with Painting Style

Streamlined Transmission: A Semantic-Aware XR Deployment Framework Enhanced by Generative AI

Channel-Feedback-Free Transmission for Downlink FD-RAN: A Radio Map based Complex-valued Precoding Network Approach

Optimal State Estimation in the Presence of Non-Gaussian Uncertainty via Wasserstein Distance Minimization

A Mixing-Accelerated Primal-Dual Proximal Algorithm for Distributed Nonconvex Optimization

KG-TREAT: Pre-training for Treatment Effect Estimation by Synergizing Patient Data with Knowledge Graphs

Representation learning in multiplex graphs: Where and how to fuse information?

MultiFIX: An XAI-friendly feature inducing approach to building models from multimodal data

REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Models

pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning

EXMOS: Explanatory Model Steering Through Multifaceted Explanations and Data Configurations

Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment

Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models

Multi-spatial Multi-temporal Air Quality Forecasting with Integrated Monitoring and Reanalysis Data

RethinkingTMSC: An Empirical Study for Target-Oriented Multimodal Sentiment Classification

Multi-view user representation learning for user matching without personal information

Capturing High-order Structures on Motif-based Graph Nerual Networks

MUST: An Effective and Scalable Framework for Multimodal Search of Target Modality

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models

Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition

Who is the Real Hero? Measuring Developer Contribution via Multi-dimensional Data Integration

Applying hybrid clustering in pulsar candidate sifting with multi-modality for FAST survey

A Novel Site-Agnostic Multimodal Deep Learning Model to Identify Pro-Eating Disorder Content on Social Media

Advancing Audio Emotion and Intent Recognition with Large Pre-Trained Models and Bayesian Inference

Towards Unified AI Drug Discovery with Multiple Knowledge Modalities