多模态大模型 - arXivDaily 专题

2409.16627 2024-10-03 cs.IR 78%

Train Once, Deploy Anywhere: Matryoshka Representation Learning for Multimodal Recommendation

Yueqi Wang, Zhenrui Yue, Huimin Zeng, Dong Wang, Julian McAuley

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted to EMNLP 2024 Findings

2409.18462 2024-09-30 cs.LG q-bio.NC 78%

Latent Representation Learning for Multimodal Brain Activity Translation

Arman Afrasiyabi, Dhananjay Bhaskar, Erica L. Busch, Laurent Caplette, Rahul Singh, Guillaume Lajoie, Nicholas B. Turk-Browne, Smita Krishnaswamy

专题命中多模态训练与对齐：multimodal(title,abstract)

2409.12481 2024-09-20 cs.CE 78%

A physics-enhanced multi-modal fused neural network for predicting contamination length interval in pipeline

Jian Du, Pengtao Niu, Jianqin Zheng, Qi Liao, Yongtu Liang

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 16 pages, 9 figures. This paper is one of the research outputs of the intelligent oil and gas pipeline in our team, which can be abbreviated as "DeepPipe". This paper have been submitted to the journal and is under review

2409.11906 2024-09-19 cs.RO 78%

Fusion in Context: A Multimodal Approach to Affective State Recognition

Youssef Mohamed, Severin Lemaignan, Arzu Guneysu, Patric Jensfelt, Christian Smith

专题命中多模态训练与对齐：multimodal(title,abstract)

2409.11609 2024-09-19 cs.LG 78%

Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Model

Derek Jollie, Jingmin Sun, Zecheng Zhang, Hayden Schaeffer

专题命中多模态训练与对齐：multimodal(title,abstract)

2409.10993 2024-09-18 cs.IR 78%

Multi-modal Generative Models in Recommendation System

Arnau Ramisa, Rene Vidal, Yashar Deldjoo, Zhankui He, Julian McAuley, Anton Korikov, Scott Sanner, Mahesh Sathiamoorthy, Atoosa Kasrizadeh, Silvia Milano, Francesco Ricci

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 32 pages 5 figures

2312.17495 2024-09-16 cs.LG physics.bio-ph q-bio.BM 78%

Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction

Xiaohua Lu, Liangxu Xie, Lei Xu, Rongzhi Mao, Shan Chang, Xiaojun Xu

专题命中多模态训练与对齐：multimodal(title,abstract)

2408.14609 2024-08-28 cs.CR 78%

Securing Biometric Data: Fully Homomorphic Encryption in Multimodal Iris and Face Recognition

Surendra Singh, Lambert Igene, Stephanie Schuckers

专题命中多模态训练与对齐：multimodal(title,abstract)

2310.07048 2024-08-21 cs.LG cs.DC cs.NI 78%

FedMFS: Federated Multimodal Fusion Learning with Selective Modality Communication

Liangqi Yuan, Dong-Jun Han, Vishnu Pandi Chellapandi, Stanislaw H. Żak, Christopher G. Brinton

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments ICC 2024

2408.03096 2024-08-07 cs.SI 78%

Enhancing Twitter Bot Detection via Multimodal Invariant Representations

Jibing Gong, Jiquan Peng, Jin Qu, ShuYing Du, Kaiyu Wang

专题命中多模态训练与对齐：multimodal(title,abstract)

2403.12384 2024-08-02 cs.IR cs.LG 78%

AlignRec: Aligning and Training in Multimodal Recommendations

Yifan Liu, Kangning Zhang, Xiangyuan Ren, Yanhua Huang, Jiarui Jin, Yingjie Qin, Ruilong Su, Ruiwen Xu, Yong Yu, Weinan Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 9 page paper, 2 page appendix. Accepted by CIKM24

2303.06471 2024-07-29 cs.LG 78%

Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review

Asim Waqas, Aakash Tripathi, Ravi P. Ramachandran, Paul Stewart, Ghulam Rasool

专题命中多模态训练与对齐：multimodal(title,abstract)

2311.13817 2024-07-29 cs.LG physics.chem-ph q-bio.QM 78%

Enhancing Peak Assignment in 13C NMR Spectroscopy: A Novel Approach Using Multimodal Alignment

Hao Xu, Zhengyang Zhou, Pengyu Hong

专题命中多模态训练与对齐：multimodal(title,abstract)

2406.18829 2024-06-28 stat.ME stat.ML 78%

Full Information Linked ICA: addressing missing data problem in multimodal fusion

Ruiyang Li, F. DuBois Bowman, Seonjoo Lee

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 17 pages, 6 figures

2401.09181 2024-06-28 cs.LG 78%

Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer

Junhao Zheng, Qianli Ma, Zhen Liu, Binquan Wu, Huawen Feng

专题命中多模态训练与对齐：multimodal(title,abstract)

2304.12259 2024-06-19 physics.comp-ph cond-mat.mtrl-sci physics.data-an 78%

Imaging 3D Chemistry at 1 nm Resolution with Fused Multi-Modal Electron Tomography

Jonathan Schwartz, Zichao Wendy Di, Yi Jiang, Jason Manassa, Jacob Pietryga, Yiwen Qian, Min Gee Cho, Jonathan L. Rowell, Huihuo Zheng, Richard D. Robinson, Junsi Gu, Alexey Kirilin, Steve Rozeveld, Peter Ercius, Jeffrey A. Fessler, Ting Xu, Mary Scott, Robert Hovden

专题命中多模态训练与对齐：multi-modal(title,abstract)

Journal ref Nat Commun 15, 3555 (2024)

2404.11058 2024-06-10 eess.IV 78%

Multimodal Fusion of Echocardiography and Electronic Health Records for the Detection of Cardiac Amyloidosis

Zishun Feng, Joseph A. Sivak, Ashok K. Krishnamurthy

专题命中多模态训练与对齐：multimodal(title,abstract)

2308.00264 2024-06-04 cs.CL cs.AI cs.LG cs.MM 78%

Multimodal Multi-loss Fusion Network for Sentiment Analysis

Zehui Wu, Ziwei Gong, Jaywon Koo, Julia Hirschberg

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CL、cs.AI、cs.MM

Comments First two authors contributed equally to the paper

2405.19031 2024-05-30 cs.IR 78%

SynerGraph: An Integrated Graph Convolution Network for Multimodal Recommendation

Mert Burabak, Tevfik Aytekin

专题命中多模态训练与对齐：multimodal(title,abstract)

2405.16083 2024-05-28 cs.LG 78%

From Orthogonality to Dependency: Learning Disentangled Representation for Multi-Modal Time-Series Sensing Signals

Ruichu Cai, Zhifang Jiang, Zijian Li, Weilin Chen, Xuexin Chen, Zhifeng Hao, Yifan Shen, Guangyi Chen, Kun Zhang

专题命中多模态训练与对齐：multi-modal(title,abstract)

2405.07435 2024-05-14 cs.CE 78%

An Efficient Multimodal Learning Framework to Comprehend Consumer Preferences Using BERT and Cross-Attention

Junichiro Niimi

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments This manuscript is under peer review

2404.16005 2024-04-26 cs.LG eess.SP 78%

Unimodal and Multimodal Sensor Fusion for Wearable Activity Recognition

Hymalai Bello

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted in IEEE 22nd International Conference on Pervasive Computing and Communications (PerCom 2024)

2310.02561 2024-03-27 eess.SP 78%

Integrated Sensing and Communications Towards Proactive Beamforming in mmWave V2I via Multi-Modal Feature Fusion (MMFF)

Haotian Zhang, Shijian Gao, Xiang Cheng, Liuqing Yang

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 14 pages, 12 figures, 5 tables

2401.17859 2024-03-20 cs.IR 78%

Towards Semantic Consistency: Dirichlet Energy Driven Robust Multi-Modal Entity Alignment

Yuanyi Wang, Haifeng Sun, Jiabo Wang, Jingyu Wang, Wei Tang, Qi Qi, Shaoling Sun, Jianxin Liao

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments arXiv admin note: text overlap with arXiv:2307.16210 by other authors

2403.12371 2024-03-20 cs.LG 78%

Advancing Time Series Classification with Multimodal Language Modeling

Mingyue Cheng, Yiheng Chen, Qi Liu, Zhiding Liu, Yucong Luo

专题命中多模态训练与对齐：multimodal(title,abstract)

2311.00136 2024-03-19 q-bio.NC cs.LG cs.NE 78%

Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data

Antonis Antoniades, Yiyi Yu, Joseph Canzano, William Wang, Spencer LaVere Smith

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 9 pages for main paper. 22 pages in total. 13 figures, 1 table

2403.01483 2024-03-05 cs.RO 78%

BronchoCopilot: Towards Autonomous Robotic Bronchoscopy via Multimodal Reinforcement Learning

Jianbo Zhao, Hao Chen, Qingyao Tian, Jian Chen, Bingyu Yang, Hongbin Liu

专题命中多模态训练与对齐：multimodal(title,abstract)

2403.00717 2024-03-04 cs.HC cs.GR 78%

MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation

JooYoung Seo, Yilin Xia, Bongshin Lee, Sean McCurry, Yu Jun Yam

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted to CHI 2024. Source code is available at https://github.com/xability/maidr

2402.19071 2024-03-01 cs.CY cs.HC 78%

FATE in MMLA: A Student-Centred Exploration of Fairness, Accountability, Transparency, and Ethics in Multimodal Learning Analytics

Yueqiao Jin, Vanessa Echeverria, Lixiang Yan, Linxuan Zhao, Riordan Alfredo, Yi-Shan Tsai, Dragan Gašević, Roberto Martinez-Maldonado

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 16 pages, 1 figure

2402.12743 2024-02-21 cs.CR cs.LG 78%

APT-MMF: An advanced persistent threat actor attribution method based on multimodal and multilevel feature fusion

Nan Xiao, Bo Lang, Ting Wang, Yikai Chen

专题命中多模态训练与对齐：multimodal(title,abstract)

1. 多模态训练与对齐 6903 篇

Train Once, Deploy Anywhere: Matryoshka Representation Learning for Multimodal Recommendation

Latent Representation Learning for Multimodal Brain Activity Translation

A physics-enhanced multi-modal fused neural network for predicting contamination length interval in pipeline

Fusion in Context: A Multimodal Approach to Affective State Recognition

Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Model

Multi-modal Generative Models in Recommendation System

Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction

Securing Biometric Data: Fully Homomorphic Encryption in Multimodal Iris and Face Recognition

FedMFS: Federated Multimodal Fusion Learning with Selective Modality Communication

Enhancing Twitter Bot Detection via Multimodal Invariant Representations

AlignRec: Aligning and Training in Multimodal Recommendations

Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review

Enhancing Peak Assignment in 13C NMR Spectroscopy: A Novel Approach Using Multimodal Alignment

Full Information Linked ICA: addressing missing data problem in multimodal fusion

Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer

Imaging 3D Chemistry at 1 nm Resolution with Fused Multi-Modal Electron Tomography

Multimodal Fusion of Echocardiography and Electronic Health Records for the Detection of Cardiac Amyloidosis

Multimodal Multi-loss Fusion Network for Sentiment Analysis

SynerGraph: An Integrated Graph Convolution Network for Multimodal Recommendation

From Orthogonality to Dependency: Learning Disentangled Representation for Multi-Modal Time-Series Sensing Signals

An Efficient Multimodal Learning Framework to Comprehend Consumer Preferences Using BERT and Cross-Attention

Unimodal and Multimodal Sensor Fusion for Wearable Activity Recognition

Integrated Sensing and Communications Towards Proactive Beamforming in mmWave V2I via Multi-Modal Feature Fusion (MMFF)

Towards Semantic Consistency: Dirichlet Energy Driven Robust Multi-Modal Entity Alignment

Advancing Time Series Classification with Multimodal Language Modeling

Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data

BronchoCopilot: Towards Autonomous Robotic Bronchoscopy via Multimodal Reinforcement Learning

MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation

FATE in MMLA: A Student-Centred Exploration of Fairness, Accountability, Transparency, and Ethics in Multimodal Learning Analytics

APT-MMF: An advanced persistent threat actor attribution method based on multimodal and multilevel feature fusion