多模态大模型 - arXivDaily 专题

2311.13022 2023-11-23 cs.LG cs.CV 74%

Unsupervised Multimodal Surface Registration with Geometric Deep Learning

Mohamed A. Suliman, Logan Z. J. Williams, Abdulah Fawaz, Emma C. Robinson

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

2311.12040 2023-11-22 q-bio.QM cs.AI cs.LG 74%

TransCDR: a deep learning model for enhancing the generalizability of cancer drug response prediction through transfer learning and multimodal data fusion for drug representation

Xiaoqiong Xia, Chaoyu Zhu, Yuqi Shan, Fan Zhong, Lei Liu

专题命中多模态训练与对齐：multimodal(title)；分类 cs.AI

Comments 8 figures

2309.15109 2023-09-27 cs.CV cs.RO 74%

DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation

Zeyu Wang, Dingwen Li, Chenxu Luo, Cihang Xie, Xiaodong Yang

专题命中多模态训练与对齐：cross-modal(title)；分类 cs.CV

Comments ICCV 2023

2209.00993 2023-08-22 eess.SP cs.AI cs.HC 74%

Data Fusion in Neuromarketing: Multimodal Analysis of Biosignals, Lifecycle Stages, Current Advances, Datasets, Trends, and Challenges

Mario Quiles Pérez, Enrique Tomás Martínez Beltrán, Sergio López Bernal, Eduardo Horna Prat, Luis Montesano Del Campo, Lorenzo Fernández Maimó, Alberto Huertas Celdrán

专题命中多模态训练与对齐：multimodal(title)；分类 cs.AI

Comments 26 pages, 15 figures

2308.08414 2023-08-17 cs.CV 74%

Tem-adapter: Adapting Image-Text Pretraining for Video Question Answer

Guangyi Chen, Xiao Liu, Guangrun Wang, Kun Zhang, Philip H. S. Torr, Xiao-Ping Zhang, Yansong Tang

专题命中多模态训练与对齐：image-text(title)；分类 cs.CV

Comments ICCV 2023

2307.15301 2023-07-31 cs.CV 74%

Attentive Multimodal Fusion for Optical and Scene Flow

Youjie Zhou, Guofeng Mei, Yiming Wang, Fabio Poiesi, Yi Wan

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Comments This work is accepted for publication in IEEE Robotics and Automation Letters

2307.04377 2023-07-11 cs.SD eess.AS 74%

HCLAS-X: Hierarchical and Cascaded Lyrics Alignment System Using Multimodal Cross-Correlation

Minsung Kang, Soochul Park, Keunwoo Choi

专题命中多模态训练与对齐：multimodal(title)；分类 eess.AS

2307.02978 2023-07-07 cs.CV 74%

Multi-modal multi-class Parkinson disease classification using CNN and decision level fusion

Sushanta Kumar Sahu, Ananda S. Chowdhury

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments 10th International Conference on Pattern Recognition and Machine Intelligence (Acepted)

2303.13814 2023-03-27 cs.CV 74%

Multimodal Adaptive Fusion of Face and Gait Features using Keyless attention based Deep Neural Networks for Human Identification

Ashwin Prakash, Thejaswin S, Athira Nambiar, Alexandre Bernardino

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Comments -

2303.11755 2023-03-22 cs.CV 74%

LIMITR: Leveraging Local Information for Medical Image-Text Representation

Gefen Dawidowicz, Elad Hirsch, Ayellet Tal

专题命中多模态训练与对齐：image-text(title)；分类 cs.CV

2303.09782 2023-03-20 cs.CV 74%

High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusion

Anh Duy Nguyen, Huy Hieu Pham, Huynh Thanh Trung, Quoc Viet Hung Nguyen, Thao Nguyen Truong, Phi Le Nguyen

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Comments Under review by Plos ONE journal

2302.11283 2023-02-23 cs.CV 74%

Asynchronous Trajectory Matching-Based Multimodal Maritime Data Fusion for Vessel Traffic Surveillance in Inland Waterways

Yu Guo, Ryan Wen Liu, Jingxiang Qu, Yuxu Lu, Fenghua Zhu, Yisheng Lv

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

2302.05200 2023-02-13 cs.CV 74%

End-to-end Semantic Object Detection with Cross-Modal Alignment

Silvan Ferreira, Allan Martins, Ivanovitch Silva

专题命中多模态训练与对齐：cross-modal(title)；分类 cs.CV

2212.07560 2022-12-20 cs.CV cs.NE cs.RO eess.IV 74%

Multi-level and multi-modal feature fusion for accurate 3D object detection in Connected and Automated Vehicles

Yiming Hou, Mahdi Rezaei, Richard Romano

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

2211.03109 2022-11-08 eess.IV cs.CV 74%

A Sequence Agnostic Multimodal Preprocessing for Clogged Blood Vessel Detection in Alzheimer's Diagnosis

Partho Ghosh, Md. Abrar Istiak, Mir Sayeed Mohammad, Swapnil Saha, Uday Kamal

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Comments 5 pages, 4 figures

2210.09739 2022-10-19 cs.CV cs.RO 74%

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles with Label Propagation for Cross-Domain Adaptation

Simon Bultmann, Jan Quenzel, Sven Behnke

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments 35 pages, 18 figures, Accepted for Robotics and Autonomous Systems, Elsevier. arXiv admin note: substantial text overlap with arXiv:2108.06608

2112.13593 2022-10-13 cs.LG cs.CL q-fin.TR 74%

Multi-modal Attention Network for Stock Movements Prediction

Shwai He, Shi Gu

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CL

Comments The AAAI-22 Workshop on Knowledge Discovery from Unstructured Data in Financial Services (KDF 2022)

2210.04208 2022-10-11 cs.CV 74%

Let Images Give You More:Point Cloud Cross-Modal Training for Shape Analysis

Xu Yan, Heshen Zhan, Chaoda Zheng, Jiantao Gao, Ruimao Zhang, Shuguang Cui, Zhen Li

专题命中多模态训练与对齐：cross-modal(title)；分类 cs.CV

Comments To appear in NIPS2022

2207.00186 2022-08-04 cs.CV cs.RO 74%

MMFN: Multi-Modal-Fusion-Net for End-to-End Driving

Qingwen Zhang, Mingkai Tang, Ruoyu Geng, Feiyi Chen, Ren Xin, Lujia Wang

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments 7 pages, 5 figures, accepted by IROS 2022

2111.00993 2022-07-08 cs.CV 74%

Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusion

Jianing Qiu, Lipeng Chen, Xiao Gu, Frank P. -W. Lo, Ya-Yen Tsai, Jiankai Sun, Jiaqi Liu, Benny Lo

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Journal ref IEEE Robotics and Automation Letters, June, 2022

2204.08653 2022-04-20 cs.SE cs.CL cs.LG 74%

On The Cross-Modal Transfer from Natural Language to Code through Adapter Modules

Divyam Goel, Ramansh Grover, Fatemeh H. Fard

专题命中多模态训练与对齐：cross-modal(title)；分类 cs.CL

Comments 11 pages, 6 figures, ICPC 2022. 30th International Conference on Program Comprehension (ICPC '22), May 16--17, 2022, Virtual Event, USA}

2203.03568 2022-03-08 cs.CV 74%

An Unsupervised Domain Adaptive Approach for Multimodal 2D Object Detection in Adverse Weather Conditions

George Eskandar, Robert A. Marsden, Pavithran Pandiyan, Mario Döbler, Karim Guirguis, Bin Yang

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

2202.05500 2022-02-14 cs.CV cs.RO 74%

Multi-Modal Fusion for Sensorimotor Coordination in Steering Angle Prediction

Farzeen Munir, Shoaib Azam, Byung-Geun Lee, Moongu Jeon

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

2201.08747 2022-01-24 q-bio.NC cs.AI 74%

Inferring Brain Dynamics via Multimodal Joint Graph Representation EEG-fMRI

Jalal Mirakhorli

专题命中多模态训练与对齐：multimodal(title)；分类 cs.AI

Comments 13 pages, 2 figures

2110.15763 2021-11-01 cs.CL 74%

How to Leverage Multimodal EHR Data for Better Medical Predictions?

Bo Yang, Lijun Wu

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CL

Comments Accepted by EMNLP 2021

2107.11757 2021-10-22 cs.CL 74%

MuSe-Toolbox: The Multimodal Sentiment Analysis Continuous Annotation Fusion and Discrete Class Transformation Toolbox

Lukas Stappen, Lea Schumann, Benjamin Sertolli, Alice Baird, Benjamin Weigel, Erik Cambria, Björn W. Schuller

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CL

Comments (1) https://github.com/lstappen/MuSe-Toolbox (2) docker pull musetoolbox/musetoolbox

2110.07919 2021-10-18 eess.IV cs.CV 74%

Combining CNNs With Transformer for Multimodal 3D MRI Brain Tumor Segmentation With Self-Supervised Pretraining

Mariia Dobko, Danylo-Ivan Kolinko, Ostap Viniavskyi, Yurii Yelisieiev

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

2109.01066 2021-09-03 cs.CV 74%

4D-Net for Learned Multi-Modal Alignment

AJ Piergiovanni, Vincent Casser, Michael S. Ryoo, Anelia Angelova

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments ICCV 2021

2108.07139 2021-08-17 cs.LG cs.AI 74%

Efficient Feature Representations for Cricket Data Analysis using Deep Learning based Multi-Modal Fusion Model

Souridas Alaka, Rishikesh Sreekumar, Hrithwik Shalu

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.AI

2108.06608 2021-08-17 cs.CV cs.RO 74%

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles

Simon Bultmann, Jan Quenzel, Sven Behnke

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments Accepted for: 10th European Conference on Mobile Robots (ECMR), Bonn, Germany, September 2021

1. 多模态训练与对齐 6903 篇

Unsupervised Multimodal Surface Registration with Geometric Deep Learning

TransCDR: a deep learning model for enhancing the generalizability of cancer drug response prediction through transfer learning and multimodal data fusion for drug representation

DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation

Data Fusion in Neuromarketing: Multimodal Analysis of Biosignals, Lifecycle Stages, Current Advances, Datasets, Trends, and Challenges

Tem-adapter: Adapting Image-Text Pretraining for Video Question Answer

Attentive Multimodal Fusion for Optical and Scene Flow

HCLAS-X: Hierarchical and Cascaded Lyrics Alignment System Using Multimodal Cross-Correlation

Multi-modal multi-class Parkinson disease classification using CNN and decision level fusion

Multimodal Adaptive Fusion of Face and Gait Features using Keyless attention based Deep Neural Networks for Human Identification

LIMITR: Leveraging Local Information for Medical Image-Text Representation

High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusion

Asynchronous Trajectory Matching-Based Multimodal Maritime Data Fusion for Vessel Traffic Surveillance in Inland Waterways

End-to-end Semantic Object Detection with Cross-Modal Alignment

Multi-level and multi-modal feature fusion for accurate 3D object detection in Connected and Automated Vehicles

A Sequence Agnostic Multimodal Preprocessing for Clogged Blood Vessel Detection in Alzheimer's Diagnosis

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles with Label Propagation for Cross-Domain Adaptation

Multi-modal Attention Network for Stock Movements Prediction

Let Images Give You More:Point Cloud Cross-Modal Training for Shape Analysis

MMFN: Multi-Modal-Fusion-Net for End-to-End Driving

Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusion

On The Cross-Modal Transfer from Natural Language to Code through Adapter Modules

An Unsupervised Domain Adaptive Approach for Multimodal 2D Object Detection in Adverse Weather Conditions

Multi-Modal Fusion for Sensorimotor Coordination in Steering Angle Prediction

Inferring Brain Dynamics via Multimodal Joint Graph Representation EEG-fMRI

How to Leverage Multimodal EHR Data for Better Medical Predictions?

MuSe-Toolbox: The Multimodal Sentiment Analysis Continuous Annotation Fusion and Discrete Class Transformation Toolbox

Combining CNNs With Transformer for Multimodal 3D MRI Brain Tumor Segmentation With Self-Supervised Pretraining

4D-Net for Learned Multi-Modal Alignment

Efficient Feature Representations for Cricket Data Analysis using Deep Learning based Multi-Modal Fusion Model

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles