多模态大模型 - arXivDaily 专题

2210.15678 2022-10-31 cs.LG cs.AI 79%

Prototype-Based Layered Federated Cross-Modal Hashing

Jiale Liu, Yu-Wei Zhan, Xin Luo, Zhen-Duo Chen, Yongxin Wang, Xin-Shun Xu

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.AI

2208.09658 2022-10-28 cs.LG cs.AI q-bio.BM q-bio.QM 79%

A biologically-inspired multi-modal evaluation of molecular generative machine learning

Elizaveta Vinogradova, Abay Artykbayev, Alisher Amanatay, Mukhamejan Karatayev, Maxim Mametkulov, Albina Li, Anuar Suleimenov, Abylay Salimzhanov, Karina Pats, Rustam Zhumagambetov, Ferdinand Molnár, Vsevolod Peshkov, Siamac Fazli

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.AI

Comments 59 pages, 26 figures Project GitHub repository, https://gitlab.com/cheml.io/abraham

2210.11502 2022-10-24 cs.LG cs.AI 79%

Multimodal Neural Network For Demand Forecasting

Nitesh Kumar, Kumar Dheenadayalan, Suprabath Reddy, Sumant Kulkarni

专题命中多模态评测：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments Accepted at ICONIP 2022

2206.13455 2022-10-21 eess.IV cs.CV cs.RO 79%

IBISCape: A Simulated Benchmark for multi-modal SLAM Systems Evaluation in Large-scale Dynamic Environments

Abanob Soliman, Fabien Bonardi, Désiré Sidibé, Samia Bouchafa

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted for publication in the Journal of Intelligent & Robotic Systems

Journal ref J Intell Robot Syst 106, 53 (2022)

2210.03501 2022-10-18 cs.CL 79%

Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancement

Hui Liu, Wenya Wang, Haoliang Li

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP2022

2210.08394 2022-10-18 cs.CV 79%

mRI: Multi-modal 3D Human Pose Estimation Dataset using mmWave, RGB-D, and Inertial Sensors

Sizhe An, Yin Li, Umit Ogras

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022). Project page: https://sizhean.github.io/mri

2210.05419 2022-10-12 cs.CV cs.DB 79%

Exploring Interactions and Regulations in Collaborative Learning: An Interdisciplinary Multimodal Dataset

Yante Li, Yang Liu, KhÁnh Nguyen, Henglin Shi, Eija Vuorenmaa, Sanna Jarvela, Guoying Zhao

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 17 pages, 9 figures

2205.01920 2022-10-11 cs.CV 79%

Scene Clustering Based Pseudo-labeling Strategy for Multi-modal Aerial View Object Classification

Jun Yu, Hao Chang, Keda Lu, Liwen Zhang, Shenshen Du, Zhong Zhang

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2209.15099 2022-10-03 cs.CL 79%

MUG: Interactive Multimodal Grounding on User Interfaces

Tao Li, Gang Li, Jingjie Zheng, Purple Wang, Yang Li

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2209.05036 2022-09-13 eess.IV cs.CV cs.LG 79%

TMSS: An End-to-End Transformer-based Multimodal Network for Segmentation and Survival Prediction

Numan Saeed, Ikboljon Sobirov, Roba Al Majzoub, Mohammad Yaqub

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2209.04027 2022-09-12 cs.CV 79%

Cross-Modal Knowledge Transfer Without Task-Relevant Source Data

Sk Miraj Ahmed, Suhas Lohit, Kuan-Chuan Peng, Michael J. Jones, Amit K. Roy-Chowdhury

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

2209.02981 2022-09-08 cs.DB cs.CL 79%

VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene Graph

Yanzeng Li, Zilong Zheng, Wenjuan Han, Lei Zou

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments ISWC 2022 Posters, Demos, and Industry Tracks

2209.00062 2022-09-02 cs.CV 79%

Class-Aware Attention for Multimodal Trajectory Prediction

Bimsara Pathiraja, Shehan Munasinghe, Malshan Ranawella, Maleesha De Silva, Ranga Rodrigo, Peshala Jayasekara

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2208.08331 2022-08-18 eess.IV cs.CV cs.LG 79%

Leukocyte Classification using Multimodal Architecture Enhanced by Knowledge Distillation

Litao Yang, Deval Mehta, Dwarikanath Mahapatra, Zongyuan Ge

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to MICCAI 2022 workshop - MOVI2022

2208.07256 2022-08-16 cs.RO cs.CV 79%

Multi-modal Transformer Path Prediction for Autonomous Vehicle

Chia Hong Tseng, Jie Zhang, Min-Te Sun, Kazuya Sakai, Wei-Shinn Ku

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 9 pages, 12 figures, and 5 tables

2206.02425 2022-08-05 eess.IV cs.CV 79%

mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation

Yao Zhang, Nanjun He, Jiawei Yang, Yuexiang Li, Dong Wei, Yawen Huang, Yang Zhang, Zhiqiang He, Yefeng Zheng

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to MICCAI 2022

2207.14571 2022-08-02 cs.CV 79%

Prompting for Multi-Modal Tracking

Jinyu Yang, Zhe Li, Feng Zheng, Aleš Leonardis, Jingkuan Song

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted at ACMMM 2022

2104.08373 2022-08-02 cs.CV 79%

Constructing Robust Emotional State-based Feature with a Novel Voting Scheme for Multi-modal Deception Detection in Videos

Jun-Teng Yang, Guei-Ming Liu, Scott C. -H Huang

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, for AAAI23 publication

2207.10506 2022-07-22 cs.CV 79%

Multi-modal Retinal Image Registration Using a Keypoint-Based Vessel Structure Aligning Network

Aline Sindel, Bettina Hohberger, Andreas Maier, Vincent Christlein

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 11 pages, 3 figures, 3 tables, accepted to MICCAI 2022

2108.13327 2022-07-22 cs.CL 79%

N24News: A New Dataset for Multimodal News Classification

Zhen Wang, Xu Shan, Xiangxie Zhang, Jie Yang

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Journal ref Proceedings of the 13th Conference on Language Resources and Evaluation (LREC 2022), pages 6768-6775

2105.13131 2022-07-20 cs.LG cs.AI 79%

Exploiting Multi-modal Contextual Sensing for City-bus's Stay Location Characterization: Towards Sub-60 Seconds Accurate Arrival Time Prediction

Ratna Mandal, Prasenjit Karmakar, Soumyajit Chatterjee, Debaleen Das Spandan, Shouvit Pradhan, Sujoy Saha, Sandip Chakraborty, Subrata Nandi

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.AI

Comments 20 pages, 16 figures

Journal ref TIOT-2021-0028

2207.00748 2022-07-18 cs.CL 79%

Sequence-aware multimodal page classification of Brazilian legal documents

Pedro H. Luz de Araujo, Ana Paula G. S. de Almeida, Fabricio A. Braz, Nilton C. da Silva, Flavio de Barros Vidal, Teofilo E. de Campos

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments 11 pages, 6 figures. This preprint, which was originally written on 8 April 2021, has not undergone peer review or any post-submission improvements or corrections. The Version of Record of this article is published in the International Journal on Document Analysis and Recognition, and is available online at https://doi.org/10.1007/s10032-022-00406-7 and https://rdcu.be/cRvvV

Journal ref International Journal on Document Analysis and Recognition.2022

2207.06410 2022-07-15 cs.HC cs.AI cs.LG 79%

MDEAW: A Multimodal Dataset for Emotion Analysis through EDA and PPG signals from wireless wearable low-cost off-the-shelf Devices

Arijit Nandi, Fatos Xhafa, Laia Subirats, Santi Fort

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

2203.09855 2022-07-13 cs.CV 79%

Multi-Modal Masked Pre-Training for Monocular Panoramic Depth Completion

Zhiqiang Yan, Xiang Li, Kun Wang, Zhenyu Zhang, Jun Li, Jian Yang

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by ECCV2022

2207.02094 2022-07-06 eess.IV cs.CV 79%

Is a PET all you need? A multi-modal study for Alzheimer's disease using 3D CNNs

Marla Narazani, Ignacio Sarasua, Sebastian Pölsterl, Aldana Lizarraga, Igor Yakushev, Christian Wachinger

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2206.11458 2022-06-24 eess.IV cs.CV q-bio.QM 79%

Weighted Concordance Index Loss-based Multimodal Survival Modeling for Radiation Encephalopathy Assessment in Nasopharyngeal Carcinoma Radiotherapy

Jiansheng Fang, Anwei Li, Pu-Yun OuYang, Jiajian Li, Jingwen Wang, Hongbo Liu, Fang-Yun Xie, Jiang Liu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 11 pages, 3 figures, MICCAI2022

2206.08788 2022-06-20 cs.AI cs.CY cs.SI 79%

Is Multi-Modal Necessarily Better? Robustness Evaluation of Multi-modal Fake News Detection

Jinyin Chen, Chengyu Jia, Haibin Zheng, Ruoxi Chen, Chenbo Fu

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.AI

2103.01910 2022-06-20 cs.CL 79%

MultiSubs: A Large-scale Multimodal and Multilingual Dataset

Josiah Wang, Pranava Madhyastha, Josiel Figueiredo, Chiraag Lala, Lucia Specia

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments Added an n-gram with back-off baseline model to the lexical translation task (Section 7.2.4). Also synchronised the paper structure to the LREC2022 version of this work. This arxiv version is a longer version of the LREC2022 version including more experiments and an additional lexical translation task

2007.14728 2022-06-13 eess.IV cs.CV cs.LG 79%

Multimodal Spatial Attention Module for Targeting Multimodal PET-CT Lung Tumor Segmentation

Xiaohang Fu, Lei Bi, Ashnil Kumar, Michael Fulham, Jinman Kim

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2206.02119 2022-06-07 cs.CL 79%

A Multimodal Corpus for Emotion Recognition in Sarcasm

Anupama Ray, Shubham Mishra, Apoorva Nunna, Pushpak Bhattacharyya

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

1. 多模态评测 9189 篇

Prototype-Based Layered Federated Cross-Modal Hashing

A biologically-inspired multi-modal evaluation of molecular generative machine learning

Multimodal Neural Network For Demand Forecasting

IBISCape: A Simulated Benchmark for multi-modal SLAM Systems Evaluation in Large-scale Dynamic Environments

Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancement

mRI: Multi-modal 3D Human Pose Estimation Dataset using mmWave, RGB-D, and Inertial Sensors

Exploring Interactions and Regulations in Collaborative Learning: An Interdisciplinary Multimodal Dataset

Scene Clustering Based Pseudo-labeling Strategy for Multi-modal Aerial View Object Classification

MUG: Interactive Multimodal Grounding on User Interfaces

TMSS: An End-to-End Transformer-based Multimodal Network for Segmentation and Survival Prediction

Cross-Modal Knowledge Transfer Without Task-Relevant Source Data

VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene Graph

Class-Aware Attention for Multimodal Trajectory Prediction

Leukocyte Classification using Multimodal Architecture Enhanced by Knowledge Distillation

Multi-modal Transformer Path Prediction for Autonomous Vehicle

mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation

Prompting for Multi-Modal Tracking

Constructing Robust Emotional State-based Feature with a Novel Voting Scheme for Multi-modal Deception Detection in Videos

Multi-modal Retinal Image Registration Using a Keypoint-Based Vessel Structure Aligning Network

N24News: A New Dataset for Multimodal News Classification

Exploiting Multi-modal Contextual Sensing for City-bus's Stay Location Characterization: Towards Sub-60 Seconds Accurate Arrival Time Prediction

Sequence-aware multimodal page classification of Brazilian legal documents

MDEAW: A Multimodal Dataset for Emotion Analysis through EDA and PPG signals from wireless wearable low-cost off-the-shelf Devices

Multi-Modal Masked Pre-Training for Monocular Panoramic Depth Completion

Is a PET all you need? A multi-modal study for Alzheimer's disease using 3D CNNs

Weighted Concordance Index Loss-based Multimodal Survival Modeling for Radiation Encephalopathy Assessment in Nasopharyngeal Carcinoma Radiotherapy

Is Multi-Modal Necessarily Better? Robustness Evaluation of Multi-modal Fake News Detection

MultiSubs: A Large-scale Multimodal and Multilingual Dataset

Multimodal Spatial Attention Module for Targeting Multimodal PET-CT Lung Tumor Segmentation

A Multimodal Corpus for Emotion Recognition in Sarcasm