多模态大模型

Multi-modal Learning based Prediction for Disease

Yaran Chen, Xueyu Chen, Yu Han, Haoran Li, Dongbin Zhao, Jingzhong Li, Xu Wang

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

HGT: A Hierarchical GCN-Based Transformer for Multimodal Periprosthetic Joint Infection Diagnosis Using CT Images and Text

Ruiyang Li, Fujun Yang, Xianjie Liu, Hongwei Shi

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments the content has some errors

MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System

Libo Qin, Shijue Huang, Qiguang Chen, Chenran Cai, Yudi Zhang, Bin Liang, Wanxiang Che, Ruifeng Xu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Comments Accepted by ACL2023 Findings

Multimodal Object Detection in Remote Sensing

Abdelbadie Belmouhcine, Jean-Christophe Burnel, Luc Courtrai, Minh-Tan Pham, Sébastien Lefèvre

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 4 pages, accepted to IGARSS 2023

End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Models

Barry Menglong Yao, Aditya Shah, Lichao Sun, Jin-Hee Cho, Lifu Huang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted by SIGIR 23, 11 pages, 4 figures

Journal ref Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '23), July 23--27, 2023, Taipei, Taiwan

MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domain

Francesco Ragusa, Antonino Furnari, Giovanni Maria Farinella

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2010.05654

Journal ref Computer Vision and Image Understanding 2023

End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformers

Egor Panfilov, Simo Saarakkala, Miika T. Nieminen, Aleksei Tiulpin

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Longitudinal Multimodal Transformer Integrating Imaging and Latent Clinical Signatures From Routine EHRs for Pulmonary Nodule Classification

Thomas Z. Li, John M. Still, Kaiwen Xu, Ho Hin Lee, Leon Y. Cai, Aravind R. Krishnan, Riqiang Gao, Mirza S. Khan, Sanja Antic, Michael Kammer, Kim L. Sandler, Fabien Maldonado, Bennett A. Landman, Thomas A. Lasko

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to MICCAI 2023

PTVD: A Large-Scale Plot-Oriented Multimodal Dataset Based on Television Dramas

Chen Li, Xutan Peng, Teng Wang, Yixiao Ge, Mengyang Liu, Xuyuan Xu, Yexin Wang, Ying Shan

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 19 pages, 10 figures

Mutual Query Network for Multi-Modal Product Image Segmentation

Yun Guo, Wei Feng, Zheng Zhang, Xiancong Ren, Yaoyu Li, Jingjing Lv, Xin Zhu, Zhangang Lin, Jingping Shao

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by ICME2023

1st Place Solution to MultiEarth 2023 Challenge on Multimodal SAR-to-EO Image Translation

Jingi Ju, Hyeoncheol Noh, Minwoo Kim, Dong-Geol Choi

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

M-VAAL: Multimodal Variational Adversarial Active Learning for Downstream Medical Image Analysis Tasks

Bidur Khanal, Binod Bhattarai, Bishesh Khanal, Danail Stoyanov, Cristian A. Linte

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Cross-Modal Video to Body-joints Augmentation for Rehabilitation Exercise Quality Assessment

Ali Abedi, Mobin Malmirian, Shehroz S. Khan

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Multimodal Pathology Image Search Between H&E Slides and Multiplexed Immunofluorescent Images

Amir Hajighasemi, MD Jillur Rahman Saurav, Mohammad S Nasr, Jai Prakash Veerla, Aarti Darji, Parisa Boodaghi Malidarreh, Michael Robben, Helen H Shang, Jacob M Luber

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Towards Arabic Multimodal Dataset for Sentiment Analysis

Abdelhamid Haouhat, Slimane Bellaouar, Attia Nehar, Hadda Cherroun

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 8 pages

A Vessel-Segmentation-Based CycleGAN for Unpaired Multi-modal Retinal Image Synthesis

Aline Sindel, Andreas Maier, Vincent Christlein

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted to BVM 2023

Journal ref BVM 2023

HaVQA: A Dataset for Visual Question Answering and Multimodal Research in Hausa Language

Shantipriya Parida, Idris Abdulmumin, Shamsuddeen Hassan Muhammad, Aneesh Bose, Guneet Singh Kohli, Ibrahim Said Ahmad, Ketan Kotwal, Sayan Deb Sarkar, Ondřej Bojar, Habeebah Adamu Kakudi

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted at ACL 2023 as a long paper (Findings)

BIG-C: a Multimodal Multi-Purpose Dataset for Bemba

Claytone Sikasote, Eunice Mukonde, Md Mahfuz Ibn Alam, Antonios Anastasopoulos

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments accepted to ACL 2023

VIMA: General Robot Manipulation with Multimodal Prompts

Yunfan Jiang, Agrim Gupta, Zichen Zhang, Guanzhi Wang, Yongqiang Dou, Yanjun Chen, Li Fei-Fei, Anima Anandkumar, Yuke Zhu, Linxi Fan

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments ICML 2023 Camera-ready version. Project website: https://vimalabs.github.io/

GAMUS: A Geometry-aware Multi-modal Semantic Segmentation Benchmark for Remote Sensing Data

Zhitong Xiong, Sining Chen, Yi Wang, Lichao Mou, Xiao Xiang Zhu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments 13 pages

An Extensible Multimodal Multi-task Object Dataset with Materials

Trevor Standley, Ruohan Gao, Dawn Chen, Jiajun Wu, Silvio Savarese

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments ICLR 2023

MGeo: Multi-Modal Geographic Pre-Training Method

Ruixue Ding, Boli Chen, Pengjun Xie, Fei Huang, Xin Li, Qiang Zhang, Yao Xu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Comments 10 pages, 5 figures

Unsupervised Domain-agnostic Fake News Detection using Multi-modal Weak Signals

Amila Silva, Ling Luo, Shanika Karunasekera, Christopher Leckie

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Comments 15 pages

The Multimodal Driver Monitoring Database: A Naturalistic Corpus to Study Driver Attention

Sumit Jha, Mohamed F. Marzban, Tiancheng Hu, Mohamed H. Mahmoud, Naofal Al-Dhahir, Carlos Busso

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 14 pages, 12 Figures, 3 tables

Journal ref IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 8, pp. 10736-10752, August 2022

Building Multimodal AI Chatbots

Min Young Lee

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Bachelor's thesis

Predicting air quality via multimodal AI and satellite imagery

Andrew Rowley, Oktay Karakuş

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments 14 pages, 7 figures, 4 tables

MEDIC: A Multimodal Empathy Dataset in Counseling

Zhou'an_Zhu, Xin Li, Jicai Pan, Yufei Xiao, Yanan Chang, Feiyi Zheng, Shangfei Wang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensors

Walter Zimmer, Joseph Birkner, Marcel Brucker, Huu Tung Nguyen, Stefan Petrovski, Bohan Wang, Alois C. Knoll

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Towards Multi-Modal DBMSs for Seamless Querying of Texts and Tables

Matthias Urban, Carsten Binnig

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation

Ru Peng, Yawen Zeng, Junbo Zhao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments EMNLP2022 Oral Long paper