多模态大模型

A Multimodal Dataset and Benchmark for Radio Galaxy and Infrared Host Detection

Nikhel Gupta, Zeeshan Hayder, Ray P. Norris, Minh Hyunh, Lars Petersson

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted in NeurIPS 2023 conference ML4PS workshop (https://nips.cc/). The full version accepted in PASA, is available at https://doi.org/10.1017/pasa.2023.64

RadImageGAN -- A Multi-modal Dataset-Scale Generative AI for Medical Imaging

Zelong Liu, Alexander Zhou, Arnold Yang, Alara Yilmaz, Maxwell Yoo, Mikey Sullivan, Catherine Zhang, James Grant, Daiqing Li, Zahi A. Fayad, Sean Huver, Timothy Deyer, Xueyan Mei

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Multimodal Misinformation Detection in a South African Social Media Environment

Amica De Jager, Vukosi Marivate, Abioudun Modupe

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Artificial Intelligence Research. SACAIR 2023

Automated Multimodal Data Annotation via Calibration With Indoor Positioning System

Ryan Rubel, Andrew Dudash, Mohammad Goli, James O'Hara, Karl Wunderlich

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Contains eight pages and 10 figures. A version of this document was accepted to IEEE IRC 2023

BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Models

Rizhao Cai, Zirui Song, Dayan Guan, Zhenhao Chen, Xing Luo, Chenyu Yi, Alex Kot

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Code is available at https://github.com/AIFEG/BenchLMM

LLaVA-Grounding: Grounded Visual Chat with Large Multimodal Models

Hao Zhang, Hongyang Li, Feng Li, Tianhe Ren, Xueyan Zou, Shilong Liu, Shijia Huang, Jianfeng Gao, Lei Zhang, Chunyuan Li, Jianwei Yang

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Human-Machine Cooperative Multimodal Learning Method for Cross-subject Olfactory Preference Recognition

Xiuxin Xia, Yuchen Guo, Yanwei Wang, Yuchao Yang, Yan Shi, Hong Men

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 14 pages, 13 figures

Deformable multi-modal image registration for the correlation between optical measurements and histology images

Lianne Feenstra, Maud Lambregts, Theo J. M Ruers, Behdad Dashtbozorg

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Multimodal Interactive Lung Lesion Segmentation: A Framework for Annotating PET/CT Images based on Physiological and Anatomical Cues

Verena Jasmin Hallitschke, Tobias Schlumberger, Philipp Kataliakos, Zdravko Marinov, Moon Kim, Lars Heiliger, Constantin Seibold, Jens Kleesiek, Rainer Stiefelhagen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at ISBI 2023; 5 pages, 5 figures

Beyond Text: Unveiling Multimodal Proficiency of Large Language Models with MultiAPI Benchmark

Xiao Liu, Jianfeng Lin, Jiawei Zhang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Work in Progress

UIT-Saviors at MEDVQA-GI 2023: Improving Multimodal Learning with Image Enhancement for Gastrointestinal Visual Question Answering

Triet M. Thai, Anh T. Vo, Hao K. Tieu, Linh N. P. Bui, Thien T. B. Nguyen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments ImageCLEF2023 published version: https://ceur-ws.org/Vol-3497/paper-129.pdf

Leveraging Transformers to Improve Breast Cancer Classification and Risk Assessment with Multi-modal and Longitudinal Data

Yiqiu Shen, Jungkyu Park, Frank Yeung, Eliana Goldberg, Laura Heacock, Farah Shamout, Krzysztof J. Geras

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments ML4H 2023 Findings Track

Multimodal Clinical Benchmark for Emergency Care (MC-BEC): A Comprehensive Benchmark for Evaluating Foundation Models in Emergency Medicine

Emma Chen, Aman Kansal, Julie Chen, Boyang Tom Jin, Julia Rachel Reisler, David A Kim, Pranav Rajpurkar

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track

Dual Radar: A Multi-modal Dataset with Dual 4D Radar for Autonomous Driving

Xinyu Zhang, Li Wang, Jian Chen, Cheng Fang, Lei Yang, Ziying Song, Guangqi Yang, Yichen Wang, Xiaofei Zhang, Jun Li, Zhiwei Li, Qingshan Yang, Zhenlin Zhang, Shuzhi Sam Ge

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Causal disentanglement of multimodal data

Elise Walker, Jonas A. Actor, Carianne Martinez, Nathaniel Trask

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab

Jieming Cui, Ziren Gong, Baoxiong Jia, Siyuan Huang, Zilong Zheng, Jianzhu Ma, Yixin Zhu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Multimodal ChatGPT for Medical Applications: an Experimental Study of GPT-4V

Zhiling Yan, Kai Zhang, Rong Zhou, Lifang He, Xiang Li, Lichao Sun

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

A Contextualized Real-Time Multimodal Emotion Recognition for Conversational Agents using Graph Convolutional Networks in Reinforcement Learning

Fathima Abdul Rahman, Guang Lu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 5 pages (4 main + 1 reference), 2 figures. Submitted to IEEE FG2024

M2C: Towards Automatic Multimodal Manga Complement

Hongcheng Guo, Boyang Wang, Jiaqi Bai, Jiaheng Liu, Jian Yang, Zhoujun Li

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments EMNLP2023. arXiv admin note: text overlap with arXiv:2210.15461

Zenseact Open Dataset: A large-scale and diverse multimodal dataset for autonomous driving

Mina Alibeigi, William Ljungbergh, Adam Tonderski, Georg Hess, Adam Lilja, Carl Lindstrom, Daria Motorniuk, Junsheng Fu, Jenny Widahl, Christoffer Petersson

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments International Conference on Computer Vision (ICCV) 2023

Beyond Unimodal: Generalising Neural Processes for Multimodal Uncertainty Estimation

Myong Chol Jung, He Zhao, Joanna Dipnall, Lan Du

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted to NeurIPS 2023

Benchmarking Sequential Visual Input Reasoning and Prediction in Multimodal Large Language Models

Mingwei Zhu, Leigang Sha, Yu Shu, Kangjia Zhao, Tiancheng Zhao, Jianwei Yin

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Unleash the Potential of Image Branch for Cross-modal 3D Object Detection

Yifan Zhang, Qijian Zhang, Junhui Hou, Yixuan Yuan, Guoliang Xing

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2023

Revisiting Multi-modal 3D Semantic Segmentation in Real-world Autonomous Driving

Feng Jiang, Chaoping Tu, Gang Zhang, Jun Li, Hanqing Huang, Junyu Lin, Di Feng, Jian Pu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments 7 pages, 3 figures

Solution for SMART-101 Challenge of ICCV Multi-modal Algorithmic Reasoning Task 2023

Xiangyu Wu, Yang Yang, Shengdong Xu, Yifeng Wu, Qingguo Chen, Jianfeng Lu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

I2SRM: Intra- and Inter-Sample Relationship Modeling for Multimodal Information Extraction

Yusheng Huang, Zhouhan Lin

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Multi-modal Queried Object Detection in the Wild

Yifan Xu, Mengdan Zhang, Chaoyou Fu, Peixian Chen, Xiaoshan Yang, Ke Li, Changsheng Xu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Cross-City Matters: A Multimodal Remote Sensing Benchmark Dataset for Cross-City Semantic Segmentation using High-Resolution Domain Adaptation Networks

Danfeng Hong, Bing Zhang, Hao Li, Yuxuan Li, Jing Yao, Chenyu Li, Martin Werner, Jocelyn Chanussot, Alexander Zipf, Xiao Xiang Zhu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

MMASD: A Multimodal Dataset for Autism Intervention Analysis

Jicheng Li, Vuthea Chheang, Pinar Kullu, Eli Brignac, Zhang Guo, Kenneth E. Barner, Anjana Bhat, Roghayeh Leila Barmaki

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 2 figures

Multi-modal Variational Autoencoders for normative modelling across multiple imaging modalities

Ana Lawry Aguila, James Chapman, Andre Altmann

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV