多模态大模型

Large Multimodal Model based Standardisation of Pathology Reports with Confidence and their Prognostic Significance

Ethar Alzaid, Gabriele Pergola, Harriet Evans, David Snead, Fayyaz Minhas

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 19 pages, 6 figures

Journal ref J Pathol Clin Res, 10: e70010 (2024)

FTII-Bench: A Comprehensive Multimodal Benchmark for Flow Text with Image Insertion

Jiacheng Ruan, Yebin Yang, Zehao Lin, Yuchen Feng, Feiyu Xiong, Zeyun Tang, Zhiyu Li

专题命中 多模态评测 ：multimodal(title)；image-text(abstract)；分类 cs.CV

Comments Work in progress. 9 pages, 3 figures

Meta-Learning for Color-to-Infrared Cross-Modal Style Transfer

Evelyn A. Stump, Francesco Luzi, Leslie M. Collins, Jordan M. Malof

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Comments This paper has been accepted to WACV 2025

Benchmarking Multimodal Models for Ukrainian Language Understanding Across Academic and Cultural Domains

Yurii Paniv, Artur Kiulian, Dmytro Chaplynskyi, Mykola Khandoga, Anton Polishko, Tetiana Bas, Guillermo Gabrielli

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Multi-modal Document Presentation Attack Detection With Forensics Trace Disentanglement

Changsheng Chen, Yongyi Deng, Liangwei Lin, Zitong Yu, Zhimao Lai

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted to ICME 2024

Multimodal 3D Brain Tumor Segmentation with Adversarial Training and Conditional Random Field

Lan Jiang, Yuchao Zheng, Miao Yu, Haiqing Zhang, Fatemah Aladwani, Alessandro Perelli

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 7 figures, Annual Conference on Medical Image Understanding and Analysis (MIUA) 2024

Journal ref Medical Image Understanding and Analysis (MIUA), Lecture Notes in Computer Science, Springer, vol. 14859, 2024

Can Reasons Help Improve Pedestrian Intent Estimation? A Cross-Modal Approach

Vaishnavi Khindkar, Vineeth Balasubramanian, Chetan Arora, Anbumani Subramanian, C. V. Jawahar

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

The ADUULM-360 Dataset -- A Multi-Modal Dataset for Depth Estimation in Adverse Weather

Markus Schön, Jona Ruof, Thomas Wodtko, Michael Buchholz, Klaus Dietmayer

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments 2024 IEEE International Conference on Intelligent Transportation Systems (ITSC)

Self-supervised Multimodal Speech Representations for the Assessment of Schizophrenia Symptoms

Gowtham Premananth, Carol Espy-Wilson

专题命中 多模态评测 ：multimodal(title,abstract)；分类 eess.AS

MEANT: Multimodal Encoder for Antecedent Information

Benjamin Iyoya Irving, Annika Marie Schoene

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Journal ref In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP), Miami, FL, pages 8579-8600

TableGPT2: A Large Multimodal Model with Tabular Data Integration

Aofeng Su, Aowen Wang, Chao Ye, Chen Zhou, Ga Zhang, Gang Chen, Guangcheng Zhu, Haobo Wang, Haokai Xu, Hao Chen, Haoze Li, Haoxuan Lan, Jiaming Tian, Jing Yuan, Junbo Zhao, Junlin Zhou, Kaizhe Shou, Liangyu Zha, Lin Long, Liyao Li, Pengzuo Wu, Qi Zhang, Qingyi Huang, Saisai Yang, Tao Zhang, Wentao Ye, Wufang Zhu, Xiaomeng Hu, Xijun Gu, Xinjie Sun, Xiang Li, Yuhang Yang, Zhiqing Xiao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

DAAL: Density-Aware Adaptive Line Margin Loss for Multi-Modal Deep Metric Learning

Hadush Hailu Gebrerufael, Anil Kumar Tiwari, Gaurav Neupane, Goitom Ybrah Hailu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments 13 pages, 4 fugues, 2 tables

Cognitive Insights Across Languages: Enhancing Multimodal Interview Analysis

David Ortiz-Perez, Jose Garcia-Rodriguez, David Tomás

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments GitHub repository: https://github.com/davidorp/taukadial

Journal ref Interspeech 2024, pages 952-956

Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning

Hao Shao, Shengju Qian, Han Xiao, Guanglu Song, Zhuofan Zong, Letian Wang, Yu Liu, Hongsheng Li

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Project Page: https://hao-shao.com/projects/viscot.html

S3E: A Multi-Robot Multimodal Dataset for Collaborative SLAM

Dapeng Feng, Yuhua Qi, Shipeng Zhong, Zhiqiang Chen, Qiming Chen, Hongbo Chen, Jin Wu, Jun Ma

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by IEEE Robotics and Automation Letters (RA-L)

CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models

Wentao Liu, Qianjun Pan, Yi Zhang, Zhuo Liu, Ji Wu, Jie Zhou, Aimin Zhou, Qin Chen, Bo Jiang, Liang He

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens

Anas Awadalla, Le Xue, Oscar Lo, Manli Shu, Hannah Lee, Etash Kumar Guha, Matt Jordan, Sheng Shen, Mohamed Awadalla, Silvio Savarese, Caiming Xiong, Ran Xu, Yejin Choi, Ludwig Schmidt

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

MatViX: Multimodal Information Extraction from Visually Rich Articles

Ghazal Khalighinejad, Sharon Scott, Ollie Liu, Kelly L. Anderson, Rickard Stureborg, Aman Tyagi, Bhuwan Dhingra

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Multi-Modal Transformer and Reinforcement Learning-based Beam Management

Mohammad Ghassemi, Han Zhang, Ali Afana, Akram Bin Sediq, Melike Erol-Kantarci

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

Comments 5 pages, 5 figures, IEEE Networking Letters

Large Model for Small Data: Foundation Model for Cross-Modal RF Human Activity Recognition

Yuxuan Weng, Guoquan Wu, Tianyue Zheng, Yanbing Yang, Jun Luo

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Attention-Enhanced Cross-modal Localization Between 360 Images and Point Clouds

Zhipeng Zhao, Huai Yu, Chenwei Lyv, Wen Yang, Sebastian Scherer

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Comments This work has been submitted to the IEEE for possible publication

MM-WLAuslan: Multi-View Multi-Modal Word-Level Australian Sign Language Recognition Dataset

Xin Shen, Heming Du, Hongwei Sheng, Shuyun Wang, Hui Chen, Huiqiang Chen, Zhuojie Wu, Xiaobiao Du, Jiaying Ying, Ruihan Lu, Qingzheng Xu, Xin Yu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

rECGnition_v1.0: Arrhythmia detection using cardiologist-inspired multi-modal architecture incorporating demographic attributes in ECG

Shreya Srivastava, Durgesh Kumar, Jatin Bedi, Sandeep Seth, Deepak Sharma

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

Human-AI Collaborative Multi-modal Multi-rater Learning for Endometriosis Diagnosis

Hu Wang, David Butler, Yuan Zhang, Jodie Avery, Steven Knox, Congbo Ma, Louise Hull, Gustavo Carneiro

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Multimodal Object Query Initialization for 3D Object Detection

Mathijs R. van Geerenstein, Felicia Ruppel, Klaus Dietmayer, Dariu M. Gavrila

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments This work has been submitted to the IEEE for possible publication

Crossroads of Continents: Automated Artifact Extraction for Cultural Adaptation with Large Multimodal Models

Anjishnu Mukherjee, Ziwei Zhu, Antonios Anastasopoulos

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments under review

Multimodal growth and development assessment model

Ying Li, Zichen Song, Zijie Gong, Sitan Huang, Jiewei Ge

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.MM

Comments 7 Pages 7 Figures

Towards Continual Egocentric Activity Recognition: A Multi-modal Egocentric Activity Dataset for Continual Learning

Linfeng Xu, Qingbo Wu, Lili Pan, Fanman Meng, Hongliang Li, Chiyuan He, Hanxin Wang, Shaoxu Cheng, Yu Dai

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments IEEE Transactions on Multimedia

Journal ref in IEEE Transactions on Multimedia, vol. 26, pp. 2430-2443, 2024

WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation

João Matos, Shan Chen, Siena Placino, Yingya Li, Juan Carlos Climent Pardo, Daphna Idan, Takeshi Tohyama, David Restrepo, Luis F. Nakayama, Jose M. M. Pascual-Leone, Guergana Savova, Hugo Aerts, Leo A. Celi, A. Ian Wong, Danielle S. Bitterman, Jack Gallifant

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments submitted for review, total of 14 pages

Performance Evaluation of Deep Learning and Transformer Models Using Multimodal Data for Breast Cancer Classification

Sadam Hussain, Mansoor Ali, Usman Naseem, Beatriz Alejandra Bosques Palomo, Mario Alexis Monsivais Molina, Jorge Alberto Garza Abdala, Daly Betzabeth Avendano Avalos, Servando Cardona-Huerta, T. Aaron Gulliver, Jose Gerardo Tamez Pena

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments The paper was accepted and presented in 3rd Workshop on Cancer Prevention, detection, and intervenTion (CaPTion @ MICCAI 2024)