多模态大模型

SmartRSD: An Intelligent Multimodal Approach to Real-Time Road Surface Detection for Safe Driving

Adnan Md Tayeb, Mst Ayesha Khatun, Mohtasin Golam, Md Facklasur Rahaman, Ali Aouto, Oroceo Paul Angelo, Minseon Lee, Dong-Seong Kim, Jae-Min Lee, Jung-Hyeon Kim

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 4 pages

DurLAR: A High-fidelity 128-channel LiDAR Dataset with Panoramic Ambient and Reflectivity Imagery for Multi-modal Autonomous Driving Applications

Li Li, Khalid N. Ismail, Hubert P. H. Shum, Toby P. Breckon

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by 3DV 2021; 13 pages, 14 figures; Dataset at https://github.com/l1997i/durlar

Journal ref Proc. Int. Conf. on 3D Vision (3DV 2021)

SemanticSpray++: A Multimodal Dataset for Autonomous Driving in Wet Surface Conditions

Aldi Piroli, Vinzenz Dallabetta, Johannes Kopp, Marc Walessa, Daniel Meissner, Klaus Dietmayer

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at IEEE Intelligent Vehicles Symposium (IV 2024)

Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models

Yi-Fan Zhang, Qingsong Wen, Chaoyou Fu, Xue Wang, Zhang Zhang, Liang Wang, Rong Jin

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Project page: https://github.com/yfzhang114/SliME

Multiagent Multitraversal Multimodal Self-Driving: Open MARS Dataset

Yiming Li, Zhiheng Li, Nuo Chen, Moonjun Gong, Zonglin Lyu, Zehong Wang, Peili Jiang, Chen Feng

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2024

M2SA: Multimodal and Multilingual Model for Sentiment Analysis of Tweets

Gaurish Thakkar, Sherzod Hakimov, Marko Tadić

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Journal ref LREC-COLING 2024 - The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation

PreBit -- A multimodal model with Twitter FinBERT embeddings for extreme price movement prediction of Bitcoin

Yanzhao Zou, Dorien Herremans

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 21 pages, submitted preprint to Elsevier Expert Systems with Applications

Journal ref Expert Systems with Applications, 233, 120838 (2023)

CalibNet: Dual-branch Cross-modal Calibration for RGB-D Salient Instance Segmentation

Jialun Pei, Tao Jiang, He Tang, Nian Liu, Yueming Jin, Deng-Ping Fan, Pheng-Ann Heng

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Comments This work has been accepted by TIP 2024

MGIMM: Multi-Granularity Instruction Multimodal Model for Attribute-Guided Remote Sensing Image Detailed Description

Cong Yang, Zuchao Li, Lefei Zhang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Evaluating Durability: Benchmark Insights into Multimodal Watermarking

Jielin Qiu, William Han, Xuandong Zhao, Shangbang Long, Christos Faloutsos, Lei Li

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Multi-modal Stance Detection: New Datasets and Model

Bin Liang, Ang Li, Jingqian Zhao, Lin Gui, Min Yang, Yue Yu, Kam-Fai Wong, Ruifeng Xu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Comments ACL'24 Findings

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems

Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Leng Thai, Junhao Shen, Jinyi Hu, Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, Maosong Sun

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2024 (main), update

GRASP: A novel benchmark for evaluating language GRounding And Situated Physics understanding in multimodal language models

Serwan Jassim, Mario Holubar, Annika Richter, Cornelius Wolff, Xenia Ohmer, Elia Bruni

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

CMDBench: A Benchmark for Coarse-to-fine Multimodal Data Discovery in Compound AI Systems

Yanlin Feng, Sajjadur Rahman, Aaron Feng, Vincent Chen, Eser Kandogan

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments Governance, Understanding and Integration of Data for Effective and Responsible AI (GUIDE-AI '24), June 14, 2024, Santiago, AA, Chile

Multimodal Metadata Assignment for Cultural Heritage Artifacts

Luis Rei, Dunja Mladenić, Mareike Dorozynski, Franz Rottensteiner, Thomas Schleider, Raphaël Troncy, Jorge Sebastián Lozano, Mar Gaitán Salvatella

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Journal ref Multimedia Systems 29 (2023) 847-869

MSSC-BiMamba: Multimodal Sleep Stage Classification and Early Diagnosis of Sleep Disorders with Bidirectional Mamba

Chao Zhang, Weirong Cui, Jingjing Guo

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 10 pages

A Multimodal Dangerous State Recognition and Early Warning System for Elderly with Intermittent Dementia

Liyun Deng, Lei Jin, Guangcheng Wang, Quan Shi, Han Wang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages,9 figures

Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Compare

Hanwei Zhu, Haoning Wu, Yixuan Li, Zicheng Zhang, Baoliang Chen, Lingyu Zhu, Yuming Fang, Guangtao Zhai, Weisi Lin, Shiqi Wang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

SCaRL- A Synthetic Multi-Modal Dataset for Autonomous Driving

Avinash Nittur Ramesh, Aitor Correas-Serrano, María González-Huici

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted in International Conference on Microwaves for Intelligent Mobility - 16.&17. April 2024 - Boppard near Koblenz, Germany

EmpathicStories++: A Multimodal Dataset for Empathy towards Personal Experiences

Jocelyn Shen, Yubin Kim, Mohit Hulse, Wazeer Zulfikar, Sharifa Alghowinem, Cynthia Breazeal, Hae Won Park

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2024 Findings

Chain-of-Thought Prompting for Demographic Inference with Large Multimodal Models

Yongsheng Yu, Jiebo Luo

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to ICME 2024

A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges

Huangjun Shen, Liangying Shao, Wenbo Li, Zhibin Lan, Zhanyu Liu, Jinsong Su

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Explainable Multimodal Emotion Recognition

Zheng Lian, Haiyang Sun, Licai Sun, Hao Gu, Zhuofan Wen, Siyuan Zhang, Shun Chen, Mingyu Xu, Ke Xu, Kang Chen, Lan Chen, Shan Liang, Ya Li, Jiangyan Yi, Bin Liu, Jianhua Tao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.MM

MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing

Siddhant Agarwal, Shivam Sharma, Preslav Nakov, Tanmoy Chakraborty

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments The paper has been accepted in ACL'24 (Findings)

Multimodal Collaboration Networks for Geospatial Vehicle Detection in Dense, Occluded, and Large-Scale Events

Xin Wu, Zhanchao Huang, Li Wang, Jocelyn Chanussot, Jiaojiao Tian

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Russian-Language Multimodal Dataset for Automatic Summarization of Scientific Papers

Alena Tsanda, Elena Bruches

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 12 pages, accepted to AINL

Enhancing Apparent Personality Trait Analysis with Cross-Modal Embeddings

Ádám Fodor, Rachid R. Saboundji, András Lőrincz

专题命中 多模态评测 ：cross-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 14 pages, 4 figures

Journal ref Annales Universitatis Scientiarium Budapestinensis de Rolando Eötvös Nominatae. Sectio Computatorica, MaCS Special Issue, 2021

MMIST-ccRCC: A Real World Medical Dataset for the Development of Multi-Modal Systems

Tiago Mota, M. Rita Verdelho, Alceu Bissoto, Carlos Santiago, Catarina Barata

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted in DCA in MI Workshop@CVPR2024

Multi-modal Learnable Queries for Image Aesthetics Assessment

Zhiwei Xiong, Yunfan Zhang, Zhiqi Shen, Peiran Ren, Han Yu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by ICME2024

Sports Analysis and VR Viewing System Based on Player Tracking and Pose Estimation with Multimodal and Multiview Sensors

Wenxuan Guo, Zhiyu Pan, Ziheng Xi, Alapati Tuerxun, Jianjiang Feng, Jie Zhou

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2312.06409