多模态大模型

Leveraging Multimodal Models for Enhanced Neuroimaging Diagnostics in Alzheimer's Disease

Francesco Chiumento, Mingming Liu

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Comments The paper has been accepted by the conference: "2024 International Conference on Big Data (IEEE Big Data 2024)"

LLMCount: Enhancing Stationary mmWave Detection with Multimodal-LLM

Boyan Li, Shengyi Ding, Deen Ma, Yixuan Wu, Hongjie Liao, Kaiyuan Hu

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Multi-modal NeRF Self-Supervision for LiDAR Semantic Segmentation

Xavier Timoneda, Markus Herb, Fabian Duerr, Daniel Goehring, Fisher Yu

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2024

GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI

Pengcheng Chen, Jin Ye, Guoan Wang, Yanjun Li, Zhongying Deng, Wei Li, Tianbin Li, Haodong Duan, Ziyan Huang, Yanzhou Su, Benyou Wang, Shaoting Zhang, Bin Fu, Jianfei Cai, Bohan Zhuang, Eric J Seibel, Junjun He, Yu Qiao

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments GitHub: https://github.com/uni-medical/GMAI-MMBench Hugging face: https://huggingface.co/datasets/OpenGVLab/GMAI-MMBench

AGL-NET: Aerial-Ground Cross-Modal Global Localization with Varying Scales

Tianrui Guan, Ruiqi Xian, Xijun Wang, Xiyang Wu, Mohamed Elnoor, Daeun Song, Dinesh Manocha

专题命中 多模态评测 ：cross-modal(title)；分类 cs.CV

Multimodal Active Measurement for Human Mesh Recovery in Close Proximity

Takahiro Maeda, Keisuke Takeshita, Norimichi Ukita, Kazuhito Tanaka

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments Accepted at Robotics and Automation Letters (RA-L) on Sep 2024

DAMMI:Daily Activities in a Psychologically Annotated Multi-Modal IoT dataset

Mohsen Falah Rad, Kamrad Khoshhal Roudposhti, Mohammad Hassan Khoobkar, Mohsen Shirali, Zahra Ahmadi, Carlos Fernandez-Llatas

专题命中 多模态评测 ：multi-modal(title)；分类 cs.AI

Comments 14 pages

T2Vs Meet VLMs: A Scalable Multimodal Dataset for Visual Harmfulness Recognition

Chen Yeh, You-Ming Chang, Wei-Chen Chiu, Ning Yu

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments Accepted to NeurIPS'24 Datasets and Benchmarks Track

Multimodal Trajectory Prediction for Autonomous Driving on Unstructured Roads using Deep Convolutional Network

Lei Li, Zhifa Chen, Jian Wang, Bin Zhou, Guizhen Yu, Xiaoxuan Chen

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Comments 11 pages,6 figures

SSE: Multimodal Semantic Data Selection and Enrichment for Industrial-scale Data Assimilation

Maying Shen, Nadine Chang, Sifei Liu, Jose M. Alvarez

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Models

Renqiu Xia, Song Mao, Xiangchao Yan, Hongbin Zhou, Bo Zhang, Haoyang Peng, Jiahao Pi, Daocheng Fu, Wenjie Wu, Hancheng Ye, Shiyang Feng, Bin Wang, Chao Xu, Conghui He, Pinlong Cai, Min Dou, Botian Shi, Sheng Zhou, Yongwei Wang, Bin Wang, Junchi Yan, Fei Wu, Yu Qiao

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments Homepage of DocGenome: https://unimodal4reasoning.github.io/DocGenome_page 22 pages, 11 figures

Diagram Formalization Enhanced Multi-Modal Geometry Problem Solver

Zeren Zhang, Jo-Ku Cheng, Jingyang Deng, Lu Tian, Jinwen Ma, Ziran Qin, Xiaokai Zhang, Na Zhu, Tuo Leng

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Synthetic Lunar Terrain: A Multimodal Open Dataset for Training and Evaluating Neuromorphic Vision Algorithms

Marcus Märtens, Kevin Farries, John Culton, Tat-Jun Chin

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments 7 pages, 5 figures, to be published at "International Symposium on Artificial Intelligence, Robotics and Automation in Space, i-SAIRAS, 2024

A Modular Approach for Multimodal Summarization of TV Shows

Louis Mahon, Mirella Lapata

专题命中 多模态评测 ：multimodal(title)；分类 cs.CL

Q-Bench+: A Benchmark for Multi-modal Foundation Models on Low-level Vision from Single Images to Pairs

Zicheng Zhang, Haoning Wu, Erli Zhang, Guangtao Zhai, Weisi Lin

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CV

Comments Accepted by TPAMI. arXiv admin note: substantial text overlap with arXiv:2309.14181

Classification of freshwater snails of the genus Radomaniola with multimodal triplet networks

Dennis Vetter, Muhammad Ahsan, Diana Delicado, Thomas A. Neubauer, Thomas Wilke, Gemma Roig

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments Spotlight at ICML 2024 AI for Science workshop

Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMs

Yiqun Duan, Qiang Zhang, Renjing Xu

专题命中 多模态评测 ：multi-modal(title)；分类 cs.AI

Journal ref Published as oral presentation paper atthe 2024 IEEE International Conference on Robotics and Automation (ICRA2024), Yokohama, Japan

Explicitly Guided Information Interaction Network for Cross-modal Point Cloud Completion

Hang Xu, Chen Long, Wenxiao Zhang, Yuan Liu, Zhen Cao, Zhen Dong, Bisheng Yang

专题命中 多模态评测 ：cross-modal(title)；分类 cs.CV

Comments ECCV 2024

SideSeeing: A multimodal dataset and collection of tools for sidewalk assessment

R. J. P. Damaceno, L. Ferreira, F. Miranda, M. Hosseini, R. M. Cesar

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments 11 pages, 7 figures

Multimodal Learning and Cognitive Processes in Radiology: MedGaze for Chest X-ray Scanpath Prediction

Akash Awasthi, Ngan Le, Zhigang Deng, Rishi Agrawal, Carol C. Wu, Hien Van Nguyen

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Comments Submitted to the Journal

Interpretable Multimodal Out-of-context Detection with Soft Logic Regularization

Huanhuan Ma, Jinghao Zhang, Qiang Liu, Shu Wu, Liang Wang

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments ICASSP 2024 lecture paper

Demonstration of an Adversarial Attack Against a Multimodal Vision Language Model for Pathology Imaging

Poojitha Thota, Jai Prakash Veerla, Partha Sai Guttikonda, Mohammad S. Nasr, Shirin Nilizadeh, Jacob M. Luber

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Cross-Modal Domain Adaptation in Brain Disease Diagnosis: Maximum Mean Discrepancy-based Convolutional Neural Networks

Xuran Zhu

专题命中 多模态评测 ：cross-modal(title)；分类 cs.CV

HOH: Markerless Multimodal Human-Object-Human Handover Dataset with Large Object Count

Noah Wiederhold, Ava Megyeri, DiMaggio Paris, Sean Banerjee, Natasha Kholgade Banerjee

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

Comments NeurIPS 2023 Datasets and Benchmarks

GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigation

Mukul Khanna, Ram Ramrakhya, Gunjan Chhablani, Sriram Yenamandra, Theophile Gervet, Matthew Chang, Zsolt Kira, Devendra Singh Chaplot, Dhruv Batra, Roozbeh Mottaghi

专题命中 多模态评测 ：multi-modal(title)；分类 cs.AI

Scaffolding Language Learning via Multi-modal Tutoring Systems with Pedagogical Instructions

Zhengyuan Liu, Stella Xin Yin, Carolyn Lee, Nancy F. Chen

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CL

BjTT: A Large-scale Multimodal Dataset for Traffic Prediction

Chengyang Zhang, Yong Zhang, Qitan Shao, Jiangtao Feng, Bo Li, Yisheng Lv, Xinglin Piao, Baocai Yin

专题命中 多模态评测 ：multimodal(title)；分类 cs.AI

Towards Red Teaming in Multimodal and Multilingual Translation

Christophe Ropers, David Dale, Prangthip Hansanti, Gabriel Mejia Gonzalez, Ivan Evtimov, Corinne Wong, Christophe Touret, Kristina Pereyra, Seohyun Sonia Kim, Cristian Canton Ferrer, Pierre Andrews, Marta R. Costa-jussà

专题命中 多模态评测 ：multimodal(title)；分类 cs.CL

Comments arXiv admin note: substantial text overlap with arXiv:2312.05187

A multimodal gesture recognition dataset for desktop human-computer interaction

Qi Wang, Fengchao Zhu, Guangming Zhu, Liang Zhang, Ning Li, Eryang Gao

专题命中 多模态评测 ：multimodal(title)；分类 cs.CV

LLMs for Multi-Modal Knowledge Extraction and Analysis in Intelligence/Safety-Critical Applications

Brett Israelsen, Soumalya Sarkar

专题命中 多模态评测 ：multi-modal(title)；分类 cs.CL

Comments initial draft