多模态大模型

A New Era in Human Factors Engineering: A Survey of the Applications and Prospects of Large Multimodal Models

Li Fan, Lee Ching-Hung, Han Su, Feng Shanshan, Jiang Zhuoxuan, Sun Zhu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 14 pages, journal paper

The Role of Emotions in Informational Support Question-Response Pairs in Online Health Communities: A Multimodal Deep Learning Approach

Mohsen Jozani, Jason A. Williams, Ahmed Aleroud, Sarbottam Bhagat

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 37 pages, 15 figures

A Multimodal Learning-based Approach for Autonomous Landing of UAV

Francisco Neves, Luís Branco, Maria Pereira, Rafael Claro, Andry Pinto

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Dense Road Surface Grip Map Prediction from Multimodal Image Data

Jyri Maanpää, Julius Pesonen, Heikki Hyyti, Iaroslav Melekhov, Juho Kannala, Petri Manninen, Antero Kukko, Juha Hyyppä

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 17 pages, 7 figures (supplementary material 1 page, 1 figure). Submitted to 27th International Conference of Pattern Recognition (ICPR 2024)

Unsupervised Tumor-Aware Distillation for Multi-Modal Brain Image Translation

Chuan Huang, Jia Wei, Rui Li

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 5 figures. It has been provisionally accepted for IJCNN 2024

Variational Multi-Modal Hypergraph Attention Network for Multi-Modal Relation Extraction

Qian Li, Cheng Ji, Shu Guo, Yong Zhao, Qianren Mao, Shangguang Wang, Yuntao Wei, Jianxin Li

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CL

Incremental Multimodal Surface Mapping via Self-Organizing Gaussian Mixture Models

Kshitij Goel, Wennie Tabib

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 7 figures, published in IEEE Robotics and Automation Letters

Learning to Rebalance Multi-Modal Optimization by Adaptively Masking Subnetworks

Yang Yang, Hongpeng Pan, Qing-Yuan Jiang, Yi Xu, Jinghui Tang

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments 17 pages;6 figures

Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models

Songtao Jiang, Yan Zhang, Chenyi Zhou, Yeying Jin, Yang Feng, Jian Wu, Zuozhu Liu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL

Cross-modal tumor segmentation using generative blending augmentation and self training

Guillaume Sallé, Pierre-Henri Conze, Julien Bert, Nicolas Boussion, Dimitris Visvikis, Vincent Jaouen

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV

PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search

Chensheng Peng, Zhaoyu Zeng, Jinling Gao, Jundong Zhou, Masayoshi Tomizuka, Xinbing Wang, Chenghu Zhou, Nanyang Ye

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments IEEE Robotics and Automation Letters 2024. Code is available at https://github.com/PholyPeng/PNAS-MOT

Journal ref IEEE Robotics and Automation Letters, 2024

VL-Mamba: Exploring State Space Models for Multimodal Learning

Yanyuan Qiao, Zheng Yu, Longteng Guo, Sihan Chen, Zijia Zhao, Mingzhen Sun, Qi Wu, Jing Liu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Detecting Brain Tumors through Multimodal Neural Networks

Antonio Curci, Andrea Esposito

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Presented at NeroPRAI 2024 (co-located with ICPRAM 2024). This version did not undergo peer review: refer to the open access version of record (see DOI)

Journal ref Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods (ICPRAM 2024) - NeroPRAI 2024

Adaptive Multi-Modal Cross-Entropy Loss for Stereo Matching

Peng Xu, Zhiyu Xiang, Chenyu Qiao, Jingyun Fu, Tianyu Pu

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

CMDA: Cross-Modal and Domain Adversarial Adaptation for LiDAR-Based 3D Object Detection

Gyusam Chang, Wonseok Roh, Sujin Jang, Dongwook Lee, Daehyun Ji, Gyeongrok Oh, Jinsun Park, Jinkyu Kim, Sangpil Kim

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by AAAI 2024

Detecting Concrete Visual Tokens for Multimodal Machine Translation

Braeden Bowen, Vipin Vijayan, Scott Grigsby, Timothy Anderson, Jeremy Gwinnup

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL

Hyperspectral Image Analysis in Single-Modal and Multimodal setting using Deep Learning Techniques

Shivam Pande

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 253 pages

InfiMM-HD: A Leap Forward in High-Resolution Multimodal Understanding

Haogeng Liu, Quanzeng You, Xiaotian Han, Yiqi Wang, Bohan Zhai, Yongfei Liu, Yunzhe Tao, Huaibo Huang, Ran He, Hongxia Yang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Multimodal Learning To Improve Cardiac Late Mechanical Activation Detection From Cine MR Images

Jiarui Xing, Nian Wu, Kenneth Bilchick, Frederick Epstein, Miaomiao Zhang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Multimodal Federated Learning in Healthcare: a Review

Jacob Thrasher, Alina Devkota, Prasiddha Siwakotai, Rohit Chivukula, Pranav Poudel, Chaunbo Hu, Binod Bhattarai, Prashnna Gyawali

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 28 pages, 5 figures

TinyLLaVA: A Framework of Small-scale Large Multimodal Models

Baichuan Zhou, Ying Hu, Xi Weng, Junlong Jia, Jie Luo, Xien Liu, Ji Wu, Lei Huang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Our model weights and codes will be made public at https://github.com/DLCV-BUAA/TinyLLaVABench

Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation

Antonin Vobecky, David Hurych, Oriane Siméoni, Spyros Gidaris, Andrei Bursuc, Patrick Pérez, Josef Sivic

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments v2: improved quality of images. See the project webpage https://vobecant.github.io/DriveAndSegment/ for the code and more

Learning on Multimodal Graphs: A Survey

Ciyuan Peng, Jiayuan He, Feng Xia

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 9 pages, 1 figure

MMRec: Simplifying Multimodal Recommendation

Xin Zhou

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.MM

Comments Published at MMAsia'23 Workshops

Optical skin: Sensor-integration-free multimodal flexible sensing

Sho Shimadera, Kei Kitagawa, Koyo Sagehashi, Tomoaki Niiyama, Satoshi Sunada

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 11 figures

Journal ref Sci Rep 12, 13096 (2022)

FM-AE: Frequency-masked Multimodal Autoencoder for Zinc Electrolysis Plate Contact Abnormality Detection

Canzong Zhou, Can Zhou, Hongqiu Zhu, Tianhao Liu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 2023 The 34th Chinese Process Control Conference (CPCC 2023)

AccidentGPT: Accident Analysis and Prevention from V2X Environmental Perception with Multi-modal Large Model

Lening Wang, Yilong Ren, Han Jiang, Pinlong Cai, Daocheng Fu, Tianqi Wang, Zhiyong Cui, Haiyang Yu, Xuesong Wang, Hanchu Zhou, Helai Huang, Yinhai Wang

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.AI

Comments 21 pages, 19 figures

Towards Robust Multimodal Prompting With Missing Modalities

Jaehyuk Jang, Yooseung Wang, Changick Kim

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to ICASSP 2024

When Graph Data Meets Multimodal: A New Paradigm for Graph Understanding and Reasoning

Qihang Ai, Jianwu Zhou, Haiyun Jiang, Lemao Liu, Shuming Shi

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 15 pages, 10 figures, 9 tables

Cross-Modal Conceptualization in Bottleneck Models

Danis Alukaev, Semen Kiselev, Ilya Pershin, Bulat Ibragimov, Vladimir Ivanov, Alexey Kornaev, Ivan Titov

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CL

Comments Accepted at EMNLP 2023; camera-ready version