多模态大模型 - arXivDaily 专题

2304.10756 2023-04-24 cs.CV cs.LG 79%

Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentation

Harsh Maheshwari, Yen-Cheng Liu, Zsolt Kira

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2304.09660 2023-04-20 cs.CL 79%

MPMQA: Multimodal Question Answering on Product Manuals

Liang Zhang, Anwen Hu, Jing Zhang, Shuo Hu, Qin Jin

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2204.13686 2023-04-18 cs.CV 79%

HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling

Zhongang Cai, Daxuan Ren, Ailing Zeng, Zhengyu Lin, Tao Yu, Wenjia Wang, Xiangyu Fan, Yang Gao, Yifan Yu, Liang Pan, Fangzhou Hong, Mingyuan Zhang, Chen Change Loy, Lei Yang, Ziwei Liu

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Homepage: https://caizhongang.github.io/projects/HuMMan/

2304.06401 2023-04-14 cs.CV 79%

Why Existing Multimodal Crowd Counting Datasets Can Lead to Unfulfilled Expectations in Real-World Applications

Martin Thißen, Elke Hergenröther

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2304.05080 2023-04-12 cs.CV eess.IV 79%

Investigating Imbalances Between SAR and Optical Utilization for Multi-Modal Urban Mapping

Sebastian Hafner, Yifang Ban, Andrea Nascetti

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 4 pages, 3 figures, accepted for publication in the JURSE 2023 Proceedings

2209.13351 2023-04-11 cs.CV 79%

SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagery

Jiaqing Zhang, Jie Lei, Weiying Xie, Zhenman Fang, Yunsong Li, Qian Du

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments The article is accepted by IEEE Transactions on Geoscience and Remote Sensing

2204.06766 2023-04-06 cs.LG cs.AI 79%

Multimodal spatiotemporal graph neural networks for improved prediction of 30-day all-cause hospital readmission

Siyi Tang, Amara Tariq, Jared Dunnmon, Umesh Sharma, Praneetha Elugunti, Daniel Rubin, Bhavik N. Patel, Imon Banerjee

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Journal ref IEEE Journal of Biomedical and Health Informatics, vol. 27, no. 4, pp. 2071-2082, April 2023

2304.01233 2023-04-05 cs.CL cs.LG 79%

Multi-Modal Perceiver Language Model for Outcome Prediction in Emergency Department

Sabri Boughorbel, Fethi Jarray, Abdulaziz Al Homaid, Rashid Niaz, Khalid Alyafei

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CL

2211.09769 2023-03-22 eess.SP cs.CV cs.LG 79%

DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Dataset

Ahmed Alkhateeb, Gouranga Charan, Tawfik Osman, Andrew Hredzak, João Morais, Umut Demirhan, Nikhil Srinivas

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments The dataset is available on the DeepSense 6G website http://deepsense6g.net/

2206.07331 2023-03-14 cs.MM 79%

ETMA: Efficient Transformer Based Multilevel Attention framework for Multimodal Fake News Detection

Ashima Yadav, Shivani Gaba, Haneef Khan, Ishan Budhiraja, Akansha Singh, Krishan Kant Singh

专题命中多模态评测：multimodal(title,abstract)；分类 cs.MM

Comments Accepted for publication in IEEE Transactions on Computational Social Systems

2211.01234 2023-03-10 cs.CV 79%

Uncertainty-Aware DNN for Multi-Modal Camera Localization

Matteo Vaghi, Augusto Luis Ballardini, Simone Fontana, Domenico Giorgio Sorrenti

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2211.06726 2023-03-07 cs.CV 79%

MultiCrossViT: Multimodal Vision Transformer for Schizophrenia Prediction using Structural MRI and Functional Network Connectivity Data

Yuda Bi, Anees Abrol, Zening Fu, Vince Calhoun

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments I submitted the wrong paper

2302.14406 2023-03-01 cs.CL 79%

Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Dataset

Brielen Madureira, David Schlangen

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to EACL 2023

2212.07328 2023-02-28 cs.CV 79%

Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Experts

Zhitong Gao, Yucong Chen, Chuyu Zhang, Xuming He

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Published in ICLR 2023

2302.09934 2023-02-21 cs.AI 79%

CISum: Learning Cross-modality Interaction to Enhance Multimodal Semantic Coverage for Multimodal Summarization

Litian Zhang, Xiaoming Zhang, Ziming Guo, Zhipeng Liu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments accepted by SIAM SDM2023

2210.00662 2023-02-17 cs.CV 79%

Under the Cover Infant Pose Estimation using Multimodal Data

Daniel G. Kyrollos, Anthony Fuller, Kim Greenwood, JoAnn Harrold, James R. Green

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2302.06914 2023-02-15 cs.SE cs.AI 79%

Heterogeneous Anomaly Detection for Software Systems via Semi-supervised Cross-modal Attention

Cheryl Lee, Tianyi Yang, Zhuangbin Chen, Yuxin Su, Yongqiang Yang, Michael R. Lyu

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.AI

Comments In Proceedings of the 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE). arXiv admin note: substantial text overlap with arXiv:2207.02918

2302.04473 2023-02-10 cs.IR cs.MM 79%

A Comprehensive Survey on Multimodal Recommender Systems: Taxonomy, Evaluation, and Future Directions

Hongyu Zhou, Xin Zhou, Zhiwei Zeng, Lingzi Zhang, Zhiqi Shen

专题命中多模态评测：multimodal(title,abstract)；分类 cs.MM

Comments 33 pages, 4 figures

2302.01582 2023-02-06 cs.CL 79%

Controlling for Stereotypes in Multimodal Language Model Evaluation

Manuj Malik, Richard Johansson

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2103.02451 2023-02-03 cs.CV cs.LG cs.RO 79%

Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimation

Hemang Chawla, Arnav Varma, Elahe Arani, Bahram Zonooz

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at 2021 IEEE International Conference on Robotics and Automation (ICRA)

2301.06782 2023-01-18 cs.CV 79%

A Large-Scale Outdoor Multi-modal Dataset and Benchmark for Novel View Synthesis and Implicit Scene Reconstruction

Chongshan Lu, Fukun Yin, Xin Chen, Tao Chen, Gang YU, Jiayuan Fan

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2212.13885 2022-12-29 eess.SP cs.AI cs.LG 79%

Emotion Recognition with Pre-Trained Transformers Using Multimodal Signals

Juan Vazquez-Rodriguez, Grégoire Lefebvre, Julien Cumin, James L Crowley

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Journal ref ACII 2022 - 10th International Conference on Affective Computing and Intelligent Interaction, Oct 2022, Nara, Japan

2212.10724 2022-12-22 eess.IV cs.CV 79%

Investigation of Network Architecture for Multimodal Head-and-Neck Tumor Segmentation

Ye Li, Junyu Chen, Se-in Jang, Kuang Gong, Quanzheng Li

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted for oral presentation by IEEE Medical Imaging Conference 2022

2212.09310 2022-12-20 eess.IV cs.CV cs.LG 79%

Multimodal CNN Networks for Brain Tumor Segmentation in MRI: A BraTS 2022 Challenge Solution

Ramy A. Zeineldin, Mohamed E. Karar, Oliver Burgert, Franziska Mathis-Ullrich

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted in BraTS 2022 (as part of the BrainLes workshop proceedings distributed by Springer LNCS). arXiv admin note: text overlap with arXiv:2112.06554

2212.07729 2022-12-16 cs.CV 79%

HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Driving

Andrei Zanfir, Mihai Zanfir, Alexander Gorban, Jingwei Ji, Yin Zhou, Dragomir Anguelov, Cristian Sminchisescu

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Published at the 6th Conference on Robot Learning (CoRL 2022), Auckland, New Zealand

2204.06972 2022-12-01 cs.CV cs.LG 79%

The multi-modal universe of fast-fashion: the Visuelle 2.0 benchmark

Geri Skenderi, Christian Joppi, Matteo Denitto, Berniero Scarpa, Marco Cristani

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted at the 5th Workshop on Computer Vision for Fashion, Art, and Design @ CVPR22

2211.09386 2022-11-18 cs.CV 79%

BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection

Zehui Chen, Zhenyu Li, Shiquan Zhang, Liangji Fang, Qinhong Jiang, Feng Zhao

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

2211.07993 2022-11-16 eess.IV cs.CV cs.LG 79%

DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans

Haoran Li, Cheng Li, Weijian Huang, Xiawu Zheng, Yan Xi, Shanshan Wang

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 4 pages,2 figures,2 tables

2209.01534 2022-11-15 cs.CV cs.LG 79%

Multi-modal Masked Autoencoders Learn Compositional Histopathological Representations

Wisdom Oluchi Ikezogwo, Mehmet Saygin Seyfioglu, Linda Shapiro

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Extended Abstract presented at Machine Learning for Health (ML4H) symposium 2022, November 28th, 2022, New Orleans, United States & Virtual, http://www.ml4h.cc, 10 pages

2210.17292 2022-11-01 cs.LG cs.AI 79%

M$^3$Care: Learning with Missing Modalities in Multimodal Healthcare Data

Chaohe Zhang, Xu Chu, Liantao Ma, Yinghao Zhu, Yasha Wang, Jiangtao Wang, Junfeng Zhao

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments 9 pages

Journal ref KDD 2022

1. 多模态评测 9189 篇

Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentation

MPMQA: Multimodal Question Answering on Product Manuals

HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling

Why Existing Multimodal Crowd Counting Datasets Can Lead to Unfulfilled Expectations in Real-World Applications

Investigating Imbalances Between SAR and Optical Utilization for Multi-Modal Urban Mapping

SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagery

Multimodal spatiotemporal graph neural networks for improved prediction of 30-day all-cause hospital readmission

Multi-Modal Perceiver Language Model for Outcome Prediction in Emergency Department

DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Dataset

ETMA: Efficient Transformer Based Multilevel Attention framework for Multimodal Fake News Detection

Uncertainty-Aware DNN for Multi-Modal Camera Localization

MultiCrossViT: Multimodal Vision Transformer for Schizophrenia Prediction using Structural MRI and Functional Network Connectivity Data

Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Dataset

Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Experts

CISum: Learning Cross-modality Interaction to Enhance Multimodal Semantic Coverage for Multimodal Summarization

Under the Cover Infant Pose Estimation using Multimodal Data

Heterogeneous Anomaly Detection for Software Systems via Semi-supervised Cross-modal Attention

A Comprehensive Survey on Multimodal Recommender Systems: Taxonomy, Evaluation, and Future Directions

Controlling for Stereotypes in Multimodal Language Model Evaluation

Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimation

A Large-Scale Outdoor Multi-modal Dataset and Benchmark for Novel View Synthesis and Implicit Scene Reconstruction

Emotion Recognition with Pre-Trained Transformers Using Multimodal Signals

Investigation of Network Architecture for Multimodal Head-and-Neck Tumor Segmentation

Multimodal CNN Networks for Brain Tumor Segmentation in MRI: A BraTS 2022 Challenge Solution

HUM3DIL: Semi-supervised Multi-modal 3D Human Pose Estimation for Autonomous Driving

The multi-modal universe of fast-fashion: the Visuelle 2.0 benchmark

BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection

DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans

Multi-modal Masked Autoencoders Learn Compositional Histopathological Representations

M$^3$Care: Learning with Missing Modalities in Multimodal Healthcare Data