多模态大模型 - arXivDaily 专题

2205.15465 2022-06-01 cs.CL 79%

Analyzing Modality Robustness in Multimodal Sentiment Analysis

Devamanyu Hazarika, Yingting Li, Bo Cheng, Shuai Zhao, Roger Zimmermann, Soujanya Poria

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments NAACL 2022

2204.07649 2022-06-01 cs.CV 79%

MultiEarth 2022 -- Multimodal Learning for Earth and Environment Workshop and Challenge

Miriam Cha, Kuan Wei Huang, Morgan Schmidt, Gregory Angelides, Mark Hamilton, Sam Goldberg, Armando Cabrera, Phillip Isola, Taylor Perron, Bill Freeman, Yen-Chen Lin, Brandon Swenson, Jean Piou

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2205.11031 2022-05-24 cs.CV cs.LG 79%

Body Composition Estimation Based on Multimodal Multi-task Deep Neural Network

Subas Chhatkuli, Iris Jiang, Kyohei Kamiyama

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 11 pages, 8 figures, 1 table

2205.03439 2022-05-10 eess.IV cs.CV cs.LG 79%

Global Multi-modal 2D/3D Registration via Local Descriptors Learning

Viktoria Markova, Matteo Ronchetti, Wolfgang Wein, Oliver Zettinig, Raphael Prevost

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments This preprint was submitted to MICCAI 2022 and has not undergone post-submission improvements or corrections. The Version of Record of this contribution will be published in Springer LNCS

2104.09770 2022-04-20 cs.CV 79%

M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection

Junke Wang, Zuxuan Wu, Wenhao Ouyang, Xintong Han, Jingjing Chen, Ser-Nam Lim, Yu-Gang Jiang

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments accepted by ICMR 2022

2204.06347 2022-04-14 cs.CL 79%

WikiDiverse: A Multimodal Entity Linking Dataset with Diversified Contextual Topics and Entity Types

Xuwu Wang, Junfeng Tian, Min Gui, Zhixu Li, Rui Wang, Ming Yan, Lihan Chen, Yanghua Xiao

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2204.05454 2022-04-13 cs.CV 79%

Are Multimodal Transformers Robust to Missing Modality?

Mengmeng Ma, Jian Ren, Long Zhao, Davide Testuggine, Xi Peng

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments In CVPR 2022

2204.04564 2022-04-12 cs.CV cs.HC 79%

Multimodal Transformer for Nursing Activity Recognition

Momal Ijaz, Renato Diaz, Chen Chen

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments CVPR-2022 Workshop

2204.01026 2022-04-05 cs.CV 79%

STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenes

Peishan Cong, Xinge Zhu, Feng Qiao, Yiming Ren, Xidong Peng, Yuenan Hou, Lan Xu, Ruigang Yang, Dinesh Manocha, Yuexin Ma

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments accepted at CVPR2022

2203.16542 2022-04-04 cs.CV 79%

Towards Multimodal Depth Estimation from Light Fields

Titus Leistner, Radek Mackowiak, Lynton Ardizzone, Ullrich Köthe, Carsten Rother

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2203.14093 2022-03-30 cs.CL cs.LG cs.PL cs.SE 79%

MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain

Jan Pašek, Jakub Sido, Miloslav Konopík, Ondřej Pražák

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2203.10622 2022-03-22 eess.IV cs.CV 79%

Multi-Modal Learning Using Physicians Diagnostics for Optical Coherence Tomography Classification

Y. Logan, K. Kokilepersaud, G. Kwon, G. AlRegib, C. Wykoff, H. Yu

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2203.05137 2022-03-22 cs.CV cs.RO 79%

Cross-modal Map Learning for Vision and Language Navigation

Georgios Georgakis, Karl Schmeckpeper, Karan Wanchoo, Soham Dan, Eleni Miltsakaki, Dan Roth, Kostas Daniilidis

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

2202.02833 2022-03-21 eess.IV cs.CV cs.LG 79%

CheXstray: Real-time Multi-Modal Data Concordance for Drift Detection in Medical Imaging AI

Arjun Soin, Jameson Merkow, Jin Long, Joseph Paul Cohen, Smitha Saligrama, Stephen Kaiser, Steven Borg, Ivan Tarapov, Matthew P Lungren

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Added code url

2202.13645 2022-03-01 cs.CL 79%

MSCTD: A Multimodal Sentiment Chat Translation Dataset

Yunlong Liang, Fandong Meng, Jinan Xu, Yufeng Chen, Jie Zhou

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments Accepted at ACL 2022 as a long paper of main conference. Code and data: https://github.com/XL2248/MSCTD

2202.05268 2022-02-14 eess.IV cs.CV 79%

HNF-Netv2 for Brain Tumor Segmentation using multi-modal MR Imaging

Haozhe Jia, Chao Bai, Weidong Cai, Heng Huang, Yong Xia

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments RSNA 2021 Brain Tumor AI Challenge Top Solution. arXiv admin note: substantial text overlap with arXiv:2012.15318

2202.00259 2022-02-02 cs.CV 79%

Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics

Hangjie Yuan, Mang Wang, Dong Ni, Liangpeng Xu

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted to AAAI2022

2201.09639 2022-01-25 cs.CV 79%

Question Generation for Evaluating Cross-Dataset Shifts in Multi-modal Grounding

Arjun R. Akula

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2201.09421 2022-01-25 cs.CV eess.IV 79%

Mutual Attention-based Hybrid Dimensional Network for Multimodal Imaging Computer-aided Diagnosis

Yin Dai, Yifan Gao, Fayu Liu, Jun Fu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 11 pages, 8 figures

2201.01249 2022-01-05 cs.AI cs.LG eess.IV 79%

ExAID: A Multimodal Explanation Framework for Computer-Aided Diagnosis of Skin Lesions

Adriano Lucieri, Muhammad Naseer Bajwa, Stephan Alexander Braun, Muhammad Imran Malik, Andreas Dengel, Sheraz Ahmed

专题命中多模态评测：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments Accepted for publication in Computer Methods and Programs in Biomedicine

2112.12141 2021-12-23 cs.CV 79%

Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Driving

Jingxiao Zheng, Xinwei Shi, Alexander Gorban, Junhua Mao, Yang Song, Charles R. Qi, Ting Liu, Visesh Chari, Andre Cornman, Yin Zhou, Congcong Li, Dragomir Anguelov

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2112.09467 2021-12-20 cs.CL cs.LG 79%

A Multimodal Approach for Automatic Mania Assessment in Bipolar Disorder

Pınar Baki

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2112.08176 2021-12-16 cs.LG cs.AI 79%

AMSER: Adaptive Multi-modal Sensing for Energy Efficient and Resilient eHealth Systems

Emad Kasaeyan Naeini, Sina Shahhosseini, Anil Kanduri, Pasi Liljeberg, Amir M. Rahmani, Nikil Dutt

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.AI

2112.04831 2021-12-10 cs.CL 79%

Multimodal Fake News Detection

Santiago Alonso-Bartolome, Isabel Segura-Bedmar

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2111.11665 2021-11-30 eess.IV cs.CV 79%

RadFusion: Benchmarking Performance and Fairness for Multimodal Pulmonary Embolism Detection from CT and EHR

Yuyin Zhou, Shih-Cheng Huang, Jason Alan Fries, Alaa Youssef, Timothy J. Amrhein, Marcello Chang, Imon Banerjee, Daniel Rubin, Lei Xing, Nigam Shah, Matthew P. Lungren

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments RadFusion dataset: https://stanfordaimi.azurewebsites.net/datasets/3a7548a4-8f65-4ab7-85fa-3d68c9efc1bd

2006.00753 2021-11-29 cs.CV 79%

Structured Multimodal Attentions for TextVQA

Chenyu Gao, Qi Zhu, Peng Wang, Hui Li, Yuliang Liu, Anton van den Hengel, Qi Wu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments winner of TextVQA Challenge 2020, Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence

2111.06881 2021-11-15 cs.CV cs.LG cs.RO 79%

Multimodal Virtual Point 3D Detection

Tianwei Yin, Xingyi Zhou, Philipp Krähenbühl

专题命中多模态评测：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments NeurIPS 2021, code available at https://tianweiy.github.io/mvp/

2111.05736 2021-11-11 cs.IR cs.CV cs.LG 79%

Multimodal Approach for Metadata Extraction from German Scientific Publications

Azeddine Bouabdallah, Jorge Gavilan, Jennifer Gerbl, Prayuth Patumcharoenpol

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 5 figures, 4 tables

2111.02710 2021-11-05 eess.IV cs.CV cs.LG 79%

Towards dynamic multi-modal phenotyping using chest radiographs and physiological data

Nasir Hayat, Krzysztof J. Geras, Farah E. Shamout

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted in medical imaging meets NeurIPS 2021

2111.02705 2021-11-05 cs.LG cs.CL stat.ML 79%

Benchmarking Multimodal AutoML for Tabular Data with Text Fields

Xingjian Shi, Jonas Mueller, Nick Erickson, Mu Li, Alexander J. Smola

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

Comments Proceedings of the Neural Information Processing Systems (NeurIPS) Track on Datasets and Benchmarks 2021

1. 多模态评测 9189 篇

Analyzing Modality Robustness in Multimodal Sentiment Analysis

MultiEarth 2022 -- Multimodal Learning for Earth and Environment Workshop and Challenge

Body Composition Estimation Based on Multimodal Multi-task Deep Neural Network

Global Multi-modal 2D/3D Registration via Local Descriptors Learning

M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection

WikiDiverse: A Multimodal Entity Linking Dataset with Diversified Contextual Topics and Entity Types

Are Multimodal Transformers Robust to Missing Modality?

Multimodal Transformer for Nursing Activity Recognition

STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenes

Towards Multimodal Depth Estimation from Light Fields

MQDD: Pre-training of Multimodal Question Duplicity Detection for Software Engineering Domain

Multi-Modal Learning Using Physicians Diagnostics for Optical Coherence Tomography Classification

Cross-modal Map Learning for Vision and Language Navigation

CheXstray: Real-time Multi-Modal Data Concordance for Drift Detection in Medical Imaging AI

MSCTD: A Multimodal Sentiment Chat Translation Dataset

HNF-Netv2 for Brain Tumor Segmentation using multi-modal MR Imaging

Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics

Question Generation for Evaluating Cross-Dataset Shifts in Multi-modal Grounding

Mutual Attention-based Hybrid Dimensional Network for Multimodal Imaging Computer-aided Diagnosis

ExAID: A Multimodal Explanation Framework for Computer-Aided Diagnosis of Skin Lesions

Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Driving

A Multimodal Approach for Automatic Mania Assessment in Bipolar Disorder

AMSER: Adaptive Multi-modal Sensing for Energy Efficient and Resilient eHealth Systems

Multimodal Fake News Detection

RadFusion: Benchmarking Performance and Fairness for Multimodal Pulmonary Embolism Detection from CT and EHR

Structured Multimodal Attentions for TextVQA

Multimodal Virtual Point 3D Detection

Multimodal Approach for Metadata Extraction from German Scientific Publications

Towards dynamic multi-modal phenotyping using chest radiographs and physiological data

Benchmarking Multimodal AutoML for Tabular Data with Text Fields