多模态大模型 - arXivDaily 专题

2107.08685 2021-07-20 cs.CL 79%

Constructing Multi-Modal Dialogue Dataset by Replacing Text with Semantically Relevant Images

Nyoungwoo Lee, Suwon Shin, Jaegul Choo, Ho-Jin Choi, Sung-Hyun Myaeng

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2021

2107.05047 2021-07-13 cs.CV cs.LG 79%

One Map Does Not Fit All: Evaluating Saliency Map Explanation on Multi-Modal Medical Images

Weina Jin, Xiaoxiao Li, Ghassan Hamarneh

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2107.04396 2021-07-12 cs.CV 79%

Multi-Modal Association based Grouping for Form Structure Extraction

Milan Aggarwal, Mausoom Sarkar, Hiresh Gupta, Balaji Krishnamurthy

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments This work has been accepted and presented at WACV 2020

2107.03442 2021-07-09 eess.IV cs.CV cs.LG 79%

Modality Completion via Gaussian Process Prior Variational Autoencoders for Multi-Modal Glioma Segmentation

Mohammad Hamghalam, Alejandro F. Frangi, Baiying Lei, Amber L. Simpson

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted in MICCAI 2021

2004.13274 2021-07-01 cs.MM cs.HC 79%

Exploring the contextual factors affecting multimodal emotion recognition in videos

Prasanta Bhattacharya, Raj Kumar Gupta, Yinping Yang

专题命中多模态评测：multimodal(title,abstract)；分类 cs.MM

Comments Accepted version at IEEE Transactions on Affective Computing

2011.03882 2021-06-28 cs.RO cs.AI 79%

Multi-Modal Learning of Keypoint Predictive Models for Visual Object Manipulation

Sarah Bechtle, Neha Das, Franziska Meier

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.AI

2106.12738 2021-06-25 cs.CV 79%

Planetary UAV localization based on Multi-modal Registration with Pre-existing Digital Terrain Model

Xue Wan, Yuanbin Shao, Shengyang Li

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2102.12319 2021-06-23 cs.CV cs.RO 79%

GEM: Glare or Gloom, I Can Still See You -- End-to-End Multimodal Object Detection

Osama Mazhar, Robert Babuska, Jens Kober

专题命中多模态评测：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments IEEE Robotics and Automation Letters (RA-L)

2012.13623 2021-06-18 cs.LG cs.CV 79%

Self-Supervised Multimodal Domino: in Search of Biomarkers for Alzheimer's Disease

Alex Fedorov, Tristan Sylvain, Eloy Geenjaar, Margaux Luck, Lei Wu, Thomas P. DeRamus, Alex Kirilin, Dmitry Bleklov, Vince D. Calhoun, Sergey M. Plis

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2004.00202 2021-06-15 cs.CV cs.LG cs.RO 79%

Shared Cross-Modal Trajectory Prediction for Autonomous Driving

Chiho Choi, Joon Hee Choi, Srikanth Malla, Jiachen Li

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

Comments CVPR 2021 [Oral]. arXiv admin note: substantial text overlap with arXiv:2011.08436

2106.04853 2021-06-10 cs.CL 79%

DravidianMultiModality: A Dataset for Multi-modal Sentiment Analysis in Tamil and Malayalam

Bharathi Raja Chakravarthi, Jishnu Parameswaran P. K, Premjith B, K. P Soman, Rahul Ponnusamy, Prasanna Kumar Kumaresan, Kingston Pal Thamburaj, John P. McCrae

专题命中多模态评测：multi-modal(title)；multimodal(abstract)；分类 cs.CL

Comments 31

2106.02781 2021-06-08 cs.CV 79%

IPS300+: a Challenging Multimodal Dataset for Intersection Perception System

Huanan Wang, Xinyu Zhang, Jun Li, Zhiwei Li, Lei Yang, Shuyue Pan, Yongqiang Deng

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2105.09984 2021-06-01 cs.CL 79%

Multi-modal Sarcasm Detection and Humor Classification in Code-mixed Conversations

Manjot Bedi, Shivani Kumar, Md Shad Akhtar, Tanmoy Chakraborty

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CL

Comments 13 pages, 4 figures, 9 tables

2105.10196 2021-05-24 cs.CV 79%

Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Model

Danfeng Hong, Jingliang Hu, Jing Yao, Jocelyn Chanussot, Xiao Xiang Zhu

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Journal ref ISPRS Journal of Photogrammetry and Remote Sensing, 2021

2105.05999 2021-05-14 cs.CL 79%

Designing Multimodal Datasets for NLP Challenges

James Pustejovsky, Eben Holderness, Jingxuan Tu, Parker Glenn, Kyeongmin Rim, Kelley Lynch, Richard Brutti

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2105.00690 2021-05-06 cs.CV 79%

Multi-modal Bifurcated Network for Depth Guided Image Relighting

Hao-Hsiang Yang, Wei-Ting Chen, Hao-Lun Luo, Sy-Yen Kuo

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by CVPRW 2021. This solution is the winner in the NTIRE 2021 Depth Guide One-to-one Relighting Challenge

2007.14352 2021-04-21 cs.CV 79%

Multi-level Cross-modal Interaction Network for RGB-D Salient Object Detection

Zhou Huang, Huai-Xin Chen, Tao Zhou, Yun-Zhi Yang, Bi-Yuan Liu

专题命中多模态评测：cross-modal(title,abstract)；分类 cs.CV

Journal ref Neurocomputing 2021

2104.08489 2021-04-20 cs.LG cs.CV 79%

Semi-Supervised Multi-Modal Multi-Instance Multi-Label Deep Network with Optimal Transport

Yang Yang, Zhao-Yang Fu, De-Chuan Zhan, Zhi-Bin Liu, Yuan Jiang

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2104.07310 2021-04-16 eess.AS cs.SD 79%

Investigating the Utility of Multimodal Conversational Technology and Audiovisual Analytic Measures for the Assessment and Monitoring of Amyotrophic Lateral Sclerosis at Scale

Michael Neumann, Oliver Roesler, Jackson Liscombe, Hardik Kothare, David Suendermann-Oeft, David Pautler, Indu Navar, Aria Anvar, Jochen Kumm, Raquel Norel, Ernest Fraenkel, Alexander V. Sherman, James D. Berry, Gary L. Pattee, Jun Wang, Jordan R. Green, Vikram Ramanarayanan

专题命中多模态评测：multimodal(title,abstract)；分类 eess.AS

2104.07056 2021-04-16 eess.IV cs.CV 79%

Anatomy-guided Multimodal Registration by Learning Segmentation without Ground Truth: Application to Intraprocedural CBCT/MR Liver Segmentation and Registration

Bo Zhou, Zachary Augenfeld, Julius Chapiro, S. Kevin Zhou, Chi Liu, James S. Duncan

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments 12 pages, 8 figures, published at Medical Image Analysis (MedIA), code available at https://github.com/bbbbbbzhou/APA2Seg-Net

2104.03046 2021-04-08 cs.CV cs.LG 79%

Multimodal Continuous Visual Attention Mechanisms

António Farinhas, André F. T. Martins, Pedro M. Q. Aguiar

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2104.02609 2021-04-07 eess.IV cs.CV 79%

I-ODA, Real-World Multi-modal Longitudinal Data for OphthalmicApplications

Nooshin Mojab, Vahid Noroozi, Abdullah Aleem, Manoj P. Nallabothula, Joseph Baker, Dimitri T. Azar, Mark Rosenblatt, RV Paul Chan, Darvin Yi, Philip S. Yu, Joelle A. Hallak

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

2007.05056 2021-04-05 cs.CV cs.LG 79%

Multimodal price prediction

Aidin Zehtab-Salmasi, Ali-Reza Feizi-Derakhshi, Narjes Nikzad-Khasmakhi, Meysam Asgari-Chenaghlu, Saeideh Nabipour

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments This is a preprint of an article published in "Annals of Data Science". The final authenticated version is available online at: https://link.springer.com/article/10.1007/s40745-021-00326-z

2104.00249 2021-04-02 cs.CV cs.LG 79%

LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agents

ByeoungDo Kim, Seong Hyeon Park, Seokhwan Lee, Elbek Khoshimjonov, Dongsuk Kum, Junsoo Kim, Jeong Soo Kim, Jun Won Choi

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments 13 pages, 2 figures, 7 tables, CVPR 2021

2008.08143 2021-04-02 cs.CV 79%

How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language

Amanda Duarte, Shruti Palaskar, Lucas Ventura, Deepti Ghadiyaram, Kenneth DeHaan, Florian Metze, Jordi Torres, Xavier Giro-i-Nieto

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2021. Dataset website: http://how2sign.github.io/

2103.16871 2021-04-01 cs.CV 79%

Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity

Yuanxin Ye, Jie Shan, Lorenzo Bruzzone, Li Shen

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV

2103.16273 2021-03-31 cs.CV cs.RO 79%

Multi-modal Trajectory Prediction for Autonomous Driving with Semantic Map and Dynamic Graph Attention Network

Bo Dong, Hao Liu, Yu Bai, Jinbiao Lin, Zhuoran Xu, Xinyu Xu, Qi Kong

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments NIPS2020 Workshop on Machine Learning for Autonomous Driving

2103.15409 2021-03-30 cs.CV 79%

A Dataset and Benchmark Towards Multi-Modal Face Anti-Spoofing Under Surveillance Scenarios

Xudong Chen, Shugong Xu, Qiaobin Ji, Shan Cao

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Published in: IEEE Access

Journal ref IEEE Access, vol. 9, pp. 28140-28155, 2021

2103.08219 2021-03-16 cs.CV 79%

Adapt Everywhere: Unsupervised Adaptation of Point-Clouds and Entropy Minimisation for Multi-modal Cardiac Image Segmentation

Sulaiman Vesal, Mingxuan Gu, Ronak Kosti, Andreas Maier, Nishant Ravikumar

专题命中多模态评测：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted for publication in IEEE Transactions on Medical Imaging (IEEE TMI)

2103.04845 2021-03-09 cs.RO cs.AI 79%

HANDS: A Multimodal Dataset for Modeling Towards Human Grasp Intent Inference in Prosthetic Hands

Mo Han, Sezen Ya{ğ}mur Günay, Gunar Schirner, Taşkın Padır, Deniz Erdo{ğ}muş

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

1. 多模态评测 9189 篇

Constructing Multi-Modal Dialogue Dataset by Replacing Text with Semantically Relevant Images

One Map Does Not Fit All: Evaluating Saliency Map Explanation on Multi-Modal Medical Images

Multi-Modal Association based Grouping for Form Structure Extraction

Modality Completion via Gaussian Process Prior Variational Autoencoders for Multi-Modal Glioma Segmentation

Exploring the contextual factors affecting multimodal emotion recognition in videos

Multi-Modal Learning of Keypoint Predictive Models for Visual Object Manipulation

Planetary UAV localization based on Multi-modal Registration with Pre-existing Digital Terrain Model

GEM: Glare or Gloom, I Can Still See You -- End-to-End Multimodal Object Detection

Self-Supervised Multimodal Domino: in Search of Biomarkers for Alzheimer's Disease

Shared Cross-Modal Trajectory Prediction for Autonomous Driving

DravidianMultiModality: A Dataset for Multi-modal Sentiment Analysis in Tamil and Malayalam

IPS300+: a Challenging Multimodal Dataset for Intersection Perception System

Multi-modal Sarcasm Detection and Humor Classification in Code-mixed Conversations

Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Model

Designing Multimodal Datasets for NLP Challenges

Multi-modal Bifurcated Network for Depth Guided Image Relighting

Multi-level Cross-modal Interaction Network for RGB-D Salient Object Detection

Semi-Supervised Multi-Modal Multi-Instance Multi-Label Deep Network with Optimal Transport

Investigating the Utility of Multimodal Conversational Technology and Audiovisual Analytic Measures for the Assessment and Monitoring of Amyotrophic Lateral Sclerosis at Scale

Anatomy-guided Multimodal Registration by Learning Segmentation without Ground Truth: Application to Intraprocedural CBCT/MR Liver Segmentation and Registration

Multimodal Continuous Visual Attention Mechanisms

I-ODA, Real-World Multi-modal Longitudinal Data for OphthalmicApplications

Multimodal price prediction

LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agents

How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language

Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity

Multi-modal Trajectory Prediction for Autonomous Driving with Semantic Map and Dynamic Graph Attention Network

A Dataset and Benchmark Towards Multi-Modal Face Anti-Spoofing Under Surveillance Scenarios

Adapt Everywhere: Unsupervised Adaptation of Point-Clouds and Entropy Minimisation for Multi-modal Cardiac Image Segmentation

HANDS: A Multimodal Dataset for Modeling Towards Human Grasp Intent Inference in Prosthetic Hands