多模态大模型

On Vision Features in Multimodal Machine Translation

Bei Li, Chuanhao Lv, Zefan Zhou, Tao Zhou, Tong Xiao, Anxiang Ma, JingBo Zhu

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Long paper accepted by ACL2022 main conference

Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer

Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren

专题命中 图文多模态 ：cross-modal(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2022, 13 pages, 4 figures

UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation

Zhengkun Zhang, Xiaojun Meng, Yasheng Wang, Xin Jiang, Qun Liu, Zhenglu Yang

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted at AAAI2022

MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding

Woojeong Jin, Maziar Sanjabi, Shaoliang Nie, Liang Tan, Xiang Ren, Hamed Firooz

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to EMNLP 2021 Findings

Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision

Xiaoshi Wu, Hadar Averbuch-Elor, Jin Sun, Noah Snavely

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Published in ICCV 2021; Project webpage: https://www.cs.cornell.edu/projects/babel/

A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval

Manh-Duy Nguyen, Binh T. Nguyen, Cathal Gurrin

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays

Xiaosong Wang, Ziyue Xu, Leo Tam, Dong Yang, Daguang Xu

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Multimodal Pivots for Image Caption Translation

Julian Hitschler, Shigehiko Schamoni, Stefan Riezler

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Final version, accepted at ACL 2016. New section on Human Evaluation

Consensus-Aware Visual-Semantic Embedding for Image-Text Matching

Haoran Wang, Ying Zhang, Zhong Ji, Yanwei Pang, Lin Ma

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments Accepted by ECCV 2020, Code is publicly available at: https://github.com/BruceW91/CVSE

Adaptive Offline Quintuplet Loss for Image-Text Matching

Tianlang Chen, Jiajun Deng, Jiebo Luo

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments Accepted by ECCV 2020. Code is available at https://github.com/sunnychencool/AOQ

Learning Multimodal Representations for Unseen Activities

AJ Piergiovanni, Michael S. Ryoo

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Journal ref WACV 2020

Evaluating Multimodal Representations on Visual Semantic Textual Similarity

Oier Lopez de Lacalle, Ander Salaberria, Aitor Soroa, Gorka Azkune, Eneko Agirre

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted in ECAI-2020, 8 pages, 6 tables, 6 figures

Graph Structured Network for Image-Text Matching

Chunxiao Liu, Zhendong Mao, Tianzhu Zhang, Hongtao Xie, Bin Wang, Yongdong Zhang

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2020

Expressing Objects just like Words: Recurrent Visual Embedding for Image-Text Matching

Tianlang Chen, Jiebo Luo

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments Accepted by AAAI-20

Learning Cross-modal Context Graph for Visual Grounding

Yongfei Liu, Bo Wan, Xiaodan Zhu, Xuming He

专题命中 图文多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments AAAI-2020

VATEX Captioning Challenge 2019: Multi-modal Information Fusion and Multi-stage Training Strategy for Video Captioning

Ziqi Zhang, Yaya Shi, Jiutong Wei, Chunfeng Yuan, Bing Li, Weiming Hu

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CL

Visual Semantic Reasoning for Image-Text Matching

Kunpeng Li, Yulun Zhang, Kai Li, Yuanyuan Li, Yun Fu

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments Accepted to ICCV 2019 (Oral)

Multi-Modal Recognition of Worker Activity for Human-Centered Intelligent Manufacturing

Wenjin Tao, Ming C. Leu, Zhaozheng Yin

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments 17 pages, 8 figures, 6 tables

Position Focused Attention Network for Image-Text Matching

Yaxiong Wang, Hao Yang, Xueming Qian, Lin Ma, Jing Lu, Biao Li, Xin Fan

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CL

Comments Accepted by IJCAI 2019

A Neural, Interactive-predictive System for Multimodal Sequence to Sequence Tasks

Álvaro Peris, Francisco Casacuberta

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments ACL 2019 - System demonstrations

Multimodal Transformer with Multi-View Visual Representation for Image Captioning

Jun Yu, Jing Li, Zhou Yu, Qingming Huang

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments submitted to a journal

Multimodal Semantic Attention Network for Video Captioning

Liang Sun, Bing Li, Chunfeng Yuan, Zhengjun Zha, Weiming Hu

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 6 pages, 4 figures, accepted by IEEE International Conference on Multimedia and Expo (ICME) 2019

UMONS Submission for WMT18 Multimodal Translation Task

Jean-Benoit Delbrouck, Stéphane Dupont

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Visually Grounded Word Embeddings and Richer Visual Features for Improving Multimodal Neural Machine Translation

Jean-Benoit Delbrouck, Stéphane Dupont, Omar Seddati

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to GLU 2017. arXiv admin note: text overlap with arXiv:1707.00995

Journal ref Proc. GLU 2017 International Workshop on Grounding Language Understanding

OSU Multimodal Machine Translation System Report

Mingbo Ma, Dapeng Li, Kai Zhao, Liang Huang

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments 5, WMT 2017

From Deterministic to Generative: Multi-Modal Stochastic RNNs for Video Captioning

Jingkuan Song, Yuyu Guo, Lianli Gao, Xuelong Li, Alan Hanjalic, Heng Tao Shen

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

MAT: A Multimodal Attentive Translator for Image Captioning

Chang Liu, Fuchun Sun, Changhu Wang, Feng Wang, Alan Yuille

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

CUNI System for the WMT17 Multimodal Translation Task

Jindřich Helcl, Jindřich Libovický

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments 8 pages; Camera-ready submission to WMT17

Multimodal Compact Bilinear Pooling for Multimodal Neural Machine Translation

Jean-Benoit Delbrouck, Stephane Dupont

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Submitted to ICLR Workshop 2017

Multimodal Memory Modelling for Video Captioning

Junbo Wang, Wei Wang, Yan Huang, Liang Wang, Tieniu Tan

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV