多模态大模型

Few-shot Domain-Adaptive Visually-fused Event Detection from Text

Farhad Moghimifar, Fatemeh Shiri, Van Nguyen, Reza Haffari, Yuan-Fang Li

专题命中 视频多模态 ：image-text(abstract)；分类 cs.CL、cs.AI

CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding

Zhijian Hou, Wanjun Zhong, Lei Ji, Difei Gao, Kun Yan, Wing-Kwong Chan, Chong-Wah Ngo, Zheng Shou, Nan Duan

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL

Comments ACL 2023 Camera Ready. 14 pages, 7 figures, 4 tables

Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignment

Peng Jin, Hao Li, Zesen Cheng, Jinfa Huang, Zhennan Wang, Li Yuan, Chang Liu, Jie Chen

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.AI

Comments IJCAI 2023

VideoOFA: Two-Stage Pre-Training for Video-to-Text Generation

Xilun Chen, Lili Yu, Wenhan Xiong, Barlas Oğuz, Yashar Mehdad, Wen-tau Yih

专题命中 视频多模态 ：image-text(abstract)；分类 cs.CV、cs.CL

Self-Supervised Temporal Analysis of Spatiotemporal Data

Yi Cao, Swetava Ganguli, Vipul Pandey

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments Accepted for oral presentation at the 43rd IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 2023, Pasadena, California. 4 pages and 7 figures

TCR: Short Video Title Generation and Cover Selection with Attention Refinement

Yakun Yu, Jiuding Yang, Weidong Guo, Hui Liu, Yu Xu, Di Niu

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.MM

Comments Accepted by PAKDD23

Skeleton-based action analysis for ADHD diagnosis

Yichun Li, Yi Li, Rajesh Nair, Syed Mohsen Naqvi

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks

Pedro Rodriguez, Mahmoud Azab, Becka Silvert, Renato Sanchez, Linzy Labson, Hardik Shah, Seungwhan Moon

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments EACL 2023 Camera Ready

Synopses of Movie Narratives: a Video-Language Dataset for Story Understanding

Yidan Sun, Qin Chao, Yangfeng Ji, Boyang Li

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments 25 pages, 17 figures

Towards Good Practices for Missing Modality Robust Action Recognition

Sangmin Woo, Sumin Lee, Yeonju Park, Muhammad Adi Nugroho, Changick Kim

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments AAAI 2023 (Oral); Code: https://github.com/sangminwoo/ActionMAE

Improving Video Retrieval by Adaptive Margin

Feng He, Qi Wang, Zhifan Feng, Wenbin Jiang, Yajuan Lv, Yong zhu, Xiao Tan

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.CL

Comments Accepted by SIGIR 2021

Learning Bidirectional Action-Language Translation with Limited Supervision and Incongruent Input

Ozan Özdemir, Matthias Kerzel, Cornelius Weber, Jae Hee Lee, Muhammad Burhan Hafez, Patrick Bruns, Stefan Wermter

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

Comments Published in: Applied Artificial Intelligence, 37:1, 2179167

Journal ref Applied Artificial Intelligence Volume 37, 2023 - Issue 1

Semi-Parametric Video-Grounded Text Generation

Sungdong Kim, Jin-Hwa Kim, Jiyoung Lee, Minjoon Seo

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.CL

Comments Preprint (16 pages, 5 figures)

Temporal Perceiving Video-Language Pre-training

Fan Ma, Xiaojie Jin, Heng Wang, Jingjia Huang, Linchao Zhu, Jiashi Feng, Yi Yang

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Inferring latent neural sources via deep transcoding of simultaneously acquired EEG and fMRI

Xueqing Liu, Tao Tu, Paul Sajda

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2022): Workshop and Shared Task Report

Ali Hürriyetoğlu, Hristo Tanev, Vanni Zavarella, Reyyan Yeniterzi, Osman Mutlu, Erdem Yörük

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

Comments to appear at CASE 2022 @ EMNLP 2022

Holistic Interaction Transformer Network for Action Detection

Gueter Josmy Faure, Min-Hung Chen, Shang-Hong Lai

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments Accepted for WACV 2023. Code: https://github.com/joslefaure/HIT

Flamingo: a Visual Language Model for Few-Shot Learning

Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katie Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi, Tengda Han, Zhitao Gong, Sina Samangooei, Marianne Monteiro, Jacob Menick, Sebastian Borgeaud, Andrew Brock, Aida Nematzadeh, Sahand Sharifzadeh, Mikolaj Binkowski, Ricardo Barreira, Oriol Vinyals, Andrew Zisserman, Karen Simonyan

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments 54 pages. In Proceedings of Neural Information Processing Systems (NeurIPS) 2022

OWL (Observe, Watch, Listen): Audiovisual Temporal Context for Localizing Actions in Egocentric Videos

Merey Ramazanova, Victor Escorcia, Fabian Caba Heilbron, Chen Zhao, Bernard Ghanem

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、eess.AS

VTC: Improving Video-Text Retrieval with User Comments

Laura Hanu, James Thewlis, Yuki M. Asano, Christian Rupprecht

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL

Comments Accepted paper at the European Conference on Computer Vision (ECCV) 2022

STAR-Transformer: A Spatio-temporal Cross Attention Transformer for Human Action Recognition

Dasom Ahn, Sangwon Kim, Hyunsu Hong, Byoung Chul Ko

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.AI

Comments Accepted by WACV 2023

RaP: Redundancy-aware Video-language Pre-training for Text-Video Retrieval

Xing Wu, Chaochen Gao, Zijia Lin, Zhongyuan Wang, Jizhong Han, Songlin Hu

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.AI

Comments EMNLP 2022

Behavior Transformers: Cloning $k$ modes with one stone

Nur Muhammad Mahi Shafiullah, Zichen Jeff Cui, Ariuntuya Altanzaya, Lerrel Pinto

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments Code and data available at https://github.com/notmahi/bet

Zero-Shot Video Question Answering via Frozen Bidirectional Language Models

Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL

Comments NeurIPS 2022 Camera-Ready; Project Webpage: https://antoyang.github.io/frozenbilm.html; 25 pages; 5 figures

VLSNR:Vision-Linguistics Coordination Time Sequence-aware News Recommendation

Songhao Han, Wei Huang, Xiaotian Luan

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI、cs.MM

Comments 10 pages, 5 figures

Semantic Segmentation of Vegetation in Remote Sensing Imagery Using Deep Learning

Alexandru Munteanu, Marian Neagul

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments Masters thesis presented in 2021 at the West University of Timisoara, faculty of Mathematics and Computer Science

Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrieval

Chengzhi Lin, Ancong Wu, Junwei Liang, Jun Zhang, Wenhang Ge, Wei-Shi Zheng, Chunhua Shen

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.CL

Comments NIPS2022

Journal ref NIPS2022

LAVIS: A Library for Language-Vision Intelligence

Dongxu Li, Junnan Li, Hung Le, Guangsen Wang, Silvio Savarese, Steven C. H. Hoi

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments Preprint of LAVIS technical report

AutoTransition: Learning to Recommend Video Transition Effects

Yaojie Shen, Libo Zhang, Kai Xu, Xiaojie Jin

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.MM

Comments To appear at ECCV 2022

CLIP2TV: Align, Match and Distill for Video-Text Retrieval

Zijian Gao, Jingyu Liu, Weiqi Sun, Sheng Chen, Dedan Chang, Lili Zhao

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL