多模态大模型

MSED: a multi-modal sleep event detection model for clinical sleep analysis

Alexander Neergaard Olesen, Poul Jennum, Emmanuel Mignot, Helge B. D. Sorensen

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments 10 pages, 4 figures. Accepted for publication in IEEE Transactions on Biomedical Engineering

Multi-video Moment Ranking with Multimodal Clue

Danyang Hou, Liang Pang, Yanyan Lan, Huawei Shen, Xueqi Cheng

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments 9 pages,6 figures

Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generation

Xueliang Zhao, Yuxuan Wang, Chongyang Tao, Chenshuo Wang, Dongyan Zhao

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CL

Comments To appear at EMNLP 2022 findings

Instance Segmentation with Cross-Modal Consistency

Alex Zihao Zhu, Vincent Casser, Reza Mahjourian, Henrik Kretzschmar, Sören Pirk

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments 8 pages, 9 figures, 5 tables. Presented at IROS 2022

Snowpack Estimation in Key Mountainous Water Basins from Openly-Available, Multimodal Data Sources

Malachy Moran, Kayla Woputz, Derrick Hee, Manuela Girotto, Paolo D'Odorico, Ritwik Gupta, Daniel Feldman, Puya Vahabi, Alberto Todeschini, Colorado J Reed

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments Accepted Oral Presentation at CVPR 2022 MultiEarth

Evaluating Multimodal Interactive Agents

Josh Abramson, Arun Ahuja, Federico Carnevale, Petko Georgiev, Alex Goldin, Alden Hung, Jessica Landon, Timothy Lillicrap, Alistair Muldal, Blake Richards, Adam Santoro, Tamara von Glehn, Greg Wayne, Nathaniel Wong, Chen Yan

专题命中 视频多模态 ：multimodal(title)；分类 cs.AI

Multi-modal curb detection and filtering

Sandipan Das, Navid Mahabadi, Saikat Chatterjee, Maurice Fallon

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

An EEG-Based Multi-Modal Emotion Database with Both Posed and Authentic Facial Actions for Emotion Analysis

Xiaotian Li, Xiang Zhang, Huiyuan Yang, Wenna Duan, Weiying Dai, Lijun Yin

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Journal ref FG2021(long Oral)

MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization

Alexander Kunitsyn, Maksim Kalashnikov, Maksim Dzabraev, Andrei Ivaniuta

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Discourse Parsing in Videos: A Multi-modal Appraoch

Arjun R. Akula, Song-Chun Zhu

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments Accepted in CVPR 2019 Workshop on Language and Vision (Oral Presentation)

Journal ref CVPR 2019 Workshop on Language and Vision (Oral Presentation)

EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillation

Lin Wang, Yujeong Chae, Sung-Hoon Yoon, Tae-Kyun Kim, Kuk-Jin Yoon

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments CVPR 2021 (updated references in this version)

VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehicles

Alexander Amini, Tsun-Hsuan Wang, Igor Gilitschenski, Wilko Schwarting, Zhijian Liu, Song Han, Sertac Karaman, Daniela Rus

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments First two authors contributed equally. Code and project website is available here: https://vista.csail.mit.edu

MDMMT: Multidomain Multimodal Transformer for Video Retrieval

Maksim Dzabraev, Maksim Kalashnikov, Stepan Komkov, Aleksandr Petiushko

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Journal ref CVPR Workshops 2021: 3354-3363

Space-Time Crop & Attend: Improving Cross-modal Video Representation Learning

Mandela Patrick, Yuki M. Asano, Bernie Huang, Ishan Misra, Florian Metze, Joao Henriques, Andrea Vedaldi

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments Accepted to ICCV 2021. Code at https://github.com/facebookresearch/GDT

Leveraging Local Temporal Information for Multimodal Scene Classification

Saurabh Sahu, Palash Goyal

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Modelling Urban Dynamics with Multi-Modal Graph Convolutional Networks

Krittika D'Silva, Jordan Cambe, Anastasios Noulas, Cecilia Mascolo, Adam Waksman

专题命中 视频多模态 ：multi-modal(title)；分类 cs.AI

Comments 10 pages, 4 figures. arXiv admin note: substantial text overlap with arXiv:2104.13981

Unified Multi-Modal Landmark Tracking for Tightly Coupled Lidar-Visual-Inertial Odometry

David Wisth, Marco Camurri, Sandipan Das, Maurice Fallon

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments Video: https://youtu.be/MjXYAHurWe8

Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imaging

He Sun, Katherine L. Bouman

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments This paper has been accepted to AAAI 2021. Keywords: Computational Imaging, Normalizing Flow, Uncertainty Quantification, Interferometry, MRI

Multimodal Memorability: Modeling Effects of Semantics and Decay on Video Memorability

Anelise Newman, Camilo Fosco, Vincent Casser, Allen Lee, Barry McNamara, Aude Oliva

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments European Conference on Computer Vision

A Modular Approach for Synchronized Wireless Multimodal Multisensor Data Acquisition in Highly Dynamic Social Settings

Chirag Raman, Stephanie Tan, Hayley Hung

专题命中 视频多模态 ：multimodal(title)；分类 cs.MM

Comments 9 pages, 8 figures, Proceedings of the 28th ACM International Conference on Multimedia (MM '20), October 12--16, 2020, Seattle, WA, USA. First two authors contributed equally

Multimodal and multiview distillation for real-time player detection on a football field

Anthony Cioppa, Adrien Deliège, Noor Ul Huda, Rikke Gade, Marc Van Droogenbroeck, Thomas B. Moeslund

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments Accepted for the CVSports workshop of CVPR 2020 ; 8 pages + references

Speech2Action: Cross-modal Supervision for Action Recognition

Arsha Nagrani, Chen Sun, David Ross, Rahul Sukthankar, Cordelia Schmid, Andrew Zisserman

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments Accepted to CVPR 2020

Scattering Features for Multimodal Gait Recognition

Srđan Kitić, Gilles Puy, Patrick Pérez, Philippe Gilberton

专题命中 视频多模态 ：multimodal(title)；分类 eess.AS

Comments Published at IEEE GlobalSIP 2017

Situational Grounding within Multimodal Simulations

James Pustejovsky, Nikhil Krishnaswamy

专题命中 视频多模态 ：multimodal(title)；分类 cs.AI

Comments AAAI-19 Workshop on Games and Simulations for Artificial Intelligence

Multi-modal Capsule Routing for Actor and Action Video Segmentation Conditioned on Natural Language Queries

Bruce McIntosh, Kevin Duarte, Yogesh S Rawat, Mubarak Shah

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Cross-Modal and Hierarchical Modeling of Video and Text

Bowen Zhang, Hexiang Hu, Fei Sha

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments Accepted by ECCV 2018

Unsupervised Trajectory Segmentation and Promoting of Multi-Modal Surgical Demonstrations

Zhenzhou Shao, Hongfa Zhao, Jiexin Xie, Ying Qu, Yong Guan, Jindong Tan

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments 7 pages, 6 figures

Encoding Longer-term Contextual Multi-modal Information in a Predictive Coding Model

Junpei Zhong, Tetsuya Ogata, Angelo Cangelosi

专题命中 视频多模态 ：multi-modal(title)；分类 cs.AI

Comments Submitted to ICDL/EpiRob 2018 (8th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics )

Multi-modal Aggregation for Video Classification

Chen Chen, Xiaowei Zhao, Yang Liu

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

A Computational Framework for Multi-Modal Social Action Identification

Jason Anastasopoulos, Jake Ryland Williams

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CL