视频大模型

EAGLE: Egocentric AGgregated Language-video Engine

Jing Bi, Yunlong Tang, Luchuan Song, Ali Vosoughi, Nguyen Nguyen, Chenliang Xu

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by ACMMM 24

Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives

Kristen Grauman, Andrew Westbury, Lorenzo Torresani, Kris Kitani, Jitendra Malik, Triantafyllos Afouras, Kumar Ashutosh, Vijay Baiyya, Siddhant Bansal, Bikram Boote, Eugene Byrne, Zach Chavis, Joya Chen, Feng Cheng, Fu-Jen Chu, Sean Crane, Avijit Dasgupta, Jing Dong, Maria Escobar, Cristhian Forigua, Abrham Gebreselasie, Sanjay Haresh, Jing Huang, Md Mohaiminul Islam, Suyog Jain, Rawal Khirodkar, Devansh Kukreja, Kevin J Liang, Jia-Wei Liu, Sagnik Majumder, Yongsen Mao, Miguel Martin, Effrosyni Mavroudi, Tushar Nagarajan, Francesco Ragusa, Santhosh Kumar Ramakrishnan, Luigi Seminara, Arjun Somayazulu, Yale Song, Shan Su, Zihui Xue, Edward Zhang, Jinxu Zhang, Angela Castillo, Changan Chen, Xinzhu Fu, Ryosuke Furuta, Cristina Gonzalez, Prince Gupta, Jiabo Hu, Yifei Huang, Yiming Huang, Weslie Khoo, Anush Kumar, Robert Kuo, Sach Lakhavani, Miao Liu, Mi Luo, Zhengyi Luo, Brighid Meredith, Austin Miller, Oluwatumininu Oguntola, Xiaqing Pan, Penny Peng, Shraman Pramanick, Merey Ramazanova, Fiona Ryan, Wei Shan, Kiran Somasundaram, Chenan Song, Audrey Southerland, Masatoshi Tateno, Huiyu Wang, Yuchen Wang, Takuma Yagi, Mingfei Yan, Xitong Yang, Zecheng Yu, Shengxin Cindy Zha, Chen Zhao, Ziwei Zhao, Zhifan Zhu, Jeff Zhuo, Pablo Arbelaez, Gedas Bertasius, David Crandall, Dima Damen, Jakob Engel, Giovanni Maria Farinella, Antonino Furnari, Bernard Ghanem, Judy Hoffman, C. V. Jawahar, Richard Newcombe, Hyun Soo Park, James M. Rehg, Yoichi Sato, Manolis Savva, Jianbo Shi, Mike Zheng Shou, Michael Wray

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments Expanded manuscript (compared to arxiv v1 from Nov 2023 and CVPR 2024 paper from June 2024) for more comprehensive dataset and benchmark presentation, plus new results on v2 data release

Event-Free Moving Object Segmentation from Moving Ego Vehicle

Zhuyun Zhou, Zongwei Wu, Danda Pani Paudel, Rémi Boutteau, Fan Yang, Luc Van Gool, Radu Timofte, Dominique Ginhac

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba

Chaoqi Luo, Yiping Xie, Zitong Yu

专题命中 动作与事件理解 ：long video(abstract)；分类 cs.CV

Comments Accepted by CCBR 2024

MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls

Yuxuan Bian, Ailing Zeng, Xuan Ju, Xian Liu, Zhaoyang Zhang, Wei Liu, Qiang Xu

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

HAT: History-Augmented Anchor Transformer for Online Temporal Action Localization

Sakib Reza, Yuexi Zhang, Mohsen Moghaddam, Octavia Camps

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to ECCV 2024

Spherical World-Locking for Audio-Visual Localization in Egocentric Videos

Heeseung Yun, Ruohan Gao, Ishwarya Ananthabhotla, Anurag Kumar, Jacob Donley, Chao Li, Gunhee Kim, Vamsi Krishna Ithapu, Calvin Murdock

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments ECCV2024

Harnessing Temporal Causality for Advanced Temporal Action Detection

Shuming Liu, Lin Sui, Chen-Lin Zhang, Fangzhou Mu, Chen Zhao, Bernard Ghanem

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments 1st in Moment Queries track at the Ego4D Challenge 2024; 1st in Action Recognition, Action Detection, and Audio-Based Interaction Detection tracks at the EPIC-Kitchens Challenge 2024

EA-VTR: Event-Aware Video-Text Retrieval

Zongyang Ma, Ziqi Zhang, Yuxin Chen, Zhongang Qi, Chunfeng Yuan, Bing Li, Yingmin Luo, Xu Li, Xiaojuan Qi, Ying Shan, Weiming Hu

专题命中 动作与事件理解 ：text-to-video(abstract)；分类 cs.CV

Comments Accepted by ECCV 2024

Temporal Grounding of Activities using Multimodal Large Language Models

Young Chol Song

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

GPT-4o: Visual perception performance of multimodal large language models in piglet activity understanding

Yiqi Wu, Xiaodan Hu, Ziming Fu, Siling Zhou, Jiangong Li

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling

Sherwin Bahmani, Ivan Skorokhodov, Victor Rong, Gordon Wetzstein, Leonidas Guibas, Peter Wonka, Sergey Tulyakov, Jeong Joon Park, Andrea Tagliasacchi, David B. Lindell

专题命中 动作与事件理解 ：text-to-video(abstract)；分类 cs.CV

Comments CVPR 2024; Project page: https://sherwinbahmani.github.io/4dfy

ReVideo: Remake a Video with Motion and Content Control

Chong Mou, Mingdeng Cao, Xintao Wang, Zhaoyang Zhang, Ying Shan, Jian Zhang

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Global Motion Understanding in Large-Scale Video Object Segmentation

Volodymyr Fedynyak, Yaroslav Romanus, Oles Dobosevych, Igor Babin, Roman Riazantsev

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

A Transformer-Based Model for the Prediction of Human Gaze Behavior on Videos

Suleyman Ozdel, Yao Rong, Berat Mert Albaba, Yen-Ling Kuo, Xi Wang, Enkelejda Kasneci

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments 2024 Symposium on Eye Tracking Research and Applications (ETRA24), Glasgow, United Kingdom

Gaze-Guided Graph Neural Network for Action Anticipation Conditioned on Intention

Suleyman Ozdel, Yao Rong, Berat Mert Albaba, Yen-Ling Kuo, Xi Wang, Enkelejda Kasneci

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments 2024 Symposium on Eye Tracking Research and Applications (ETRA24), Glasgow, United Kingdom

Action-conditioned video data improves predictability

Meenakshi Sarkar, Debasish Ghose

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing

Jianhong Bai, Tianyu He, Yuchi Wang, Junliang Guo, Haoji Hu, Zuozhu Liu, Jiang Bian

专题命中 动作与事件理解 ：text-to-video(abstract)；分类 cs.CV

Comments Project page: https://jianhongbai.github.io/UniEdit/

Efficient and Effective Weakly-Supervised Action Segmentation via Action-Transition-Aware Boundary Alignment

Angchi Xu, Wei-Shi Zheng

专题命中 动作与事件理解 ：long video(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024

DragAnything: Motion Control for Anything using Entity Representation

Weijia Wu, Zhuang Li, Yuchao Gu, Rui Zhao, Yefei He, David Junhao Zhang, Mike Zheng Shou, Yan Li, Tingting Gao, Di Zhang

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Comments The project website is at: https://weijiawu.github.io/draganything_page/ . The code is at: https://github.com/showlab/DragAnything

TadML: A fast temporal action detection with Mechanics-MLP

Bowen Deng, Dongchang Liu

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments 8 pages,3 figures

Multi-modal News Understanding with Professionally Labelled Videos (ReutersViLNews)

Shih-Han Chou, Matthew Kowal, Yasmin Niknam, Diana Moyano, Shayaan Mehdi, Richard Pito, Cheng Zhang, Ian Knopke, Sedef Akinli Kocak, Leonid Sigal, Yalda Mohsenzadeh

专题命中 动作与事件理解 ：video-language(abstract)；分类 cs.CV

Beyond Grounding: Extracting Fine-Grained Event Hierarchies Across Modalities

Hammad A. Ayyubi, Christopher Thomas, Lovish Chum, Rahul Lokesh, Long Chen, Yulei Niu, Xudong Lin, Xuande Feng, Jaywon Koo, Sounak Ray, Shih-Fu Chang

专题命中 动作与事件理解 ：video-language(abstract)；分类 cs.CV

Comments AAAI 2024

ST(OR)2: Spatio-Temporal Object Level Reasoning for Activity Recognition in the Operating Room

Idris Hamoud, Muhammad Abdullah Jamal, Vinkle Srivastav, Didier Mutter, Nicolas Padoy, Omid Mohareri

专题命中 动作与事件理解 ：long video(abstract)；分类 cs.CV

Action Scene Graphs for Long-Form Understanding of Egocentric Videos

Ivan Rodin, Antonino Furnari, Kyle Min, Subarna Tripathi, Giovanni Maria Farinella

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidance

Zuozhuo Dai, Zhenghao Zhang, Yao Yao, Bingxue Qiu, Siyu Zhu, Long Qin, Weizhi Wang

专题命中 动作与事件理解 ：video diffusion(abstract)；分类 cs.CV

ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detection

Thinh Phan, Khoa Vo, Duy Le, Gianfranco Doretto, Donald Adjeroh, Ngan Le

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Streaming Video Temporal Action Segmentation In Real Time

Wujun Wen, Yunheng Li, Zhuben Dong, Lin Feng, Wanxiao Yang, Shenlan Liu

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments accepted by ISKE2023

BIT: Bi-Level Temporal Modeling for Efficient Supervised Action Segmentation

Zijia Lu, Ehsan Elhamifar

专题命中 动作与事件理解 ：long video(abstract)；分类 cs.CV

Comments 9 pages, 6 figures

Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesis

Chonghyuk Song, Gengshan Yang, Kangle Deng, Jun-Yan Zhu, Deva Ramanan

专题命中 动作与事件理解 ：long video(abstract)；分类 cs.CV

Comments ICCV 2023 camera-ready version. Project page with code, models, and data: https://andrewsonga.github.io/totalrecon