视频大模型

Paper2Video: Automatic Video Generation from Scientific Papers

Zeyu Zhu, Kevin Qinghong Lin, Mike Zheng Shou

机构 * Show Lab, National University of Singapore（展示实验室，新加坡国立大学） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Project Page: https://showlab.github.io/Paper2Video/

Ovi: Twin Backbone Cross-Modal Fusion for Audio-Video Generation

Chetwin Low, Weimin Wang, Calder Katyal

机构 * Character AI ； Yale University（耶鲁大学） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioning

Liyang Chen, Tianxiang Ma, Jiawei Liu, Bingchuan Li, Zhuowei Chen, Lijie Liu, Xu He, Gen Li, Qian He, Zhiyong Wu

机构 * Tsinghua University（清华大学） ； Intelligent Creation Lab, ByteDance（字节跳动智能创作实验室） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

ChoreoMuse: Robust Music-to-Dance Video Generation with Style Transfer and Beat-Adherent Motion

Xuanchen Wang, Heng Wang, Weidong Cai

机构 * School of Computer Science, The University of Sydney（计算机科学学院，悉尼大学） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments 10 pages, 5 figures, accepted by the 33rd ACM International Conference on Multimedia (ACM MM 2025), demo page: https://choreomuse.github.io

EndoGen: Conditional Autoregressive Endoscopic Video Generation

Xinyu Liu, Hengyu Liu, Cheng Wang, Tianming Liu, Yixuan Yuan

机构 * The Chinese University of Hong Kong, Hong Kong SAR（香港中文大学） ； University of Georgia（佐治亚大学） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments MICCAI 2025

Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Model

Wei Li, Ming Hu, Guoan Wang, Lihao Liu, Kaijing Zhou, Junzhi Ning, Xin Guo, Zongyuan Ge, Lixu Gu, Junjun He

机构 * Shanghai Artificial Intelligence Laboratory, China（上海人工智能实验室） ； Shanghai Jiao Tong University, China（上海交通大学） ； Monash University, Australia（墨尔本大学） ； East China Normal University, China（华东师范大学） ； Eye Hospital, Wenzhou Medical University, China（温州医学院眼医院） ； Shanghai Academy of Artificial Intelligence for Science, China（上海人工智能科学研究院） ； Imperial College London, UK（伦敦帝国理工学院） ； Shanghai Innovation Institute, China（上海创新研究院） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments Early accepted in MICCAI25

HRVGAN: High Resolution Video Generation using Spatio-Temporal GAN

Abhinav Sagar

机构 * University of Maryland（马里兰大学） ； College Park, Maryland 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance

Yuang Zhang, Jiaxi Gu, Li-Wen Wang, Han Wang, Junqi Cheng, Yuefeng Zhu, Fangyuan Zou

机构 * Tencent（腾讯） ； Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments ICML 2025

OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animation

Qijun Gan, Ruizi Yang, Jianke Zhu, Shaofei Xue, Steven Hoi

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Project page: https://omni-avatar.github.io/

IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation

Yuanze Lin, Yi-Wen Chen, Yi-Hsuan Tsai, Ronald Clark, Ming-Hsuan Yang

机构 * University of Oxford（牛津大学） ； UC Merced（加州大学默塞德分校） ； NEC Labs America（NEC美国实验室） ； Atmanity Inc.（Atmanity公司） ； Google DeepMind Project（谷歌DeepMind项目） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Tech Report

Interactive Video Generation via Domain Adaptation

Ishaan Rawal, Suryansh Kumar

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Preprint. Under Review

DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation

Minghong Cai, Xiaodong Cun, Xiaoyu Li, Wenze Liu, Zhaoyang Zhang, Yong Zhang, Ying Shan, Xiangyu Yue

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments CVPR 2025; 21 pages, 23 figures, Project page: https://onevfall.github.io/project_page/ditctrl ; GitHub repository: https://github.com/TencentARC/DiTCtrl

Secure & Personalized Music-to-Video Generation via CHARCHA

Mehul Agarwal, Gauri Agarwal, Santiago Benoit, Andrew Lippman, Jean Oh

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments NeurIPS 2024 Creative AI Track

ECHOPulse: ECG controlled echocardio-grams video generation

Yiwei Li, Sekeun Kim, Zihao Wu, Hanqi Jiang, Yi Pan, Pengfei Jin, Sifan Song, Yucheng Shi, Tianming Liu, Quanzheng Li, Xiang Li

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulation

Homanga Bharadhwaj, Debidatta Dwibedi, Abhinav Gupta, Shubham Tulsiani, Carl Doersch, Ted Xiao, Dhruv Shah, Fei Xia, Dorsa Sadigh, Sean Kirmani

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments Preprint. Under Review

Fundus2Video: Cross-Modal Angiography Video Generation from Static Fundus Photography with Clinical Knowledge Guidance

Weiyi Zhang, Siyu Huang, Jiancheng Yang, Ruoyu Chen, Zongyuan Ge, Yingfeng Zheng, Danli Shi, Mingguang He

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments The paper has been accepted by Medical Image Computing and Computer Assisted Intervention Society (MICCAI) 2024

Explainable and Controllable Motion Curve Guided Cardiac Ultrasound Video Generation

Junxuan Yu, Rusi Chen, Yongsong Zhou, Yanlin Chen, Yaofei Duan, Yuhao Huang, Han Zhou, Tan Tao, Xin Yang, Dong Ni

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments Accepted by MICCAI MLMI 2024

MotionCtrl: A Unified and Flexible Motion Controller for Video Generation

Zhouxia Wang, Ziyang Yuan, Xintao Wang, Tianshui Chen, Menghan Xia, Ping Luo, Ying Shan

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments SIGGRAPH 2024 Conference Proceedings

Bora: Biomedical Generalist Video Generation Model

Weixiang Sun, Xiaocao You, Ruizhe Zheng, Zhengqing Yuan, Xiang Li, Lifang He, Quanzheng Li, Lichao Sun

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

TAVGBench: Benchmarking Text to Audible-Video Generation

Yuxin Mao, Xuyang Shen, Jing Zhang, Zhen Qin, Jinxing Zhou, Mochu Xiang, Yiran Zhong, Yuchao Dai

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Technical Report. Project page:https://github.com/OpenNLPLab/TAVGBench

InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions

Yiyuan Zhang, Yuhao Kang, Zhixin Zhang, Xiaohan Ding, Sanyuan Zhao, Xiangyu Yue

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Code, models, and demo are available at https://github.com/invictus717/InteractiveVideo

A Survey of AI Text-to-Image and AI Text-to-Video Generators

Aditi Singh

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV、eess.IV

Comments 4 pages, 2 tables, 4th International Conference on Artificial Intelligence, Robotics and Control (AIRC 2023)

MeVGAN: GAN-based Plugin Model for Video Generation with Applications in Colonoscopy

Łukasz Struski, Tomasz Urbańczyk, Krzysztof Bucki, Bartłomiej Cupiał, Aneta Kaczyńska, Przemysław Spurek, Jacek Tabor

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Measuring the Quality of Text-to-Video Model Outputs: Metrics and Dataset

Iya Chivileva, Philip Lynch, Tomas E. Ward, Alan F. Smeaton

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV、cs.MM

Comments 13 pages

Sounding Video Generator: A Unified Framework for Text-guided Sounding Video Generation

Jiawei Liu, Weining Wang, Sihan Chen, Xinxin Zhu, Jing Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Journal ref IEEE Transactions on Multimedia 2023

Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video Retrieval

Fan Hu, Aozhu Chen, Ziyue Wang, Fangming Zhou, Jianfeng Dong, Xirong Li

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted by ECCV2022

Audio-Driven Talking Face Video Generation with Dynamic Convolution Kernels

Zipeng Ye, Mengfei Xia, Ran Yi, Juyong Zhang, Yu-Kun Lai, Xuwei Huang, Guoxin Zhang, Yong-jin Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments in IEEE Transactions on Multimedia

Reading-strategy Inspired Visual Representation Learning for Text-to-Video Retrieval

Jianfeng Dong, Yabing Wang, Xianke Chen, Xiaoye Qu, Xirong Li, Yuan He, Xun Wang

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted by IEEE Transactions on Circuits and Systems for Video Technology. Code is available at https://github.com/LiJiaBei-7/rivrl

Xp-GAN: Unsupervised Multi-object Controllable Video Generation

Bahman Rouhani, Mohammad Rahmati

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments 8 pages, 9 figures

Towards Using Clothes Style Transfer for Scenario-aware Person Video Generation

Jingning Xu, Benlai Tang, Mingjie Wang, Siyuan Bian, Wenyi Guo, Xiang Yin, Zejun Ma

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM