视频大模型

IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation

Yuanze Lin, Yi-Wen Chen, Yi-Hsuan Tsai, Ronald Clark, Ming-Hsuan Yang

机构 * University of Oxford（牛津大学） ； UC Merced（加州大学默塞德分校） ； NEC Labs America（NEC美国实验室） ； Atmanity Inc.（Atmanity公司） ； Google DeepMind Project（谷歌DeepMind项目） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Tech Report

Interactive Video Generation via Domain Adaptation

Ishaan Rawal, Suryansh Kumar

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Preprint. Under Review

DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation

Minghong Cai, Xiaodong Cun, Xiaoyu Li, Wenze Liu, Zhaoyang Zhang, Yong Zhang, Ying Shan, Xiangyu Yue

机构 * MMLab, CUHK（香港中文大学多媒体实验室） ； GVC Lab, Great Bay University（大湾区大学GVC实验室） ； ARC Lab, Tencent PCG（腾讯平台与内容事业群ARC实验室） ； Tencent AI Lab（腾讯AI实验室） ； SHIAE, CUHK（香港中文大学SHIAE实验室） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments CVPR 2025; 21 pages, 23 figures, Project page: https://onevfall.github.io/project_page/ditctrl ; GitHub repository: https://github.com/TencentARC/DiTCtrl

Secure & Personalized Music-to-Video Generation via CHARCHA

Mehul Agarwal, Gauri Agarwal, Santiago Benoit, Andrew Lippman, Jean Oh

机构 * Carnegie Mellon University（卡内基梅隆大学） ； MIT Media Lab（麻省理工学院媒体实验室） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments NeurIPS 2024 Creative AI Track

ECHOPulse: ECG controlled echocardio-grams video generation

Yiwei Li, Sekeun Kim, Zihao Wu, Hanqi Jiang, Yi Pan, Pengfei Jin, Sifan Song, Yucheng Shi, Tianming Liu, Quanzheng Li, Xiang Li

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulation

Homanga Bharadhwaj, Debidatta Dwibedi, Abhinav Gupta, Shubham Tulsiani, Carl Doersch, Ted Xiao, Dhruv Shah, Fei Xia, Dorsa Sadigh, Sean Kirmani

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments Preprint. Under Review

Fundus2Video: Cross-Modal Angiography Video Generation from Static Fundus Photography with Clinical Knowledge Guidance

Weiyi Zhang, Siyu Huang, Jiancheng Yang, Ruoyu Chen, Zongyuan Ge, Yingfeng Zheng, Danli Shi, Mingguang He

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments The paper has been accepted by Medical Image Computing and Computer Assisted Intervention Society (MICCAI) 2024

Explainable and Controllable Motion Curve Guided Cardiac Ultrasound Video Generation

Junxuan Yu, Rusi Chen, Yongsong Zhou, Yanlin Chen, Yaofei Duan, Yuhao Huang, Han Zhou, Tan Tao, Xin Yang, Dong Ni

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments Accepted by MICCAI MLMI 2024

MotionCtrl: A Unified and Flexible Motion Controller for Video Generation

Zhouxia Wang, Ziyang Yuan, Xintao Wang, Tianshui Chen, Menghan Xia, Ping Luo, Ying Shan

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments SIGGRAPH 2024 Conference Proceedings

Bora: Biomedical Generalist Video Generation Model

Weixiang Sun, Xiaocao You, Ruizhe Zheng, Zhengqing Yuan, Xiang Li, Lifang He, Quanzheng Li, Lichao Sun

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

TAVGBench: Benchmarking Text to Audible-Video Generation

Yuxin Mao, Xuyang Shen, Jing Zhang, Zhen Qin, Jinxing Zhou, Mochu Xiang, Yiran Zhong, Yuchao Dai

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Technical Report. Project page:https://github.com/OpenNLPLab/TAVGBench

InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions

Yiyuan Zhang, Yuhao Kang, Zhixin Zhang, Xiaohan Ding, Sanyuan Zhao, Xiangyu Yue

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments Code, models, and demo are available at https://github.com/invictus717/InteractiveVideo

A Survey of AI Text-to-Image and AI Text-to-Video Generators

Aditi Singh

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV、eess.IV

Comments 4 pages, 2 tables, 4th International Conference on Artificial Intelligence, Robotics and Control (AIRC 2023)

MeVGAN: GAN-based Plugin Model for Video Generation with Applications in Colonoscopy

Łukasz Struski, Tomasz Urbańczyk, Krzysztof Bucki, Bartłomiej Cupiał, Aneta Kaczyńska, Przemysław Spurek, Jacek Tabor

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Measuring the Quality of Text-to-Video Model Outputs: Metrics and Dataset

Iya Chivileva, Philip Lynch, Tomas E. Ward, Alan F. Smeaton

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV、cs.MM

Comments 13 pages

Sounding Video Generator: A Unified Framework for Text-guided Sounding Video Generation

Jiawei Liu, Weining Wang, Sihan Chen, Xinxin Zhu, Jing Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Journal ref IEEE Transactions on Multimedia 2023

Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video Retrieval

Fan Hu, Aozhu Chen, Ziyue Wang, Fangming Zhou, Jianfeng Dong, Xirong Li

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted by ECCV2022

Audio-Driven Talking Face Video Generation with Dynamic Convolution Kernels

Zipeng Ye, Mengfei Xia, Ran Yi, Juyong Zhang, Yu-Kun Lai, Xuwei Huang, Guoxin Zhang, Yong-jin Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Comments in IEEE Transactions on Multimedia

Reading-strategy Inspired Visual Representation Learning for Text-to-Video Retrieval

Jianfeng Dong, Yabing Wang, Xianke Chen, Xiaoye Qu, Xirong Li, Yuan He, Xun Wang

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted by IEEE Transactions on Circuits and Systems for Video Technology. Code is available at https://github.com/LiJiaBei-7/rivrl

Xp-GAN: Unsupervised Multi-object Controllable Video Generation

Bahman Rouhani, Mohammad Rahmati

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments 8 pages, 9 figures

Towards Using Clothes Style Transfer for Scenario-aware Person Video Generation

Jingning Xu, Benlai Tang, Mingjie Wang, Siyuan Bian, Wenyi Guo, Xiang Yin, Zejun Ma

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、cs.MM

Speech2Video: Cross-Modal Distillation for Speech to Video Generation

Shijing Si, Jianzong Wang, Xiaoyang Qu, Ning Cheng, Wenqi Wei, Xinghua Zhu, Jing Xiao

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments Accepted by InterSpeech2021

Image-to-Video Generation via 3D Facial Dynamics

Xiaoguang Tu, Yingtian Zou, Jian Zhao, Wenjie Ai, Jian Dong, Yuan Yao, Zhikang Wang, Guodong Guo, Zhifeng Li, Wei Liu, Jiashi Feng

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

One Shot Audio to Animated Video Generation

Neeraj Kumar, Srishti Goel, Ankur Narang, Brejesh Lall, Mujtaba Hasan, Pranshu Agarwal, Dipankar Sarkar

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments arXiv admin note: substantial text overlap with arXiv:2012.07842, arXiv:2012.07304

Temporal Shift GAN for Large Scale Video Generation

Andres Munoz, Mohammadreza Zolfaghari, Max Argus, Thomas Brox

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV、eess.IV

Comments 14 pages, 15 figures

S^2VG: 3D Stereoscopic and Spatial Video Generation via Denoising Frame Matrix

S^2VG：基于去噪帧矩阵的3D立体与空间视频生成

Peng Dai, Feitong Tan, Qiangeng Xu, Yihua Huang, David Futschik, Ruofei Du, Sean Fanello, Yinda Zhang, Xiaojuan Qi

机构 * Department of Electrical and Electronic Engineering at The University of Hong Kong（香港大学电子与电气工程系） ； Google（谷歌） 纠错

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

AI总结 提出一种无需姿态和训练的方法，利用现成单目视频生成模型，通过深度图扭曲和帧矩阵修复框架，生成时空一致的3D立体与空间视频。

Comments immersive video generation, 4D scene, spatial video, stereo video

ModelScope Text-to-Video Technical Report

Jiuniu Wang, Hangjie Yuan, Dayou Chen, Yingya Zhang, Xiang Wang, Shiwei Zhang

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

Comments Technical report. Project page: \url{https://modelscope.cn/models/damo/text-to-video-synthesis/summary}

Markov Decision Process for Video Generation

Vladyslav Yushchenko, Nikita Araslanov, Stefan Roth

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV；video understanding(comments)

Comments To appear at 2019 ICCV Workshop on Large Scale Holistic Video Understanding

Tether the Subject, Release the Scene: Query-Aware Memory Routing for Long-Horizon Autoregressive Video Generation

绑定主体，释放场景：面向长时序自回归视频生成的查询感知记忆路由

Chen Li, Peng Zhang, Hanyu Zhou, Jialong Zuo, Fei Wang, Daiguo Zhou, Nong Sang, Changxin Gao

机构 * Huazhong University of Science and Technology（华中科技大学） ； MiLM Plus, Xiaomi Inc.（小米公司MiLM Plus） 纠错

专题命中 视频生成 ：video generation(title)；long video(abstract)；分类 cs.CV

AI总结 针对流式自回归视频生成中记忆锚定的场景欠进展问题，提出无需训练的查询感知时空记忆路由器 TetherMem，分离主体与场景查询调节历史访问，在长视频生成的整体质量与场景进展指标上优于基线方法。

Surgical Video Generation From Diffusion to World Models: A Survey

手术视频生成：从扩散模型到世界模型：综述

Fuxiang Huang, Chenxu Zhang, Liang Han, Lei Zhang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

AI总结 该综述梳理2024-2026年手术视频生成领域文献，分三类总结方法，指出生成任务从合成帧转向建模场景因果动态，分析瓶颈并提供实验参考，为相关交叉领域研究者提供参考。

Comments 4 pages, 1 figures, 3 tables. Accepted for oral presentation at the 2026 3rd International Conference on Intelligent Perception and Pattern Recognition (IPPR 2026)