视频大模型

Sora Detector: A Unified Hallucination Detection for Large Text-to-Video Models

Zhixuan Chu, Lei Zhang, Yichen Sun, Siqiao Xue, Zhibo Wang, Zhan Qin, Kui Ren

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2306.08302, arXiv:2403.05131 by other authors

PEEKABOO: Interactive Video Generation via Masked-Diffusion

Yash Jain, Anshul Nasery, Vibhav Vineet, Harkirat Behl

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project webpage - https://jinga-lala.github.io/projects/Peekaboo/

DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation

Guosheng Zhao, Xiaofeng Wang, Zheng Zhu, Xinze Chen, Guan Huang, Xiaoyi Bao, Xingang Wang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project Page: https://drivedreamer2.github.io

TrailBlazer: Trajectory Control for Diffusion-Based Video Generation

Wan-Duo Kurt Ma, J. P. Lewis, W. Bastiaan Kleijn

专题命中 视频生成 ：video generation(title)；text-to-video(abstract)；分类 cs.CV

Comments 14 pages, 18 figures, Project Page: https://hohonu-vicml.github.io/Trailblazer.Page/

F3-Pruning: A Training-Free and Generalized Pruning Strategy towards Faster and Finer Text-to-Video Synthesis

Sitong Su, Jianzhi Liu, Lianli Gao, Jingkuan Song

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

Endora: Video Generation Models as Endoscopy Simulators

Chenxin Li, Hengyu Liu, Yifan Liu, Brandon Y. Feng, Wuyang Li, Xinyu Liu, Zhen Chen, Jing Shao, Yixuan Yuan

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project page: https://endora-medvidgen.github.io/

Intention-driven Ego-to-Exo Video Generation

Hongchen Luo, Kai Zhu, Wei Zhai, Yang Cao

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Stochastic Video Generation with a Learned Prior

Remi Denton, Rob Fergus

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Video Generation with Consistency Tuning

Chaoyi Wang, Yaozhe Song, Yafeng Zhang, Jun Pei, Lijie Xia, Jianpo Liu

专题命中 视频生成 ：video generation(title)；long video(abstract)；分类 cs.CV

Tuning-Free Noise Rectification for High Fidelity Image-to-Video Generation

Weijie Li, Litong Gong, Yiran Zhu, Fanda Fan, Biao Wang, Tiezheng Ge, Bo Zheng

专题命中 视频生成 ：video generation(title)；video diffusion(abstract)；分类 cs.CV

AtomoVideo: High Fidelity Image-to-Video Generation

Litong Gong, Yiran Zhu, Weijie Li, Xiaoyang Kang, Biao Wang, Tiezheng Ge, Bo Zheng

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Technical report. Page: https://atomo-video.github.io/

FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing

Yuren Cong, Mengmeng Xu, Christian Simon, Shoufa Chen, Jiawei Ren, Yanping Xie, Juan-Manuel Perez-Rua, Bodo Rosenhahn, Tao Xiang, Sen He

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

Comments Accepted by ICLR2024. Project page: https://flatten-video-editing.github.io/

Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modeling

Xiaoyu Shi, Zhaoyang Huang, Fu-Yun Wang, Weikang Bian, Dasong Li, Yi Zhang, Manyuan Zhang, Ka Chun Cheung, Simon See, Hongwei Qin, Jifeng Dai, Hongsheng Li

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project page: https://xiaoyushi97.github.io/Motion-I2V/

UniVG: Towards UNIfied-modal Video Generation

Ludan Ruan, Lei Tian, Chuanwei Huang, Xu Zhang, Xinyan Xiao

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Learn the Force We Can: Enabling Sparse Motion Control in Multi-Object Video Generation

Aram Davtyan, Paolo Favaro

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted to AAAI 2024. Project website: https://araachie.github.io/yoda

Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learning

Kaibin Tian, Yanhua Cheng, Yi Liu, Xinglin Hou, Quan Chen, Han Li

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

DreaMoving: A Human Video Generation Framework based on Diffusion Models

Mengyang Feng, Jinlin Liu, Kai Yu, Yuan Yao, Zheng Hui, Xiefan Guo, Xianhui Lin, Haolan Xue, Chen Shi, Xiaowen Li, Aojie Li, Xiaoyang Kang, Biwen Lei, Miaomiao Cui, Peiran Ren, Xuansong Xie

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments 5 pages, 5 figures, Tech. Report

GenDeF: Learning Generative Deformation Field for Video Generation

Wen Wang, Kecheng Zheng, Qiuyu Wang, Hao Chen, Zifan Shi, Ceyuan Yang, Yujun Shen, Chunhua Shen

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project page: https://aim-uofa.github.io/GenDeF/

VideoBooth: Diffusion-based Video Generation with Image Prompts

Yuming Jiang, Tianxing Wu, Shuai Yang, Chenyang Si, Dahua Lin, Yu Qiao, Chen Change Loy, Ziwei Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project page: https://vchitect.github.io/VideoBooth-project/

An Empirical Study of Frame Selection for Text-to-Video Retrieval

Mengxia Wu, Min Cao, Yang Bai, Ziyin Zeng, Chen Chen, Liqiang Nie, Min Zhang

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

Comments Accepted by 2023 EMNLP findings

Audio-Enhanced Text-to-Video Retrieval using Text-Conditioned Feature Alignment

Sarah Ibrahimi, Xiaohang Sun, Pichao Wang, Amanmeet Garg, Ashutosh Sanan, Mohamed Omar

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

Comments Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023

Write What You Want: Applying Text-to-video Retrieval to Audiovisual Archives

Yuchen Yang

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.MM

GLOBER: Coherent Non-autoregressive Video Generation via GLOBal Guided Video DecodER

Mingzhen Sun, Weining Wang, Zihan Qin, Jiahui Sun, Sihan Chen, Jing Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

The Power of Sound (TPoS): Audio Reactive Video Generation with Stable Diffusion

Yujin Jeong, Wonjeong Ryoo, Seunghyun Lee, Dabin Seo, Wonmin Byeon, Sangpil Kim, Jinkyu Kim

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments ICCV2023

StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation

Yuhan Wang, Liming Jiang, Chen Change Loy

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments ICCV 2023. Code: https://github.com/johannwyh/StyleInV Project page: https://www.mmlab-ntu.com/project/styleinv/index.html

Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generation

Fa-Ting Hong, Dan Xu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted by ICCV2023, update the reference and figures

DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectory

Shengming Yin, Chenfei Wu, Jian Liang, Jie Shi, Houqiang Li, Gong Ming, Nan Duan

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Text-to-Video: a Two-stage Framework for Zero-shot Identity-agnostic Talking-head Generation

Zhichao Wang, Mengyu Dai, Keld Lundgaard

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

Comments 6 pages

TeachCLIP: Multi-Grained Teaching for Efficient Text-to-Video Retrieval

Kaibin Tian, Ruixiang Zhao, Hu Hu, Runquan Xie, Fengzong Lian, Zhanhui Kang, Xirong Li

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

PV3D: A 3D Generative Model for Portrait Video Generation

Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Wenqing Zhang, Song Bai, Jiashi Feng, Mike Zheng Shou

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted to ICLR2023, Project Page https://showlab.github.io/pv3d