视频大模型

Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models

Wen Wang, Yan Jiang, Kangyang Xie, Zide Liu, Hao Chen, Yue Cao, Xinlong Wang, Chunhua Shen

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments Add customized video editing. Under Review

FAAC: Facial Animation Generation with Anchor Frame and Conditional Control for Superior Fidelity and Editability

Linze Li, Sunqi Fan, Hengjun Pu, Zhaodong Bing, Yao Tang, Tianzhu Ye, Tong Yang, Liangyu Chen, Jiajun Liang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

VidToMe: Video Token Merging for Zero-Shot Video Editing

Xirui Li, Chao Ma, Xiaokang Yang, Ming-Hsuan Yang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project page: https://vidtome-diffusion.github.io

SAVE: Protagonist Diversification with Structure Agnostic Video Editing

Yeji Song, Wonsik Shin, Junsoo Lee, Jeesoo Kim, Nojun Kwak

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments Project website: https://ldynx.github.io/SAVE/

SAVE: Spectral-Shift-Aware Adaptation of Image Diffusion Models for Text-driven Video Editing

Nazmul Karim, Umar Khalid, Mohsen Joneidi, Chen Chen, Nazanin Rahnavard

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments 11 pages, 10 figures

ControlVideo: Conditional Control for One-shot Text-driven Video Editing and Beyond

Min Zhao, Rongzhen Wang, Fan Bao, Chongxuan Li, Jun Zhu

专题命中 视频生成 ：long video(abstract)；分类 cs.CV

Continuously Controllable Facial Expression Editing in Talking Face Videos

Zhiyao Sun, Yu-Hui Wen, Tian Lv, Yanan Sun, Ziyang Zhang, Yaoyuan Wang, Yong-Jin Liu

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Affective Computing (DOI: 10.1109/TAFFC.2023.3334511). Demo video: https://youtu.be/WD-bNVya6kM . Project page: https://raineggplant.github.io/FEE4TV

Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer Learning

Huanjin Yao, Wenhao Wu, Zhiheng Li

专题命中 视频生成 ：video understanding(abstract)；分类 cs.CV

Comments Technical report

DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving

Xiaofeng Wang, Zheng Zhu, Guan Huang, Xinze Chen, Jiagang Zhu, Jiwen Lu

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project Page: https://drivedreamer.github.io

Edit-A-Video: Single Video Editing with Object-Aware Consistency

Chaehun Shin, Heeseung Kim, Che Hyun Lee, Sang-gil Lee, Sungroh Yoon

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments ACML 2023 Best Paper Award

FateZero: Fusing Attentions for Zero-shot Text-based Video Editing

Chenyang Qi, Xiaodong Cun, Yong Zhang, Chenyang Lei, Xintao Wang, Ying Shan, Qifeng Chen

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments Accepted to ICCV 2023 as an Oral Presentation. Project page: https://fate-zero-edit.github.io ; GitHub repository: https://github.com/ChenyangQiQi/FateZero

Encoding and Decoding Narratives: Datafication and Alternative Access Models for Audiovisual Archives

Yuchen Yang

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.MM

Comments arXiv admin note: substantial text overlap with arXiv:2310.05825

Latent Wander: an Alternative Interface for Interactive and Serendipitous Discovery of Large AV Archives

Yuchen Yang, Linyida Zhang

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.MM

OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions

Jin Liu, Xi Wang, Xiaomeng Fu, Yesheng Chai, Cai Yu, Jiao Dai, Jizhong Han

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Paper Under Review

Unified Coarse-to-Fine Alignment for Video-Text Retrieval

Ziyang Wang, Yi-Lin Sung, Feng Cheng, Gedas Bertasius, Mohit Bansal

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments ICCV 2023

RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model

Fengxiang Bie, Yibo Yang, Zhongzhu Zhou, Adam Ghanem, Minjia Zhang, Zhewei Yao, Xiaoxia Wu, Connor Holmes, Pareesa Golnari, David A. Clifton, Yuxiong He, Dacheng Tao, Shuaiwen Leon Song

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Learning Modulated Transformation in GANs

Ceyuan Yang, Qihang Zhang, Yinghao Xu, Jiapeng Zhu, Yujun Shen, Bo Dai

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Technical report

MagicAvatar: Multimodal Avatar Generation and Animation

Jianfeng Zhang, Hanshu Yan, Zhongcong Xu, Jiashi Feng, Jun Hao Liew

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project page: https://magic-avatar.github.io/

1st Place Solution for the 5th LSVOS Challenge: Video Instance Segmentation

Tao Zhang, Xingye Tian, Yikang Zhou, Yu Wu, Shunping Ji, Cilin Yan, Xuebo Wang, Xin Tao, Yuan Zhang, Pengfei Wan

专题命中 视频生成 ：long video(abstract)；分类 cs.CV

Ada-TTA: Towards Adaptive High-Quality Text-to-Talking Avatar Synthesis

Zhenhui Ye, Ziyue Jiang, Yi Ren, Jinglin Liu, Chen Zhang, Xiang Yin, Zejun Ma, Zhou Zhao

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Accepted by ICML 2023 Workshop, 6 pages, 3 figures

Scalable Adaptive Computation for Iterative Generation

Allan Jabri, David Fleet, Ting Chen

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments ICML'23. Code at https://github.com/google-research/pix2seq

Quantifying Sample Anonymity in Score-Based Generative Models with Adversarial Fingerprinting

Mischa Dombrowski, Bernhard Kainz

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments 10 pages, 6 figures

Consistency Models

Yang Song, Prafulla Dhariwal, Mark Chen, Ilya Sutskever

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments ICML 2023

SceneScape: Text-Driven Consistent Scene Generation

Rafail Fridman, Amit Abecasis, Yoni Kasten, Tali Dekel

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project page: https://scenescape.github.io/

MAGVIT: Masked Generative Video Transformer

Lijun Yu, Yong Cheng, Kihyuk Sohn, José Lezama, Han Zhang, Huiwen Chang, Alexander G. Hauptmann, Ming-Hsuan Yang, Yuan Hao, Irfan Essa, Lu Jiang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments CVPR 2023 highlight

VindLU: A Recipe for Effective Video-and-Language Pretraining

Feng Cheng, Xizi Wang, Jie Lei, David Crandall, Mohit Bansal, Gedas Bertasius

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments CVPR 2023. Project page: https://klauscc.github.io/vindlu.html

Video-P2P: Video Editing with Cross-attention Control

Shaoteng Liu, Yuechen Zhang, Wenbo Li, Zhe Lin, Jiaya Jia

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments 10 pages, 9 figures. Project page: https://video-p2p.github.io/

One-Shot Face Video Re-enactment using Hybrid Latent Spaces of StyleGAN2

Trevine Oorloff, Yaser Yacoob

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments The project page is located at https://trevineoorloff.github.io/FaceVideoReenactment_HybridLatents.io/

Text-To-4D Dynamic Scene Generation

Uriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual, Iurii Makarov, Filippos Kokkinos, Naman Goyal, Andrea Vedaldi, Devi Parikh, Justin Johnson, Yaniv Taigman

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Recovering Surveillance Video Using RF Cues

Xiang Li, Rabih Younes

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Technical Report