The field of video generation has made remarkable advancements, yet there remains a pressing need for a clear, systematic recipe that can guide the development of robust and scalable models. In this work, we present a comprehensive study that systematically explores the interplay of model architectures, training recipes, and data curation strategies, culminating in a simple and scalable text-image-conditioned video generation method, named STIV. Our framework integrates image condition into a Diffusion Transformer (DiT) through frame replacement, while incorporating text conditioning via a joint image-text conditional classifier-free guidance. This design enables STIV to perform both text-to-video (T2V) and text-image-to-video (TI2V) tasks simultaneously. Additionally, STIV can be easily extended to various applications, such as video prediction, frame interpolation, multi-view generation, and long video generation, etc. With comprehensive ablation studies on T2I, T2V, and TI2V, STIV demonstrate strong performance, despite its simple design. An 8.7B model with 512 resolution achieves 83.1 on VBench T2V, surpassing both leading open and closed-source models like CogVideoX-5B, Pika, Kling, and Gen-3. The same-sized model also achieves a state-of-the-art result of 90.1 on VBench I2V task at 512 resolution. By providing a transparent and extensible recipe for building cutting-edge video generation models, we aim to empower future research and accelerate progress toward more versatile and reliable video generation solutions.
MultiDiffSense: Diffusion-Based Multi-Modal Visuo-Tactile Image Generation Conditioned on Object Shape and Contact Pose
Department of Bioengineering, Imperial-X Initiative, Imperial College London(生物工程系、Imperial-X计划、帝国理工学院伦敦分校);CAMS-Oxford Institute, University of Oxford(CAMS-牛津研究所、牛津大学)
Point Cloud Geometry Scalable Coding with a Quality-Conditioned Latents Probability Estimator
Università di Padova(帕多瓦大学);Instituto Superior Técnico – Universidade de Lisboa(里斯本大学高等技术学院);ESTG – Politécnico de Leiria(莱里亚理工学院技术与管理学院);Instituto de Telecomunicações(电信研究所)
GWM: Towards Scalable Gaussian World Models for Robotic Manipulation
Tsinghua University(清华大学);State Key Laboratory of General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,BIGAI);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院)
Point Cloud Geometry Scalable Coding Using a Resolution and Quality-conditioned Latents Probability Estimator
University of Padova(帕多瓦大学);Instituto de Telecomunicações(电信研究所);Instituto Superior Técnico(高等技术学院);Universidade de Lisboa(里斯本大学);Politécnico de Leiria(莱里亚理工学院)
I Seek You in Videos: Identity-Conditioned Queries for Person-Centric Video Reasoning
Beijing Jiaotong University(北京交通大学);HUJING Digital Media & Entertainment Group(汇晶数字媒体与娱乐集团);MAIS Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS)
3DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesis
Shanghai Jiao Tong University(上海交通大学);Academy of Military Science(军事科学院);The University of Sydney(悉尼大学);College of Computer Science and Technology, National University of Defense Technology(国防科技大学计算机学院)