We propose X-WAM, a Unified 4D World Model that unifies real-time robotic action execution and high-fidelity 4D world synthesis (video + 3D reconstruction) in a single framework, addressing the critical limitations of prior unified world models (e.g., UWM) that only model 2D pixel-space and fail to balance action efficiency and world modeling quality. To leverage the strong visual priors of pretrained video diffusion models, X-WAM imagines the future world by predicting multi-view RGB-D videos, and obtains spatial information efficiently through a lightweight structural adaptation: replicating the final few blocks of the pretrained Diffusion Transformer into a dedicated depth prediction branch for the reconstruction of future spatial information. Moreover, we propose Asynchronous Noise Sampling (ANS) to jointly optimize generation quality and action decoding efficiency. ANS applies a specialized asynchronous denoising schedule during inference, which rapidly decodes actions with fewer steps to enable efficient real-time execution, while dedicating the full sequence of steps to generate high-fidelity video. Rather than entirely decoupling the timesteps during training, ANS samples from their joint distribution to align with the inference distribution. Pretrained on over 5,800 hours of robotic data, X-WAM achieves 79.2% and 90.7% average success rate on RoboCasa and RoboTwin 2.0 benchmarks, while producing high-fidelity 4D reconstruction and generation surpassing existing methods in both visual and geometric metrics.
Department of Computer Science and Engineering, Southern University of Science and Technology, China(南方科技大学计算机科学与工程系);National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University, China(大数据系统计算技术国家工程实验室,深圳大学);Shenzhen Polytechnic University, China(深圳职业技术大学);Zhejiang University, China(浙江大学);Alibaba Group, China(阿里巴巴集团)
Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising
Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Nanjing University(南京大学);Tsinghua University(清华大学);SenseTime Research(商汤科技研究院)
Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation
Shanghai Innovation Institute(上海创新研究院);Fudan University(复旦大学);University of Science and Technology of China(中国科学技术大学);Nanjing University(南京大学);Baidu(百度)
MFR-Net: Multi-faceted Responsive Listening Head Generation via Denoising Diffusion Model
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
Tuning-Free Long Video Generation via Global-Local Collaborative Diffusion
Space AI, Li Auto(理想汽车太空智能部门);Zhejiang University(浙江大学);University of Science and Technology of China(中国科学技术大学);University of New South Wales(新南威尔士大学);Singapore University of Technology and Design(新加坡科技设计大学)
Enhancing Video Physical Consistency via Role-aware Joint Training and Modality-decoupled Denoising
University of Science and Technology of China(中国科学技术大学);University of Electronic Science and Technology of China(电子科技大学);Fudan University(复旦大学);Georgia Institute of Technology(佐治亚理工学院);Shanghai Jiao Tong University(上海交通大学)
When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators
Zhejiang University of Technology(浙江工业大学);University of New South Wales (UNSW Sydney)(新南威尔士大学(悉尼));University of Auckland(奥克兰大学);Zhejiang University(浙江大学)
Speech Driven Video Editing via an Audio-Conditioned Diffusion Model
University of Galway(高威大学);University of Wrocław(弗罗茨瓦夫大学);Wrocław University of Science and Technology(弗罗茨瓦夫理工大学);Tooploox(Tooploox公司);Trinity College Dublin(都柏林圣三一学院)
Hierarchical Denoising For Multi-Step Visual Reasoning
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(北京大学计算机科学学院多媒体信息处理技术国家重点实验室);The Hong Kong University of Science and Technology(香港科技大学);Beihang University(北京航空航天大学);Fuzhou University(福州大学);Muka Robotics(木卡机器人)