arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.22699cs.CV

Z-Image: 一种基于单流扩散Transformer的高效图像生成基础模型

Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer

Alibaba Group(阿里巴巴集团)
Image Team, Huanqia Cai, Sihan Cao, Ruoyi Du, Peng Gao, Aiming Hao, Steven Hoi, Zhaohui Hou, Shijie Huang, Dengyang Jiang, Yuming Jiang, Xin Jin, Liangchen Li, … 展开作者

Image Team, Huanqia Cai, Sihan Cao, Ruoyi Du, Peng Gao, Aiming Hao, Steven Hoi, Zhaohui Hou, Shijie Huang, Dengyang Jiang, Yuming Jiang, Xin Jin, Liangchen Li, Zhen Li, Zhong-Yu Li, David Liu, Dongyang Liu, Qilong Wu, Feng Yu, Zechao Zhan, Chi Zhang, Shifeng Zhang, Ruikai Zhou, Shilin Zhou

AI总结:

提出Z-Image,一种6B参数的高效图像生成基础模型,采用可扩展单流扩散Transformer架构,通过优化数据基础设施和训练流程,仅用314K H800 GPU小时完成训练,性能媲美顶级商业模型。

摘要:

高性能图像生成模型领域目前由专有系统主导,例如Nano Banana Pro和Seedream 4.0。领先的开源替代方案,包括Qwen-Image、Hunyuan-Image-3.0和FLUX.2,其特点是参数数量庞大(20B到80B),使得它们在消费级硬件上进行推理和微调变得不切实际。为了解决这一差距,我们提出了Z-Image,一个高效的6B参数基础生成模型,基于可扩展单流扩散Transformer(S3-DiT)架构,挑战了“不惜一切代价扩大规模”的范式。通过系统地优化整个模型生命周期——从精心策划的数据基础设施到精简的训练课程——我们仅用314K H800 GPU小时(约63万美元)就完成了完整的训练流程。我们的少步蒸馏方案结合奖励后训练进一步产生了Z-Image-Turbo,在企业级H800 GPU上提供亚秒级推理延迟,并与消费级硬件(<16GB VRAM)兼容。此外,我们的全预训练范式还使得能够高效训练Z-Image-Edit,一个具有令人印象深刻的指令跟随能力的编辑模型。定性和定量实验均表明,我们的模型在多个维度上达到了与领先竞争对手相当或超越的性能。最值得注意的是,Z-Image在逼真图像生成和双语文本渲染方面表现出卓越的能力,其结果可与顶级商业模型相媲美,从而证明了以显著降低的计算开销实现最先进结果是可行的。我们公开发布了我们的代码、权重和在线演示,以促进可访问、预算友好且最先进的生成模型的发展。

英文摘要:

The landscape of high-performance image generation models is currently dominated by proprietary systems, such as Nano Banana Pro and Seedream 4.0. Leading open-source alternatives, including Qwen-Image, Hunyuan-Image-3.0 and FLUX.2, are characterized by massive parameter counts (20B to 80B), making them impractical for inference, and fine-tuning on consumer-grade hardware. To address this gap, we propose Z-Image, an efficient 6B-parameter foundation generative model built upon a Scalable Single-Stream Diffusion Transformer (S3-DiT) architecture that challenges the "scale-at-all-costs" paradigm. By systematically optimizing the entire model lifecycle -- from a curated data infrastructure to a streamlined training curriculum -- we complete the full training workflow in just 314K H800 GPU hours (approx. $630K). Our few-step distillation scheme with reward post-training further yields Z-Image-Turbo, offering both sub-second inference latency on an enterprise-grade H800 GPU and compatibility with consumer-grade hardware (<16GB VRAM). Additionally, our omni-pre-training paradigm also enables efficient training of Z-Image-Edit, an editing model with impressive instruction-following capabilities. Both qualitative and quantitative experiments demonstrate that our model achieves performance comparable to or surpassing that of leading competitors across various dimensions. Most notably, Z-Image exhibits exceptional capabilities in photorealistic image generation and bilingual text rendering, delivering results that rival top-tier commercial models, thereby demonstrating that state-of-the-art results are achievable with significantly reduced computational overhead. We publicly release our code, weights, and online demo to foster the development of accessible, budget-friendly, yet state-of-the-art generative models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑