1.58-位FLUX
1.58-bit FLUX
摘要:
我们提出了1.58位FLUX,这是第一个成功的方法来量化最先进的文本到图像生成模型FLUX.1-dev,使用1.58位权重(即,{-1,0,+1}中的值),同时保持生成1024 x 1024图像的相当性能。值得注意的是,我们的量化方法在不访问图像数据的情况下运行,仅依赖于FLUX.1-dev模型的自我监督。此外,我们开发了一个针对1.58位操作优化的自定义内核,实现了模型存储减少7.7倍,推理内存减少5.1倍,并改善了推理延迟。GenEval和T2 I Compbench基准测试的广泛评估表明,1.58位FLUX在保持生成质量的同时显着提高计算效率方面是有效的。
英文摘要:
We present 1.58-bit FLUX, the first successful approach to quantizing the state-of-the-art text-to-image generation model, FLUX.1-dev, using 1.58-bit weights (i.e., values in {-1, 0, +1}) while maintaining comparable performance for generating 1024 x 1024 images. Notably, our quantization method operates without access to image data, relying solely on self-supervision from the FLUX.1-dev model. Additionally, we develop a custom kernel optimized for 1.58-bit operations, achieving a 7.7x reduction in model storage, a 5.1x reduction in inference memory, and improved inference latency. Extensive evaluations on the GenEval and T2I Compbench benchmarks demonstrate the effectiveness of 1.58-bit FLUX in maintaining generation quality while significantly enhancing computational efficiency.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。