arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.09439cs.CV
收藏

Fine-T2I: 一个大规模、高质量且多样化的开放数据集用于高质量T2I微调

Fine-T2I: An Open, Large-Scale, and Diverse Dataset for High-Quality T2I Fine-Tuning

Department of Electrical \& Computer Engineering, Northeastern University, Boston

Xu Ma, Yitian Zhang, Qihua Dong, Yun Fu

AI总结:

Fine-T2I是一个大规模高质量开放数据集,通过结合合成和真实图像,提升T2I微调的生成质量和指令遵循性。

摘要:

高质量和开放的数据集仍然是文本到图像(T2I)微调的主要瓶颈。尽管在模型架构和训练流程方面取得了快速进展,但大多数公开可用的微调数据集仍然存在分辨率低、文本图像对齐差或多样性有限的问题,导致开放研究模型与企业级模型之间存在明显的性能差距。在本文中,我们提出了Fine-T2I,一个大规模、高质量且完全开放的T2I微调数据集。Fine-T2I涵盖10种任务组合、32种提示类别、11种视觉风格和5种提示模板,并结合由强大现代模型生成的合成图像与来自专业摄影师精心挑选的现实图像。所有样本都经过严格筛选,以确保文本图像对齐、视觉保真度和提示质量,超过95%的初始候选者被剔除。最终数据集包含超过600万对文本图像,约2TB存储空间,接近预训练数据集的规模,同时保持微调级别的质量。在一系列多样化的预训练扩散和自回归模型上,使用Fine-T2I微调可以一致地提高生成质量和指令遵循性,这通过人工评估、视觉比较和自动指标得到验证。我们以开放许可发布Fine-T2I,以帮助缩小T2I微调中的数据差距。

英文摘要:

High-quality and open datasets remain a major bottleneck for text-to-image (T2I) fine-tuning. Despite rapid progress in model architectures and training pipelines, most publicly available fine-tuning datasets suffer from low resolution, poor text-image alignment, or limited diversity, resulting in a clear performance gap between open research models and enterprise-grade models. In this work, we present Fine-T2I, a large-scale, high-quality, and fully open dataset for T2I fine-tuning. Fine-T2I spans 10 task combinations, 32 prompt categories, 11 visual styles, and 5 prompt templates, and combines synthetic images generated by strong modern models with carefully curated real images from professional photographers. All samples are rigorously filtered for text-image alignment, visual fidelity, and prompt quality, with over 95% of initial candidates removed. The final dataset contains over 6 million text-image pairs, around 2 TB on disk, approaching the scale of pretraining datasets while maintaining fine-tuning-level quality. Across a diverse set of pretrained diffusion and autoregressive models, fine-tuning on Fine-T2I consistently improves both generation quality and instruction adherence, as validated by human evaluation, visual comparison, and automatic metrics. We release Fine-T2I under an open license to help close the data gap in T2I fine-tuning in the open community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑