MONET:一个大规模、开放、非冗余且增强的文本到图像数据集
MONET: A Massive, Open, Non-redundant and Enriched Text-to-image dataset
AI总结:
本文提出MONET数据集,通过多阶段过滤和增强,提供高质量的文本到图像数据,以降低大规模可重复研究的门槛。
摘要:
训练大型文本到图像模型需要高质量、经过精心编纂的数据集,具有多样内容和详细的描述。然而,收集、过滤、去重和重新描述此类语料库的高昂成本和复杂性阻碍了该领域的开放和可重复研究。我们介绍了MONET,一个开放的Apache 2.0数据集,包含约104.9亿个图像-文本对,这些数据来自29亿个原始对,通过多阶段的安全过滤、领域过滤、精确和近似去重以及使用多种视觉-语言模型重新描述,覆盖短到长形式的描述,并进一步通过合成生成样本增强。每个图像都配有预计算的嵌入和注释,以加速下游使用。为了验证MONET的有效性,我们仅使用它训练了一个400亿参数的潜在扩散模型,并在GenEval和DPG评分中达到了具有竞争力的结果,证明我们的数据集降低了大规模、可重复文本到图像研究的门槛。
英文摘要:
Training large text-to-image models requires high-quality, curated datasets with diverse content and detailed captions. Yet the cost and complexity of collecting, filtering, deduplicating, and re-captioning such corpora at scale hinder open and reproducible research in the field. We introduce MONET, an open Apache 2.0 dataset of 103.8M image-text pairs collected from 2.9B raw pairs across heterogeneous open sources through successive stages of safety filtering, domain-based filtering, exact and near-duplicate removal, and re-captioning with multiple vision-language models covering short to long-form descriptions, and further augmented with synthetically generated samples. Each image is shipped with pre-computed embeddings and annotations to accelerate downstream use. To validate the effectiveness of MONET, we train a 4B-parameter latent diffusion model exclusively on it and reach competitive GenEval and DPG scores, demonstrating that our dataset lowers the barrier to large-scale, reproducible text-to-image research.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。