Illustrious:一个开放的先进插画模型
Illustrious: an Open Advanced Illustration Model
AI总结:
本文提出开源动漫图像生成模型 Illustrious,通过优化批量大小与 dropout、提高训练分辨率至20MP以上、构建多级描述三项关键改进,在动画风格生成质量上达到最先进水平,并支持便捷定制与个性化。
摘要:
在这项工作中,我们分享了在文本到图像动漫图像生成模型 Illustrious 中实现最先进质量的见解。为了实现高分辨率、动态色彩范围图像和高恢复能力,我们专注于三个关键的模型改进方法。首先,我们深入研究了批量大小和 dropout 控制的重要性,这能够更快地学习基于可控标记的概念激活。其次,我们提高了图像的训练分辨率,影响角色解剖结构在更高分辨率下的准确描绘,并通过适当的方法将其生成能力扩展到超过 20MP。最后,我们提出了精炼的多级描述,涵盖所有标签和各种自然语言描述,作为模型开发的关键因素。通过广泛的分析和实验,Illustrious 在动画风格方面展示了最先进的性能,超越了插画领域广泛使用的模型,凭借开源特性推动了更便捷的定制和个性化。我们计划依次公开发布更新后的 Illustrious 模型系列,并制定可持续的改进计划。
英文摘要:
In this work, we share the insights for achieving state-of-the-art quality in our text-to-image anime image generative model, called Illustrious. To achieve high resolution, dynamic color range images, and high restoration ability, we focus on three critical approaches for model improvement. First, we delve into the significance of the batch size and dropout control, which enables faster learning of controllable token based concept activations. Second, we increase the training resolution of images, affecting the accurate depiction of character anatomy in much higher resolution, extending its generation capability over 20MP with proper methods. Finally, we propose the refined multi-level captions, covering all tags and various natural language captions as a critical factor for model development. Through extensive analysis and experiments, Illustrious demonstrates state-of-the-art performance in terms of animation style, outperforming widely-used models in illustration domains, propelling easier customization and personalization with nature of open source. We plan to publicly release updated Illustrious model series sequentially as well as sustainable plans for improvements.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。