LSReGen:基于反向引导框架的大规模区域生成器
LSReGen: Large-Scale Regional Generator via Backward Guidance Framework
AI总结:
针对可控图像生成中现有方法的局限,提出广义反向引导框架及LSReGen大规模布局到图像方法,实验证明其生成高质量且符合布局的图像,优于现有方法。
摘要:
近年来,AIGC(人工智能生成内容)技术的进步显著增强了大型文本到图像模型的能力。尽管有这些改进,可控图像生成仍然是一个挑战。当前的方法,如训练、前向引导和反向引导,存在明显的局限性。前两种方法要么需要大量的计算资源,要么产生次优的结果。第三种方法依赖于特定模型架构特有的现象,使其难以应用于大规模图像生成。为了解决这些问题,我们提出了一种新颖的可控生成框架,该框架在不依赖特定假设的情况下,对反向引导提供了广义的解释。利用这一框架,我们引入了LSReGen,一种大规模布局到图像的方法,旨在生成高质量、符合布局的图像。实验结果表明,LSReGen在大规模布局到图像任务中优于现有方法,凸显了我们所提出框架的有效性。我们的代码和模型将开源。
英文摘要:
In recent years, advancements in AIGC (Artificial Intelligence Generated Content) technology have significantly enhanced the capabilities of large text-to-image models. Despite these improvements, controllable image generation remains a challenge. Current methods, such as training, forward guidance, and backward guidance, have notable limitations. The first two approaches either demand substantial computational resources or produce subpar results. The third approach depends on phenomena specific to certain model architectures, complicating its application to large-scale image generation.To address these issues, we propose a novel controllable generation framework that offers a generalized interpretation of backward guidance without relying on specific assumptions. Leveraging this framework, we introduce LSReGen, a large-scale layout-to-image method designed to generate high-quality, layout-compliant images. Experimental results show that LSReGen outperforms existing methods in the large-scale layout-to-image task, underscoring the effectiveness of our proposed framework. Our code and models will be open-sourced.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。