arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.13685cs.CV
收藏

生成艺术中的金融模型:受Black-Scholes启发的文本到图像扩散中的概念融合

Financial Models in Generative Art: Black-Scholes-Inspired Concept Blending in Text-to-Image Diffusion

University of Maryland(马里兰大学)

Divya Kothandaraman, Ming Lin, Dinesh Manocha

AI总结:

该研究提出一种受Black-Scholes金融模型启发的文本到图像扩散模型概念融合新方法,通过类比两领域变量、利用马尔可夫动力学,实现数据高效、无需额外训练的多提示交叉图像生成,在多场景下优于现有技术。

摘要:

我们提出了一种在预训练文本到图像扩散模型中进行概念融合的新方法,旨在生成多个文本提示交叉处的图像。在扩散去噪的每个时间步,我们的算法预测生成图像的相关结果,并做出知情的文本条件决策。我们方法的核心是扩散模型(植根于非平衡热力学)与金融期权定价的Black-Scholes模型之间的独特类比。通过在两个领域的关键变量间建立平行关系,我们基于Black-Scholes框架的马尔可夫动力学推导出一种鲁棒的概念融合算法。我们的基于文本的概念融合算法具有数据高效性,无需额外训练,且无需人工干预或超参数调整。通过在单对象/多对象/背景对象等场景下与线性插值、交替提示、分步提示切换和CLIP引导提示选择等技术进行定性定量对比,我们的工作表明金融启发技术可增强生成式AI中的文本到图像概念融合,为更广泛的创新铺路。代码可在https://github.com/divyakraman/BlackScholesDiffusion2024获取。

英文摘要:

We introduce a novel approach for concept blending in pretrained text-to-image diffusion models, aiming to generate images at the intersection of multiple text prompts. At each time step during diffusion denoising, our algorithm forecasts predictions w.r.t. the generated image and makes informed text conditioning decisions. Central to our method is the unique analogy between diffusion models, which are rooted in non-equilibrium thermodynamics, and the Black-Scholes model for financial option pricing. By drawing parallels between key variables in both domains, we derive a robust algorithm for concept blending that capitalizes on the Markovian dynamics of the Black-Scholes framework. Our text-based concept blending algorithm is data-efficient, meaning it does not need additional training. Furthermore, it operates without human intervention or hyperparameter tuning. We highlight the benefits of our approach by comparing it qualitatively and quantitatively to other text based concept blending techniques, including linear interpolation, alternating prompts, step-wise prompt switching, and CLIP-guided prompt selection across various scenarios such as single object per text prompt, multiple objects per text prompt and objects against backgrounds. Our work shows that financially inspired techniques can enhance text-to-image concept blending in generative AI, paving the way for broader innovation. Code is available at https://github.com/divyakraman/BlackScholesDiffusion2024.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑