arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.18596cs.CV
收藏

LatentCRF:用于高效潜在扩散的连续CRF

LatentCRF: Continuous CRF for Efficient Latent Diffusion

Google Research(谷歌研究院);Stony Brook University(石溪大学)

Kanchana Ranasinghe, Sadeep Jayasumana, Andreas Veit, Ayan Chakrabarti, Daniel Glasner, Michael S Ryoo, Srikumar Ramalingam, Sanjiv Kumar

AI总结:

针对LDM多次推理迭代导致延迟的问题,提出作为神经网络层的连续CRF模型LatentCRF,通过建模潜在向量间关系替代部分计算密集的推理迭代,在无质量和多样性损失下将推理效率提升33%,且无需修改原LDM。

摘要:

Latent Diffusion Models (LDMs)(潜在扩散模型)能生成高质量、逼真的图像,然而,多次高昂的计算推理迭代所产生的延迟会限制其适用性。我们引入了LatentCRF,这是一种连续Conditional Random Field (CRF)(条件随机场)模型,作为神经网络层实现,用于建模LDM中潜在向量间的空间和语义关系。通过用我们轻量级的LatentCRF替代部分计算密集的LDM推理迭代,我们在质量、速度和多样性之间实现了更优的平衡。与完整的LDM相比,我们将推理效率提高了33%,且图像质量或多样性没有损失。LatentCRF是一个易于使用的附加组件,不需要修改LDM。

英文摘要:

Latent Diffusion Models (LDMs) produce high-quality, photo-realistic images, however, the latency incurred by multiple costly inference iterations can restrict their applicability. We introduce LatentCRF, a continuous Conditional Random Field (CRF) model, implemented as a neural network layer, that models the spatial and semantic relationships among the latent vectors in the LDM. By replacing some of the computationally-intensive LDM inference iterations with our lightweight LatentCRF, we achieve a superior balance between quality, speed and diversity. We increase inference efficiency by 33% with no loss in image quality or diversity compared to the full LDM. LatentCRF is an easy add-on, which does not require modifying the LDM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑