TransLight：基于生成解耦的图像引导定制化光照控制
TransLight: Image-Guided Customized Lighting Control with Generative Decoupling
AI总结：
针对现有光照编辑方法难以同时实现光照效果定制化控制与内容完整性保留的问题，提出TransLight框架，通过生成解耦分离内容与光照并构建百万级三元组数据集，结合IC-Light模型实现光照效果高保真转移，为光照编辑开辟新方向。
摘要：
大多数现有光照编辑方法无法同时提供光照效果的定制化控制和内容完整性保留，这使其在实际光照风格化需求中效果不佳，尤其是在将复杂光照效果从参考图像转移到用户指定目标图像这一具有挑战性的任务中。为解决该问题，我们提出TransLight，一种能实现光照效果高保真、高自由度转移的新型框架。从参考图像中提取光照效果是我们方法中最关键且最具挑战性的步骤，难点在于现实场景中光照效果所嵌入的复杂几何结构特征与内容高度耦合。为此，我们首先提出生成解耦（Generative Decoupling），使用两个微调的扩散模型精确分离图像内容与光照效果，生成新构建的百万级图像-内容-光照三元组数据集。然后，我们采用IC-Light作为生成模型，用三元组训练模型，并将参考光照图像作为额外条件信号注入。最终的TransLight模型可实现多样化光照效果的定制化自然转移。值得注意的是，通过彻底解耦参考图像中的光照效果，我们的生成解耦策略赋予TransLight高度灵活的光照控制能力。实验结果表明，TransLight是首个成功在不同图像间转移光照效果的方法，相比现有技术提供了更定制化的光照控制，并为光照协调与编辑研究开辟了新方向。
英文摘要：
Most existing illumination-editing approaches fail to simultaneously provide customized control of light effects and preserve content integrity. This makes them less effective for practical lighting stylization requirements, especially in the challenging task of transferring complex light effects from a reference image to a user-specified target image. To address this problem, we propose TransLight, a novel framework that enables high-fidelity and high-freedom transfer of light effects. Extracting the light effect from the reference image is the most critical and challenging step in our method. The difficulty lies in the complex geometric structure features embedded in light effects that are highly coupled with content in real-world scenarios. To achieve this, we first present Generative Decoupling, where two fine-tuned diffusion models are used to accurately separate image content and light effects, generating a newly curated, million-scale dataset of image-content-light triplets. Then, we employ IC-Light as the generative model and train our model with our triplets, injecting the reference lighting image as an additional conditioning signal. The resulting TransLight model enables customized and natural transfer of diverse light effects. Notably, by thoroughly disentangling light effects from reference images, our generative decoupling strategy endows TransLight with highly flexible illumination control. Experimental results establish TransLight as the first method to successfully transfer light effects across disparate images, delivering more customized illumination control than existing techniques and charting new directions for research in illumination harmonization and editing.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
