arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.22607cs.CV
收藏

LoR-LUT: 通过低秩残差学习紧凑的3D查找表

LoR-LUT: Learning Compact 3D Lookup Tables via Low-Rank Residuals

The University of Texas at Austin(德克萨斯大学奥斯汀分校);Austin, TX, USA(美国德克萨斯州奥斯汀)

Ziqi Zhao, Abhijit Mishra, Shounak Roychowdhury

AI总结:

LoR-LUT通过低秩残差学习紧凑3D查找表,提升图像感知质量并实现高效可解释的图像增强与风格迁移。

摘要:

我们提出了LoR-LUT,一种统一的低秩公式,用于生成紧凑且可解释的3D查找表(LUT)。与传统基于3D-LUT的技术不同,后者通常依赖于基底LUT的融合,而我们的统一方法通过联合使用残差校正(实际上是低秩张量)和一组基底LUTs来扩展当前框架。本文描述的方法提高了图像的现有感知质量,这主要归功于该技术对残差校正的创新使用。同时,我们通过显著减少网络、残差校正和LUT参数的数量,实现了相同的三线性插值复杂度。从LoR-LUT在MIT-Adobe FiveK数据集上训练得到的实验结果来看,它能够以高感知保真度和亚兆字节的模型大小重现专家级别的修图特征。此外,我们引入了一个交互式可视化工具,称为LoR-LUT查看器,它通过一系列滑动条控制不同参数,将输入图像转换为LUT调整的输出图像。该工具提供了一种有效的方法来增强可解释性和用户对视觉结果的信心。总体而言,我们提出的方法为未来的基于LUT的图像增强和风格迁移提供了一种紧凑、可解释且高效的方向。

英文摘要:

We present LoR-LUT, a unified low-rank formulation for compact and interpretable 3D lookup table (LUT) generation. Unlike conventional 3D-LUT-based techniques that rely on fusion of basis LUTs, which are usually dense tensors, our unified approach extends the current framework by jointly using residual corrections, which are in fact low-rank tensors, together with a set of basis LUTs. The approach described here improves the existing perceptual quality of an image, which is primarily due to the technique's novel use of residual corrections. At the same time, we achieve the same level of trilinear interpolation complexity, using a significantly smaller number of network, residual corrections, and LUT parameters. The experimental results obtained from LoR-LUT, which is trained on the MIT-Adobe FiveK dataset, reproduce expert-level retouching characteristics with high perceptual fidelity and a sub-megabyte model size. Furthermore, we introduce an interactive visualization tool, termed LoR-LUT Viewer, which transforms an input image into the LUT-adjusted output image, via a number of slidebars that control different parameters. The tool provides an effective way to enhance interpretability and user confidence in the visual results. Overall, our proposed formulation offers a compact, interpretable, and efficient direction for future LUT-based image enhancement and style transfer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑