UniTele:学习设备相关退化以实现统一的智能手机长焦超分辨率
UniTele: Learning Device-Conditioned Degradations for Unified Smartphone Telephoto Super-Resolution
AI总结:
本研究提出UniTele模型,通过学习设备特定退化并合成额外训练对,解决手机超长焦成像的设备依赖退化问题,提升超分辨率恢复的保真度与稳定性。
摘要:
手机的超长焦成像存在复杂且依赖设备的退化问题,传统手工设计的流程难以有效捕捉这类退化。然而,收集不同手机和多样场景下的大规模对齐训练对既成本高昂又难以扩展。因此,本研究探讨能否仅通过少量物理拍摄样本学习设备特定的退化,并将其迁移用于训练统一的超分辨率(SR)模型。核心思路是将退化学习分解为两个可学习组件:一个捕捉高分辨率条件下设备特定的成像特性,另一个捕捉超长焦成像中产生的额外信息损失与伪影。我们通过拍摄相同内容在两种显示尺寸和变焦设置下的图像,构建了涵盖华为、苹果、vivo三个手机品牌的配对基准:较大的显示图像在手机最大光学变焦设置下拍摄,较小的图像则通过手机原生成像管线直接在最高原生变焦设置下拍摄。该基准包含519个训练对和60个保留对。我们利用该基准学习设备特定退化,再将其应用于外部图像以合成数千个额外配对,用于训练UniTele SR模型。与适配前的预训练Qwen和FLUX骨干网络相比,完整的UniTele训练方案在保留基准上显著提升了配对恢复保真度与感知相似度,且生成的恢复结果更稳定、视觉上更忠实。
英文摘要:
Super-telephoto imaging on mobile phones suffers from complex, device-dependent degradations that are poorly captured by conventional handcrafted pipelines. Collecting large-scale aligned training pairs across different phones and diverse scenes, however, is both costly and difficult to scale. We therefore study whether device-specific degradations can be learned from only a small number of physical captures and transferred for training a unified super-resolution (SR) model. Our key idea is to factor degradation learning into two learnable components: one captures the device-specific imaging characteristics under well-resolved conditions, while the other captures the additional information loss and artifacts that arise in super-telephoto imaging. We build a paired benchmark across three phone brands (Huawei, Apple, and vivo) by photographing the same content at two display sizes and zoom settings. The larger displayed image is captured at the phone's maximum optical zoom setting, while the smaller image is photographed directly at the phone's highest native zoom setting through the phone's native imaging pipeline. The benchmark contains 519 training and 60 held-out pairs. We use the benchmark to learn device-specific degradation, then apply it to external images to synthesize thousands of additional pairs to train our UniTele SR model. Relative to the pretrained Qwen and FLUX backbones before adaptation, the full UniTele training recipe substantially improves paired restoration fidelity and perceptual similarity on the held-out benchmark and yields markedly more stable and visually faithful restorations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。