ReX-Shot：基于几何与相机基础生成的单图像重摄影
ReX-Shot: Single-Image Rephotography via Geometry- and Camera-Grounded Generation
浏览论文内容
中文总结 AI 辅助
ReX-Shot是首个从单图像联合控制视点、焦距和摄影效果的统一生成框架，通过几何与相机基础生成技术实现更优性能与近实时交互性，解决了现有方法的多因素控制局限
中文摘要 AI 辅助
单图像重摄影旨在从单张参考图像合成指定视点、焦距和摄影效果的场景新视图，这些因素在成像过程中存在内在耦合关系。现有方法通常将这些因素分开处理，在联合控制时表现不佳：新视图合成在焦距变化下可能引入几何失真，而超分辨率和指令引导编辑仍局限于二维，无法可靠地将细节恢复或外观控制扩展到新视点。我们将这些限制归因于不完善的单图像三维重建以及连续焦距放大的采样限制。为减少几何误差带来的投影偏差，我们使用隐式变换的基础模型特征进行稳健的目标视图引导。我们进一步将焦距放大表述为几何引导的超分辨率问题，并利用生成细节先验恢复稀疏三维重采样过程中丢失的细节。基于这个三维感知生成骨干，我们将摄影效果控制从二维滤波提升到三维感知外观编辑，在视点和焦距之间保持内容一致性。这些组件构成了ReX-Shot，一个用于单图像重摄影的基于几何与相机基础的生成框架。据我们所知，ReX-Shot是首个从单图像联合控制视点、焦距和参数化摄影效果的统一框架。实验表明，ReX-Shot在所有三项控制任务上均优于代表性基线，同时支持近实时交互式重摄影。
英文摘要
Single-image rephotography aims to synthesize new shots of a scene from a single reference image with specified viewpoints, focal lengths, and photographic effects, which are intrinsically coupled in imaging. Existing methods typically treat these factors separately and struggle under joint control: novel-view synthesis may introduce geometric distortions under focal-length changes, while super-resolution and instruction-guided editing remain confined to 2D and cannot reliably extend detail restoration or appearance control to novel viewpoints. We attribute these limitations to imperfect single-image 3D reconstruction and the sampling limit of continuous focal-length enlargement. To reduce projection bias from geometric errors, we use implicitly transformed foundation-model features for robust target-view guidance. We further formulate focal-length enlargement as a geometry-guided super-resolution problem and exploit generative detail priors to recover details lost during sparse 3D resampling. Built on this 3D-aware generative backbone, we lift photographic-effect control from 2D filtering to 3D-aware appearance editing, preserving content consistency across viewpoints and focal lengths. These components form ReX-Shot, a geometry- and camera-grounded generative framework for single-image rephotography. To our knowledge, ReX-Shot is the first unified framework to jointly control viewpoint, focal length, and parameterized photographic effects from a single image. Experiments show that ReX-Shot outperforms representative baselines across all three controls while enabling near-real-time interactive rephotography.
发表机构
- School of Electronic Science and Engineering, Nanjing University（南京大学电子科学与工程学院）
- vivo Mobile Communication Co., Ltd.（维沃移动通信有限公司）
机构由 AI 辅助整理，请以论文原文为准。
