智能手机相机对的一键式全焦点照片合成
Point-and-Shoot All-in-Focus Photo Synthesis from Smartphone Camera Pair
AI总结：
本文提出EasyAIF方法，首次利用智能手机主摄与超广角相机单次拍摄实现全焦点照片合成，通过预测-优化网络和动态频域对齐解决视差遮挡与颜色不一致问题，并构建了包含2686个场景的数据集以验证其优越性能。
摘要：
全焦点（AIF）摄影有望成为现代智能手机的商业卖点。标准的AIF合成需要手动、耗时的操作，例如焦点堆叠合成，这对普通用户并不友好。为了实现智能手机上的一键式AIF摄影，我们希望AIF照片能够从场景的单次拍摄中生成，而不是由同一相机拍摄的多张照片合成。受益于现代智能手机中的多摄像头模块，我们引入了一项新任务：利用主摄（广角）和超广角相机进行AIF合成。其目标是借助超广角相机拍摄的照片，恢复主摄照片中离焦区域的清晰细节。该相机设置带来了新的挑战，例如视差引起的遮挡以及相机之间颜色不一致。为克服这些挑战，我们引入了一个预测-优化网络来缓解遮挡，并提出了用于颜色校正的动态频域对齐方法。为了实现有效的训练和评估，我们还构建了一个包含2686个独特场景的AIF数据集。每个场景包含两张由主摄拍摄的照片、一张由超广角相机拍摄的照片以及一张合成的AIF照片。结果表明，我们命名为EasyAIF的解决方案能够生成高质量的AIF照片，并在定量和定性评估中均优于强基线方法。我们首次成功展示了利用主摄和超广角相机实现一键式AIF照片合成。
英文摘要：
All-in-Focus (AIF) photography is expected to be a commercial selling point for modern smartphones. Standard AIF synthesis requires manual, time-consuming operations such as focal stack compositing, which is unfriendly to ordinary people. To achieve point-and-shoot AIF photography with a smartphone, we expect that an AIF photo can be generated from one shot of the scene, instead of from multiple photos captured by the same camera. Benefiting from the multi-camera module in modern smartphones, we introduce a new task of AIF synthesis from main (wide) and ultra-wide cameras. The goal is to recover sharp details from defocused regions in the main-camera photo with the help of the ultra-wide-camera one. The camera setting poses new challenges such as parallax-induced occlusions and inconsistent color between cameras. To overcome the challenges, we introduce a predict-and-refine network to mitigate occlusions and propose dynamic frequency-domain alignment for color correction. To enable effective training and evaluation, we also build an AIF dataset with 2686 unique scenes. Each scene includes two photos captured by the main camera, one photo captured by the ultrawide camera, and a synthesized AIF photo. Results show that our solution, termed EasyAIF, can produce high-quality AIF photos and outperforms strong baselines quantitatively and qualitatively. For the first time, we demonstrate point-and-shoot AIF photo synthesis successfully from main and ultra-wide cameras.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
