This paper presents a new deep-learning based method to simultaneously calibrate the intrinsic parameters of fisheye lens and rectify the distorted images. Assuming that the distorted lines generated by fisheye projection should be straight after rectification, we propose a novel deep neural network to impose explicit geometry constraints onto processes of the fisheye lens calibration and the distorted image rectification. In addition, considering the nonlinearity of distortion distribution in fisheye images, the proposed network fully exploits multi-scale perception to equalize the rectification effects on the whole image. To train and evaluate the proposed model, we also create a new largescale dataset labeled with corresponding distortion parameters and well-annotated distorted lines. Compared with the state-of-the-art methods, our model achieves the best published rectification quality and the most accurate estimation of distortion parameters on a large set of synthetic and real fisheye images.
Dual Diffusion Architecture for Fisheye Image Rectification: Synthetic-to-Real Generalization
Institute of Information Science, Beijing Jiaotong University（北京交通大学信息科学研究所）；Beijing Key Laboratory of Advanced Information Science and Network（北京先进信息科学与网络重点实验室）
FishEyeRecNet: A Multi-Context Collaborative Deep Network for Fisheye Image Rectification
University of Sydney（悉尼大学）；National University of Defense Technology（国防科技大学）；Stevens Institute of Technology（斯蒂文斯理工学院）；Hangzhou Dianzi University（杭州电子科技大学）
SimFIR: A Simple Framework for Fisheye Image Rectification with Self-supervised Representation Learning
University of Science and Technology of China（中国科学技术大学）；Zhangjiang Laboratory（张江实验室）；The University of Sydney（悉尼大学）；Hefei Comprehensive National Science Center（合肥综合性国家科学中心）
提出 SimFIR 自监督框架，利用 ViT 图像块表示与统一畸变感知预训练任务学习细粒度畸变特征，从而提升鱼眼图像校正性能和真实场景泛化能力。
Spatiotemporal Deformation Perception for Fisheye Video Rectification
Institute of Information Science, Beijing Jiaotong University（北京交通大学信息科学研究所）；Beijing Key Laboratory of Advanced Information Science and Network（北京先进信息科学与网络重点实验室）
Location-guided Head Pose Estimation for Fisheye Image
School of Electronics and Information Technology, Sun Yat-sen University（中山大学电子与信息工程学院）；Data Science Research Center, Duke Kunshan University（昆山杜克大学数据科学研究中心）；Brigham Young University（杨百翰大学）
A Deep Ordinal Distortion Estimation Approach for Distortion Rectification
Institute of Information Science, Beijing Jiaotong University（北京交通大学信息科学研究所）；Beijing Key Laboratory of Advanced Information Science and Network Technology（先进信息科学与网络技术北京市重点实验室）
HyperErase: Scale-Calibrated Hypernetwork for Multi-Concept Erasure in Text-to-Image Models
Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳））；Jilin University（吉林大学）；Tsinghua Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；South China University of Technology（华南理工大学）；Peng Cheng Laboratory（鹏城实验室）
