Training autonomous vehicles requires lots of driving sequences in all situations\cite{zhao2016}. Typically a simulation environment (software-in-the-loop, SiL) accompanies real-world test drives to systematically vary environmental parameters. A missing piece in the optical model of those SiL simulations is the sharpness, given in linear system theory by the point-spread function (PSF) of the optical system. We present a novel numerical model for the PSF of an optical system that can efficiently model both experimental measurements and lens design simulations of the PSF. The numerical basis for this model is a non-linear regression of the PSF with an artificial neural network (ANN). The novelty lies in the portability and the parameterization of this model, which allows to apply this model in basically any conceivable optical simulation scenario, e.g. inserting a measured lens into a computer game to train autonomous vehicles. We present a lens measurement series, yielding a numerical function for the PSF that depends only on the parameters defocus, field and azimuth. By convolving existing images and videos with this PSF model we apply the measured lens as a transfer function, therefore generating an image as if it were seen with the measured lens itself. Applications of this method are in any optical scenario, but we focus on the context of autonomous driving, where quality of the detection algorithms depends directly on the optical quality of the used camera system. With the parameterization of the optical model we present a method to validate the functional and safety limits of camera-based ADAS based on the real, measured lens actually used in the product.
Towards Blind Lens Aberration Correction via Large LensLib Pre-training and Discrete Degradation Priors
National Research Center for Optical Instrumentation, Zhejiang University(浙江省光学仪器研究中心,浙江大学);INSAIT, Sofia University "St. Kliment Ohridski"(INSAIT,索菲亚大学"圣克莱门特·欧弗里迪斯基");School of Artificial Intelligence and Robotics, Hunan University(人工智能与机器人学院,湖南大学);National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University(机器人视觉感知与控制技术国家工程研究中心,湖南大学)
Blind Ultrasound Image Enhancement via Self-Supervised Physics-Guided Degradation Modeling
Department of Computer Engineering, College of Computing and Mathematics, King Fahd University of Petroleum & Minerals (KFUPM)(计算机工程系,计算与数学学院,国王法赫德石油与矿物大学);SDAIA–KFUPM Joint Research Center for Artificial Intelligence (JRC-AI), King Fahd University of Petroleum & Minerals(人工智能联合研究中心(JRC-AI),国王法赫德石油与矿物大学);Department of Computer Science and Information Technology, Sir Syed University of Engineering and Technology (SSUET)(计算机科学与信息科技系,西德大学工程与技术学院);Digital Technology & Innovation Center, Siemens Healthineers, Princeton, NJ 08540, USA(数字技术与创新中心,西门子健康部,美国新泽西州普林斯顿);Department of Aerospace Engineering, King Fahd University of Petroleum & Minerals (KFUPM)(航空航天工程系,国王法赫德石油与矿物大学);Interdisciplinary Research Center for Smart Mobility and Logistics, King Fahd University of Petroleum & Minerals (KFUPM)(智能交通与物流跨学科研究中心,国王法赫德石油与矿物大学)
Large-FOV RGBD Imaging via Structured PSF Coding in a Bio-inspired Monocentric System
State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University(极端光物理与仪器国家重点实验室,浙江大学);DJI Technology Co. Ltd.(大疆科技有限公司);School of Artificial Intelligence and Robotics, Hunan University(人工智能与机器人学院,湖南大学);National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University(机器人视觉感知与控制技术国家工程研究中心,湖南大学)
POLISH'ing the Sky: Wide-Field and High-Dynamic Range Interferometric Image Reconstruction with Application to Strong Lens Discovery
Department of Computing and Mathematical Sciences, California Institute of Technology (Caltech), Pasadena, CA, USA(计算与数学科学系,加州理工学院(Caltech),帕萨迪纳,CA,美国);Center for Astrophysics ∣ \mid Harvard & Smithsonian, Cambridge, MA, USA(天体物理中心,哈佛与史密松尼天体物理研究中心,剑桥,MA,美国)