Omnidirectional images (also referred to as static 360° panoramas) impose viewing conditions much different from those of regular 2D images. How do humans perceive image distortions in immersive virtual reality (VR) environments is an important problem which receives less attention. We argue that, apart from the distorted panorama itself, two types of VR viewing conditions are crucial in determining the viewing behaviors of users and the perceived quality of the panorama: the starting point and the exploration time. We first carry out a psychophysical experiment to investigate the interplay among the VR viewing conditions, the user viewing behaviors, and the perceived quality of 360° images. Then, we provide a thorough analysis of the collected human data, leading to several interesting findings. Moreover, we propose a computational framework for objective quality assessment of 360° images, embodying viewing conditions and behaviors in a delightful way. Specifically, we first transform an omnidirectional image to several video representations using different user viewing behaviors under different viewing conditions. We then leverage advanced 2D full-reference video quality models to compute the perceived quality. We construct a set of specific quality measures within the proposed framework, and demonstrate their promises on three VR quality databases.
Perceptual Depth Quality Assessment of Stereoscopic Omnidirectional Images
School of Computer Science and Informatics, Cardiff University(卡迪夫大学计算机科学与信息学院);Department of Electrical and Computer Engineering, University of Waterloo(滑铁卢大学电气与计算机工程系)
Multitask Auxiliary Network for Perceptual Quality Assessment of Non-Uniformly Distorted Omnidirectional Images
School of Computing and Artificial Intelligence, Jiangxi University of Finance and Economics(江西财经大学计算与人工智能学院);Jiangxi Provincial Key Laboratory of Multimedia Intelligent Processing(江西省多媒体智能处理重点实验室);Harvard Medical School, Harvard University(哈佛大学医学院)
Pseudocylindrical Convolutions for Learned Omnidirectional Image Compression
University of Science and Technology of China(中国科学技术大学);City University of Hong Kong(香港城市大学);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳市人工智能与机器人研究院)
Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessment
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);The University of Tokyo(东京大学);University of Maryland, College Park(马里兰大学帕克分校);Pingan Group(平安集团)
Subjective and Objective Quality Assessment of Non-Uniformly Distorted Omnidirectional Images
School of Computing and Artificial Intelligence, Jiangxi University of Finance and Economics(江西财经大学计算与人工智能学院);Harvard Medical School, Harvard University(哈佛大学医学院)