Bjøntegaard 圣经——为什么你比较视频编解码器的方式可能是错误的
The Bjøntegaard Bible -- Why your Way of Comparing Video Codecs May Be Wrong
AI总结:
本文深入评估 Bjøntegaard Delta 计算,发现其在标准率失真比较中误差低,但在 VMAF、能耗等场景误差高,并提出使用建议以最大化 BD 值有效性。
摘要:
在本文中,我们对 Bjøntegaard Delta 进行了深入评估。我们构建了一个大型视频压缩性能比较数据集,使用了包括 PSNR、VMAF、比特率和处理能耗在内的多种指标。这些指标针对经典透视视频、360°视频、点云和屏幕内容等视觉数据类型进行评估。作为压缩技术,我们考虑了多种混合视频编解码器以及最先进的基于神经网络的压缩方法。通过在由量化参数等参数定义的标准点之间使用额外的支撑点,我们评估了 Bjøntegaard-Delta (BD) 计算的插值误差及其对最终 BD 值的影响。通过分析,我们发现 BD 计算在率失真比较的标准应用中最为准确,平均误差低于 0.5 个百分点。对于其他应用和特殊情况,例如 VMAF 质量、能耗考虑或编解码器间比较,误差更高(高达 5 个百分点),但可以通过使用更多数量的支撑点将误差减半。我们最终提出了关于如何使用 BD 计算以最大化所得 BD 值有效性的建议。主要建议如下:第一,应绘制并分析相对曲线差异。第二,对于 SSIM 和 VMAF 等饱和指标,应使用对数域。第三,低于由子集误差指示的特定阈值的 BD 值不应用于得出建议。第四,使用两个支撑点足以获得粗略的性能估计。
英文摘要:
In this paper, we provide an in-depth assessment on the Bjøntegaard Delta. We construct a large data set of video compression performance comparisons using a diverse set of metrics including PSNR, VMAF, bitrate, and processing energies. These metrics are evaluated for visual data types such as classic perspective video, 360$^\circ$ video, point clouds, and screen content. As compression technology, we consider multiple hybrid video codecs as well as state-of-the-art neural network based compression methods. Using additional supporting points inbetween standard points defined by parameters such as the quantization parameter, we assess the interpolation error of the Bjøntegaard-Delta (BD) calculus and its impact on the final BD value. From the analysis, we find that the BD calculus is most accurate in the standard application of rate-distortion comparisons with mean errors below 0.5 percentage points. For other applications and special cases, e.g., VMAF quality, energy considerations, or inter-codec comparisons, the errors are higher (up to 5 percentage points), but can be halved by using a higher number of supporting points. We finally come up with recommendations on how to use the BD calculus such that the validity of the resulting BD-values is maximized. Main recommendations are as follows: First, relative curve differences should be plotted and analyzed. Second, the logarithmic domain should be used for saturating metrics such as SSIM and VMAF. Third, BD values below a certain threshold indicated by the subset error should not be used to draw recommendations. Fourth, using two supporting points is sufficient to obtain rough performance estimates.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。