看得足够:为节能客户端渲染的非参考感知分辨率选择
Seeing enough: non-reference perceptual resolution selection for power-efficient client-side rendering
AI总结:
本文提出一种非参考方法,通过人类视觉系统的时空限制,预测渲染视频中可感知的最低分辨率,从而实现节能的客户端渲染。
摘要:
许多客户端应用,尤其是游戏,在受限制的设备上以高分辨率和帧率渲染视频,即使用户感知不到额外像素的好处。现有感知视频质量度量标准可以指示较低分辨率是否足够好,但它们是全参考且计算成本高,不适合实际应用和设备部署。本文利用人类视觉系统的时空限制,提出一种非参考方法,仅通过渲染视频预测最低分辨率,使其在感知上与最佳可用选项无法区分,从而实现节能的客户端渲染。该方法不依赖特定编解码器,仅需对现有基础设施进行最小修改。网络在大量渲染内容上训练,这些内容标注有全参考感知视频质量度量标准。预测显著提升感知质量,同时大幅降低计算成本,表明了通往以感知为导向的节能客户端渲染的可行路径。
英文摘要:
Many client-side applications, especially games, render video at high resolution and frame rate on power-constrained devices, even when users perceive little or no benefit from all those extra pixels. Existing perceptual video quality metrics can indicate when a lower resolution is "good enough", but they are full-reference and computationally expensive, making them impractical for real-world applications and deployment on-device. In this work, we leverage the spatio-temporal limits of the human visual system and propose a non-reference method that predicts, from the rendered video alone, the lowest resolution that remains perceptually indistinguishable from the best available option, enabling power-efficient client-side rendering. Our approach is codec-agnostic and requires only minimal modifications to existing infrastructure. The network is trained on a large dataset of rendered content labeled with a full-reference perceptual video quality metric. The prediction significantly enhances perceptual quality while substantially reducing computational costs, suggesting a practical path toward perception-guided, power-efficient client-side rendering.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。