超越像素差异：面向Web UI视觉回归测试的图像变化描述基准
Beyond Pixel Diffs: Benchmarking Image Change Captioning for Web UI Visual Regression Testing
AI总结：
针对Web UI视觉回归测试中像素级比较产生大量误报的问题，提出Web UI图像变化描述任务（WUICC）及其基准数据集WUICC-bench，评估了11种代表性方法，发现现有方法在Web UI领域表现不佳但能有效抑制视觉噪声。
摘要：
视觉回归测试（VRT）是现代软件发布流程中的标准质量保证步骤。每次变更时，它重新渲染用户界面（UI）截图，将每张截图与批准的基线图像进行比较，并将任何检测到的差异路由给人工审查员，由他们决定这是预期的更新还是意外的回归。一种广泛使用的方法（尤其是在开源和持续集成流程中）是像素级比较，该方法在语义上是盲目的，将渲染噪声和真正的缺陷同等对待，产生大量误报，迫使开发人员和测试人员在每个发布周期花费大量时间和精力手动审查标记的差异。工业工具将机器学习应用于VRT，但缺乏公开评估。更关键的是，目前没有数据集或基准支持UI变化的自然语言描述，这种能力可以用文字告诉测试人员发生了什么变化，而不是让他们解释二进制标志或高亮区域。为了解决这一空白，我们提出了一个新任务——Web UI图像变化描述（WUICC），它位于VRT和图像差异描述（IDC）的交汇处，并发布了该任务的第一个数据集和基准WUICC-bench。我们评估了11种代表性的IDC方法，以及两种零样本通用大语言模型。我们发现：（1）由于Web UI领域的布局多样性、密集文本和细粒度变化，这些方法往往难以应对；（2）然而，训练过的方法已经比VRT依赖的像素级比较更选择性地抑制了非有意义的视觉噪声，为未来的领域特定研究提供了坚实基础。
英文摘要：
Visual regression testing (VRT) is a standard quality assurance step in modern software release pipelines. On every change, it re-renders user interface (UI) screenshots, compares each one against an approved baseline image, and routes any detected difference to a human reviewer who decides whether it is an intended update or an unintended regression. A widely used approach, especially in open-source and continuous-integration pipelines, is pixel-level comparison, which is semantically blind and treats rendering noise and genuine defects identically, producing large volumes of false positives that force developers and testers to spend substantial time and effort manually reviewing flagged differences at every release cycle. Industry tools apply machine learning to VRT, but lack public evaluation. More critically, no dataset or benchmark exists to support natural language descriptions of UI changes, a capability that tells testers what changed in words instead of leaving them to interpret a binary flag or a highlighted region. To address the gap, we propose a new task, Web UI Image Change Captioning (WUICC), which sits at the intersection of VRT and image difference captioning (IDC), and release WUICC-bench, its first dataset and benchmark for the task. We evaluate eleven representative IDC methods, together with two zero-shot general-purpose LLMs. We find that: (1) these methods tend to struggle in the Web UI domain due to its layout diversity, dense text, and fine-grained changes, and (2) yet the trained methods already suppress non-meaningful visual noise far more selectively than the pixel-level comparison VRT relies on, providing a solid foundation for future domain-specific research.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
