arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.13412cs.CV

TextVBench:视频生成中文本渲染与保留能力的评估

TextVBench: Evaluating Text Rendering and Preservation in Video Generation

University of Science and Technology of China(中国科学技术大学)

Ruiqiang Zhang, Hengyi Wang, Chang Liu, Guanjie Wang, Zehua Ma, Weiming Zhang

AI总结:

研究针对视频生成中文本渲染与保留的评估难题,提出TextVBench基准框架,含两个互补任务,经评估MiniMax-H3等模型,发现参考文本区域增多时性能显著下降。

摘要:

现代视频生成模型能够合成逼真场景,但存在字符渲染错误、遗漏请求文本或跨帧文本变更的问题。测量这些缺陷比单独对每一帧应用OCR更困难:当场景包含多个文本目标和多个带噪声的OCR区域时,评估器必须先确定哪个观测对应哪个预期文本。我们提出TextVBench,这是一个将视觉-文本评估建模为多目标、多实例时空对应问题的基准与评估框架。TextVBench包含两个互补任务:TextVBench-T2V测量提示指定文本的生成与维持,TextVBench-Ref2V测量参考图像中文本的保留。两个任务均采用目标条件候选选择而非无约束VLM转录,支持一个目标映射到多个OCR区域,并将帧级空间保真度与跨帧时间保真度分离。长度加权调和分数汇总这些因素,而额外文本诊断则揭示单一OCR分数所隐藏的失败模式。该基准围绕受控文本、布局、载体和运动属性组织,以便将聚合分数追溯到特定能力限制。在评估的模型运行中,MiniMax-H3的T2V TextVScore达到68.32,最强的Ref2V分数为56.51;属性切片显示,随着同时参考文本区域数量增加,分数出现显著下降。

英文摘要:

Modern video generators can synthesize convincing scenes while rendering a few characters incorrectly, omitting requested text, or changing it across frames. Measuring these failures is harder than applying OCR independently to each frame: when a scene contains multiple text targets and multiple noisy OCR regions, the evaluator must first determine which observation belongs to which intended text. We introduce TextVBench, a benchmark and evaluation framework that formulates visual-text evaluation as a multi-target, multi-instance spatiotemporal correspondence problem. TextVBench contains two complementary tracks: TextVBench-T2V measures the creation and maintenance of prompt-specified text, while TextVBench-Ref2V measures preservation of text from reference images. Both tracks use target-conditioned candidate selection rather than unconstrained VLM transcription, support one target mapping to multiple OCR regions, and separate frame-level spatial fidelity from cross-frame temporal fidelity. A length-weighted harmonic score summarizes these factors, while extra-text diagnostics expose failure modes hidden by a single OCR score. The benchmark is organized around controlled text, layout, carrier, and motion attributes so that aggregate scores can be traced back to specific capability limits. Across the evaluated model runs, MiniMax-H3 reaches a T2V TextVScore of 68.32, while the strongest Ref2V score is 56.51; attribute slices reveal a pronounced drop as the number of simultaneous reference text regions increases.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑