视频生成模型在地理上是否公平?一种以吸引力为中心的全球视觉知识评估
Are Video Generation Models Geographically Fair? An Attraction-Centric Evaluation of Global Visual Knowledge
AI总结:
本文通过GAP框架评估了文本到视频模型在地理公平性上的表现,发现模型在不同地区和文化群体中具有相对均匀的地理相关视觉知识,表明其在全球应用中的潜力。
摘要:
近年来,文本到视频生成技术取得了显著进展,产生了视觉上引人注目的结果,但尚不清楚这些模型是否编码了地理上公平的视觉知识。在本工作中,我们通过以吸引力为中心的评估方法,研究了文本到视频模型的地理公平性和地理相关的视觉知识。我们引入了Geo-Attraction Landmark Probing(GAP),一种系统框架,用于评估模型如何忠实合成来自不同地区的旅游景点,并构建了GEOATTRACTION-500基准,包含500个分布在全球的景点,涵盖各种地区和受欢迎程度水平。GAP集成了互补的度量标准,将整体视频质量与景点特定的知识分离,包括全局结构对齐、细粒度关键点对齐和视觉语言模型判断,所有度量标准均经过人类评估验证。将GAP应用于最先进的文本到视频模型Sora 2,我们发现,与常见的强地理偏见假设相反,该模型在不同地区、发展水平和文化群体中表现出相对均匀的地理相关视觉知识水平,仅对景点受欢迎程度有轻微依赖。这些结果表明,当前的文本到视频模型表达全球视觉知识比预期更均匀,突显了其在全球部署应用中的潜力,也强调了随着这些系统的发展,持续评估的必要性。
英文摘要:
Recent advances in text-to-video generation have produced visually compelling results, yet it remains unclear whether these models encode geographically equitable visual knowledge. In this work, we investigate the geo-equity and geographically grounded visual knowledge of text-to-video models through an attraction-centric evaluation. We introduce Geo-Attraction Landmark Probing (GAP), a systematic framework for assessing how faithfully models synthesize tourist attractions from diverse regions, and construct GEOATTRACTION-500, a benchmark of 500 globally distributed attractions spanning varied regions and popularity levels. GAP integrates complementary metrics that disentangle overall video quality from attraction-specific knowledge, including global structural alignment, fine-grained keypoint-based alignment, and vision-language model judgments, all validated against human evaluation. Applying GAP to the state-of-the-art text-to-video model Sora 2, we find that, contrary to common assumptions of strong geographic bias, the model exhibits a relatively uniform level of geographically grounded visual knowledge across regions, development levels, and cultural groupings, with only weak dependence on attraction popularity. These results suggest that current text-to-video models express global visual knowledge more evenly than expected, highlighting both their promise for globally deployed applications and the need for continued evaluation as such systems evolve.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。