发表机构
The Chinese University of Hong Kong（香港中文大学）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本研究审计文本到3D评估中配置变化对排行榜的影响，发现多数评估器的配置方差超过生成器间方差，获胜者变化多为描述性而非确认性，建议报告协议依赖的比较与不确定性。
AI 中文摘要
当每个生成的场景保持不变时，文本到3D排行榜会发生变化吗？我们针对渲染图像评估审计了这一问题，其中相机设置和标题措辞成为测量协议的一部分。在来自六个生成器的300个冻结场景中，我们为19个对齐评估器加上一个感知质量对照，变化了八个渲染和标题因素，然后测试了四种针对性的场景退化。峰值配置方差超过了17/19个对齐评估器的生成器间方差，其中11/19的提示自举下限高于1。排名比分数更稳定，但18/19个评估器在某些配置下改变了其点估计获胜者。成对协议余量包络显示了哪些比较在测试设置中保持其方向。选定的配对具有相反的点态区间，但在完整搜索的同步推断下，没有反转能够幸存。因此，观察到的获胜者变化是描述性的，而非生成器优势的确认性变化。敏感性仍然独立：没有评估器，甚至无提示对照，在布局打乱上超过67%的平局调整方向判别率，这仅是诊断性的而非人类验证的真实基准。该审计区分了分数稳定性、决策不确定性和针对性敏感性，并建议报告（生成器、分数、卡片ID）以及依赖协议的比较和选择感知的不确定性。
英文摘要
Can a text-to-3D leaderboard change when every generated scene stays fixed? We audit this question for rendered-image evaluation, where camera settings and caption wording become part of the measurement protocol. Across 300 frozen scenes from six generators, we vary eight render and caption factors for 19 alignment evaluators plus one perceptual-quality control, then test four targeted scene degradations. Peak configuration variance exceeds between-generator variance for 17/19 alignment evaluators, with prompt-bootstrap lower bounds above 1 for 11/19. Rankings are more stable than scores, yet 18/19 evaluators change their point-estimate winner under some configuration. Pairwise protocol margin envelopes show which comparisons keep their direction across the tested settings. Selected pairs have opposite pointwise intervals, but no reversal survives simultaneous inference over the full search. Thus the observed winner changes are descriptive, not confirmed changes in generator superiority. Sensitivity remains separate: no evaluator, even the prompt-free control, exceeds 67% tie-adjusted directional discrimination on layout scrambling, which is diagnostic rather than human-validated ground truth. The audit separates score stability, decision uncertainty, and targeted sensitivity, and recommends reporting (generator, score, card ID) with protocol-dependent comparisons and selection-aware uncertainty.
Comments26 pages, 6 figures
