在可视化的“英雄时代”，我们从评估中实际学到了什么？
What Do We Actually Learn from Evaluations in the "Heroic Era" of Visualization?
摘要：
我们经常指出，与该领域的早期相比，可视化系统评估的数量和复杂性相对增加，作为我们作为一个领域正在成熟的证据。我不太相信。特别是，我觉得，可视化的评估，因为他们通常在现场执行或要求由审查员，没有告诉我们很多是有用的或可转让的可视化系统，无论统计的严谨性或生态有效性的评估。通过一系列的思想实验，我展示了我们目前的可视化评估的概念是如何不完整的，反复无常的，或者对于进一步发展该领域的目标是无用的，更符合医学科学的“英雄时代”，而不是我们可能渴望成为的严格的循证领域。最后，我建议重新审视我们设计评价的模式以及我们作为一个领域的优先事项。
英文摘要：
We often point to the relative increase in the amount and sophistication of evaluations of visualization systems versus the earliest days of the field as evidence that we are maturing as a field. I am not so convinced. In particular, I feel that evaluations of visualizations, as they are ordinarily performed in the field or asked for by reviewers, fail to tell us very much that is useful or transferable about visualization systems, regardless of the statistical rigor or ecological validity of the evaluation. Through a series of thought experiments, I show how our current conceptions of visualization evaluations can be incomplete, capricious, or useless for the goal of furthering the field, more in line with the "heroic age" of medical science than the rigorous evidence-based field we might aspire to be. I conclude by suggesting that our models for designing evaluations, and our priorities as a field, should be revisited.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
