最佳与所有:标准化考试成绩报告的公平性和准确性
Best vs. All: Equity and Accuracy of Standardized Test Score Reporting
摘要:
我们研究了一个大学招生标准化考试的博弈模型。学生有两种类型:高和低。有一所大学想招收高类型的学生。学生们参加一个潜在的昂贵的标准化考试,提供了一个嘈杂的信号,他们的类型。这些学生来自两个人口群体,这两个群体在天赋方面相同(即类型分布相同),但在获得资源方面不同:资源较高的人口可以选择参加多次考试,而资源较低的人口只能参加一次考试。我们研究了两种模型的成绩报告,捕捉现有的政策所使用的高校。第一个政策(有时被称为“超级得分”)允许学生报告他们获得的最大分数。另一项政策要求报告所有分数。我们发现,在我们的模型中,要求所有分数都被报告的结果在均衡中是优越的,无论是从大学的角度来看(录取规则更准确),还是从人口公平的角度来看:学生的录取概率与他们的人口无关,取决于他们的类型。特别是,假阳性率和假阴性率在这种情况下是相同的,在高度和资源不足的学生群体。尽管根据这一政策,资源较多的学生可以-根据自己的选择-报告其类型的更准确的信号,或者与资源较少的人口合并,但情况仍然如此。
英文摘要:
We study a game theoretic model of standardized testing for college admissions. Students are of two types; High and Low. There is a college that would like to admit the High type students. Students take a potentially costly standardized exam which provides a noisy signal of their type. The students come from two populations, which are identical in talent (i.e. the type distribution is the same), but differ in their access to resources: the higher resourced population can at their option take the exam multiple times, whereas the lower resourced population can only take the exam once. We study two models of score reporting, which capture existing policies used by colleges. The first policy (sometimes known as "super-scoring") allows students to report the max of the scores they achieve. The other policy requires that all scores be reported. We find in our model that requiring that all scores be reported results in superior outcomes in equilibrium, both from the perspective of the college (the admissions rule is more accurate), and from the perspective of equity across populations: a student's probability of admission is independent of their population, conditional on their type. In particular, the false positive rates and false negative rates are identical in this setting, across the highly and poorly resourced student populations. This is the case despite the fact that the more highly resourced students can -- at their option -- either report a more accurate signal of their type, or pool with the lower resourced population under this policy.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。