arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.08889stat.AP
收藏

美国能源部-美国联邦调查局研究中重复性和再现性的再分析

A Re-analysis of Repeatability and Reproducibility in the Ames-USDOE-FBI Study

Alan H. Dorfman, Richard Valliant

摘要:

法医火器鉴定,即由受过训练的火器检验员确定子弹或弹药筒是否来自普通武器,长期以来一直是刑事法院的支柱。法医枪支鉴定的可靠性在一般科学界受到质疑,为此进行了几项研究,旨在表明枪支检查是准确的,即错误率低。较少研究的是一致性问题,。无论是由一名检验员在不同场合对同一子弹或弹壳进行的两次检验得出相同的结论-相互间的可靠性或重复性-还是由两名检验员进行的-相互间的可靠性或重复性。在2020年美国埃姆斯实验室向联邦调查局提交的一份报告中,描述了一项重要的研究,该研究超越了对准确性的考虑,调查了枪支检查的重复性和再现性。报告的结论自相矛盾。所观察到的考官与自己或与其他考官的一致性似乎一般。然而,该研究得出的结论是重复性和再现性令人满意,因为观察到的一致性超过了称为预期一致性的数量。我们发现,适当地采用预期的协议,因为它的目的并不意味着令人满意的重复性和再现性,而是相反。

英文摘要:

Forensic firearms identification, the determination by a trained firearms examiner as to whether or not bullets or cartridges came from a common weapon, has long been a mainstay in the criminal courts. Reliability of forensic firearms identification has been challenged in the general scientific community, and, in response, several studies have been carried out aimed at showing that firearms examination is accurate, that is, has low error rates. Less studied has been the question of consistency, of. whether two examinations of the same bullets or cartridge cases come to the same conclusion, carried out by an examiner on separate occasions -- intrarater reliability or repeatability -- or by two examiners -- interrater reliability or reproducibility. One important study, described in a 2020 Report by the Ames Laboratory-USDOE to the Federal Bureau of Investigation, went beyond considerations of accuracy to investigate firearms examination repeatability and reproducibility. The Report's conclusions were paradoxical. The observed agreement of examiners with themselves or with other examiners appears mediocre. However, the study concluded repeatability and reproducibility are satisfactory, on grounds that the observed agreement exceeds a quantity called the expected agreement. We find that appropriately employing expected agreement as it was intended does not suggest satisfactory repeatability and reproducibility, but the opposite.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑