自动化条件下保持人工验证能力
Maintaining Human Verification Capacity under Automation
- Texas A&M University（德克萨斯农工大学）
- Redwood Research（红杉研究）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
本文提出一个框架，分析自动化检查对人工验证能力保持的影响，指出更好的检查虽提升检测率但削弱独立专业知识激励，并建议通过检测测试和纵向测试来评估和维持验证能力。
AI中文摘要：
人工验证依赖于在需要之前必须保持的专业知识。本文探讨了自动化检查的依赖、人工检查能力的投资以及中断期间的表现之间的联系。更好的检查能力降低了检查员工作时每增加一单位人工技能所获得的错误减少量。因此，即使它降低了维护和错误的最佳可实现预期成本，也可能减少保持独立专业知识的激励。在一个示例中，信息更丰富的检查器在工作时将检测率从\hoPowWorkA{}提高到\hoPowWorkC{}百分比，但组织随后不再进行常规实践，在检查器首次失效时仅检测到\hoPowOnsetC{}百分比的错误，而使用信息较少的检查器时检测率为\hoPowOnsetA{}百分比。因此，检测要求既涉及当前能力，也涉及其在新培训生效之前的存续。来自结肠镜检查和航空领域的证据表明，在常规自动化下，无辅助表现较弱，但未隔离其机制。该框架将检测目标与明确的专业知识储备和培训管道联系起来。标准检测测试估计每个数量，并揭示自动化偏差和静默检查器失效。该框架将要求与最小化预期损失区分开来，并提出纵向测试。
英文摘要：
Human verification depends on expertise that must be maintained before it is needed. This paper links reliance on automated checks, investment in human checking ability, and performance during an interruption. Better checking lowers the error reduction gained from an extra unit of human skill while the checker works. It can therefore reduce the incentive to preserve independent expertise, even when it lowers the best achievable expected cost of maintenance and errors. In an illustration, a more informative checker raises detection while it works from \hoPowWorkA{} to \hoPowWorkC{} percent, but the organization then keeps no routine practice and detects \hoPowOnsetC{} percent of errors when the checker first fails, against \hoPowOnsetA{} percent with a less informative checker. A detection requirement therefore concerns both current capability and its survival until new training becomes effective. Evidence from colonoscopy and aviation documents weaker unaided performance under routine automation, without isolating the mechanism. The framework connects a detection target to an explicit reserve of expertise and a training pipeline. Standard detection tests estimate each quantity and reveal automation bias and silent checker failures. The framework distinguishes the requirement from minimizing expected loss and proposes a longitudinal test.
