arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.23633cs.AIecon.GNq-fin.EC
收藏

AI暴露分数:它们衡量什么、遗漏什么以及下一步是什么

AI Exposure Scores: what they measure, what they miss, and what comes next

Cohere Labs(Cohere实验室)

Campbell Lund, Thomas Euyang, Zanele Munyikwa, Marzieh Fadaee

AI总结:

本文以2023年GPTs暴露分数为案例,分析静态暴露分数在政策分析中的结构性局限,并综述五种应对方法,强调需弥合研究-政策差距。

摘要:

一组在2023年计算的暴露分数已成为未来工作辩论的核心实证输入。由Eloundou等人(2023)提出,本文称为GPTs是GPTs分数,他们将暴露定义为大型语言模型可以协助的职业任务份额。这项工作是一种真正的方法论贡献,但随着分数从其产生的时间和地点传播,作者指出的局限性并不总是随之传播。结果导致两个差距扩大。第一个是结构性的,介于静态暴露分数衡量的内容与政策问题实际所需之间。以这些分数的扩散作为案例研究,我们展示了它们的时间、地理和本体论局限性如何在政策导向分析中累积,并调查了五类应对这些局限的研究:动态和基于基准的测量、集成方法、任务框架扩展、以工人为中心的指标以及采用和使用数据。第二个差距是我们认为需要更多关注的:研究人员和政策制定者之间的协调。那些询问谁受到伤害、谁受益、如何以及何时受益的政策相关研究,继续引用静态的GPTs是GPTs分数,而没有参与那些能让这些问题更可靠地得到回答的方法论更新。然后我们询问在应对不确定性方面还有哪些额外步骤:事后框架以及重新构想哪些未来值得建设的审慎政治工作。弥合研究-政策差距是一项共同任务:政策制定者必须扩大其证据基础,将工人视为认知伙伴,并从预测转向准备;研究人员必须建立数据基础设施,采用参与式方法,并面向政策制定者写作。更好的测量很重要,但它不会单独弥合第二个差距。

英文摘要:

A set of exposure scores calculated in 2023 has become a central empirical input to the future of work debate. Produced by Eloundou et al. (2023) and referred to here as the GPTs are GPTs scores, they define exposure as the share of occupational tasks a large language model can assist with. This work is a genuine methodological contribution, but as the scores travel from the time and place they were produced, the limitations the authors named do not always travel with them. Two gaps have widened as a result. The first is structural, between what static exposure scores measure and what policy questions actually require. Taking the diffusion of these scores as a case study, we show how their temporal, geographic, and ontological limitations compound in policy-facing analyses, and we survey five families of research responding to these limits: dynamic and benchmark-based measures, ensemble methods, task-framework extensions, worker-centered metrics, and adoption and usage data. The second gap is the one we argue needs more attention: the coordination between researchers and policymakers. The policy-relevant work which ask who is harmed, who benefits, how, and when, continues to reference the static GPTs are GPTs scores without engagement with the methodological updates that would let these questions be answered more reliably. We then ask what additional steps towards navigating uncertainty remain: ex-post frameworks and the deliberate, political work of reimagining what futures are worthy of building towards are. Closing the research-policy gap is a shared task: policymakers must widen their evidence base, engage workers as epistemic partners, and shift from prediction to preparedness; researchers must build data infrastructure, adopt participatory methods, and write with policymakers in mind. Better measurement matters, but it will not close the second gap alone.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑