arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.02076econ.GNcs.HCq-fin.EC
收藏

当AI评判你的作品:算法评估的隐藏成本

When an AI Judges Your Work: The Hidden Costs of Algorithmic Assessment

Kellogg School of Management, Northwestern University(西北大学凯洛格管理学院);Walmart Connect(沃尔玛连接);University of California, Santa Barbara(加州大学圣塔芭芭拉分校)

David Almog, Lucas Lippman, Daniel Martin

AI总结:

本文研究了AI评估对工人行为的影响,发现工人在AI评估下产出更多但质量更低,并更倾向于使用外部工具,但工具使用并未解释产出差异。

摘要:

我们通过一个在线实验,使用真实的工作任务来研究当工人知道AI将用来评判他们的工作而不是人类时,他们的行为是否会改变。我们发现,当被分配AI评估者时,个体会产生更多的产出。然而,考虑到数量,其产出质量较低,无论质量是通过人类还是LLM评分来衡量。我们还发现,当工人知道AI将用来评判他们的工作而不是人类时,他们更可能使用外部工具,包括LLM。然而,外部工具使用量的增加似乎无法解释不同处理条件下产出数量或质量的差异。

英文摘要:

We use an online experiment with a real work task to study whether workers change their behavior when they know AI will be used to judge their work instead of humans. We find that individuals produce a higher quantity of output when they are assigned an AI evaluator. However, controlling for quantity, the quality of their output is lower, regardless of whether quality is measured using humans or LLM grades. We also find that workers are more likely to use external tools, including LLMs, when they know AI is used to judge their work instead of humans. However, the increase in external tool use does not appear to explain the differences in quantity or quality across treatments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑