生成式AI(genAI)使用中的成熟度:来自一家大型企业的实地证据
Sophistication in GenAI Use: Field Evidence from a Large Firm
浏览论文内容
中文总结 AI 辅助
本研究以某大型企业后台员工为对象,通过8个月的71万余条数据,发现资深员工genAI使用更成熟,战略等领域成熟度最高,且成熟度难随时间或培训提升,为管理者和研究者提供相关衡量指标与见解。
中文摘要 AI 辅助
我们研究一家大型企业后台员工在生成式AI(genAI)使用上的成熟度差异。利用专有数据,我们观察了2025年8个月内来自15个职能领域近4000名后台员工的713564条员工提示词及其对应的大语言模型响应。我们记录了三个主要发现:第一,资深员工的genAI使用更为成熟,这与领域专长可补充genAI能力的观点一致;第二,成熟度在各职能间差异显著,在战略、数字创新和项目管理领域最高,这三个群体均聚焦于全企业战略举措与组织变革;第三,我们未观察到成熟度随时间的提升,也未观察到正式AI培训后的持久提升,这表明成熟使用较难改变。总体而言,本研究提供了管理者可用于改善结果、研究人员可用于未来研究的genAI成熟度衡量指标与见解。
英文摘要
We study how sophistication in generative AI (genAI) use varies among the back-office workforce of a large firm. Using proprietary data, we observe 713,564 employee prompts and their corresponding large language model responses from nearly 4,000 back-office employees across 15 functional areas over eight months in 2025. We document three main findings. First, senior employees exhibit more sophisticated genAI use, consistent with domain expertise complementing genAI capabilities. Second, sophistication varies considerably across functions and is highest in Strategy, Digital Innovation, and Project Management, three groups that share a focus on firmwide strategic initiatives and organizational change. Third, we observe neither improvements in sophistication over time nor lasting improvements following formal AI training, suggesting that sophisticated use can be difficult to change. Together, our study provides measures of and insights into sophisticated genAI use that managers can use to improve outcomes and that researchers can use in future research.
发表机构
- University of Texas at Austin(德克萨斯大学奥斯汀分校)
- KPMG LLP(毕马威有限责任公司)
机构由 AI 辅助整理,请以论文原文为准。