利用大型语言模型实现学术研究中昂贵数据集的普及化访问
Leveraging Large Language Models to Democratize Access to Costly Datasets for Academic Research
AI总结:
本文提出一种基于 GPT-4o-mini 和 RAG 框架的新方法,从企业披露中自动化收集数据,以人类水平准确率和极低成本生成大规模数据集,旨在打破资源壁垒,促进学术研究的数据访问公平与包容性。
摘要:
长期以来,对实证研究至关重要的昂贵数据集的不平等获取一直阻碍着来自弱势机构的研究人员,限制了他们为其所在领域做出贡献和推进职业生涯的能力。大型语言模型(LLMs)的最新突破有望通过自动化从非结构化来源收集数据来普及数据访问。我们开发并评估了一种新颖的方法,在检索增强生成(RAG)框架内使用 GPT-4o-mini 从企业披露中收集数据。我们的方法在从约 10,000 份委托声明书中收集 CEO 薪酬比率,以及从超过 12,000 份 10-K 文件中收集关键审计事项(CAMs)时,达到了人类水平的准确率,LLM 处理时间分别为 9 分钟和 40 分钟,每次成本均低于 10 美元。这与人工收集所需的数百小时或商业数据库订阅所需的数千美元形成了鲜明对比。为了通过赋能资源有限的研究人员探索新的探究途径来培育一个更具包容性的研究社区,我们分享了我们的方法和由此产生的数据集。
英文摘要:
Unequal access to costly datasets essential for empirical research has long hindered researchers from disadvantaged institutions, limiting their ability to contribute to their fields and advance their careers. Recent breakthroughs in Large Language Models (LLMs) have the potential to democratize data access by automating data collection from unstructured sources. We develop and evaluate a novel methodology using GPT-4o-mini within a Retrieval-Augmented Generation (RAG) framework to collect data from corporate disclosures. Our approach achieves human-level accuracy in collecting CEO pay ratios from approximately 10,000 proxy statements and Critical Audit Matters (CAMs) from more than 12,000 10-K filings, with LLM processing times of 9 and 40 minutes respectively, each at a cost under US $10. This stands in stark contrast to the hundreds of hours needed for manual collection or the thousands of dollars required for commercial database subscriptions. To foster a more inclusive research community by empowering researchers with limited resources to explore new avenues of inquiry, we share our methodology and the resulting datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。