arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2509.03391cs.DLcs.CY
收藏

参数多于总体:调查研究中的大语言模型系统文献综述

More Parameters Than Populations: A Systematic Literature Review of Large Language Models within Survey Research

Old Dominion University(老道明大学);University of Mannheim(曼海姆大学);LMU Munich(慕尼黑大学);Oberlin College(欧柏林学院)

Trent D. Buskirk, Florian Keusch, Leah von der Heyde, Adam Eck

AI总结:

通过系统文献综述,评估大语言模型在调查研究三个阶段(数据收集前、中、后)的应用,讨论其潜力与陷阱,并展望调查研究对LLM发展的贡献。

摘要:

[工作论文]调查研究长期以来一直是人力驱动的领域,但也接纳了多种技术来收集、处理和分析各种行为、政治和社会结果。与此同时,大语言模型(LLM)带来了新的技术挑战和前提条件,以充分利用其潜力。在本文中,我们报告了一项基于多个大规模数据库关键词搜索和引文网络的系统文献综述的进展,评估LLM目前在调查研究过程中的应用情况。我们根据调查研究过程综合并组织我们的发现,包括LLM在三个广泛阶段的使用示例:数据收集前、数据收集和数据收集后。我们基于现有文献中的示例,讨论了LLM潜在用例的选定示例及其陷阱。考虑到调查研究在数据质量方面拥有丰富的经验和历史,我们讨论了一些机会,并描述了调查研究为LLM的持续发展和改进做出贡献的未来展望。

英文摘要:

[Working Paper] Survey research has a long-standing history of being a human-powered field, but one that embraces various technologies for the collection, processing, and analysis of various behavioral, political, and social outcomes of interest, among others. At the same time, Large Language Models (LLMs) bring new technological challenges and prerequisites in order to fully harness their potential. In this paper, we report work-in-progress on a systematic literature review based on keyword searches from multiple large-scale databases as well as citation networks that assesses how LLMs are currently being applied within the survey research process. We synthesize and organize our findings according to the survey research process to include examples of LLM usage across three broad phases: pre-data collection, data collection, and post-data collection. We discuss selected examples of potential use cases for LLMs as well as its pitfalls based on examples from existing literature. Considering survey research has rich experience and history regarding data quality, we discuss some opportunities and describe future outlooks for survey research to contribute to the continued development and refinement of LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑