arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.12109cs.CLcs.AI

通过理论指导的结构化访谈生成人格模拟

Generative Personality Simulation via Theory-Informed Structured Interview

Department of Psychological Sciences & 2 Department of Computer Science, Rice University(1 心理学系 & 2 计算机科学系,莱斯大学);Department of Electrical and Computer Engineering, Northeastern University(3 电气与计算机工程系,东北大学);Department of Computer Science, Johns Hopkins University(4 计算机科学系,约翰霍普金斯大学);Microsoft Research Asia(微软亚洲研究院)

Pengda Wang, Huiqi Zou, Han Jiang, Hanjie Chen, Tianjun Sun, Xiaoyuan Yi, Ziang Xiao, Frederick L. Oswald

AI总结:

本文提出通过理论指导的结构化访谈提升LLM生成的人格数据异质性,结合心理测量理论改进模拟保真度,并预测人格相关行为结果。

摘要:

尽管LLMs在作为人类代理方面具有潜力,但它们往往无法生成具有人类样态的异质数据,从而削弱了其在推进社会科学研究中的价值。为解决这一差距,我们提出了一种新的方法,通过人格结构化访谈(PSI)将心理学洞察融入LLM模拟中。PSI利用心理测量量表开发程序,从正式心理学视角捕捉与人格相关的语言信息。为了系统评估模拟保真度,我们开发了一种基于测量理论的评估程序,考虑了人格的潜在构念性质,并评估其可靠性、结构有效性以及外部有效性。三个实验的结果表明,PSI有效提高了LLM模拟的人格数据的异质性,并预测了与人格相关的行为结果。我们进一步提供了一个理论框架,用于设计理论指导的结构化访谈,以提高LLM在模拟人类样态数据方面在更广泛心理测量研究中的可靠性与有效性。

英文摘要:

Despite their potential as human proxies, LLMs often fail to generate heterogeneous data with human-like diversity, thereby diminishing their value in advancing social science research. To address this gap, we propose a novel method to incorporate psychological insights into LLM simulation through the Personality Structured Interview (PSI). PSI leverages psychometric scale-development procedures to capture personality-related linguistic information from a formal psychological perspective. To systematically evaluate simulation fidelity, we developed a measurement theory grounded evaluation procedure that considers the latent construct nature of personality and evaluates its reliability, structural validity, and external validity. Results from three experiments demonstrate that PSI effectively improves human-like heterogeneity in LLM-simulated personality data and predicts personality-related behavioral outcomes. We further offer a theoretical framework for designing theory-informed structured interviews to enhance the reliability and effectiveness of LLMs in simulating human-like data for broader psychometric research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑