AI驱动的生成心理测量学规模开发终极教程:释放AIGENIE的瓶颈
The Ultimate Tutorial for AI-driven Scale Development in Generative Psychometrics: Releasing AIGENIE from its Bottle
AI总结:
本文介绍AIGENIE包,利用大语言模型和网络心理测量方法自动化生成和验证心理测量量表,提供六个部分教程及两个示例,支持多种LLM提供商,实现离线模式。
摘要:
心理量表开发传统上需要大量专家参与、迭代修订和大规模试点测试。AIGENIE R包实现了AI-GENIE框架,整合大语言模型文本生成与网络心理测量方法,自动化这一过程的早期阶段。该包利用LLM生成候选项目池,将其转换为高维嵌入,并应用多步骤减少流程——探索性图分析(EGA)、唯一变量分析(UVA)和bootstrap EGA——生成结构验证的项目池。本文分六部分介绍该包:安装设置、理解API、文本生成、项目生成、AIGENIE函数和GENIE函数。两个运行示例展示了该包的使用:大五人格模型和AI焦虑。该包支持多种LLM提供商,提供完全离线模式,无需外部API调用,并提供GENIE()函数供研究人员应用心理测量减少流程。AIGENIE包在R-universe上免费提供。
英文摘要:
Psychological scale development has traditionally required extensive expert involvement, iterative revision, and large-scale pilot testing before psychometric evaluation can begin. The \texttt{AIGENIE} R package implements the AI-GENIE framework (Automatic Item Generation and Validation with Network-Integrated Evaluation), which integrates large language model (LLM) text generation with network psychometric methods to automate the early stages of this process. The package generates candidate item pools using LLMs, transforms them into high-dimensional embeddings, and applies a multi-step reduction pipeline --- Exploratory Graph Analysis (EGA), Unique Variable Analysis (UVA), and bootstrap EGA --- to produce structurally validated item pools entirely \textit{in silico}. This tutorial introduces the package across eight parts: installation and setup, text generation, embeddings, item generation, the full AI-GENIE pipeline, the GENIE pipeline for researcher-supplied items, advanced prompt engineering, and fully local operation. Two running examples illustrate the package's use: the Big Five personality model (a well-established construct) and AI Anxiety (an emerging construct). The package supports multiple LLM providers (OpenAI, Anthropic, Groq, HuggingFace, and local models), offers a fully offline mode with no external API calls, and provides the \texttt{GENIE()} function for researchers who wish to apply the psychometric reduction pipeline to existing item pools regardless of their origin. The \texttt{AIGENIE} package is freely available on CRAN at \url{https://CRAN.R-project.org/package=AIGENIE}.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。