PsychoGAT：通过基于LLM Agents的交互式小说游戏实现的新型心理测量范式
PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agents
AI总结：
提出PsychoGAT框架，利用LLM agents将标准化心理量表转化为交互式小说游戏，实现心理评估的通用游戏化，在多项心理测量指标上取得显著效果并提升用户体验。
摘要：
心理测量对心理健康、自我认知和个人发展至关重要。传统方法如自我报告量表和心理学家访谈常面临参与度和可及性的挑战。尽管已探索基于游戏和基于LLM的工具以提升用户兴趣并自动化评估，但它们难以平衡参与度与泛化能力。在本研究中，我们提出PsychoGAT（Psychological Game AgenTs）以实现心理评估的通用游戏化。主要洞见是强大的LLM既能作为熟练的心理学家，也能作为创新的游戏设计师。通过将LLM agents纳入指定角色并仔细管理其交互，PsychoGAT能将任何标准化量表转化为个性化且引人入胜的交互式小说游戏。为验证该方法，我们进行心理测量评估以评估其有效性，并聘请人类评估者检查涵盖抑郁、认知扭曲和人格特质等各种心理构念的生成内容。结果表明，PsychoGAT作为有效的评估工具，在信度、收敛效度和区分效度等心理测量指标上取得了统计学显著的卓越表现。此外，人类评估确认了PsychoGAT在内容连贯性、交互性、趣味性、沉浸感和满意度方面的提升。
英文摘要：
Psychological measurement is essential for mental health, self-understanding, and personal development. Traditional methods, such as self-report scales and psychologist interviews, often face challenges with engagement and accessibility. While game-based and LLM-based tools have been explored to improve user interest and automate assessment, they struggle to balance engagement with generalizability. In this work, we propose PsychoGAT (Psychological Game AgenTs) to achieve a generic gamification of psychological assessment. The main insight is that powerful LLMs can function both as adept psychologists and innovative game designers. By incorporating LLM agents into designated roles and carefully managing their interactions, PsychoGAT can transform any standardized scales into personalized and engaging interactive fiction games. To validate the proposed method, we conduct psychometric evaluations to assess its effectiveness and employ human evaluators to examine the generated content across various psychological constructs, including depression, cognitive distortions, and personality traits. Results demonstrate that PsychoGAT serves as an effective assessment tool, achieving statistically significant excellence in psychometric metrics such as reliability, convergent validity, and discriminant validity. Moreover, human evaluations confirm PsychoGAT's enhancements in content coherence, interactivity, interest, immersion, and satisfaction.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
