Large Language Model personas, explicit profiles specifying a user's attributes, preferences, and behavioural tendencies, are increasingly used to simulate human conversations for user modelling, social reasoning, and behavioural analysis. Evaluating whether such simulations faithfully reflect human conversational behaviour is critical, yet current practice often relies on LLM-as-a-judge approaches that provide limited grounding in observable behaviour and produce opaque scalar scores. We present Eval4Sim, an evaluation framework that measures alignment between simulated and human conversations across three dimensions: adherence, whether persona traits are recoverable from dialogue via dense retrieval; consistency, whether a persona maintains a distinguishable stylistic identity via authorship verification; and naturalness, whether conversations exhibit human-like turn-to-turn flow via dialogue NLI. Unlike optimization-oriented metrics, each dimension takes a human corpus as a reference baseline and penalizes deviations in both directions, distinguishing insufficient persona encoding from over-optimized, unnatural behaviour. The framework is corpus-agnostic: any persona-annotated conversational dataset can serve as the reference. Evaluated over ten simulation corpora, Eval4Sim surfaces systematic trade-offs invisible to single-score methods.
Evaluating Personality Traits in Large Language Models: Insights from Psychological Questionnaires
School of Physics, Mathematics and Computing（物理、数学与计算学院）；University of Western Australia（西澳大学）；School of Computing（计算机学院）；School of Psychological Sciences（心理科学学院）
HEART-Bench: Do LLM Agents Exhibit Human-like Psychology?
Shanghai Jiao Tong University（上海交通大学）；Imperial College London（伦敦帝国理工学院）；Quwan Group（启元集团）；University of Washington（华盛顿大学）；South China Normal University（华南师范大学）
Exploring the Impact of Personality Traits on Conversational Recommender Systems: A Simulation with Large Language Models
Chinese University of Hong Kong（香港中文大学）；National University of Singapore（新加坡国立大学）；Singapore Management University（新加坡管理大学）；Hong Kong Baptist University（香港浸会大学）；Huazhong University of Science and Technology（华中科技大学）
Generative Personality Simulation via Theory-Informed Structured Interview
Department of Psychological Sciences & 2 Department of Computer Science, Rice University（1 心理学系 & 2 计算机科学系，莱斯大学）；Department of Electrical and Computer Engineering, Northeastern University（3 电气与计算机工程系，东北大学）；Department of Computer Science, Johns Hopkins University（4 计算机科学系，约翰霍普金斯大学）；Microsoft Research Asia（微软亚洲研究院）
Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning
School of Computer Science and Technology, Wuhan University of Science and Technology（武汉科技大学计算机科学与技术学院）；Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology（湖北省智能信息处理与实时工业系统重点实验室）；Innovation, Policy and Entrepreneurship Thrust, The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）创新、政策与创业方向）；Tübingen AI Center, University of Tübingen（图宾根大学图宾根人工智能中心）；Department of Computer Science, University of Copenhagen（哥本哈根大学计算机科学系）
Scaling Law in LLM Simulated Personality: More Detailed and Realistic Persona Profile Is All You Need
Department of Computer；Information Engineering, Hebei Petroleum University of Technology, Chengde, China (e-mail；School of Computer Science \& Technology, Beijing Institute of Technology, Beijing, China (e-mail
German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studies
University of Mannheim（曼海姆大学）；GESIS -- Leibniz Institute for the Social Sciences（莱布尼茨社会科学研究所）；RWTH Aachen University（亚琛工业大学）；Complexity Science Hub（复杂性科学中心）
University of Patras（帕特雷大学）；CTI（计算机技术研究所）；Technical University of Catalonia（加泰罗尼亚理工大学）；University of Geneva（日内瓦大学）
This research investigates the effective incorporation of the human factor and user perception in text-based interactive media. In such contexts, the reliability of user texts is often compromised by behavioural and emotional dimensions. To this end, several attempts have been made in the state of the art, to introduce psychological approaches in such systems, including computational psycholinguistics, personality traits and cognitive psychology methods. In contrast, our method is fundamentally different since we employ a psychoanalysis-based approach; in particular, we use the notion of Lacan…
