Simulating real personalities with large language models requires grounding generation in authentic personal data. Existing evaluation approaches rely on demographic surveys, personality questionnaires, or short AI-led interviews as proxies, but lack direct assessment against what individuals actually said. We address this gap with an interview-grounded evaluation framework for personality simulation at a large scale. We extract over 671,000 question-answer pairs from 23,000 verified interview transcripts across 1,000 public personalities, each with an average of 11.5 hours of interview content. We propose a multi-dimensional evaluation framework with four complementary metrics measuring content similarity, factual consistency, personality alignment, and factual knowledge retention. Through systematic comparison, we find that interview grounding yields consistent gains in content alignment and exact-match factual recall over biographical profiles and parametric prompting. We further find complementary strengths: retrieval-augmented methods tend to preserve personality alignment, while larger chronological contexts generally reduce contradictions and improve factual recall. Our evaluation framework enables principled method selection based on application requirements, and our empirical findings provide actionable insights for advancing personality simulation research.
Generative Personality Simulation via Theory-Informed Structured Interview
Department of Psychological Sciences & 2 Department of Computer Science, Rice University（1 心理学系 & 2 计算机科学系，莱斯大学）；Department of Electrical and Computer Engineering, Northeastern University（3 电气与计算机工程系，东北大学）；Department of Computer Science, Johns Hopkins University（4 计算机科学系，约翰霍普金斯大学）；Microsoft Research Asia（微软亚洲研究院）
InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews
Fudan University（复旦大学）；Carnegie Mellon University（卡内基梅隆大学）；The Chinese University of Hong Kong（香港中文大学）；Renmin University of China（中国人民大学）；Beijing University of Technology（北京工业大学）；Boston University（波士顿大学）；RhineAI（莱茵AI公司）；SenseTime（商汤科技）
Why did My Robot Just Change Personality? Prompting Guidelines for a Grounded Robot Persona in LLM-Based HRI
RPTU Kaiserslautern（凯泽斯劳滕工业大学）；Linköping University（林雪平大学）；University of Hertfordshire（赫特福德大学）；Eindhoven University of Technology（埃因霍温理工大学）；Australian National University（澳大利亚国立大学）；University of Cambridge（剑桥大学）；University of Naples Federico II（那不勒斯费德里科二世大学）；Ben-Gurion University of the Negev（本-古里安大学内盖夫分校）；The Azrieli National Center for Autism and Neurodevelopment Research（阿兹列利国家自闭症与神经发育研究中心）
Neuron-based Personality Trait Induction in Large Language Models
Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学首都人工智能学院）；Tongyi Lab（通义实验室）；Institute of Statistics and Big Data, Renmin University of China（中国人民大学统计与大数据研究院）
Effectiveness of Large Language Models in Simulating Regional Psychological Structures: An Empirical Examination of Personality and Subjective Well-being
Tsinghua University（清华大学）；Neoma Business School（诺欧商学院）；Beijing Technology and Business University（北京工商大学）；Beijing Normal University（北京师范大学）
Patients With Personality: Realistic Patient Simulation through Controlled Diversity and Selective Disclosure
Technical University of Munich（慕尼黑技术大学）；Munich Center for Machine Learning（慕尼黑机器学习中心）；TUM University Hospital（慕尼黑技术大学医院）；Google DeepMind（谷歌DeepMind）；Google Research（谷歌研究）；Imperial College London（伦敦帝国学院）
University of Oxford（牛津大学）；The Alan Turing Institute（艾伦·图灵研究所）；University of Warwick（华威大学）
Bipolar disorder (BD) and borderline personality disorder (BPD) are both chronic psychiatric disorders. However, their overlapping symptoms and common comorbidity make it challenging for the clinicians to distinguish the two conditions on the basis of a clinical interview. In this work, we first present a new multi-modal dataset containing interviews involving individuals with BD or BPD being interviewed about a non-clinical topic . We investigate the automatic detection of the two conditions, and demonstrate a good linear classifier that can be learnt using a down-selected set of features fro…
LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals
Computer Science Department, Stanford University（斯坦福大学计算机科学系）；Department of Communication Studies, Northwestern University（西北大学传播学系）；Department of Communication, University of Washington（华盛顿大学传播学系）；Google DeepMind（谷歌DeepMind）；Department of Sociology, Stanford University（斯坦福大学社会学系）；Sciences Po（巴黎政治学院）
HEART-Bench: Do LLM Agents Exhibit Human-like Psychology?
Shanghai Jiao Tong University（上海交通大学）；Imperial College London（伦敦帝国理工学院）；Quwan Group（启元集团）；University of Washington（华盛顿大学）；South China Normal University（华南师范大学）
AnchorSIPS: A Synthetic Dataset and Evaluation Resource for Evidence-Supported Psychosis-Risk Symptom Measurement
Monash University（莫纳什大学）；Orygen（奥瑞金）；The University of Melbourne（墨尔本大学）；Swinburne University of Technology（斯威本科技大学）；University of Liverpool（利物浦大学）；Khalifa University（哈利法大学）
Computational Phenomenology of Borderline Personality Disorder: A Comparative Evaluation of LLM-Simulated Expert Personas and Human Clinical Experts
IDEAS Research Institute（IDEAS研究机构）；Adam Mickiewicz University（亚当·密茨凯维奇大学）；AMU Center for Artificial Intelligence（AMU人工智能中心）；Poznań University of Medical Sciences（波兹南医科大学）；Maria Curie-Skłodowska University（玛丽·居里-斯洛多夫斯卡大学）；University of Warsaw（华沙大学）
Elder-Sim: A Psychometrically Validated Platform for Personality-Stable Elderly Digital Twins
Yulin AI-Enhanced HealthCare Lab（云林人工智能增强医疗实验室）；School of Nursing, Fudan University（复旦大学护理学院）；School of Nursing, Medical College of Soochow University（苏州大学医学院护理学院）；School of Nursing, Dali University（大理大学护理学院）；Department of Advanced Interdisciplinary Studies, The University of Tokyo（东京大学先进跨学科研究部）；The First Affiliated Hospital of Soochow University（苏州大学第一附属医院）；Department of Nursing, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University（江西医学院护理部，南昌大学第一附属医院）；School of Social Development, East China University of Political Science and Law（中国政法大学社会发展学院）；Rory Meyers College of Nursing, New York University（纽约大学 Rory Meyers 护理学院）；New York University Shanghai（纽约大学上海校区）
University of Oxford（牛津大学）；The Alan Turing Institute（艾伦·图灵研究所）；University of Sheffield（谢菲尔德大学）；Queen Mary University of London（伦敦玛丽女王大学）
Bipolar disorder (BD) and borderline personality disorder (BPD) are two chronic mental health conditions that clinicians find challenging to distinguish based on clinical interviews, due to their overlapping symptoms. In this work, we investigate the automatic detection of these two conditions by modelling both verbal and non-verbal cues in a set of interviews. We propose a new approach of modelling short-term features with visibility-signature transform, and compare it with widely used high-level statistical functions. We demonstrate the superior performance of our proposed signature-based mo…
Psychologically-Grounded Graph Modeling for Interpretable Depression Detection
Singapore Institute of Technology（新加坡科技学院）；Nanyang Technological University（南洋理工大学）；ELLIS Institute Finland（芬兰ELLIS研究所）；University of Turku（图尔库大学）；Princess Nourah bint Abdulrahman University（普里西拉努拉·本·阿卜杜勒拉赫曼大学）
"I Never Said That": A dataset, taxonomy and baselines on response clarity classification
National Technical University of Athens（雅典国立技术大学）；Instituto de Telecomunicações（电信研究所）；Instituto Superior Técnico, Universidade de Lisboa（里斯本大学高等技术学院）；ELLIS Unit Lisbon（ELLIS里斯本单元）
Evaluating Scaffolding-Oriented Multi-Agent Large Language Model System for Clinical Interview Training
The Ohio State University（俄亥俄州立大学）；The Hong Kong University of Science and Technology（香港科技大学）；Southern University of Science and Technology（南方科技大学）；Johns Hopkins University（约翰斯·霍普金斯大学）；Guangzhou Medical University（广州医科大学）
Summon a Demon and Bind it: A Grounded Theory of LLM Red Teaming
Paul G. Allen School of Computer Science & Engineering（保罗·G·艾伦计算机科学与工程学院）；IT University of Copenhagen（哥本哈根信息技术大学）；Berkeley Center for Human-Compatible AI, UC Berkeley（加州大学伯克利分校伯克利人类兼容人工智能中心）；NVIDIA Corporation（英伟达公司）
P-React: Synthesizing Topic-Adaptive Reactions of Personality Traits via Mixture of Specialized LoRA Experts
School of Computer Science and Technology, East China Normal University（东华大学计算机科学与技术学院）；Shanghai Institute of AI for Education, East China Normal University（东华大学人工智能教育研究所）；Xiaohongshu Inc.（小红书公司）
