arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2312.16070cs.CYcs.CLcs.HC

ChatGPT 能读懂你是谁吗?

Can ChatGPT Read Who You Are?

ELLIS Alicante(阿利坎特ELLIS);University of South Bohemia(南波希米亚大学);Czech Institute of Informatics, Robotics, and Cybernetics, CTU in Prague(布拉格捷克理工大学捷克信息学、机器人与控制论研究所)

Erik Derner, Dalibor Kučera, Nuria Oliver, Jan Zahálka

AI总结:

本研究通过155名捷克语参与者的文本数据,评估ChatGPT从短文本推断大五人格特质的能力,发现其表现可与人类评分者媲美,但存在积极偏差,并探讨了提示构成的影响及伦理问题。

摘要:

人工智能(AI)与心理学之间的相互作用,特别是在人格评估领域,代表着一个重要的新兴研究方向。准确的人格特质估计不仅对于增强人机交互中的个性化至关重要,而且对于从心理健康到教育等广泛的应用也至关重要。本文分析了通用聊天机器人 ChatGPT 从短文本中有效推断人格特质的能力。我们报告了一项综合用户研究的结果,该研究使用了由 155 名具有代表性的人口样本参与者撰写的捷克语文本。他们基于大五人格量表(BFI)问卷的自我评估作为真实标签。我们将 ChatGPT 做出的人格特质估计与人类评分者的估计进行了比较,并报告了 ChatGPT 在从文本中推断人格特质方面具有竞争力的表现。我们还发现了 ChatGPT 在所有人格维度上的评估中存在一种“积极偏差”,并探讨了提示构成对准确性的影响。这项工作有助于理解 AI 在心理评估中的能力,同时突出了使用大型语言模型进行人格推断的潜力和局限性。我们的研究强调了负责任地开发 AI 的重要性,并考虑了 AI 应用中的隐私、同意、自主性和偏见等伦理影响。

英文摘要:

The interplay between artificial intelligence (AI) and psychology, particularly in personality assessment, represents an important emerging area of research. Accurate personality trait estimation is crucial not only for enhancing personalization in human-computer interaction but also for a wide variety of applications ranging from mental health to education. This paper analyzes the capability of a generic chatbot, ChatGPT, to effectively infer personality traits from short texts. We report the results of a comprehensive user study featuring texts written in Czech by a representative population sample of 155 participants. Their self-assessments based on the Big Five Inventory (BFI) questionnaire serve as the ground truth. We compare the personality trait estimations made by ChatGPT against those by human raters and report ChatGPT's competitive performance in inferring personality traits from text. We also uncover a 'positivity bias' in ChatGPT's assessments across all personality dimensions and explore the impact of prompt composition on accuracy. This work contributes to the understanding of AI capabilities in psychological assessment, highlighting both the potential and limitations of using large language models for personality inference. Our research underscores the importance of responsible AI development, considering ethical implications such as privacy, consent, autonomy, and bias in AI applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑