arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.02092cs.CL
收藏

深层词汇假设:识别自然语言中的人格结构

Deep Lexical Hypothesis: Identifying personality structure in natural language

Boston University(波士顿大学);University of Oregon(俄勒冈大学)

Andrew Cutler, David M. Condon

摘要:

自然语言处理(NLP)的最新进展已经产生了可以执行复杂任务的通用模型,例如总结长段落和跨语言翻译。在这里,我们介绍了一种方法来提取形容词相似性的语言模型与传统的心理语言学研究中的调查为基础的评级,但在自然环境中使用数百万倍的文本。通过这种方法产生的相关结构与Saucier和Goldberg(1996 a)报告的435个术语的自我和他人评级高度相似。使用NLP产生的前三个未旋转因子与调查数据中的因子一致,系数为0.89,0.79和0.79。这种结构对许多建模决策都是鲁棒的:形容词集,包括1,710个术语(Goldberg,1982)和18,000个术语(Allport & Odbert,1936);用于提取相关性的查询;和语言模型。值得注意的是,神经质和开放性只有微弱和不一致的恢复。这是一个新的信号源,更接近词汇假设的原始(语义)视野。这种方法可以应用于调查无法应用的领域:同时使用几十种语言,有数万个项目,对历史文本,以及以极低的成本进行超大规模的调查。公开代码是为了便于复制和快速迭代新的研究方向。

英文摘要:

Recent advances in natural language processing (NLP) have produced general models that can perform complex tasks such as summarizing long passages and translating across languages. Here, we introduce a method to extract adjective similarities from language models as done with survey-based ratings in traditional psycholexical studies but using millions of times more text in a natural setting. The correlational structure produced through this method is highly similar to that of self- and other-ratings of 435 terms reported by Saucier and Goldberg (1996a). The first three unrotated factors produced using NLP are congruent with those in survey data, with coefficients of 0.89, 0.79, and 0.79. This structure is robust to many modeling decisions: adjective set, including those with 1,710 terms (Goldberg, 1982) and 18,000 terms (Allport & Odbert, 1936); the query used to extract correlations; and language model. Notably, Neuroticism and Openness are only weakly and inconsistently recovered. This is a new source of signal that is closer to the original (semantic) vision of the Lexical Hypothesis. The method can be applied where surveys cannot: in dozens of languages simultaneously, with tens of thousands of items, on historical text, and at extremely large scale for little cost. The code is made public to facilitate reproduction and fast iteration in new directions of research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑