arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.03753cs.CLcs.LG
收藏

基于GPT-3的对象概念语义特征

Semantic features of object concepts generated with GPT-3

Max Planck Institute for Human Cognitive and Brain Sciences(马克斯·普朗克人类认知与脑科学研究所)

Hannes Hansen, Martin N. Hebart

摘要:

语义特征在研究人类概念表征的本质中一直扮演着重要的角色。然而,从人类评分员那里经验性地采样和规范特征所需的大量时间和精力,将其使用限制在有限的一组手动策划的概念上。考虑到最近基于transformer的语言模型的发展前景,我们在这里询问是否有可能使用这样的模型来自动生成任意对象概念的有意义的属性列表,以及这些模型是否会产生与人类相似的特征。为此,我们探索了GPT-3模型,为1,854个对象生成语义特征,并将自动生成的特征与现有的人类特征规范进行了比较。GPT-3生成的特征比人类多得多,但在生成的特征类型中显示出相似的分布。生成的特征规范在预测相似性,相关性和类别成员资格方面与人类规范相媲美,而方差划分表明,这些预测是由人类和GPT-3的相似方差驱动的。总之,这些结果突出了大语言模型的潜力,以捕捉人类知识的重要方面,并产生一个新的方法,自动生成可解释的功能集,从而大大扩大了潜在的使用语义特征的心理和语言学研究。

英文摘要:

Semantic features have been playing a central role in investigating the nature of our conceptual representations. Yet the enormous time and effort required to empirically sample and norm features from human raters has restricted their use to a limited set of manually curated concepts. Given recent promising developments with transformer-based language models, here we asked whether it was possible to use such models to automatically generate meaningful lists of properties for arbitrary object concepts and whether these models would produce features similar to those found in humans. To this end, we probed a GPT-3 model to generate semantic features for 1,854 objects and compared automatically-generated features to existing human feature norms. GPT-3 generated many more features than humans, yet showed a similar distribution in the types of generated features. Generated feature norms rivaled human norms in predicting similarity, relatedness, and category membership, while variance partitioning demonstrated that these predictions were driven by similar variance in humans and GPT-3. Together, these results highlight the potential of large language models to capture important facets of human knowledge and yield a new approach for automatically generating interpretable feature sets, thus drastically expanding the potential use of semantic features in psychological and linguistic studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑