This study evaluates the potential of a large language model for aiding in generation of semantic feature norms - a critical tool for evaluating conceptual structure in cognitive science. Building from an existing human-generated dataset, we show that machine-verified norms capture aspects of conceptual structure beyond what is expressed in human norms alone, and better explain human judgments of semantic similarity amongst items that are distally related. The results suggest that LLMs can greatly enhance traditional methods of semantic feature norm verification, with implications for our understanding of conceptual representation in humans and machines.
Evaluating LLM Personalization via Semantic Constraint Verification
University of New South Wales(新南威尔士大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);The Technology Innovation Institute(技术创新研究所);The Hong Kong University of Science and Technology(香港科技大学)
Found in Translation: semantic approaches for enhancing AI interpretability in face verification
Université de Mons (UMONS)(蒙斯大学);Université Libre de Bruxelles (ULB)(布鲁塞尔自由大学);Laboratoire de Recherche de l'EPITA -- LRE(EPITA研究所(LRE));Univ Gustave Eiffel(古斯塔夫·埃菲尔大学);CNRS(法国国家科学研究中心);LIGM(信息与建模实验室)
From Bits to Beliefs: Recoverable Semantic Fingerprints for Black-Box Verification of Large Language Models
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));South China University of Technology(华南理工大学);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
PerceptTwin: Semantic Scene Reconstruction for Iterative LLM Planning and Verification
Department of Computer Science and Operations Research, Université de Montréal(蒙特利尔大学计算机科学与运筹学系);Mila - Quebec AI Institute(魁北克人工智能研究所);CIFAR AI Chair(CIFAR人工智能主席)
V-CAGE: Context-Aware Generation and Verification for Scalable Long-Horizon Embodied Tasks
Department of Computer Science and Technology, University of Cambridge, Cambridge, England.(计算机科学与技术系,剑桥大学,剑桥,英格兰);Shanghai Jiao Tong University, Shanghai, China(上海交通大学,上海,中国);Wuhan University, Wuhan, Hubei, China(武汉大学,武汉,湖北,中国)
DoubtProbe: Black-Box Jailbreak Defense via Structural Verification and Semantic Auditing
East China Normal University(东华大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所)