This position paper argues that, in order to understand AI, we cannot rely on our existing vocabulary of human words. Instead, we should strive to develop neologisms: new words that represent precise human concepts that we want to teach machines, or machine concepts that we need to learn. We start from the premise that humans and machines have differing concepts. This means interpretability can be framed as a communication problem: humans must be able to reference and control machine concepts, and communicate human concepts to machines. Creating a shared human-machine language through developing neologisms, we believe, could solve this communication problem. Successful neologisms achieve a useful amount of abstraction: not too detailed, so they're reusable in many contexts, and not too high-level, so they convey precise information. As a proof of concept, we demonstrate how a "length neologism" enables controlling LLM response length, while a "diversity neologism" allows sampling more variable responses. Taken together, we argue that we cannot understand AI using our existing vocabulary, and expanding it through neologisms creates opportunities for both controlling and understanding machines better.
ExtrinSplat: Decoupling Geometry and Semantics for Open-Vocabulary Understanding in 3D Gaussian Splatting
Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology, Shenzhen Graduate School, Peking University(广东省超高清沉浸式媒体技术重点实验室,北京大学深圳研究生院);School of Computer Science and Technology, Tianjin University(天津大学计算机科学与技术学院);Guangdong Bohua UHD Innovation Center Co., Ltd.(广东博华超高清创新中心有限公司)
Establishing Vocabulary Tests as a Benchmark for Evaluating Large Language Models
Universidad Carlos III de Madrid(马德里卡洛斯三世大学);Universidad Politécnica de Madrid(马德里理工大学);Universidad de Valladolid(巴利亚多利德大学);Universidad de Salamanca(萨拉曼卡大学);Ghent University(根特大学)
Around the world in 60 words: A generative vocabulary test for online research
Max Planck Institute for Empirical Aesthetics(马克斯·普朗克经验美学研究所);Ernst Strüngmann Institute for Neuroscience(恩斯特·斯特吕格曼神经科学研究所);Max Planck Institute for Human Cognitive and Brain Sciences(马克斯·普朗克人类认知与脑科学研究所);Princeton University(普林斯顿大学);University of Augsburg(奥格斯堡大学)