New York University(纽约大学);University of Cambridge(剑桥大学);Max Planck Institute for Empirical Aesthetics(马克斯·普朗克经验美学研究所);Anthropic(Anthropic公司);Massachusetts Institute of Technology(麻省理工学院);University College London(伦敦大学学院);University of California, Berkeley(加州大学伯克利分校);Princeton University(普林斯顿大学)
Ilia Sucholutsky, Katherine M. Collins, Maya Malaviya, Nori Jacoby, Weiyang Liu, Theodore R. Sumers, Michalis Korakakis, Umang Bhatt, Mark Ho, Joshua B. Tenenba… 展开作者
Ilia Sucholutsky, Katherine M. Collins, Maya Malaviya, Nori Jacoby, Weiyang Liu, Theodore R. Sumers, Michalis Korakakis, Umang Bhatt, Mark Ho, Joshua B. Tenenbaum, Brad Love, Zachary A. Pardos, Adrian Weller, Thomas L. Griffiths
A good teacher should not only be knowledgeable, but should also be able to communicate in a way that the student understands -- to share the student's representation of the world. In this work, we introduce a new controlled experimental setting, GRADE, to study pedagogy and representational alignment. We use GRADE through a series of machine-machine and machine-human teaching experiments to characterize a utility curve defining a relationship between representational alignment, teacher expertise, and student learning outcomes. We find that improved representational alignment with a student improves student learning outcomes (i.e., task accuracy), but that this effect is moderated by the size and representational diversity of the class being taught. We use these insights to design a preliminary classroom matching procedure, GRADE-Match, that optimizes the assignment of students to teachers. When designing machine teachers, our results suggest that it is important to focus not only on accuracy, but also on representational alignment with human learners.
Geometry matters: insights from Ollivier Ricci Curvature and Ricci Flow into representational alignment through Ollivier-Ricci Curvature and Ricci Flow
Max Planck Institute for Human Cognitive and Brain Sciences(马克斯·普朗克人类认知与脑科学研究所);Berlin School of Mind and Brain(柏林心智与脑学校);Humboldt-Universität zu Berlin(洪堡大学);Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI)(可扩展数据与人工智能中心(ScaDS.AI))
Back into Plato's Cave: Examining Cross-modal Representational Convergence at Scale
UC Berkeley(伯克利大学);Technical University Munich, MCML(慕尼黑技术大学);University of Tübingen, Tübingen AI Center(图宾根大学);Toyota Technical Institute at Chicago(芝加哥丰田技术研究所)
Barycentric alignment for instance-level comparison of neural representations
Department of XXX, University of YYY, Location, Country(YYY大学XXX系);School of ZZZ, Institute of WWW, Location, Country(WWW研究所ZZZ学院);Department of Electrical and Computer Engineering, UCSD(UCSD电子与计算机工程系);Cognitive Science Department, UCSD(UCSD认知科学系);Department of Computer Science(计算机科学系)
Princeton University(普林斯顿大学);NYU Center for Data Science(纽约大学数据科学中心);TU Berlin(柏林工业大学);BIFOLD(柏林人工智能与机器学习数据科学基础设施中心);Google DeepMind(谷歌DeepMind);MPI for Human Cognitive and Brain Sciences(马克斯·普朗克人类认知与脑科学研究所);University of Cambridge(剑桥大学);MIT(麻省理工学院);UCL(伦敦大学学院);University of Amsterdam(阿姆斯特丹大学);Intel Labs(英特尔实验室);Columbia University(哥伦比亚大学);MPI for Empirical Aesthetics(马克斯·普朗克经验美学研究所);Google Research(谷歌研究院);Anthropic(Anthropic公司);Harvard University(哈佛大学)
Dimensions underlying the representational alignment of deep neural networks with humans
Max Planck Institute for Human Cognitive and Brain Sciences(马克斯·普朗克人类认知与脑科学研究所);Donders Institute for Brain, Cognition and Behaviour(唐德斯脑、认知与行为研究所);Technische Universität Berlin(柏林工业大学);Berlin Institute for the Foundations of Learning and Data (BIFOLD)(柏林学习与数据基础研究所);Justus Liebig University(尤斯图斯·李比希大学);Center for Mind, Brain and Behavior, Universities of Marburg, Giessen, and Darmstadt(马尔堡、吉森和达姆施塔特大学心智、大脑与行为中心);Google DeepMind(谷歌DeepMind)
Representational Alignment with Chemical Induced Fit for Molecular Relational Learning
Wuhan University of Technology(武汉理工大学);Yonsei University(延世大学);Hubei Key Laboratory of Transportation Internet of Things(湖北省交通运输物联网重点实验室);Dalian University(大连大学)
Achieving More Human Brain-Like Vision via Human EEG Representational Alignment
Department of Psychology, The Ohio State University(心理学系,俄亥俄州立大学);McGovern Institute for Brain Research, Massachusetts Institute of Technology(脑科学研究所,麻省理工学院);Department of Neuroscience, The University of Texas at Dallas(神经科学系,德克萨斯大学达拉斯分校)
Signal-to-Noise Ratio and Sample Size Govern Representational Alignment in Neural Networks
SISSA Trieste, Italy(意大利特里斯特SISSA研究所);Theoretical and Scientific Data Science (TSDS) group at the International School for Advanced Studies (SISSA)(国际先进研究学院(SISSA)理论与科学数据科学(TSDS)小组);Condensed Matter and Statistical Physics section at the International Centre for Theoretical Physics (ICTP)(国际理论物理中心(ICTP)凝聚态与统计物理部门)
Partial Soft-Matching Distance for Neural Representational Comparison with Partial Unit Correspondence
Department of Cognitive Science University of California, San Diego(认知科学系加州大学圣地亚哥分校);Center for Neural Science, New York University(纽约大学神经科学中心);Center for Computational Neuroscience, Flatiron Institute(Flatiron研究所计算神经科学中心);Department of Cognitive Science Department of Computer Science and Engineering University of California, San Diego(认知科学系计算机科学与工程系加州大学圣地亚哥分校)
Beyond representational alignment with brain-guided language models for robust reasoning
State Key Lab of General AI, School of Intelligence Science and Technology, Peking University(北京大学通用人工智能国家重点实验室、智能科学与技术学院);Department of Psychological and Cognitive Sciences, Tsinghua University(清华大学心理与认知科学系);Microsoft Research Asia(微软亚洲研究院)
The Umwelt Representation Hypothesis: Rethinking Universality
Institute of Cognitive Science, University of Osnabrück(奥尔登堡大学认知科学研究所);Department of Psychology and Education, Freie Universität Berlin(柏林自由大学心理学与教育系);Bernstein Center for Computational Neuroscience, Berlin(柏林计算神经科学中心)
Escaping Plato's Cave: JAM for Aligning Independently Trained Vision and Language Models
Computation and Neural Systems(计算与神经系统);California Institute of Technology(加利福尼亚理工学院);Computation and Mathematical Sciences(计算与数学科学);Google DeepMind(谷歌DeepMind)