Mechanistic Interpretability of Brain-to-Speech Models Across Speech Modes
Department of Computer Science, University of Maryland, College Park, United States(计算机科学系,马里兰大学,College Park,美国);Department of Electrical and Computer Engineering, University of Maryland, College Park, United States(电气与计算机工程系,马里兰大学,College Park,美国)
Brain-to-speech decoding models demonstrate robust performance in vocalized, mimed, and imagined speech; yet, the fundamental mechanisms via which these models capture and transmit information across different speech modalities are less explored. In this work, we use mechanistic interpretability to causally investigate the internal representations of a neural speech decoder. We perform cross-mode activation patching of internal activations across speech modes, and use tri-modal interpolation to examine whether speech representations vary discretely or continuously. We use coarse-to-fine causal tracing and causal scrubbing to find localized causal structure, allowing us to find internal subspaces that are sufficient for cross-mode transfer. In order to determine how finely distributed these effects are within layers, we perform neuron-level activation patching. We discover that small but not distributed subsets of neurons, rather than isolated units, affect the cross-mode transfer. Our results show that speech modes lie on a shared continuous causal manifold, and cross-mode transfer is mediated by compact, layer-specific subspaces rather than diffuse activity. Together, our findings give a causal explanation for how speech modality information is organized and used in brain-to-speech decoding models, revealing hierarchical and direction-dependent representational structure across speech modes.
MINAR: Mechanistic Interpretability for Neural Algorithmic Reasoning
Pacific Northwest National Laboratory, Richland, WA(太平洋西北国家实验室);Halıcıoğlu Data Science Institute, University of California, San Diego, San Diego, CA(哈利奇奥格鲁数据科学研究所,加州大学圣地亚哥分校);Department of Computer and Information Science, University of Pennsylvania, Pennsylvaina, PA(计算机与信息科学系,宾夕法尼亚大学);Department of Mathematics, University of Washington, Seattle, WA(数学系,华盛顿大学)
Mechanistic Interpretability of Fine-Tuned Vision Transformers on Distorted Images: Decoding Attention Head Behavior for Transparent and Trustworthy AI
Krembil Research Institute, University Health Network(肯贝尔研究所,大学健康网络)
The Quest for the Right Mediator: Surveying Mechanistic Interpretability Through the Lens of Causal Mediation Analysis
Boston University(波士顿大学);University of Mannheim(曼海姆大学);Northeastern University(东北大学);Anthropic(Anthropic公司);Massachusetts Institute of Technology(麻省理工学院);Stanford University(斯坦福大学);Technion – Israel Institute of Technology(技术学院–以色列理工学院)
Joint data imputation and mechanistic modelling for simulating heart-brain interactions in incomplete datasets
Inria(法国国家信息与自动化技术研究所);Université Côte d’Azur(蔚蓝海岸大学);PhySense(PhySense公司);Department of Information and Communication Technologies(信息与通信技术系);Universitat Pompeu Fabra(庞培法布拉大学)
Prisma: An Open Source Toolkit for Mechanistic Interpretability in Vision and Video
Mila Quebec(蒙特利尔大学);McGill University(麦吉尔大学);Meta;Université de Montréal(蒙特利尔大学);Imperial College London(伦敦帝国理工学院);Fraunhofer Heinrich Hertz Institute(弗劳恩霍夫 Heinrich Hertz 研究所);Technological University Dublin(都柏林技术大学);Apollo Research(Apollo 研究所)
A Unified Theory of Sparse Dictionary Learning in Mechanistic Interpretability: Piecewise Biconvexity and Spurious Minima
National University of Singapore(新加坡国立大学);Indian Institute of Technology, Dhanbad(印度德里理工学院);Chinese University of Hong Kong(香港中文大学);Hong Kong University of Science and Technology(香港科学与技术大学);Peking University(北京大学)
Beyond Static Interpretability: Anticipating Post-SFT Mechanisms from Pre-SFT Parameters for Better Tuning
College of Computing and Data Science(计算与数据科学学院);Nanyang Technological University(南洋理工大学);School of Computer Science and Engineering(计算机科学与工程学院);The Chinese University of Hong Kong(香港中文大学)
Mechanistic Interpretability of Antibody Language Models Using SAEs
Department of Statistics, University of Oxford, UK(英国牛津大学统计系);Reticular, San Francisco, USA(美国旧金山Reticular公司);EECS, MIT, Cambridge MA, USA(美国麻省理工学院电子工程与计算机科学系);Leyden Laboratories BV, Leiden, The Netherlands(荷兰莱顿实验室)
When the Coffee Feature Activates on Coffins: An Analysis of Feature Extraction and Steering for Mechanistic Interpretability
Department of Philosophy of Nature and Technology(自然哲学与技术系);Munich School of Philosophy(慕尼黑哲学学院);Division of the Humanities and Social Sciences(人文与社会科学系);California Institute of Technology(加州理工学院)
A Multi-Level Causal Intervention Framework for Mechanistic Interpretability in Variational Autoencoders
Indian Institute of Technology, Patna(印度理工学院巴特那分校);Rajarshi School of Management Technology, Varanasi(拉贾尔希管理技术学院瓦拉纳西分校);Jaypee Institute of Information Technology, Noida(杰皮信息技术学院诺伊达分校)
Boston University(波士顿大学);Pr(AI)2 R Group(Pr(AI)2 R 研究组);Ai2(艾伦人工智能研究所);Technion(以色列理工学院);University of Buenos Aires(布宜诺斯艾利斯大学);Northeastern University(东北大学);Brown University(布朗大学);University of Amsterdam(阿姆斯特丹大学);MIT(麻省理工学院);Cambridge University(剑桥大学)
本文提出机制可解释性基准 MIB,通过电路定位与因果变量定位两赛道系统比较方法,发现归因/掩码优化及有监督 DAS 分别表现最佳。
Apollo Research(阿波罗研究院);Anthropic(Anthropic公司);Decode Research(解码研究院);Eleuther AI(Eleuther AI公司);FAR AI(FAR AI公司);Google DeepMind(谷歌DeepMind);Leap Laboratories(飞跃实验室);Harvard University(哈佛大学);King’s College London(伦敦国王学院);Imperial College London(帝国理工学院);MATS;MIT(麻省理工学院);METR;Northeastern University(东北大学);Tel Aviv University(特拉维夫大学);Timaeus(提迈奥斯);University of Melbourne(墨尔本大学);Goodfire
Mechanistic Interpretability for Neural TSP Solvers
University of Washington, Michael G. Foster School of Business(华盛顿大学,迈克尔·G·福斯特商学院);University of Washington, Paul G. Allen School of Computer Science & Engineering(华盛顿大学,保罗·G·阿伦计算机科学与工程学院)
Opening the AI black box: program synthesis via mechanistic interpretability
Massachusetts Institute of Technology(麻省理工学院);Institute for Artificial Intelligence and Fundamental Interactions(人工智能与基本相互作用研究所);Harvard University(哈佛大学)
Discovering a Zeta Map Algorithm on Dyck Paths via Mechanistic Interpretability
Department of Mathematics, Temple University, Philadelphia, PA, USA(特拉华大学数学系);Institute for Computer-Aided Reasoning in Mathematics, Carnegie Mellon University, Pittsburgh, PA, USA(计算机辅助数学推理研究所,卡内基梅隆大学);Department of Mathematics, University of Connecticut, Storrs, CT, USA(康乃狄克大学数学系);Korea Institute for Advanced Study, Seoul 02455, Republic of Korea(韩国高等研究院)
Explaining Intrinsic Moral Self-Correction with Mechanistic Interpretability
Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan(通讯工程研究院,国立台湾大学);MediaTek Research, Taipei, Taiwan(联发科研究,台北,台湾);Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan(电气工程系,国立台湾大学);Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan(电气工程系,国立清华大学);AI Research Center (AINTU), National Taiwan University, Taipei, Taiwan(人工智能研究中心(AINTU),国立台湾大学)