arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.00901cs.AI
收藏

人工智能的真正火花与内部可解释性的重要性

Real Sparks of Artificial Intelligence and the Importance of Inner Interpretability

University of London(伦敦大学);Birkbeck College(伯贝克学院);Institute of Philosophy(哲学研究所)

Alex Grzankowski

AI总结:

本文指出微软关于GPT智能的黑盒可解释性研究方法存在缺陷,提出内部可解释性(尤其是机制可解释性)更契合智能的哲学定义,还探讨了哲学概念对该研究路径的优化作用,以推动跨学科双向交流。

摘要:

本文探讨了微软工程师开展的、关于GPT智能的最详尽研究之一。尽管他们的工作极具价值,但本文将基于常见的哲学理由论证,其采用的“黑盒可解释性(Blackbox Interpretability)”方法存在方向性错误。 不过存在更优的研究路径:一个令人振奋的新兴学科“内部可解释性(Inner Interpretability)”(具体而言是机制可解释性(Mechanistic Interpretability))正逐步发展,该学科旨在揭示模型的内部激活状态与权重,以理解其表征内容及所实现的算法。 在本文看来,黑盒可解释性的一个关键错误在于未能意识到,对于智能与理解而言,过程的执行方式至关重要。本文并不自诩能给出智能的充分必要条件的完整论述,但确实认为内部可解释性与关于智能所需条件的合理哲学观点高度契合。 因此本文的结论是审慎的,但在笔者看来,核心要点是明确如何让研究步入正轨。在论文末尾,本文将展示如何利用部分哲学概念进一步优化内部可解释性的研究路径,从而为哲学家与计算机科学家之间未来富有成效的双向交流搭建桥梁。

英文摘要:

The present paper looks at one of the most thorough articles on the intelligence of GPT, research conducted by engineers at Microsoft. Although there is a great deal of value in their work, I will argue that, for familiar philosophical reasons, their methodology, !Blackbox Interpretability"#is wrongheaded. But there is a better way. There is an exciting and emerging discipline of !Inner Interpretability"#(and specifically Mechanistic Interpretability) that aims to uncover the internal activations and weights of models in order to understand what they represent and the algorithms they implement. In my view, a crucial mistake in Black-box Interpretability is the failure to appreciate that how processes are carried out matters when it comes to intelligence and understanding. I can#t pretend to have a full story that provides both necessary and sufficient conditions for being intelligent, but I do think that Inner Interpretability dovetails nicely with plausible philosophical views of what intelligence requires. So the conclusion is modest, but the important point in my view is seeing how to get the research on the right track. Towards the end of the paper, I will show how some of the philosophical concepts can be used to further refine how Inner Interpretability is approached, so the paper helps draw out a profitable, future two-way exchange between Philosophers and Computer Scientists.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑