这篇 inaugural 讲座于 1996 年在皇家霍洛威大学伦敦分校发表。它介绍了机器学习的基础知识,并描述了该领域中的各种理论进展和实际项目。此处的讲座以原始格式呈现,但 2025 年添加了一些评论以反映近期发展,参考文献列表也已更新,以提高读者的便利性和准确性。机器学习何时开始?也许一个好的起点是 1949 年,当 Claude Shannon 提出了一种用于下棋程序的学习算法。或者我们应回到 1930 年代,当 Ronald Fisher 发展了判别分析——一种类型的学习,其问题在于构建一个决策规则,以将两种向量分开。或者可能是 18 世纪,当 David Hume 讨论了归纳思想的概念?或者 14 世纪,当 William of Ockham 提出了“简单性”原则,即“奥卡姆剃刀”(顺便说一句,Ockham 是一个靠近皇家霍洛威的小村庄)。或者可能,像西方文明和文化中的几乎所有事物一样,这些想法的起源都在于地中海。毕竟,亚里士多德曾说:“我们只能通过做事来学习某些东西。”机器学习领域受到其他学科的深刻影响,该学科本身并不是一个非常同质的学科,而是包含多个相互重叠的子领域。ML 中有许多并行的研究方向:归纳学习、神经网络、聚类和学习理论。它们都是更广泛机器学习领域的一部分。
英文摘要:
This Inaugural Lecture was given at Royal Holloway University of London in 1996. It covers an introduction to machine learning and describes various theoretical advances and practical projects in the field. The Lecture here is presented in its original format, but a few remarks have been added in 2025 to reflect recent developments, and the list of references has been updated to enhance the convenience and accuracy for readers.
When did machine learning start? Maybe a good starting point is 1949, when Claude Shannon proposed a learning algorithm for chess-playing programs. Or maybe we should go back to the 1930s when Ronald Fisher developed discriminant analysis - a type of learning where the problem is to construct a decision rule that separates two types of vectors. Or could it be the 18th century when David Hume discussed the idea of induction? Or the 14th century, when William of Ockham formulated the principle of "simplicity" known as "Ockham's razor" (Ockham, by the way, is a small village not far from Royal Holloway). Or it may be that, like almost everything else in Western civilisation and culture, the origin of these ideas lies in the Mediterranean. After all, it was Aristotle who said that "we learn some things only by doing things".
The field of machine learning has been greatly influenced by other disciplines and the subject is in itself not a very homogeneous discipline, but includes separate, overlapping subfields. There are many parallel lines of research in ML: inductive learning, neural networks, clustering, and theories of learning. They are all part of the more general field of machine learning.
A unified framework for evaluating the robustness of machine-learning interpretability for prospect risking
Center for Energy and Geo Processing (CeGP)(能源与地球处理中心);Omni Lab for Intelligent Visual Engineering and Science (OLIVES)(智能视觉工程与科学实验室);School of Electrical and Computer Engineering(电气与计算机工程学院);Georgia Institute of Technology(佐治亚理工学院)
Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospects
Nanjing University of Science and Technology(南京理工大学);Xidian University(西安电子科技大学);CSIRO(联邦科学与工业研究组织);University of Western Australia(西澳大学);University of Technology Sydney(悉尼科技大学)
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Institute of Cyber-Systems and Control, Zhejiang University(浙江大学 Cyber-Systems 控制研究所);Squirrel AI(松鼠AI);Alibaba Group(阿里巴巴集团);School of Computer Science and Technology, Zhejiang Normal University(浙江师范大学计算机科学与技术学院);Faculty of Information Technology, Monash University(莫纳什大学信息技术学院);Ant Group(蚂蚁集团);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算与信息系统学院);School of Computing, University of Connecticut(康涅狄格大学计算机学院);School of Information and Communication Technology, Griffith University(格里菲斯大学信息与通信技术学院)