arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.02871cs.LG
收藏

在线学习研究综述

Online Learning: A Comprehensive Survey

Singapore Management University(新加坡管理大学);Tencent AI Lab(腾讯人工智能实验室)

Steven C. H. Hoi, Doyen Sahoo, Jing Lu, Peilin Zhao

摘要:

在线学习代表了机器学习算法的一个重要家族,其中学习者尝试通过一次一个地从数据实例序列中学习模型/假设来解决在线预测(或任何类型的决策)任务。在线学习的目标是确保在线学习者在已知先前预测或学习任务的正确答案以及可能的附加信息的情况下将做出一系列准确的预测(或正确的决策)。这与许多传统的批量学习或离线机器学习算法形成对比,这些算法通常被设计为从给定的训练数据实例集合中批量训练模型。本调查旨在通过对基本思想和关键原理的系统回顾以及对不同算法和技术的适当分类,对在线机器学习文献进行全面调查。一般来说,根据学习类型和反馈信息的形式,现有的在线学习工作可以分为三大类:(i)有监督的在线学习,其中总是可以获得完整的反馈信息;(ii)反馈有限的在线学习;以及(iii)无监督的在线学习,其中没有反馈。由于篇幅所限,调查将主要集中在第一类,但也简要介绍其他两类的一些基本情况。最后,我们还讨论了一些开放的问题,并试图阐明在这一领域的潜在的未来研究方向。

英文摘要:

Online learning represents an important family of machine learning algorithms, in which a learner attempts to resolve an online prediction (or any type of decision-making) task by learning a model/hypothesis from a sequence of data instances one at a time. The goal of online learning is to ensure that the online learner would make a sequence of accurate predictions (or correct decisions) given the knowledge of correct answers to previous prediction or learning tasks and possibly additional information. This is in contrast to many traditional batch learning or offline machine learning algorithms that are often designed to train a model in batch from a given collection of training data instances. This survey aims to provide a comprehensive survey of the online machine learning literatures through a systematic review of basic ideas and key principles and a proper categorization of different algorithms and techniques. Generally speaking, according to the learning type and the forms of feedback information, the existing online learning works can be classified into three major categories: (i) supervised online learning where full feedback information is always available, (ii) online learning with limited feedback, and (iii) unsupervised online learning where there is no feedback available. Due to space limitation, the survey will be mainly focused on the first category, but also briefly cover some basics of the other two categories. Finally, we also discuss some open issues and attempt to shed light on potential future research directions in this field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑