arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.23924cs.LGcs.AIstat.ML
收藏

交互式机器学习:从理论到规模化

Interactive Machine Learning: From Theory to Scale

University of Wisconsin–Madison(威斯康星大学麦迪逊分校)

Yinglun Zhu

AI总结:

本论文提出交互式机器学习的新算法和理论框架,实现高效主动学习和上下文带算法,解决大规模应用中的计算效率与模型选择问题。

摘要:

机器学习在广泛的应用中取得了显著的成功,然而许多最有效的方法依赖于访问大量标记数据或广泛的在线交互。在实践中,获取高质量标签并通过试错做出决策可能是昂贵、耗时或有风险的,特别是在大规模或高风险的设置中。本论文研究了交互式机器学习,其中学习者主动影响信息的收集方式或采取的行动,利用过去的观察来指导未来的交互。我们开发了新的算法原则,并在三个维度上建立了交互学习的基本限制:具有噪声数据和丰富模型类的主动学习、具有大动作空间的顺序决策制定,以及部分反馈下的模型选择。我们的结果包括首个计算高效且无需低噪声假设的主动学习算法,实现了指数级的标签节省;首个高效、通用的上下文带算法,其保证独立于动作空间的大小;以及首个对顺序决策制定中模型选择根本成本的精确刻画。总体而言,本论文通过开发统计最优且计算高效的算法,推动了交互学习的理论基础,并为在大规模、现实世界中部署交互学习方法提供了系统性的指导。

英文摘要:

Machine learning has achieved remarkable success across a wide range of applications, yet many of its most effective methods rely on access to large amounts of labeled data or extensive online interaction. In practice, acquiring high-quality labels and making decisions through trial-and-error can be expensive, time-consuming, or risky, particularly in large-scale or high-stakes settings. This dissertation studies interactive machine learning, in which the learner actively influences how information is collected or which actions are taken, using past observations to guide future interactions. We develop new algorithmic principles and establish fundamental limits for interactive learning along three dimensions: active learning with noisy data and rich model classes, sequential decision making with large action spaces, and model selection under partial feedback. Our results include the first computationally efficient active learning algorithms achieving exponential label savings without low-noise assumptions; the first efficient, general-purpose contextual bandit algorithms whose guarantees are independent of the size of the action space; and the first tight characterizations of the fundamental cost of model selection in sequential decision making. Overall, this dissertation advances the theoretical foundations of interactive learning by developing algorithms that are statistically optimal and computationally efficient, while also providing principled guidance for deploying interactive learning methods in large-scale, real-world settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑