利用估计算法概率先验的多分类
Multiclass classification utilising an estimated algorithmic probability prior
AI总结:
本研究提出利用算法概率近似作为高斯过程先验,解决RNA序列到形状的多类监督分类问题,在极小训练数据下显著提升分类精度。
摘要:
模式识别与机器学习方法在科学、技术和社会中得到广泛应用。因此,相关理论的任何进展都可能转化为大规模影响。在此,我们探讨算法信息论,特别是算法概率,如何辅助机器学习任务。我们研究了一个多类监督分类问题,即学习RNA分子序列到形状的映射,其中不同的可能形状被视为类别。本研究的主要动机是提供一个概念验证示例,展示对算法概率的近似如何辅助一个具体且动机明确的机器学习任务。我们的方法基于直接从形状复杂度估计类(即形状)概率,并将估计的概率作为高斯过程学习问题中的先验。自然地,在大量训练数据下,先验对分类精度没有显著影响,但在极小训练数据情况下,我们表明使用先验可以大幅提高分类精度。据我们所知,这项工作是最早展示算法概率如何辅助具体、真实世界机器学习问题的研究之一。
英文摘要:
Methods of pattern recognition and machine learning are applied extensively in science, technology, and society. Hence, any advances in related theory may translate into large-scale impact. Here we explore how algorithmic information theory, especially algorithmic probability, may aid in a machine learning task. We study a multiclass supervised classification problem, namely learning the RNA molecule sequence-to-shape map, where the different possible shapes are taken to be the classes. The primary motivation for this work is a proof of concept example, where a concrete, well-motivated machine learning task can be aided by approximations to algorithmic probability. Our approach is based on directly estimating the class (i.e., shape) probabilities from shape complexities, and using the estimated probabilities as a prior in a Gaussian process learning problem. Naturally, with a large amount of training data, the prior has no significant influence on classification accuracy, but in the very small training data regime, we show that using the prior can substantially improve classification accuracy. To our knowledge, this work is one of the first to demonstrate how algorithmic probability can aid in a concrete, real-world, machine learning problem.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。