arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.13136cs.LG
收藏

部分可观察少样本学习的对比元学习

Contrastive Meta-Learning for Partially Observable Few-Shot Learning

University of Edinburgh(爱丁堡大学);Microsoft Research(微软研究院)

Adam Jelley, Amos Storkey, Antreas Antoniou, Sam Devlin

摘要:

许多对比和元学习方法通过识别多个视图中的共同特征来学习表示。然而,这些方法的形式主义通常假设要在一致地捕获的视图之间共享的特征。我们考虑的问题,学习一个统一的表示从部分观测,其中有用的功能可能只存在于一些意见。我们通过概率的形式主义,使视图映射到不同组件中具有不同程度的不确定性的表示方法,这些视图可以通过边缘化的不确定性相互整合。我们的方法,部分观察专家建模(POEM),然后使我们能够从部分观察元学习一致的表示。我们评估了我们的方法适应一个全面的少样本学习基准,元数据集,并证明了POEM的好处比其他元学习方法在表示学习从部分观察。我们进一步证明了POEM的效用,通过元学习来表示从代理探索环境所观察到的部分视图的环境。

英文摘要:

Many contrastive and meta-learning approaches learn representations by identifying common features in multiple views. However, the formalism for these approaches generally assumes features to be shared across views to be captured coherently. We consider the problem of learning a unified representation from partial observations, where useful features may be present in only some of the views. We approach this through a probabilistic formalism enabling views to map to representations with different levels of uncertainty in different components; these views can then be integrated with one another through marginalisation over that uncertainty. Our approach, Partial Observation Experts Modelling (POEM), then enables us to meta-learn consistent representations from partial observations. We evaluate our approach on an adaptation of a comprehensive few-shot learning benchmark, Meta-Dataset, and demonstrate the benefits of POEM over other meta-learning methods at representation learning from partial observations. We further demonstrate the utility of POEM by meta-learning to represent an environment from partial views observed by an agent exploring the environment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑