arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.04546cs.LGcs.CVstat.ML

Wandering Within a World: Online Contextualized Few-Shot Learning

University of Toronto(多伦多大学);Vector Institute(向量研究所);Google Research(谷歌研究院);University of Colorado, Boulder(科罗拉多大学博尔德分校)

Mengye Ren, Michael L. Iuzzolino, Michael C. Mozer, Richard S. Zemel

英文摘要:

We aim to bridge the gap between typical human and machine-learning environments by extending the standard framework of few-shot learning to an online, continual setting. In this setting, episodes do not have separate training and testing phases, and instead models are evaluated online while learning novel classes. As in the real world, where the presence of spatiotemporal context helps us retrieve learned skills in the past, our online few-shot learning setting also features an underlying context that changes throughout time. Object classes are correlated within a context and inferring the correct context can lead to better performance. Building upon this setting, we propose a new few-shot learning dataset based on large scale indoor imagery that mimics the visual experience of an agent wandering within a world. Furthermore, we convert popular few-shot learning approaches into online versions and we also propose a new contextual prototypical memory model that can make use of spatiotemporal contextual information from the recent past.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑