arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.12437cs.CV

Learning without Seeing nor Knowing: Towards Open Zero-Shot Learning

Istituto Italiano di Tecnologia(意大利技术研究院);Università degli Studi di Genova(热那亚大学);Huawei Technologies Ltd., Ireland Research Center(华为技术有限公司爱尔兰研究中心);University of Verona(维罗纳大学)

Federico Marmoreo, Julio Ivan Davila Carrazco, Vittorio Murino, Jacopo Cavazza

英文摘要:

In Generalized Zero-Shot Learning (GZSL), unseen categories (for which no visual data are available at training time) can be predicted by leveraging their class embeddings (e.g., a list of attributes describing them) together with a complementary pool of seen classes (paired with both visual data and class embeddings). Despite GZSL is arguably challenging, we posit that knowing in advance the class embeddings, especially for unseen categories, is an actual limit of the applicability of GZSL towards real-world scenarios. To relax this assumption, we propose Open Zero-Shot Learning (OZSL) to extend GZSL towards the open-world settings. We formalize OZSL as the problem of recognizing seen and unseen classes (as in GZSL) while also rejecting instances from unknown categories, for which neither visual data nor class embeddings are provided. We formalize the OZSL problem introducing evaluation protocols, error metrics and benchmark datasets. We also suggest to tackle the OZSL problem by proposing the idea of performing unknown feature generation (instead of only unseen features generation as done in GZSL). We achieve this by optimizing a generative process to sample unknown class embeddings as complementary to the seen and the unseen. We intend these results to be the ground to foster future research, extending the standard closed-world zero-shot learning (GZSL) with the novel open-world counterpart (OZSL).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑