arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.04827cs.CVcs.AI
收藏

一种消除偏差的任意镜头学习语义精化算法

Bias-Eliminated Semantic Refinement for Any-Shot Learning

Zhejiang University(浙江大学)

Liangjun Feng, Chunhui Zhao, Xi Li

摘要:

当训练样本稀缺时,语义嵌入技术,即用属性描述类标签,提供了一个条件,通过转移来自可见对象的知识来生成不可见对象的视觉特征。然而,语义描述通常是在一个外部的范例,如手动注释,导致描述和视觉特征之间的一致性弱。在本文中,我们细化了粗粒度的语义描述的任意镜头学习任务,即,零样本学习(ZML),广义零样本学习(GSL),和少样本学习(FSL)。提出了一种新的语义精化Wasserstein生成对抗网络(SRWGAN)模型,该模型采用多头表示和层次对齐技术.与传统的方法不同,语义细化的目的是确定一个偏差消除条件的不相交类特征生成,并适用于归纳和转换设置。我们在六个基准数据集上广泛评估了模型性能,并观察了任意射击学习的最新结果;例如,我们在标准GALML设置中获得了加州理工学院UCSD鸟类(CUB)数据集的70.2%谐波准确度和牛津花卉(FLO)数据集的82.2%谐波准确度。还提供了各种可视化来显示SRWGAN的偏差消除生成。我们的代码可用。

英文摘要:

When training samples are scarce, the semantic embedding technique, ie, describing class labels with attributes, provides a condition to generate visual features for unseen objects by transferring the knowledge from seen objects. However, semantic descriptions are usually obtained in an external paradigm, such as manual annotation, resulting in weak consistency between descriptions and visual features. In this paper, we refine the coarse-grained semantic description for any-shot learning tasks, ie, zero-shot learning (ZSL), generalized zero-shot learning (GZSL), and few-shot learning (FSL). A new model, namely, the semantic refinement Wasserstein generative adversarial network (SRWGAN) model, is designed with the proposed multihead representation and hierarchical alignment techniques. Unlike conventional methods, semantic refinement is performed with the aim of identifying a bias-eliminated condition for disjoint-class feature generation and is applicable in both inductive and transductive settings. We extensively evaluate model performance on six benchmark datasets and observe state-of-the-art results for any-shot learning; eg, we obtain 70.2% harmonic accuracy for the Caltech UCSD Birds (CUB) dataset and 82.2% harmonic accuracy for the Oxford Flowers (FLO) dataset in the standard GZSL setting. Various visualizations are also provided to show the bias-eliminated generation of SRWGAN. Our code is available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑