LATENTPATCH:一种用于人脸生成与编辑的非参数方法
LATENTPATCH: A Non-Parametric Approach for Face Generation and Editing
AI总结:
针对小数据集人脸生成编辑难题,提出轻量非参数方法LatentPatch,通过潜在分布序列特征匹配实现生成与编辑,在人脸数据集上验证了其有效性与通用性。
摘要:
本文提出了LatentPatch,一种仅需少量图像构成的小型数据集即可生成逼真图像的新方法。我们采用仅包含数千个参数的轻量级模型。与传统的少样本生成方法对预训练的大规模生成模型进行微调不同,我们的方法通过序列特征匹配直接在潜在分布上计算,且具备可解释性设计。该方法避开了基于Transformer、递归网络或自注意力的不适合小数据集的大模型,受非参数纹理合成与风格迁移模型启发,确保生成图像的特征从源分布中采样。我们将此前的单图像模型扩展为可处理少量图像的版本,并证明该方法既能生成逼真图像,也支持条件采样与图像编辑。我们在人脸数据集上开展实验,表明这种简洁的模型兼具有效性与通用性。
英文摘要:
This paper presents LatentPatch, a new method for generating realistic images from a small dataset of only a few images. We use a lightweight model with only a few thousand parameters. Unlike traditional few-shot generation methods that finetune pre-trained large-scale generative models, our approach is computed directly on the latent distribution by sequential feature matching, and is explainable by design. Avoiding large models based on transformers, recursive networks, or self-attention, which are not suitable for small datasets, our method is inspired by non-parametric texture synthesis and style transfer models, and ensures that generated image features are sampled from the source distribution. We extend previous single-image models to work with a few images and demonstrate that our method can generate realistic images, as well as enable conditional sampling and image editing. We conduct experiments on face datasets and show that our simplistic model is effective and versatile.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。