arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.07091cs.CVcs.AI
收藏

FaceID-6M:一个大规模、开源的FaceID定制数据集

FaceID-6M: A Large-Scale, Open-Source FaceID Customization Dataset

The University of Melbourne(墨尔本大学);University of Washington(华盛顿大学);Zhejiang University(浙江大学);Alibaba(阿里巴巴);Tsinghua University(清华大学);WeChat AI(微信AI);Tencent(腾讯);Nanyang Technological University(南洋理工大学)

Shuhe Wang, Xiaoya Li, Jiwei Li, Guoyin Wang, Xiaofei Sun, Bob Zhu, Han Qiu, Mo Yu, Shengjie Shen, Tianwei Zhang, Eduard Hovy

AI总结:

针对FaceID定制数据集缺失问题,构建并开源FaceID-6M,含600万高质量文本-图像对,经严格过滤,训练模型性能与工业模型相当且略优。

摘要:

由于当前人脸身份(FaceID)定制方法的数据驱动特性,所有最先进的模型都依赖于包含数百万个高质量文本-图像对的大规模数据集进行训练。然而,这些数据集均未公开,这限制了透明度并阻碍了该领域的进一步发展。为解决这一问题,本文收集并发布了FaceID-6M,这是首个包含600万个高质量文本-图像对的大规模开源FaceID数据集。FaceID-6M从LAION-5B中筛选而来,经过严格的图像和文本过滤步骤以确保数据集质量,包括分辨率过滤以维持高质量图像和人脸、人脸过滤以去除缺少人脸的图像,以及基于关键词的策略以保留包含与人类相关术语(如国籍、职业和姓名)的描述。通过这些清洗过程,FaceID-6M提供了一个高质量的数据集,优化用于训练强大的FaceID定制模型,通过提供开放的研究与开发资源促进该领域的进步。我们进行了大量实验以展示FaceID-6M的有效性,证明在我们的FaceID-6M数据集上训练的模型达到了与当前工业模型相当且略优的性能。此外,为支持和推进FaceID定制社区的研究,我们完全公开了代码、数据集和模型。我们的代码、模型和数据集可在 https://github.com/ShuheSH/FaceID-6M 获取。

英文摘要:

Due to the data-driven nature of current face identity (FaceID) customization methods, all state-of-the-art models rely on large-scale datasets containing millions of high-quality text-image pairs for training. However, none of these datasets are publicly available, which restricts transparency and hinders further advancements in the field. To address this issue, in this paper, we collect and release FaceID-6M, the first large-scale, open-source FaceID dataset containing 6 million high-quality text-image pairs. Filtered from LAION-5B \cite{schuhmann2022laion}, FaceID-6M undergoes a rigorous image and text filtering steps to ensure dataset quality, including resolution filtering to maintain high-quality images and faces, face filtering to remove images that lack human faces, and keyword-based strategy to retain descriptions containing human-related terms (e.g., nationality, professions and names). Through these cleaning processes, FaceID-6M provides a high-quality dataset optimized for training powerful FaceID customization models, facilitating advancements in the field by offering an open resource for research and development. We conduct extensive experiments to show the effectiveness of our FaceID-6M, demonstrating that models trained on our FaceID-6M dataset achieve performance that is comparable to, and slightly better than currently available industrial models. Additionally, to support and advance research in the FaceID customization community, we make our code, datasets, and models fully publicly available. Our codes, models, and datasets are available at: https://github.com/ShuheSH/FaceID-6M.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑