arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.05741cs.CVcs.LG

ViTNT-FIQA: 基于视觉变换器的无训练面部图像质量评估

ViTNT-FIQA: Training-Free Face Image Quality Assessment with Vision Transformers

Fraunhofer IGD(弗劳恩霍夫计算机图形学研究所);TU Darmstadt(达姆施塔特工业大学)

Guray Ozgur, Eduarda Caldeira, Tahar Chettaoui, Jan Niklas Kolf, Marco Huber, Naser Damer, Fadi Boutros

AI总结:

ViTNT-FIQA通过测量视觉变换器中间块补丁嵌入演变的稳定性,实现无训练的面部图像质量评估,具有高效计算和广泛适用性。

摘要:

面部图像质量评估(FIQA)对于可靠的人脸识别系统至关重要。当前方法主要利用仅最终层的表示,而无训练方法需要多次前向传递或反向传播。我们提出ViTNT-FIQA,一种无训练方法,通过测量视觉变换器(ViT)中间块中补丁嵌入演变的稳定性来评估图像质量。我们证明高质量的人脸图像在块之间表现出稳定的特征细化轨迹,而退化图像则表现出不规则的变换。我们的方法计算连续变换器块中L2规范化补丁嵌入之间的欧几里得距离,并将这些距离汇总为图像级质量评分。我们在一个带有受控退化水平的质量标记合成数据集上经验验证了这种相关性。与现有无训练方法不同,ViTNT-FIQA仅需要一次前向传递,无需反向传播或架构修改。通过在八个基准测试(LFW、AgeDB-30、CFP-FP、CALFW、Adience、CPLFW、XQLFW、IJB-C)上的广泛评估,我们表明ViTNT-FIQA在与最先进方法竞争的同时,保持了计算效率和对任何预训练ViT基础人脸识别模型的即时适用性。

英文摘要:

Face Image Quality Assessment (FIQA) is essential for reliable face recognition systems. Current approaches primarily exploit only final-layer representations, while training-free methods require multiple forward passes or backpropagation. We propose ViTNT-FIQA, a training-free approach that measures the stability of patch embedding evolution across intermediate Vision Transformer (ViT) blocks. We demonstrate that high-quality face images exhibit stable feature refinement trajectories across blocks, while degraded images show erratic transformations. Our method computes Euclidean distances between L2-normalized patch embeddings from consecutive transformer blocks and aggregates them into image-level quality scores. We empirically validate this correlation on a quality-labeled synthetic dataset with controlled degradation levels. Unlike existing training-free approaches, ViTNT-FIQA requires only a single forward pass without backpropagation or architectural modifications. Through extensive evaluation on eight benchmarks (LFW, AgeDB-30, CFP-FP, CALFW, Adience, CPLFW, XQLFW, IJB-C), we show that ViTNT-FIQA achieves competitive performance with state-of-the-art methods while maintaining computational efficiency and immediate applicability to any pre-trained ViT-based face recognition model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑