用于客户-服务器的面部分析的视觉签名的深度融合
Deep fusion of visual signatures for client-server facial analysis
摘要:
人脸分析是实现人机交互的关键技术。在这种情况下,我们提出了一个客户-服务器的【形】框架,其中客户端将待分析的面部的签名发送到服务器,并且作为回报,服务器发送回描述面部的各种信息,例如,该人是男性还是女性,她/他是否秃顶,他是否有胡子,等等。视觉特征(或组合);从非常简单和有效的特征(如局部二进制模式)到更复杂和计算量大的特征(如基于Fisher向量和CNN),这取决于可用的计算资源。本文所面临的挑战是设计一个通用的通用表示,这样一个单一的合并签名被发送到服务器,无论是由客户端计算的功能的类型和数量,但确保最佳性能。我们的解决方案是基于学习一个共同的最佳子空间,用于对齐不同的面部特征并将其合并为通用签名。我们已经在具有挑战性的CelebA数据集上验证了所提出的方法,当测试时有丰富的表示时,我们的方法优于现有的最先进的方法,同时由于客户端的资源限制,当测试时只有简单的签名(如LBP)时,我们的方法具有竞争力。
英文摘要:
Facial analysis is a key technology for enabling human-machine interaction. In this context, we present a client-server framework, where a client transmits the signature of a face to be analyzed to the server, and, in return, the server sends back various information describing the face e.g. is the person male or female, is she/he bald, does he have a mustache, etc. We assume that a client can compute one (or a combination) of visual features; from very simple and efficient features, like Local Binary Patterns, to more complex and computationally heavy, like Fisher Vectors and CNN based, depending on the computing resources available. The challenge addressed in this paper is to design a common universal representation such that a single merged signature is transmitted to the server, whatever be the type and number of features computed by the client, ensuring nonetheless an optimal performance. Our solution is based on learning of a common optimal subspace for aligning the different face features and merging them into a universal signature. We have validated the proposed method on the challenging CelebA dataset, on which our method outperforms existing state-of-the-art methods when rich representation is available at test time, while giving competitive performance when only simple signatures (like LBP) are available at test time due to resource constraints on the client.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。