arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.07030cs.AI
收藏

FairRec:面向深度推荐系统的公平性测试

FairRec: Fairness Testing for Deep Recommender Systems

Zhejiang University(浙江大学);Alibaba Group(阿里巴巴集团)

Huizhong Guo, Jinfeng Li, Jingyi Wang, Xiangyu Liu, Dongxia Wang, Zehong Hu, Rong Zhang, Hui Xue

AI总结:

本文提出FairRec统一框架和DPSO搜索算法,从模型效用、物品多样性等视角高效测试深度推荐系统中的隐藏公平性问题,并通过重排序缓解策略显著提升公平性。

摘要:

基于深度学习的推荐系统(DRSs)在工业界日益广泛部署,以不同方式为人们的日常生活带来了显著便利。然而,推荐系统也被证明存在多种问题,例如回音室效应和马太效应,其中“公平性”概念发挥着核心作用。虽然针对传统深度分类模型已经发展出许多公平性概念及相应的公平性测试方法,但它们本质上很难适用于DRSs。一个主要困难在于,现有的公平性概念与深度推荐系统多样化的测试需求之间仍缺乏系统性的理解和映射,更不用说进一步的测试或调试活动。为弥补这一差距,我们提出了FairRec,这是一个统一框架,支持从多个定制化视角对DRSs进行公平性测试,例如模型效用、物品多样性、物品流行度等。我们还提出了一种新颖、高效的基于搜索的测试方法来应对新挑战,即双端离散粒子群优化(DPSO)算法,以从大量候选群体中有效搜索以特定弱势群体形式存在的隐藏公平性问题。根据测试报告,通过对这些识别出的弱势群体采用简单的重排序缓解策略,我们表明DRSs的公平性可以得到显著提升。我们在领先公司采用的多个工业级DRSs上进行了广泛实验。结果证实,FairRec在识别深度隐藏的公平性问题方面既有效又高效,例如以一半到八分之一的时间实现了95%的测试准确率。

英文摘要:

Deep learning-based recommender systems (DRSs) are increasingly and widely deployed in the industry, which brings significant convenience to people's daily life in different ways. However, recommender systems are also shown to suffer from multiple issues,e.g., the echo chamber and the Matthew effect, of which the notation of "fairness" plays a core role.While many fairness notations and corresponding fairness testing approaches have been developed for traditional deep classification models, they are essentially hardly applicable to DRSs. One major difficulty is that there still lacks a systematic understanding and mapping between the existing fairness notations and the diverse testing requirements for deep recommender systems, not to mention further testing or debugging activities. To address the gap, we propose FairRec, a unified framework that supports fairness testing of DRSs from multiple customized perspectives, e.g., model utility, item diversity, item popularity, etc. We also propose a novel, efficient search-based testing approach to tackle the new challenge, i.e., double-ended discrete particle swarm optimization (DPSO) algorithm, to effectively search for hidden fairness issues in the form of certain disadvantaged groups from a vast number of candidate groups. Given the testing report, by adopting a simple re-ranking mitigation strategy on these identified disadvantaged groups, we show that the fairness of DRSs can be significantly improved. We conducted extensive experiments on multiple industry-level DRSs adopted by leading companies. The results confirm that FairRec is effective and efficient in identifying the deeply hidden fairness issues, e.g., achieving 95% testing accuracy with half to 1/8 time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑