This work presents Fair4Free, a novel generative model to generate synthetic fair data using data-free distillation in the latent space. Fair4Free can work on the situation when the data is private or inaccessible. In our approach, we first train a teacher model to create fair representation and then distil the knowledge to a student model (using a smaller architecture). The process of distilling the student model is data-free, i.e. the student model does not have access to the training dataset while distilling. After the distillation, we use the distilled model to generate fair synthetic samples. Our extensive experiments show that our synthetic samples outperform state-of-the-art models in all three criteria (fairness, utility and synthetic quality) with a performance increase of 5% for fairness, 8% for utility and 12% in synthetic quality for both tabular and image datasets.
Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation
School of Computer Science(计算机科学学院);Guangxi Key Lab of MSMI(广西 MSMI 重点实验室);MOE Key Lab of EBIT, Guangxi Normal University, Guilin, 541004, Guangxi, China(教育部 EBIT 重点实验室,广西师范大学,桂林,541004,广西,中国);School of Computer Science and Technology(计算机科学与技术学院);Hainan University(海南大学);China University of Mining and Technology(中国矿业大学)
Personalized Treatment Outcome Prediction from Scarce Data via Dual-Channel Knowledge Distillation and Adaptive Fusion
School of Information Management, Central China Normal University(中央财经大学信息管理学院);School of Cyber Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation, Department of Computer Science and Engineering, Southern University of Science and Technology(广东省脑启发式智能计算重点实验室,南方科技大学计算机科学与工程学院)
Debias the Black-box: A Fair Ranking Framework via Knowledge Distillation
Ping An Technology (Shenzhen) Co., Ltd.(平安科技(深圳)有限公司);University of Science and Technology of China(中国科学技术大学);Shanghai International Studies University(上海外国语大学);Peking University(北京大学)
Towards Collaborative Fairness in Federated Learning Under Imbalanced Covariate Shift
The Pennsylvania State University(宾夕法尼亚州立大学);State University of New York at Albany(纽约州立大学阿尔巴尼分校);University of Minnesota Twin Cities(明尼苏达大学双城分校);Dalian University of Technology(大连理工大学)
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation
Tsinghua-Bosch Joint ML Center(清华-博世联合机器学习中心);ShengShu;Pazhou Laboratory (Huangpu)(琶洲实验室(黄埔));Beijing Key Laboratory of Big Data Management and Analysis Methods(大数据管理与分析方法北京市重点实验室)
Model-to-Data Distillation for Graph Neural Networks
Department of Computer Science, Rice University, Houston, TX 77005, USA(计算机科学系,里士大学,休斯顿,德克萨斯州,77005,美国);Department of Computer Science & Ken Kennedy Institute, Rice University, Houston, TX 77005, USA(计算机科学系及肯尼迪学院,里士大学,休斯顿,德克萨斯州,77005,美国)