arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.10132cs.LGcs.AI
收藏

TRAPDOOR:在基于机器学习的基因组分析中重新利用后门来检测数据集偏差

TRAPDOOR: Repurposing backdoors to detect dataset bias in machine learning-based genomic analysis

New York University(纽约大学);New York University Abu Dhabi(纽约大学阿布扎比分校)

Esha Sarkar, Michail Maniatakos

摘要:

机器学习(ML)在图像、语音、文本和数据分析等多个应用中取得了前所未有的性能。使用ML来了解基因突变(基因组学)的潜在模式具有深远的影响,不仅可以克服诊断陷阱,还可以设计癌症等危及生命的疾病的治疗方法。ML算法的成功和可持续性取决于收集和用于训练的数据的质量和多样性。各群体(族裔群体、性别群体等)代表性不足在这样的数据集中,可能导致对某些群体的预测不准确,这可能进一步加剧系统性歧视问题。在这项工作中,我们提出了TRAPDOOR,一种通过重新利用一种主要用于邪恶目的的技术来识别有偏见数据集的方法:神经网络后门。我们考虑了基因组学供应链的典型协作学习环境,其中数据可能来自医院、协作项目或研究机构,而不会意识到对敏感群体的偏见。在这种情况下,我们开发了一种方法来泄漏集体数据的潜在偏差信息,而不会妨碍使用ML后门满足基因组应用的真正性能。使用真实世界的癌症数据集,我们分析了已经存在的对白人的偏见的数据集,并人为地在数据集中引入了偏见,我们的实验结果表明,TRAPDOOR可以以100%的准确率检测数据集偏见的存在,并且还可以通过以很小的误差恢复百分比来提取偏见的程度。

英文摘要:

Machine Learning (ML) has achieved unprecedented performance in several applications including image, speech, text, and data analysis. Use of ML to understand underlying patterns in gene mutations (genomics) has far-reaching results, not only in overcoming diagnostic pitfalls, but also in designing treatments for life-threatening diseases like cancer. Success and sustainability of ML algorithms depends on the quality and diversity of data collected and used for training. Under-representation of groups (ethnic groups, gender groups, etc.) in such a dataset can lead to inaccurate predictions for certain groups, which can further exacerbate systemic discrimination issues. In this work, we propose TRAPDOOR, a methodology for identification of biased datasets by repurposing a technique that has been mostly proposed for nefarious purposes: Neural network backdoors. We consider a typical collaborative learning setting of the genomics supply chain, where data may come from hospitals, collaborative projects, or research institutes to a central cloud without awareness of bias against a sensitive group. In this context, we develop a methodology to leak potential bias information of the collective data without hampering the genuine performance using ML backdooring catered for genomic applications. Using a real-world cancer dataset, we analyze the dataset with the bias that already existed towards white individuals and also introduced biases in datasets artificially, and our experimental result show that TRAPDOOR can detect the presence of dataset bias with 100% accuracy, and furthermore can also extract the extent of bias by recovering the percentage with a small error.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑