arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2112.02557cs.CLcs.AI
收藏

基于矢量隐写的文本表示的可解释隐私保护

Interpretable Privacy Preservation of Text Representations Using Vector Steganography

Purdue University(普渡大学)

Geetanjali Bihani

摘要:

由语言模型(LM)生成的上下文单词表示学习训练语料库中存在的虚假关联。最近的研究结果表明,对手可以利用这些协会逆向工程的私人属性中提到的语料库。这些发现促使人们努力将语言模型的隐私风险降到最低。然而,现有的方法缺乏可解释性,妥协的数据效用,并未能提供隐私保障。因此,我博士研究的目标是开发可解释的方法来保护文本表示的隐私,在保证隐私的同时保留数据实用性。为此,我的目标是研究和开发方法,将隐写修改的矢量几何混淆潜在的虚假关联,并保留在训练过程中学到的分布语义属性。

英文摘要:

Contextual word representations generated by language models (LMs) learn spurious associations present in the training corpora. Recent findings reveal that adversaries can exploit these associations to reverse-engineer the private attributes of entities mentioned within the corpora. These findings have led to efforts towards minimizing the privacy risks of language models. However, existing approaches lack interpretability, compromise on data utility and fail to provide privacy guarantees. Thus, the goal of my doctoral research is to develop interpretable approaches towards privacy preservation of text representations that retain data utility while guaranteeing privacy. To this end, I aim to study and develop methods to incorporate steganographic modifications within the vector geometry to obfuscate underlying spurious associations and preserve the distributional semantic properties learnt during training.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑