arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.09597cs.LG
收藏

金融机构敏感数据检测的高精度神经网络模型

Sensitive Data Detection with High-Throughput Neural Network Models for Financial Institutions

Capital One Applied Research(Capital One应用研究院)

Anh Truong, Austin Walters, Jeremy Goodsitt

摘要:

命名实体识别在许多领域得到了广泛的研究。然而,由于缺乏公开可用的标记数据集,敏感实体检测在金融机构生产系统中的应用尚未得到很好的探索。在本文中,我们使用内部和合成数据集来评估各种方法来检测金融机构中常见的非公开个人身份信息(NPI),包括非结构化和结构化数据格式。在两个预测任务上研究了包括CNN、LSTM、BiLSTM-CRF和CNN-CRF在内的神经网络模型:(i)多个数据格式上的实体检测,以及(ii)表格数据集上的列式实体预测。我们将这些模型与其他标准方法在真实数据和合成数据上进行了比较,包括F1分数,精度,召回率和吞吐量。真实的数据集包括内部结构化数据和带有手动标记标签的公共电子邮件数据。我们的实验结果表明,CNN模型在准确性和吞吐量方面简单而有效,因此是部署在生产环境中的最合适的候选模型。最后,我们提供了关于数据限制、数据标签和数据实体内在重叠的几个经验教训。

英文摘要:

Named Entity Recognition has been extensively investigated in many fields. However, the application of sensitive entity detection for production systems in financial institutions has not been well explored due to the lack of publicly available, labeled datasets. In this paper, we use internal and synthetic datasets to evaluate various methods of detecting NPI (Nonpublic Personally Identifiable) information commonly found within financial institutions, in both unstructured and structured data formats. Character-level neural network models including CNN, LSTM, BiLSTM-CRF, and CNN-CRF are investigated on two prediction tasks: (i) entity detection on multiple data formats, and (ii) column-wise entity prediction on tabular datasets. We compare these models with other standard approaches on both real and synthetic data, with respect to F1-score, precision, recall, and throughput. The real datasets include internal structured data and public email data with manually tagged labels. Our experimental results show that the CNN model is simple yet effective with respect to accuracy and throughput and thus, is the most suitable candidate model to be deployed in the production environment(s). Finally, we provide several lessons learned on data limitations, data labelling and the intrinsic overlap of data entities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑