针对余弦距离量身定制的大规模增强的提取电子邮件功能
Massive Enhanced Extracted Email Features Tailored for Cosine Distance
摘要:
在本文中,安然电子邮件数据集(预印本中引用的版本)转换为一组选定的2400个标记的电子邮件的每封电子邮件的数千个功能的过程进行了解释和评估。最后的特征是针对余弦距离定制的,使得余弦距离以可解释的标准化方式反向地反映在两封电子邮件之间共同的每封电子邮件的顶部指示词的数量。标签基于Enron电子邮件数据集(预印本中引用的版本)文件夹树中的叶文件夹名称,所选的2400封电子邮件由8个标签中的每一个300封电子邮件组成。该评价是基于使用余弦距离的k近邻多数表决分类的准确性。除了KNN多数投票分类精度和混淆矩阵,一些统计过程中的报告。使用余弦距离的KNN多数投票分类准确率为76.75%,考虑到所涉及的8个标签,这至少显示了一定程度的成功。转换的结果是48557功能每选定的电子邮件,其中每封电子邮件正好40个功能是非零的。转换的结果是一个名为MeeefTCD(为余弦距离量身定制的大规模增强提取电子邮件功能)的数据集,可在https://web.cs.dal.ca/~barahimi/data-sets/meeeftcd/和本文提到的github存储库中获得。
英文摘要:
In this paper, the process of converting the Enron email dataset (the version cited in the preprint) to thousands of features per email for a selected set of 2400 labelled emails is explained and evaluated. The final features are tailored for Cosine distance so that the Cosine distance invertly reflect the number of top indicative words of each email that are common between the two emails in an explainable normalized fashion. The labelling is based on the leaf folder name in the Enron email dataset (the version cited in the preprint) folders tree and the 2400 emails selected consist 300 emails for each of the 8 labels. The evaluation is based on the accuracy of a k nearest neighbours majority voting classification using Cosine distance. In addition to KNN majority voting classification accuracy and confusion matrix, some statistics for the process is reported. The KNN majority voting classification accuracy using Cosine distance is 76.75% which shows at least some level of success given the 8 labels involved. The result of conversion is 48557 features per selected email out of which exactly 40 features per email are non-zero. The result of conversion is a data set named MeeefTCD (Massive Enhanced Extracted Email Features Tailored for Cosine Distance) available at https://web.cs.dal.ca/~barahimi/data-sets/meeeftcd/ and on a github repository mentioned in this paper.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。