Toxic Comments Hunter:评分Toxic Comments的严重性
Toxic Comments Hunter : Score Severity of Toxic Comments
摘要:
对有毒言论的检测和识别,有利于营造文明和谐的互联网环境。在这个实验中,我们收集了与有毒评论相关的各种数据集。由于评论数据的特点,我们从不同的角度对其进行数据清洗和特征提取操作,得到不同的有毒评论训练集。在模型构建方面,利用训练集对TFIDF模型进行训练,并分别对Bert模型进行微调。最后,我们将代码封装到软件中,以实时对有毒评论进行评分。
英文摘要:
The detection and identification of toxic comments are conducive to creating a civilized and harmonious Internet environment. In this experiment, we collected various data sets related to toxic comments. Because of the characteristics of comment data, we perform data cleaning and feature extraction operations on it from different angles to obtain different toxic comment training sets. In terms of model construction, we used the training set to train the models based on TFIDF and finetuned the Bert model separately. Finally, we encapsulated the code into software to score toxic comments in real-time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。