QUST团队在SemEval-2024 Task 8:检测AI生成文本的单语和多语方法的综合研究
Team QUST at SemEval-2024 Task 8: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting AI-generated Text
AI总结:
本文介绍了QUST团队在SemEval-2024 Task 8中通过数据增强与清洗,评估并组合微调与多尺度正未标记框架(MPU)的堆叠集成方法来检测AI生成文本,最终在多语言子任务A中获得官方第13名。
摘要:
本文介绍了QUST团队参与SemEval-2024 Task 8的工作。我们首先对数据集进行数据增强和清洗,以提升模型训练效率和准确率。在单语任务中,我们评估了传统深度学习方法、多尺度正未标记框架(MPU)、微调、适配器和集成方法。随后,我们根据单语模型的准确率挑选出表现最佳的模型,并在子任务A和B中进行评估。最终模型构建采用了结合微调与MPU的堆叠集成方法。我们的系统在子任务A多语言设置的官方测试集中获得第8名(按准确率排第8,官方排名为第13)。我们在以下网址发布了系统代码:https://github.com/warmth27/SemEval2024_QUST
英文摘要:
This paper presents the participation of team QUST in Task 8 SemEval 2024. We first performed data augmentation and cleaning on the dataset to enhance model training efficiency and accuracy. In the monolingual task, we evaluated traditional deep-learning methods, multiscale positive-unlabeled framework (MPU), fine-tuning, adapters and ensemble methods. Then, we selected the top-performing models based on their accuracy from the monolingual models and evaluated them in subtasks A and B. The final model construction employed a stacking ensemble that combined fine-tuning with MPU. Our system achieved 8th (scored 8th in terms of accuracy, officially ranked 13th) place in the official test set in multilingual settings of subtask A. We release our system code at:https://github.com/warmth27/SemEval2024_QUST
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。