arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.16614cs.CRcs.AIcs.LG
收藏

使用基于Transformer的语言模型对Hinglish文本进行网络犯罪投诉的自动分类

Automated Classification of Cybercrime Complaints using Transformer-based Language Models for Hinglish Texts

Indian Institute of Technology Kanpur(印度理工学院坎普尔分校);C3ihub, IIT Kanpur(印度理工学院坎普尔分校C3ihub)

Nanda Rani, Divyanshu Singh, Bikash Saha, Sandeep Kumar Shukla

AI总结:

针对多语言网络犯罪投诉分类难题,提出利用HingBERT和HingRoBERTa处理Hinglish语码混合文本的自动分类框架,结合GenAI数据增强与隐私预处理,实现74.41%准确率,并开发了可部署的即用型工具。

摘要:

网络犯罪的增长以及多语言和语码混合投诉的复杂性给执法和网络安全机构带来了重大挑战。这些组织需要自动化、可扩展的方法来识别犯罪类型,从而实现对大量投诉的高效处理和优先级排序。人工分类效率低下,而传统的机器学习方法无法捕捉文本网络犯罪投诉的语义和上下文细微差别。此外,缺乏公开可用的数据集以及隐私问题阻碍了提出稳健解决方案的研究。为了应对这些挑战,我们提出了一个用于网络犯罪投诉自动分类的框架。该框架利用适应Hinglish的transformers,如HingBERT和HingRoBERTa,来有效处理语码混合输入。我们采用了印度网络犯罪协调中心(I4C)在CyberGuard AI Hackathon 2024期间提供的真实世界数据集。我们采用基于GenAI开源模型的数据增强方法来解决类别不平衡问题。我们还采用隐私感知预处理来确保符合伦理标准,同时保持数据完整性。我们的解决方案取得了显著的性能提升,其中HingRoBERTa达到了74.41%的准确率和71.49%的F1分数。我们还通过将Django REST后端与现代前端集成,开发了一个即用型工具。开发的工具具有可扩展性,已准备好在国家网络犯罪举报门户等平台上进行实际部署。这项工作弥合了网络犯罪投诉管理中的关键空白,为现代网络安全挑战提供了一种可扩展、注重隐私且适应性强的解决方案。

英文摘要:

The rise in cybercrime and the complexity of multilingual and code-mixed complaints present significant challenges for law enforcement and cybersecurity agencies. These organizations need automated, scalable methods to identify crime types, enabling efficient processing and prioritization of large complaint volumes. Manual triaging is inefficient, and traditional machine learning methods fail to capture the semantic and contextual nuances of textual cybercrime complaints. Moreover, the lack of publicly available datasets and privacy concerns hinder the research to present robust solutions. To address these challenges, we propose a framework for automated cybercrime complaint classification. The framework leverages Hinglish-adapted transformers, such as HingBERT and HingRoBERTa, to handle code-mixed inputs effectively. We employ the real-world dataset provided by Indian Cybercrime Coordination Centre (I4C) during CyberGuard AI Hackathon 2024. We employ GenAI open source model-based data augmentation method to address class imbalance. We also employ privacy-aware preprocessing to ensure compliance with ethical standards while maintaining data integrity. Our solution achieves significant performance improvements, with HingRoBERTa attaining an accuracy of 74.41% and an F1-score of 71.49%. We also develop ready-to-use tool by integrating Django REST backend with a modern frontend. The developed tool is scalable and ready for real-world deployment in platforms like the National Cyber Crime Reporting Portal. This work bridges critical gaps in cybercrime complaint management, offering a scalable, privacy-conscious, and adaptable solution for modern cybersecurity challenges.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑