用于作弊团伙检测的人在回路AI
Human-in-the-Loop AI for Cheating Ring Detection
AI总结:
针对在线考试中专业作弊服务形成的作弊团伙问题,提出一种遵循RAI标准的人在回路AI检测系统,通过定制设计原则与公平性评估方法,实现作弊者的有效检测与遏制。
摘要:
近年来,在线考试因其易用性而变得流行。然而,人们对在线考试的安全性提出了一些担忧,特别是在专业作弊服务帮助恶意考生通过考试,形成所谓的“作弊团伙”的情况下。在本文中,我们引入了一种用于作弊团伙检测的人在回路AI系统,旨在检测和遏制这些作弊团伙。我们概述了这种人在回路AI系统的底层逻辑,探索了为实现检测作弊者目标而量身定制的设计原则。此外,我们说明了用于评估其性能和公平性的方法,旨在减轻与AI系统相关的意外风险。该系统的设计和开发遵循负责任的AI(RAI)标准,确保在整个开发过程中融入伦理考量。
英文摘要:
Online exams have become popular in recent years due to their accessibility. However, some concerns have been raised about the security of the online exams, particularly in the context of professional cheating services aiding malicious test takers in passing exams, forming so-called "cheating rings". In this paper, we introduce a human-in-the-loop AI cheating ring detection system designed to detect and deter these cheating rings. We outline the underlying logic of this human-in-the-loop AI system, exploring its design principles tailored to achieve its objectives of detecting cheaters. Moreover, we illustrate the methodologies used to evaluate its performance and fairness, aiming to mitigate the unintended risks associated with the AI system. The design and development of the system adhere to Responsible AI (RAI) standards, ensuring that ethical considerations are integrated throughout the entire development process.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。