利用提示注入保护众包调查免受ChatGPT的干扰
Safeguarding Crowdsourcing Surveys from ChatGPT with Prompt Injection
AI总结:
针对大语言模型可能被滥用于自动回答众包调查、威胁方法完整性的问题,研究提出基于提示注入的检测机制,经测试有效率超93%,还配套开源工具,助力保障调查方法的严谨性。
摘要:
ChatGPT及其他大语言模型(LLM)已被证明在众包任务中十分有用,可有效标注机器学习训练数据。但这也意味着它们存在被滥用的可能,尤其是被用于自动回答调查。LLM有可能绕过质量保证措施,进而威胁到依赖众包调查的研究方法的完整性。本文提出一种检测调查中LLM生成回复的机制,该机制使用“提示注入”技术,例如可误导LLM给出可预测回复的指令。我们在多种问题场景、问题类型和问题位置下对该技术进行了评估,发现它能可靠检测LLM生成的回复,有效率超过93%。我们还提供了一款开源软件,帮助调查设计者使用该技术检测LLM回复。本研究是确保调查方法在LLM面前仍保持严谨性的一项进展。
英文摘要:
ChatGPT and other large language models (LLMs) have proven useful in crowdsourcing tasks, where they can effectively annotate machine learning training data. However, this means that they also have the potential for misuse, specifically to automatically answer surveys. LLMs can potentially circumvent quality assurance measures, thereby threatening the integrity of methodologies that rely on crowdsourcing surveys. In this paper, we propose a mechanism to detect LLM-generated responses to surveys. The mechanism uses "prompt injection", such as directions that can mislead LLMs into giving predictable responses. We evaluate our technique against a range of question scenarios, types, and positions, and find that it can reliably detect LLM-generated responses with more than 93% effectiveness. We also provide an open-source software to help survey designers use our technique to detect LLM responses. Our work is a step in ensuring that survey methodologies remain rigorous vis-a-vis LLMs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。