Offscript: Automated Auditing of Instruction Adherence in LLMs
Offscript: LLMs指令遵循自动审计
机构 * University of Washington Information School Seattle Washington USA ; University of Washington\ G. Allen School of Computer Science \& Engineering Seattle Washington USA ; University of Washington Information School ; University of Washington\ G. Allen School of Computer Science \& Engineering
AI总结 Offscript通过自动化审计检测LLM指令遵循问题,揭示86.4%的对话中存在潜在违规行为,其中22.2%经人工确认为实质性违规。