大模型对齐与安全

Death by a Thousand Prompts: Open Model Vulnerability Analysis

Amy Chang, Nicholas Conley, Harish Santhanalakshmi Ganesan, Adam Swanda

机构 * Cisco AI Threat Research & Security（思科AI威胁研究与安全） 纠错

专题命中 安全训练 ：alignment(abstract)；safety(abstract)；jailbreak(abstract)；prompt injection(abstract)

Academics and Generative AI: Empirical and Epistemic Indicators of Policy-Practice Voids

R. Yamamoto Ravenor

机构 * Tokyo Women’s Medical University（东京女子医科大学） 纠错

专题命中 安全训练 ：alignment(abstract)；分类 cs.AI、cs.CY

Comments 14 pages, 2 tables, 1 figure

Large language models require a new form of oversight: capability-based monitoring

Katherine C. Kellogg, Bingyang Ye, Yifan Hu, Guergana K. Savova, Byron Wallace, Danielle S. Bitterman

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Comments Under review

Evaluating Control Protocols for Untrusted AI Agents

Jon Kutasov, Chloe Loughridge, Yuqi Sun, Henry Sleight, Buck Shlegeris, Tyler Tracy, Joe Benton

专题命中 安全训练 ：safety(abstract)；分类 cs.AI