大模型对齐与安全

AlphaAlign: Incentivizing Safety Alignment with Extremely Simplified Reinforcement Learning

Yi Zhang, An Zhang, XiuYu Zhang, Leheng Sheng, Yuxin Chen, Zhenkai Liang, Xiang Wang

专题命中 安全训练 ：alignment(title,abstract)；safety(title,abstract)；分类 cs.AI、cs.LG

Mitigating Trojanized Prompt Chains in Educational LLM Use Cases: Experimental Findings and Detection Tool Design

Richard M. Charles, James H. Curry, Richard B. Charles

机构 * University of Colorado, Boulder（科罗拉多大学波德罗尔分校） ； Charles Analytics, Aurora（查尔斯分析公司） 纠错

专题命中 安全训练 ：safety(abstract)；AI safety(abstract)；分类 cs.AI

Comments 12 pages, 1 figure

WebGuard: Building a Generalizable Guardrail for Web Agents

Boyuan Zheng, Zeyi Liao, Scott Salisbury, Zeyuan Liu, Michael Lin, Qinyuan Zheng, Zifan Wang, Xiang Deng, Dawn Song, Huan Sun, Yu Su

机构 * The Ohio State University（俄亥俄州立大学） ； Scale AI ； University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.AI

Comments We publicly release WebGuard, along with its annotation tools and fine-tuned models, to facilitate open-source research on monitoring and safeguarding web agents. All resources are available at https://github.com/OSU-NLP-Group/WebGuard

A GEANT4-Based Simulation of Directional Neutron Detectors Using Liquid Scintillators and Boron Carbide Moderators

J. -H. Chen, M. Mirzakhani, R. Mahapatra, S. Sahoo

专题命中 安全训练 ：safety(abstract)

Portability of Optimizations from SC to TSO

Akshay Gopalakrishnan, Clark Verbrugge

专题命中 安全训练 ：safety(abstract)

Comments Submitted Manuscript. This pre-print has not undergone any post-review modifications/improvements