大模型对齐与安全

Resolving Conflicting Constraints in Multi-Agent Reinforcement Learning with Layered Safety

Jason J. Choi, Jasmine Jerry Aloor, Jingqi Li, Maria G. Mendoza, Hamsa Balakrishnan, Claire J. Tomlin

机构 * University of California, Berkeley（加州大学伯克利分校） ； Massachusetts Institute of Technology（麻省理工学院） 纠错

专题命中 安全训练 ：safety(title,abstract)

Comments Accepted for publication at the 2025 Robotics: Science and Systems Conference. 18 pages, 8 figures

Beyond Monoliths: Expert Orchestration for More Capable, Democratic, and Safe Language Models

Philip Quirke, Narmeen Oozeer, Chaithanya Bandi, Amir Abdullah, Jason Hoelscher-Obermaier, Jeff M. Phillips, Joshua Greaves, Clement Neo, Michael Lan, Fazl Barez, Shriyash Upadhyay

专题命中 安全训练 ：alignment(abstract)；safety(abstract)；分类 cs.CY

Comments 8 pages, 2 figures

Verifying Memoryless Sequential Decision-making of Large Language Models

Dennis Gross, Helge Spieker, Arnaud Gotlieb

机构 * Simula Research Laboratory（Simula研究实验室） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

EigenScore: OOD Detection using Covariance in Diffusion Models

Shirin Shoushtari, Yi Wang, Xiao Shi, M. Salman Asif, Ulugbek S. Kamilov

机构 * Washington University in St. Louis（华盛顿大学圣路易斯分校） ； University of California, Riverside（加州大学河滨分校） 纠错

专题命中 安全训练 ：safety(abstract)

Trajectory-Optimized Density Control with Flow Matching

Xu Duan, Dongmei Chen

专题命中 安全训练 ：alignment(abstract)