大模型对齐与安全

ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMs

Hua Shen, Tiffany Knearem, Reshmi Ghosh, Yu-Ju Yang, Nicholas Clark, Tanushree Mitra, Yun Huang

机构 * NYU Shanghai（纽约大学上海校区） ； New York University（纽约大学） ； University of Washington（华盛顿大学） ； MBZUAI ； Microsoft（微软） ； UIUC（伊利诺伊大学香槟分校） 纠错

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Generative AI for Biosciences: Emerging Threats and Roadmap to Biosecurity

Zaixi Zhang, Souradip Chakraborty, Amrit Singh Bedi, Emilin Mathew, Varsha Saravanan, Le Cong, Alvaro Velasquez, Sheng Lin-Gibson, Megan Blewett, Dan Hendrycs, Alex John London, Ellen Zhong, Ben Raphael, Adji Bousso Dieng, Jian Ma, Eric Xing, Russ Altman, George Church, Mengdi Wang

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；jailbreak(abstract)；AI safety(abstract)

AAGATE: A NIST AI RMF-Aligned Governance Platform for Agentic AI

Ken Huang, Kyriakos Rock Lambros, Jerry Huang, Yasir Mehmood, Hammad Atta, Joshua Beck, Vineeth Sai Narajala, Muhammad Zeeshan Baig, Muhammad Aziz Ul Haq, Nadeem Shahzad, Bhavya Gupta

机构 * RockCyber ； Kleiner Perkins ； Qorvex Consulting & Roshan Consulting ； SAS Institute ； OWASP ； Wentworth Institute of Higher Education & Machine Learning Professional ； Skylink Antenna ； Roshan Consulting & Robotic Process Automation ； Stanford University 纠错

专题命中 AI治理与伦理 ：red teaming(abstract)；分类 cs.AI