大模型对齐与安全

Contextual Agent Security: A Policy for Every Purpose

Lillian Tsai, Eugene Bagdasarian

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.LG

Comments Workshop in Hot Topics in Operating Systems (HotOS) 2025

Adapting a World Model for Trajectory Following in a 3D Game

Marko Tot, Shu Ishida, Abdelhak Lemkhenter, David Bignell, Pallavi Choudhury, Chris Lovett, Luis França, Matheus Ribeiro Furtado de Mendonça, Tarun Gupta, Darren Gehring, Sam Devlin, Sergio Valcarcel Macua, Raluca Georgescu

专题命中 安全训练 ：alignment(abstract)；分类 cs.AI、cs.LG

Selective Demonstration Retrieval for Improved Implicit Hate Speech Detection

Yumin Kim, Hwanhee Lee

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.AI

Conversational Medical AI: Ready for Practice

Antoine Lizée, Pierre-Auguste Beaucoté, James Whitbeck, Marion Doumeingts, Anaël Beaugnon, Isabelle Feldhaus

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.CY

Comments Accepted to AAAI25 (Oral, workshop) 14 pages, 7 figures, 3 tables

Towards Understanding and Improving Refusal in Compressed Models via Mechanistic Interpretability

Vishnu Kabir Chhabra, Mohammad Mahdi Khalili

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.AI

Keyword-Oriented Multimodal Modeling for Euphemism Identification

Yuxue Hu, Junsong Li, Meixuan Chen, Dongyu Su, Tongguan Wang, Ying Sha

专题命中 安全训练 ：alignment(abstract)；分类 cs.CL、cs.AI

Probabilistic Shielding for Safe Reinforcement Learning

Edwin Hamel-De le Court, Francesco Belardinelli, Alexander W. Goodall

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Comments 13 pages, 3 figures, Conference: AAAI 2025

Exploring the Limits of Zero Shot Vision Language Models for Hate Meme Detection: The Vulnerabilities and their Interpretations

Naquee Rizwan, Paramananda Bhaskar, Mithun Das, Swadhin Satyaprakash Majhi, Punyajoy Saha, Animesh Mukherjee

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.LG

Robust LLM safeguarding via refusal feature adversarial training

Lei Yu, Virginie Do, Karen Hambardzumyan, Nicola Cancedda

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.LG

Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics

Seungbeen Lee, Seungwon Lim, Seungju Han, Giyeong Oh, Hyungjoo Chae, Jiwan Chung, Minju Kim, Beong-woo Kwak, Yeonsoo Lee, Dongha Lee, Jinyoung Yeo, Youngjae Yu

专题命中 安全训练 ：alignment(abstract)；分类 cs.CL、cs.AI

Comments Accepted to NAACL2025 Findings

SafeSlice: Enabling SLA-Compliant O-RAN Slicing via Safe Deep Reinforcement Learning

Ahmad M. Nagib, Hatem Abou-Zeid, Hossam S. Hassanein

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Comments This article has been accepted for presentation in the IEEE International Conference on Machine Learning for Communication and Networking (ICMLCN) 2025

Balancing SoC in Battery Cells using Safe Action Perturbations

E Harshith Kumar Yadav, Rahul Narava, Anshika, Shashi Shekher Jha

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models

Longchao Da, Justin Turnau, Thirulogasankar Pranav Kutralingam, Alvaro Velasquez, Paulo Shakarian, Hua Wei

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Comments 19 pages, 6 figures, 5 tables

Provably Safe Neural Network Controllers via Differential Dynamic Logic

Samuel Teuber, Stefan Mitsch, André Platzer

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Comments 39 pages (main paper has 10 pages), 13 figures; Accepted at the Thirty-Eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024)

Journal ref in Advances in Neural Information Processing Systems, 2024, pp. 1586-1624

AutoPureData: Automated Filtering of Undesirable Web Data to Update LLM Knowledge

Praneeth Vadlapati

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.AI

Comments Final version

Journal ref Journal of Mathematical & Computer Applications, 3 (2024) E121

Gradient Co-occurrence Analysis for Detecting Unsafe Prompts in Large Language Models

Jingyuan Yang, Bowen Yan, Rongjun Li, Ziyu Zhou, Xin Chen, Zhiyong Feng, Wei Peng

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.AI

Atoxia: Red-teaming Large Language Models with Target Toxic Answers

Yuhao Du, Zhuo Li, Pengyu Cheng, Xiang Wan, Anningzhe Gao

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.AI

Comments Accepted to Findings of NAACL-2025

Leveraging Constraint Violation Signals For Action-Constrained Reinforcement Learning

Janaka Chathuranga Brahmanage, Jiajing Ling, Akshat Kumar

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Comments 7 pages and 5 pages supplementary

Video2Policy: Scaling up Manipulation Tasks in Simulation through Internet Videos

Weirui Ye, Fangchen Liu, Zheng Ding, Yang Gao, Oleh Rybkin, Pieter Abbeel

专题命中 安全训练 ：alignment(abstract)；分类 cs.AI、cs.LG

SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Models

Yi Wu, Zikang Xiong, Yiran Hu, Shreyash S. Iyengar, Nan Jiang, Aniket Bera, Lin Tan, Suresh Jagannathan

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.AI

Comments This paper has been accepted for presentation at the 2025 IEEE International Conference on Robotics and Automation (ICRA), May 19-23, 2025, Atlanta, USA, and for inclusion in the conference proceeding

Shield Synthesis for LTL Modulo Theories

Andoni Rodriguez, Guy Amir, Davide Corsi, Cesar Sanchez, Guy Katz

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Comments To appear in AAAI 2025

FLAME: Flexible LLM-Assisted Moderation Engine

Ivan Bakulin, Ilia Kopanichuk, Iaroslav Bespalov, Nikita Radchenko, Vladimir Shaposhnikov, Dmitry Dylov, Ivan Oseledets

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.AI

Free Energy Risk Metrics for Systemically Safe AI: Gatekeeping Multi-Agent Study

Michael Walters, Rafael Kaufmann, Justice Sefas, Thomas Kopinski

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Comments 9 pages, 1 figure

SoNIC: Safe Social Navigation with Adaptive Conformal Inference and Constrained Reinforcement Learning

Jianpeng Yao, Xiaopan Zhang, Yu Xia, Zejin Wang, Amit K. Roy-Chowdhury, Jiachen Li

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Comments Project website: https://sonic-social-nav.github.io/; 16 pages

Exploring Empty Spaces: Human-in-the-Loop Data Augmentation

Catherine Yeh, Donghao Ren, Yannick Assogba, Dominik Moritz, Fred Hohman

专题命中 安全训练 ：safety(abstract)；分类 cs.CL、cs.LG

Comments Code: https://github.com/apple/ml-interactive-data-augmentation/

Adaptive Learn-then-Test: Statistically Valid and Efficient Hyperparameter Selection

Matteo Zecchin, Sangwoo Park, Osvaldo Simeone

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Temporal Logic Specification-Conditioned Decision Transformer for Offline Safe Reinforcement Learning

Zijian Guo, Weichao Zhou, Wenchao Li

专题命中 安全训练 ：alignment(abstract)；分类 cs.AI、cs.LG

Comments Published in ICML 2024

Refusal Behavior in Large Language Models: A Nonlinear Perspective

Fabian Hildebrandt, Andreas Maier, Patrick Krauss, Achim Schilling

专题命中 安全训练 ：alignment(abstract)；分类 cs.CL、cs.AI

Constrained Optimization of Charged Particle Tracking with Multi-Agent Reinforcement Learning

Tobias Kortus, Ralf Keidel, Nicolas R. Gauger, Jan Kieseler

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

CuRLA: Curriculum Learning Based Deep Reinforcement Learning for Autonomous Driving

Bhargava Uppuluri, Anjel Patel, Neil Mehta, Sridhar Kamath, Pratyush Chakraborty

专题命中 安全训练 ：safety(abstract)；分类 cs.AI、cs.LG

Comments To be published in the 17th International Conference on Agents and Artificial Intelligence (ICAART), Feb 2025