大模型对齐与安全

Learning Multi-agent Multi-machine Tending by Mobile Robots

Abdalwhab Abdalwhab, Giovanni Beltrame, Samira Ebrahimi Kahou, David St-Onge

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

Comments 8 pages, 4 figures, Accepted at an AAAI workshop (The Multi-Agent AI in the Real World Workshop)

Non-maximizing policies that fulfill multi-criterion aspirations in expectation

Simon Dima, Simon Fischer, Jobst Heitzig, Joss Oliver

机构 * École Normale Supérieure（巴黎高等师范学院） ； PIK（波茨坦气候影响研究所） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Comments 15 pages main text + 4 pages supplement. Slightly corrected version (corrections in blue in Eq. 11)

Journal ref In: Freeman, R., Mattei, N. (eds) Algorithmic Decision Theory. ADT 2024. Lecture Notes in Computer Science(), vol 15248. Springer, Cham (2025)

Leveraging Large Language Models for Effective and Explainable Multi-Agent Credit Assignment

Kartik Nagpal, Dayi Dong, Jean-Baptiste Bouvier, Negar Mehr

机构 * University of California Berkeley（加州大学伯克利分校） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

Comments 8 pages+Appendix, 6 Figures, AAMAS 2025

Facilitating Emergency Vehicle Passage in Congested Urban Areas Using Multi-agent Deep Reinforcement Learning

Haoran Su

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Comments Ph.D. dissertation in Transportation Systems

On the Design of Safe Continual RL Methods for Control of Nonlinear Systems

Austin Coursey, Marcos Quinones-Grueiro, Gautam Biswas

机构 * Institute for Software Integrated Systems, Vanderbilt University（范德堡大学软件集成系统研究所） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

CHBench: A Chinese Dataset for Evaluating Health in Large Language Models

Chenlu Guo, Nuo Xu, Yi Chang, Yuan Wu

机构 * School of Artificial intelligence, Jilin University（吉林大学人工智能学院） ； Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Jilin University（吉林大学知识驱动人机智能工程研究中心） ； International Center of Future Science, Jilin University（吉林大学未来科学国际中心） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.CL

Comments 11 pages

Know Your Limits: A Survey of Abstention in Large Language Models

Bingbing Wen, Jihan Yao, Shangbin Feng, Chenjun Xu, Yulia Tsvetkov, Bill Howe, Lucy Lu Wang

机构 * University of Washington（华盛顿大学） ； Allen Institute for AI（艾伦人工智能研究所） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.CL

Comments TACL 2024

Reflexive Guidance: Improving OoDD in Vision-Language Models via Self-Guided Image-Adaptive Concept Generation

Jihyo Kim, Seulbi Lee, Sangheum Hwang

机构 * Seoul National University of Science and Technology（首尔科学技术大学） 纠错

专题命中 安全训练 ：trustworthy(abstract)；分类 cs.AI

Comments Accepted at ICLR 2025. The first two authors contributed equally

Learning Efficient Flocking Control based on Gibbs Random Fields

Dengyu Zhang, Chenghao, Feng Xue, Qingrui Zhang

机构 * School of Aeronautics and Astronautics, Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区航空航天学院） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

Comments 9 pages, 10 figures

On the stability of gradient descent with second order dynamics for time-varying cost functions

Travis E. Gibson, Sawal Acharya, Anjali Parashar, Joseph E. Gaudio, Anurdha M. Annaswamy

机构 * Massachusetts Institute of Technology（麻省理工学院） ； Brigham and Women’s Hospital（布莱根妇女医院） ； Harvard Medical School（哈佛医学院） ； Broad Institute of MIT and Harvard（麻省理工学院与哈佛大学博德研究所） ； Stanford University（斯坦福大学） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

Comments Final accepted version of TMLR paper. https://openreview.net/forum?id=HlzjI2fn2T

Journal ref Transactions on Machine Learning Research (2025).

AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligence

Minbeom Kim, Hwanhee Lee, Joonsuk Park, Hwaran Lee, Kyomin Jung

机构 * Seoul National University（首尔大学） ； Chung-Ang University（中央大学） ； NAVER AI Lab（NAVER AI实验室） ； NAVER Cloud（NAVER云） ； University of Richmond（里士满大学） ； Sogang University（西江大学） 纠错

专题命中 安全训练 ：harmlessness(abstract)；分类 cs.CL

Comments 19 pages, 11 figures

Journal ref NAACL 2025

Towards Robust Spacecraft Trajectory Optimization via Transformers

Yuji Takubo, Tommaso Guffanti, Daniele Gammelli, Marco Pavone, Simone D'Amico

机构 * The Aerospace Corporation（航空航天公司） ； University of Nowhere（诺惠尔大学） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Comments Submitted to the IEEE Aerospace Conference 2025. 13 pages, 10 figures

Policy-Adaptable Methods For Resolving Normative Conflicts Through Argumentation and Graph Colouring

Johnny Joyce

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Comments Written and submitted as master's thesis for University of Southampton in 2020

Towards A Litmus Test for Common Sense

Hugo Latapie

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

A Reinforcement Learning Approach to Quiet and Safe UAM Traffic Management

Surya Murthy, John-Paul Clarke, Ufuk Topcu, Zhenyu Gao

机构 * The University of Texas at Austin（德克萨斯大学奥斯汀分校） ； The Hong Kong University of Science and Technology（香港科技大学） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

Comments Paper presented at SciTech 2025

Journal ref AIAA SciTech 2025 Forum

Dialogue Possibilities between a Human Supervisor and UAM Air Traffic Management: Route Alteration

Jeongseok Kim, Kangjin Kim

机构 * SK Telecom（SK电信） ； Chodang University（草堂大学） 纠错

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Comments 18 pages, 2 figures, accepted to the Advances in Artificial Intelligence and Machine Learning (AAIML) journal

Journal ref Advances in Artificial Intelligence and Machine Learning (AAIML), 2023, (3):1352-1368

Quantitative Predictive Monitoring and Control for Safe Human-Machine Interaction

Shuyang Dong, Meiyi Ma, Josephine Lamp, Sebastian Elbaum, Matthew B. Dwyer, Lu Feng

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Private Yet Social: How LLM Chatbots Support and Challenge Eating Disorder Recovery

Ryuhaerang Choi, Taehan Kim, Subin Park, Jennifer G Kim, Sung-Ju Lee

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

Universal Prompt Optimizer for Safe Text-to-Image Generation

Zongyu Wu, Hongcheng Gao, Yueze Wang, Xiang Zhang, Suhang Wang

专题命中 安全训练 ：alignment(abstract)；分类 cs.CL

RL2: Reinforce Large Language Model to Assist Safe Reinforcement Learning for Energy Management of Active Distribution Networks

Xu Yang, Chenhui Lin, Haotian Liu, Wenchuan Wu

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Realizable Continuous-Space Shields for Safe Reinforcement Learning

Kyungmin Kim, Davide Corsi, Andoni Rodriguez, JB Lanier, Benjami Parellada, Pierre Baldi, Cesar Sanchez, Roy Fox

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

Comments Kim, Corsi, and Rodriguez contributed equally

Llama Guard 3-1B-INT4: Compact and Efficient Safeguard for Human-AI Conversations

Igor Fedorov, Kate Plawiak, Lemeng Wu, Tarek Elgamal, Naveen Suda, Eric Smith, Hongyuan Zhan, Jianfeng Chi, Yuriy Hulovatyy, Kimish Patel, Zechun Liu, Changsheng Zhao, Yangyang Shi, Tijmen Blankevoort, Mahesh Pasupuleti, Bilge Soran, Zacharie Delpierre Coudert, Rachad Alao, Raghuraman Krishnamoorthi, Vikas Chandra

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Two Heads Are Better Than One: Collaborative LLM Embodied Agents for Human-Robot Interaction

Mitchell Rosser, Marc. G Carmichael

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Comments 9 pages, 10 figures

Safe Multi-Agent Reinforcement Learning with Convergence to Generalized Nash Equilibrium

Zeyang Li, Navid Azizan

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

RV4Chatbot: Are Chatbots Allowed to Dream of Electric Sheep?

Andrea Gatti, Viviana Mascardi, Angelo Ferrando

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Comments In Proceedings FMAS2024, arXiv:2411.13215

Journal ref EPTCS 411, 2024, pp. 73-90

Vision-based Manipulation of Transparent Plastic Bags in Industrial Setups

F. Adetunji, A. Karukayil, P. Samant, S. Shabana, F. Varghese, U. Upadhyay, R. A. Yadav, A. Partridge, E. Pendleton, R. Plant, Y. Petillot, M. Koskinopoulou

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

A-BDD: Leveraging Data Augmentations for Safe Autonomous Driving in Adverse Weather and Lighting

Felix Assion, Florens Gressner, Nitin Augustine, Jona Klemenc, Ahmed Hammam, Alexandre Krattinger, Holger Trittenbach, Anja Philippsen, Sascha Riemer

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

Real-Time AI-Driven People Tracking and Counting Using Overhead Cameras

Ishrath Ahamed, Chamith Dilshan Ranathunga, Dinuka Sandun Udayantha, Benny Kai Kiat Ng, Chau Yuen

专题命中 安全训练 ：safety(abstract)；分类 cs.AI

Comments This paper is accepted to IEEE Region 10 conference (TENCON) 2024

Test Where Decisions Matter: Importance-driven Testing for Deep Reinforcement Learning

Stefan Pranger, Hana Chockler, Martin Tappler, Bettina Könighofer

专题命中 安全训练 ：safety(abstract)；分类 cs.LG

STAND-Guard: A Small Task-Adaptive Content Moderation Model

Minjia Wang, Pingping Lin, Siqi Cai, Shengnan An, Shengjie Ma, Zeqi Lin, Congrui Huang, Bixiong Xu

专题命中 安全训练 ：safety(abstract)；分类 cs.CL

Comments 20 pages, 1 figure