大模型对齐与安全

Whose View of Safety? A Deep DIVE Dataset for Pluralistic Alignment of Text-to-Image Models

Charvi Rastogi, Tian Huey Teh, Pushkar Mishra, Roma Patel, Ding Wang, Mark Díaz, Alicia Parrish, Aida Mostafazadeh Davani, Zoe Ashwood, Michela Paganini, Vinodkumar Prabhakaran, Verena Rieser, Lora Aroyo

机构 * Google DeepMind（谷歌DeepMind） ； Google Research（谷歌研究） 纠错

专题命中 安全评测 ：alignment(title,abstract)；safety(title,abstract)；分类 cs.AI、cs.LG

Comments 28 pages, 16 figures

From Words to Collisions: LLM-Guided Evaluation and Adversarial Generation of Safety-Critical Driving Scenarios

Yuan Gao, Mattia Piccinini, Korbinian Moller, Amr Alanwar, Johannes Betz

机构 * Professorship of Autonomous Vehicle Systems, TUM School of Engineering and Design, Technical University of Munich（自主车辆系统教授职位，技术大学慕尼黑工程与设计学院） ； Munich Institute of Robotics and Machine Intelligence (MIRMI)（慕尼黑机器人与机器智能研究所） ； TUM School of Computation, Information and Technology, Department of Computer Engineering, Technical University of Munich（技术大学慕尼黑计算、信息与技术学院，计算机工程系） 纠错

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CL、cs.AI

Comments Final Version and Paper Accepted at IEEE ITSC 2025

Mind the Modality Gap: Towards a Remote Sensing Vision-Language Model via Cross-modal Alignment

Angelos Zavras, Dimitrios Michail, Begüm Demir, Ioannis Papoutsis

机构 * organization= Orion Lab, National Observatory of Athens \& National Technical University of Athens , country= Greece ； organization= Department of Informatics \& Telematics, Harokopio University of Athens , country= Greece ； organization= Faculty of Electrical Engineering ； organization= BIFOLD - Berlin Institute for the Foundations of Learning 纠错

专题命中 安全评测 ：alignment(title,abstract)

Comments Accepted at the ISPRS Journal of Photogrammetry and Remote Sensing. Our code implementation and weights for all experiments are publicly available at https://github.com/Orion-AI-Lab/MindTheModalityGap

Humans learn to prefer trustworthy AI over human partners

Yaomin Jiang, Levin Brinkmann, Anne-Marie Nussberger, Ivan Soraperra, Jean-François Bonnefon, Iyad Rahwan

机构 * Toulouse School of Economics, Centre National de la Recherche Scientifique (TSM-R), Université Toulouse Capitole（图卢兹经济学院，法国国家科学研究中心（TSM-R），图卢兹大学） 纠错

专题命中 安全评测 ：trustworthy(title)；分类 cs.AI、cs.CY

Generative AI-Driven High-Fidelity Human Motion Simulation

Hari Iyer, Neel Macwan, Atharva Jitendra Hude, Heejin Jeong, Shenghan Guo

机构 * The Polytechnic School, Ira A. Fulton Schools of Engineering, Arizona State University（亚利桑那州立大学工程学院Polytechnic学院） ； School of Manufacturing Systems and Networks, Ira A. Fulton Schools of Engineering, Arizona State University（亚利桑那州立大学工程学院制造系统与网络学院） 纠错

专题命中 安全评测 ：alignment(abstract)；safety(abstract)；分类 cs.AI

ASTRID -- An Automated and Scalable TRIaD for the Evaluation of RAG-based Clinical Question Answering Systems

Mohita Chowdhury, Yajie Vera He, Jared Joselowitz, Aisling Higham, Ernest Lim

机构 * Ufonia Limited（乌菲尼亚有限公司） ； University of York（约克大学） 纠错

专题命中 安全评测 ：alignment(abstract)；分类 cs.CL、cs.AI

Comments 29 pages

PARAM-1 BharatGen 2.9B Model

Kundeshwar Pundalik, Piyush Sawarkar, Nihar Sahoo, Abhishek Shinde, Prateek Chanda, Vedant Goswami, Ajay Nagpal, Atul Singh, Viraj Thakur, Vijay Dewane, Aamod Thakur, Bhargav Patel, Smita Gautam, Bhagwan Panditi, Shyam Pawar, Madhav Kotcha, Suraj Racha, Saral Sureka, Pankaj Singh, Rishi Bal, Rohit Saluja, Ganesh Ramakrishnan

专题命中 安全评测 ：alignment(abstract)；分类 cs.CL、cs.LG

ParaStudent: Generating and Evaluating Realistic Student Code by Teaching LLMs to Struggle

Mihran Miroyan, Rose Niousha, Joseph E. Gonzalez, Gireeja Ranade, Narges Norouzi

机构 * University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 安全评测 ：alignment(abstract)；分类 cs.AI、cs.CY

On Pre-training of Multimodal Language Models Customized for Chart Understanding

Wan-Cyuan Fan, Yen-Chun Chen, Mengchen Liu, Lu Yuan, Leonid Sigal

专题命中 安全评测 ：alignment(abstract)；分类 cs.CL、cs.AI

Comments NeurIPS 2024 Workshop on Adaptive Foundation Models

Automated Interpretation of Non-Destructive Evaluation Contour Maps Using Large Language Models for Bridge Condition Assessment

Viraj Nishesh Darji, Callie C. Liao, Duoduo Liao

机构 * School of Computing（计算学院） ； George Mason University（乔治·玛莎大学） ； College of Science（科学学院） 纠错

专题命中 安全评测 ：safety(abstract)；分类 cs.AI

Journal ref IEEE BigData, Year: 2024; Page: 3258-3263

KiC: Keyword-inspired Cascade for Cost-Efficient Text Generation with LLMs

Woo-Chan Kim, Ji-Hoon Park, Seong-Whan Lee

机构 * Department of Artificial Intelligence, Korea University（人工智能系，韩国大学） 纠错

专题命中 安全评测 ：alignment(abstract)；分类 cs.CL

SafeAgent: Safeguarding LLM Agents via an Automated Risk Simulator

Xueyang Zhou, Weidong Wang, Lin Lu, Jiawen Shi, Guiyao Tie, Yongtian Xu, Lixing Chen, Pan Zhou, Neil Zhenqiang Gong, Lichao Sun

专题命中 安全评测 ：safety(abstract)；分类 cs.AI

Comments 38 pages;12 figures;12 tables

AI-Assisted Fixes to Code Review Comments at Scale

Chandra Maddila, Negar Ghorbani, James Saindon, Parth Thakkar, Vijayaraghavan Murali, Rui Abreu, Jingyue Shen, Brian Zhou, Nachiappan Nagappan, Peter C. Rigby

机构 * Meta 纠错

专题命中 安全评测 ：safety(abstract)；分类 cs.AI

Evaluation of Human Visual Privacy Protection: A Three-Dimensional Framework and Benchmark Dataset

Sara Abdulaziz, Giacomo D'Amicantonio, Egor Bondarev

机构 * Eindhoven University of Technology（埃因霍温理工大学） 纠错

专题命中 安全评测 ：alignment(abstract)

Comments accepted at ICCV'25 workshop CV4BIOM

LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead

Junda He, Christoph Treude, David Lo

专题命中 安全评测 ：trustworthy(abstract)

Comments TOSEM 2030 Special Issue