大模型对齐与安全

SafetyFlow: An Agent-Flow System for Automated LLM Safety Benchmarking

Xiangyang Zhu, Yuan Tian, Chunyi Li, Kaiwei Zhang, Wei Sun, Guangtao Zhai

机构 * Shanghai AI Lab（上海人工智能实验室） ； East China Normal University（东华大学） 纠错

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CL

Comments Code and dataset are available at https://github.com/yangyangyang127/SafetyFlow

CaTE Data Curation for Trustworthy AI

Mary Versa Clemens-Sewall, Christopher Cervantes, Emma Rafkin, J. Neil Otte, Tom Magelinski, Libby Lewis, Michelle Liu, Dana Udwin, Monique Kirkman-Bey

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.LG

BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Web

Zihan Guo, Yuanjian Zhou, Chenyi Wang, Linlin You, Minjie Bian, Weinan Zhang

机构 * Shanghai Innovation Institute（上海创新研究院） ； Sun Yat-sen University（中山大学） ； Zhejiang University（浙江大学） ； Shanghai Data Group Co., Ltd（上海数据集团有限公司） ； Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI

Comments A technical report with 21 pages, 3 figures, and 3 tables

V-RoAst: Visual Road Assessment. Can VLM be a Road Safety Assessor Using the iRAP Standard?

Natchapon Jongwiriyanurak, Zichao Zeng, June Moh Goo, Xinglei Wang, Ilya Ilyankou, Kerkritt Sriroongvikrai, Nicola Christie, Meihui Wang, Huanfa Chen, James Haworth

机构 * University College London（伦敦大学学院） ； Chulalongkorn University（朱拉隆梭大学） 纠错

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI

Open, Reproducible and Trustworthy Robot-Based Experiments with Virtual Labs and Digital-Twin-Based Execution Tracing

Benjamin Alt, Mareike Picklum, Sorin Arion, Franklin Kenghagho Kenfack, Michael Beetz

机构 * AICOR Institute for Artificial Intelligence, University of Bremen（人工智能研究所，不莱梅大学） 纠错

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI

Comments 8 pages, 6 figures, submitted to the 1st IROS Workshop on Embodied AI and Robotics for Future Scientific Discovery

Chemist Eye: A Visual Language Model-Powered System for Safety Monitoring and Robot Decision-Making in Self-Driving Laboratories

Francisco Munguia-Galeano, Zhengxue Zhou, Satheeshkumar Veeramani, Hatem Fakhruldeen, Louis Longley, Rob Clowes, Andrew I. Cooper

机构 * Cooper Group, Department of Chemistry, University of Liverpool（Cooper集团，化学系，利物浦大学） 纠错

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI

A Novel Evaluation Benchmark for Medical LLMs: Illuminating Safety and Effectiveness in Clinical Domains

Shirui Wang, Zhihui Tang, Huaxia Yang, Qiuhong Gong, Tiantian Gu, Hongyang Ma, Yongxin Wang, Wubin Sun, Zeliang Lian, Kehang Mao, Yinan Jiang, Zhicheng Huang, Lingyun Ma, Wenjie Shen, Yajie Ji, Yunhui Tan, Chunbo Wang, Yunlu Gao, Qianling Ye, Rui Lin, Mingyu Chen, Lijuan Niu, Zhihao Wang, Peng Yu, Mengran Lang, Yue Liu, Huimin Zhang, Haitao Shen, Long Chen, Qiguang Zhao, Si-Xuan Liu, Lina Zhou, Hua Gao, Dongqiang Ye, Lingmin Meng, Youtao Yu, Naixin Liang, Jianxiong Wu

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CL

System 2 Reasoning for Human-AI Alignment: Generality and Adaptivity via ARC-AGI

Sejin Kim, Sundong Kim

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI

Urbanite: A Dataflow-Based Framework for Human-AI Interactive Alignment in Urban Visual Analytics

Gustavo Moreira, Leonardo Ferreira, Carolina Veiga, Maryam Hosseini, Fabio Miranda

机构 * University of Illinois Chicago（伊利诺伊大学芝加哥分校） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI

Comments Accepted at IEEE VIS 2025. Urbanite is available at https://urbantk.org/urbanite

Trustworthy Medical Imaging with Large Language Models: A Study of Hallucinations Across Modalities

Anindya Bijoy Das, Shahnewaz Karim Sakib, Shibbir Ahmed

机构 * The University of Akron（阿克隆大学） ； University of Tennessee at Chattanooga（田纳西大学查塔努加分校） ； Texas State University（德克萨斯州立大学） 纠错

专题命中 安全评测 ：trustworthy(title)；safety(abstract)；分类 cs.AI

Conformal Prediction and Trustworthy AI

Anthony Bellotti, Xindi Zhao

机构 * School of Computer Science, University of Nottingham Ningbo China（诺丁汉大学宁波校区计算机科学学院） 纠错

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.LG

Comments Preprint for an essay to be published in The Importance of Being Learnable (Enhancing the Learnability and Reliability of Machine Learning Algorithms) Essays Dedicated to Alexander Gammerman on His 80th Birthday, LNCS Springer Nature Switzerland AG ed. Nguyen K.A. and Luo Z

Safety of Embodied Navigation: A Survey

Zixia Wang, Jia Hu, Ronghui Mu

机构 * University of Exeter（埃克塞特大学） 纠错

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI

T3Time: Tri-Modal Time Series Forecasting via Adaptive Multi-Head Alignment and Residual Fusion

Abdul Monaf Chowdhury, Rabeya Akter, Safaeid Hossain Arib

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.LG

Toward a Trustworthy Optimization Modeling Agent via Verifiable Synthetic Data Generation

Vinicius Lima, Dzung T. Phan, Jayant Kalagnanam, Dhaval Patel, Nianjun Zhou

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI

Comments 25 pages

The Problem with Safety Classification is not just the Models

Sowmya Vajjala

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CL

Comments Pre-print, Short paper

From Neurons to Semantics: Evaluating Cross-Linguistic Alignment Capabilities of Large Language Models via Neurons Alignment

Chongxuan Huang, Yongshi Ye, Biao Fu, Qifeng Su, Xiaodong Shi

机构 * School of Informatics, Xiamen University（厦门大学信息学院） ； Institute of Artificial Intelligence, Xiamen University（厦门大学人工智能学院） ； Key Laboratory of Digital Protection and Intelligent Processing of Intangible Cultural Heritage of Fujian and Taiwan (Xiamen University), Ministry of Culture and Tourism（福建省和台湾非物质文化遗产数字化保护与智能处理重点实验室（厦门大学），文化和旅游部） 纠错

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL

Comments ACL main 2025

"Just a strange pic": Evaluating 'safety' in GenAI Image safety annotation tasks from diverse annotators' perspectives

Ding Wang, Mark Díaz, Charvi Rastogi, Aida Davani, Vinodkumar Prabhakaran, Pushkar Mishra, Roma Patel, Alicia Parrish, Zoe Ashwood, Michela Paganini, Tian Huey Teh, Verena Rieser, Lora Aroyo

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI

Comments Accepted to AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society 2025 (AIES 2025)

Rethinking Suicidal Ideation Detection: A Trustworthy Annotation Framework and Cross-Lingual Model Evaluation

Amina Dzafic, Merve Kavut, Ulya Bayram

专题命中 安全评测 ：trustworthy(title)；分类 cs.CL、cs.AI、cs.CY

Comments This manuscript has been submitted to the IEEE Journal of Biomedical and Health Informatics

ChipAlign: Instruction Alignment in Large Language Models for Chip Design via Geodesic Interpolation

Chenhui Deng, Yunsheng Bai, Haoxing Ren

机构 * NVIDIA（英伟达） 纠错

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI

Comments Accepted to DAC 2025

The impact of labeling automotive AI as "trustworthy" or "reliable" on user evaluation and technology acceptance

John Dorsch, Ophelia Deroy

机构 * Faculty of Philosophy, Philosophy of Science and the Study of Religion, Ludwig-Maximilians-Universität München（哲学学院、科学哲学与宗教研究学院，慕尼黑路德维希-马克西米利安大学） 纠错

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI

Comments 36 pages, 12 figures

Journal ref Nature Scientific Reports, 15, 1481. 2025

Audit, Alignment, and Optimization of LM-Powered Subroutines with Application to Public Comment Processing

Reilly Raab, Mike Parker, Dan Nally, Sadie Montgomery, Anastasia Bernat, Sai Munikoti, Sameera Horawalavithana

机构 * Pacific Northwest National Laboratory（太平洋西北国家实验室） 纠错

专题命中 安全评测 ：alignment(title)；safety(abstract)；分类 cs.CL

Measuring AI Alignment with Human Flourishing

Elizabeth Hilliard, Akshaya Jagadeesh, Alex Cook, Steele Billings, Nicholas Skytland, Alicia Llewellyn, Jackson Paull, Nathan Paull, Nolan Kurylo, Keatra Nesbitt, Robert Gruenewald, Anthony Jantzi, Omar Chavez

机构 * Gloo ； Valkyrie Intelligence ； Biblica 纠错

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI

Evaluating Morphological Alignment of Tokenizers in 70 Languages

Catherine Arnett, Marisa Hudspeth, Brendan O'Connor

机构 * University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校） 纠错

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL

Comments 6 pages, 3 figures. Accepted to the Tokenization Workshop at ICML 2025

Towards Exception Safety Code Generation with Intermediate Representation Agents Framework

Xuanming Zhang, Yuxuan Chen, Yuan Yuan, Minlie Huang

机构 * University of Wisconsin-Madison（威斯康星大学麦迪逊分校） ； Stanford University（斯坦福大学） ； Tsinghua University（清华大学） ； Beihang University（北航大学） 纠错

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CL

Can Video LLMs Refuse to Answer? Alignment for Answerability in Video Large Language Models

Eunseop Yoon, Hee Suk Yoon, Mark A. Hasegawa-Johnson, Chang D. Yoo

机构 * Korea Advanced Institute of Science and Technology (KAIST)（韩国科学技术院） ； University of Illinois at Urbana-Champaign (UIUC)（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL

Comments ICLR 2025

AI Meets Maritime Training: Precision Analytics for Enhanced Safety and Performance

Vishakha Lall, Yisi Liu

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI

Comments Accepted and Presented at 11th International Maritime Science Conference

AI-Governed Agent Architecture for Web-Trustworthy Tokenization of Alternative Assets

Ailiya Borjigin, Wei Zhou, Cong He

机构 * Probe Group Pte. Ltd.（Probe集团） 纠错

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI

Comments 8 Pages, 1 figure

Leveraging Vision-Language Models to Select Trustworthy Super-Resolution Samples Generated by Diffusion Models

Cansu Korkmaz, Ahmet Murat Tekalp, Zafer Dogan

机构 * Department of Electrical and Electronics Engineering and KUIS AI Center, Koç University（电气与电子工程系和KUIS人工智能中心，科克大学） 纠错

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI

Comments 14 pages, 9 figures, 5 tables, accepted to IEEE Transactions on Circuits and Systems for Video Technology

Journal ref IEEE Transactions on Circuits and Systems for Video Technology 2025

Super Co-alignment of Human and AI for Sustainable Symbiotic Society

Yi Zeng, Feifei Zhao, Yuwei Wang, Enmeng Lu, Yaodong Yang, Lei Wang, Chao Liu, Yitao Liang, Dongcheng Zhao, Bing Han, Haibo Tong, Yao Liang, Dongqi Liang, Kang Sun, Boyuan Chen, Jinyu Fan

机构 * Beijing Key Laboratory of Safe AI and Superalignment（北京安全人工智能与超对齐关键实验室） ； Beijing Institute of AI Safety and Governance（北京人工智能安全与治理研究院） ； Brain-inspired Cognitive AI Lab（脑启发认知人工智能实验室） ； Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） ； University of Chinese Academy of Sciences（中国科学院大学） ； Wenge Technology Co., Ltd.（Wenger 技术有限公司） ； Institute for Artificial Intelligence, Peking University（北京大学人工智能研究院） ； Long-term AI（长期人工智能） ； State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University（北京师范大学认知神经科学与学习国家重点实验室） 纠错

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI

StarFT: Robust Fine-tuning of Zero-shot Models via Spuriosity Alignment

Younghyun Kim, Jongheon Jeong, Sangkyung Kwak, Kyungmin Lee, Juho Lee, Jinwoo Shin

机构 * Samsung（三星） ； Korea University（韩国大学） ； General Robotics（通用机器人） ； KAIST（韩国科学技术院） 纠错

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI

Comments IJCAI 2025; Code is available at https://github.com/alinlab/StarFT