大模型对齐与安全 - arXivDaily 专题

2510.21794 2025-10-28 cs.CV cs.AI 83%

Token-Level Inference-Time Alignment for Vision-Language Models

Kejia Chen, Jiawen Zhang, Jiacong Hu, Kewei Gao, Jian Lou, Zunlei Feng, Mingli Song

机构 * Zhejiang University（浙江大学）； Sun Yat-sen University（中山大学）

专题命中偏好对齐：alignment(title,abstract)；DPO(abstract)；分类 cs.AI

2505.05465 2025-10-28 cs.CL cs.AI cs.LG 82%

ComPO: Preference Alignment via Comparison Oracles

Peter Chen, Xi Chen, Wotao Yin, Tianyi Lin

机构 * Columbia University（哥伦比亚大学）； Stern School of Business（斯特恩商学院）； New York University（纽约大学）； DAMO Academy, Alibaba Group US（阿里云达摩院）

专题命中偏好对齐：alignment(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to NeurIPS 2025

2502.07193 2025-10-28 cs.LG stat.ML 79%

Provably Efficient Online RLHF with One-Pass Reward Modeling

Long-Fei Li, Yu-Yang Qian, Peng Zhao, Zhi-Hua Zhou

机构 * National Key Laboratory for Novel Software Technology, Nanjing University, China（国家新型软件技术实验室，南京大学）； School of Artificial Intelligence, Nanjing University, China（人工智能学院，南京大学）

专题命中偏好对齐：RLHF(title,abstract)；分类 cs.LG

Comments NeurIPS 2025; The first two authors contributed equally

2502.19158 2025-10-28 cs.CL cs.AI 73%

When Personalization Meets Reality: A Multi-Faceted Analysis of Personalized Preference Learning

Yijiang River Dong, Tiancheng Hu, Yinhong Liu, Ahmet Üstün, Nigel Collier

机构 * University of Cambridge（剑桥大学）； Cohere For AI

专题命中偏好对齐：RLHF(abstract)；safety(abstract)；分类 cs.CL、cs.AI

2503.07426 2025-10-28 cs.LG cs.AI 73%

RePO: Understanding Preference Learning Through ReLU-Based Optimization

Junkang Wu, Kexin Huang, Xue Wang, Jinyang Gao, Bolin Ding, Jiancan Wu, Xiangnan He, Xiang Wang

机构 * University of Science and Technology of China（中国科学技术大学）； Alibaba Group（阿里巴巴集团）； Institute of Dataspace, Hefei Comprehensive National Science Center（数据空间研究所，合肥综合性国家科学中心）； MoE Key Lab of BIPC, University of Science and Technology of China（BIPC联合实验室，中国科学技术大学）

专题命中偏好对齐：RLHF(abstract)；DPO(abstract)；分类 cs.AI、cs.LG

2502.13177 2025-10-28 cs.LG cs.AI 73%

KL Penalty Control via Perturbation for Direct Preference Optimization

Sangkyu Lee, Janghoon Han, Hosung Song, Stanley Jungkyu Choi, Honglak Lee, Youngjae Yu

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.AI、cs.LG

Comments Published as a main conference track paper at NeurIPS 2025

2510.23590 2025-10-28 cs.LG 70%

Lightweight Robust Direct Preference Optimization

Cheol Woo Kim, Shresth Verma, Mauricio Tec, Milind Tambe

机构 * School of Engineering and Applied Sciences, Harvard University（哈佛大学工程与应用科学学院）

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.LG

Comments arXiv admin note: substantial text overlap with arXiv:2509.02709

2510.22954 2025-10-28 cs.CL 70%

Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)

Liwei Jiang, Yuanjun Chai, Margaret Li, Mickel Liu, Raymond Fok, Nouha Dziri, Yulia Tsvetkov, Maarten Sap, Alon Albalak, Yejin Choi

专题命中偏好对齐：safety(abstract)；AI safety(abstract)；分类 cs.CL

Comments NeurIPS 2025 D&B Paper (Oral); Camera-Ready Version

2510.22084 2025-10-28 cs.CL 70%

Compositional Bias Control in Large Language Models: Preference Learning Fails, Supervision Succeeds

Atij Mahesh

机构 * University of California, Los Angeles（加州大学洛杉矶分校）

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

Comments 20 pages

2505.19601 2025-10-28 cs.LG cs.AI cs.CL 67%

Preference Optimization by Estimating the Ratio of the Data Distribution

Yeongmin Kim, Heesun Bae, Byeonghu Na, Il-Chul Moon

机构 * Korea Advanced Institute of Science and Technology (KAIST)（韩国科学技术院）

专题命中偏好对齐：DPO(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NeurIPS 2025

2504.10637 2025-10-28 cs.CL cs.AI cs.LG 67%

Better Estimation of the Kullback--Leibler Divergence Between Language Models

Afra Amini, Tim Vieira, Ryan Cotterell

机构 * ETH Zürich（苏黎世联邦理工学院）

专题命中偏好对齐：RLHF(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NeurIPS 2025

2510.23217 2025-10-28 cs.CL cs.AI 62%

Process Reward Models for Sentence-Level Verification of LVLM Radiology Reports

Alois Thomas, Maya Varma, Jean-Benoit Delbrouck, Curtis P. Langlotz

机构 * AIMI Center Stanford University（AIMI中心斯坦福大学）

专题命中偏好对齐：safety(abstract)；分类 cs.CL、cs.AI

2510.21847 2025-10-28 cs.LG 57%

SynCast: Synergizing Contradictions in Precipitation Nowcasting via Diffusion Sequential Preference Optimization

Kaiyi Xu, Junchao Gong, Wenlong Zhang, Ben Fei, Lei Bai, Wanli Ouyang

机构 * University of Science and Technology of China（中国科学技术大学）； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）； Shanghai Jiao Tong University（上海交通大学）； Chinese University of Hong Kong（香港中文大学）

专题命中偏好对齐：alignment(abstract)；分类 cs.LG

2509.05818 2025-10-28 cs.AI 57%

Chatbot To Help Patients Understand Their Health

Won Seok Jang, Hieu Tran, Manav Mistry, SaiKiran Gandluri, Yifan Zhang, Sharmin Sultana, Sunjae Kown, Yuan Zhang, Zonghai Yao, Hong Yu

机构 * Center for Healthcare Organization and Implementation Research, VA Bedford Health Care（VA贝德福德医疗中心健康组织与实施研究中心）； Miner School of Computer and Information Sciences, University of Massachusetts Lowell（马萨诸塞大学洛厄尔分校计算机与信息科学学院）； Manning College of Information and Computer Sciences, University of Massachusetts Amherst（马萨诸塞大学阿姆赫斯特分校信息与计算机科学学院）

专题命中偏好对齐：alignment(abstract)；分类 cs.AI

Comments Accepted in EMNLP 2025 Findings

2510.21723 2025-10-28 cs.HC 50%

Recognizing internal states in AI: evidence from patterned preferences in large language models

Annika Hedberg

专题命中偏好对齐：alignment(abstract)

Comments 14 pages, 1 table. Includes test protocol transcript and multi-system response data

1. 偏好对齐 15 篇