大模型对齐与安全

P-Aligner: Enabling Pre-Alignment of Language Models via Principled Instruction Synthesis

Feifan Song, Bofei Gao, Yifan Song, Yi Liu, Weimin Xiong, Yuyang Song, Tianyu Liu, Guoyin Wang, Houfeng Wang

专题命中 偏好对齐 ：alignment(title,abstract)；分类 cs.CL、cs.AI

FaST: Feature-aware Sampling and Tuning for Personalized Preference Alignment with Limited Data

Thibaut Thonet, Germán Kruszewski, Jos Rozen, Pierre Erbacher, Marc Dymetman

机构 * NAVER Labs Europe（NAVER欧洲实验室） ； Independent Researcher（独立研究者） 纠错

专题命中 偏好对齐 ：alignment(title,abstract)；分类 cs.CL

CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learning

Wenjie Li, Yujie Zhang, Haoran Sun, Yueqi Li, Fanrui Zhang, Mengzhe Xu, Victoria Borja Clausich, Sade Mellin, Renhao Yang, Chenrun Wang, Jethro Zih-Shuo Wang, Shiyi Yao, Gen Li, Yidong Xu, Hanyu Wang, Yilin Huang, Angela Lin Wang, Chen Shi, Yin Zhang, Jianan Guo, Luqi Yang, Renxuan Li, Yang Xu, Jiawei Liu, Yao Zhang, Lei Liu, Carlos Gutiérrez SanRomán, Lei Wang

机构 * College of Health Science and Technology, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院健康科学与技术学院） ； Shanghai Innovation Institute（上海创新研究院） ； Clinical Center for Sports Medicine, Department of Orthopaedics, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院骨科临床中心） ； School of Basic Medical Sciences, Intelligent Medicine Institute, Fudan University（复旦大学基础医学学院） ； Department of Hematology, The First Affiliated Hospital, College of Medicine, Zhejiang University（浙江大学医学院第一附属医院血液科） ； MoE Key Laboratory of Brain-Inspired Intelligent Perception and Cognition, University of Science and Technology of China（中国科学技术大学脑启发智能感知与认知教育部重点实验室） ； Department of Public Health and Primary Care, University of Cambridge（剑桥大学公共卫生与初级保健学院） ； Department of Medicine, Faculty of Health Sciences, Universidad CEU Cardenal Herrera（CEU卡德纳尔-赫尔曼大学健康科学学院医学系） ； Faculty of Medicine, University of Helsinki（赫尔辛基大学医学院） ； X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University（上海交通大学计算机科学学院X-LANCE实验室） ； Department of Hepatobiliary Surgery, National Cancer Center / National Clinical Research Center for Cancer / Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College（中国医学科学院肿瘤医院肝胆外科） ； Department of Surgery, The Ohio State University Wexner Medical Center, The James Comprehensive Cancer Center（俄亥俄州立大学韦克斯纳医学中心外科部，詹姆斯综合癌症中心） ； Ningbo Institute of Technology, Beihang University（北航宁波理工学院） 纠错

专题命中 偏好对齐 ：alignment(abstract)；分类 cs.CL、cs.AI、cs.LG

Are Today's LLMs Ready to Explain Well-Being Concepts?

Bohan Jiang, Dawei Li, Zhen Tan, Chengshuai Zhao, Huan Liu

专题命中 偏好对齐 ：DPO(abstract)；分类 cs.CL、cs.AI

Comments 9 pages, 4 figures, 3 tables

Real-World Offline Reinforcement Learning from Vision Language Model Feedback

Sreyas Venkataraman, Yufei Wang, Ziyu Wang, Navin Sriram Ravie, Zackory Erickson, David Held

机构 * Indian Institute of Technology, Kharagpur（印度理工学院，克哈格浦尔分校） ； IIIS, Tsinghua University（清华大学人工智能研究所） ； Robotics Institute, Carnegie Mellon University（卡内基梅隆大学机器人研究所） 纠错

专题命中 偏好对齐 ：safety(abstract)；分类 cs.AI、cs.LG

Comments 7 pages. Accepted at the LangRob Workshop 2024 @ CoRL, 2024. Accepted at 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025)