P-Aligner: Enabling Pre-Alignment of Language Models via Principled Instruction Synthesis
专题命中 偏好对齐 :alignment(title,abstract);分类 cs.CL、cs.AI
AI 大模型
大模型对齐、安全、越狱、红队、提示注入和可信评测。
专题命中 偏好对齐 :alignment(title,abstract);分类 cs.CL、cs.AI
机构 * NAVER Labs Europe(NAVER欧洲实验室) ; Independent Researcher(独立研究者)
专题命中 偏好对齐 :alignment(title,abstract);分类 cs.CL
机构 * College of Health Science and Technology, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院健康科学与技术学院) ; Shanghai Innovation Institute(上海创新研究院) ; Clinical Center for Sports Medicine, Department of Orthopaedics, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院骨科临床中心) ; School of Basic Medical Sciences, Intelligent Medicine Institute, Fudan University(复旦大学基础医学学院) ; Department of Hematology, The First Affiliated Hospital, College of Medicine, Zhejiang University(浙江大学医学院第一附属医院血液科) ; MoE Key Laboratory of Brain-Inspired Intelligent Perception and Cognition, University of Science and Technology of China(中国科学技术大学脑启发智能感知与认知教育部重点实验室) ; Department of Public Health and Primary Care, University of Cambridge(剑桥大学公共卫生与初级保健学院) ; Department of Medicine, Faculty of Health Sciences, Universidad CEU Cardenal Herrera(CEU卡德纳尔-赫尔曼大学健康科学学院医学系) ; Faculty of Medicine, University of Helsinki(赫尔辛基大学医学院) ; X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院X-LANCE实验室) ; Department of Hepatobiliary Surgery, National Cancer Center / National Clinical Research Center for Cancer / Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院肿瘤医院肝胆外科) ; Department of Surgery, The Ohio State University Wexner Medical Center, The James Comprehensive Cancer Center(俄亥俄州立大学韦克斯纳医学中心外科部,詹姆斯综合癌症中心) ; Ningbo Institute of Technology, Beihang University(北航宁波理工学院)
专题命中 偏好对齐 :alignment(abstract);分类 cs.CL、cs.AI、cs.LG
专题命中 偏好对齐 :DPO(abstract);分类 cs.CL、cs.AI
Comments 9 pages, 4 figures, 3 tables
机构 * Indian Institute of Technology, Kharagpur(印度理工学院,克哈格浦尔分校) ; IIIS, Tsinghua University(清华大学人工智能研究所) ; Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所)
专题命中 偏好对齐 :safety(abstract);分类 cs.AI、cs.LG
Comments 7 pages. Accepted at the LangRob Workshop 2024 @ CoRL, 2024. Accepted at 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025)
专题命中 安全训练 :alignment(title,abstract);safety(abstract);分类 cs.AI
机构 * Zhejiang University(浙江大学) ; Xiamen University(厦门大学) ; Shanghai Jiao Tong University(上海交通大学)
专题命中 安全训练 :safety(title,abstract);分类 cs.CL、cs.AI
机构 * Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所) ; Nanyang Technological University(南洋理工大学) ; University of Chinese Academy of Sciences(中国科学院大学)
专题命中 安全训练 :safety(abstract);分类 cs.AI
专题命中 安全训练 :trustworthy(abstract);分类 cs.LG
机构 * School of Computer Science, Wuhan University, China(武汉大学计算机学院) ; Zhongguancun Academy, Beijing, China(中关村学院)
专题命中 越狱攻击 :jailbreak(title,abstract);alignment(abstract);分类 cs.AI
Comments Accepted to ACL 2025 (Findings), camera-ready version
专题命中 越狱攻击 :alignment(abstract);分类 cs.CL、cs.AI
专题命中 红队测试 :red teaming(title,abstract);分类 cs.AI、cs.LG
机构 * Thoughtworks AI Research Labs(Thoughtworks人工智能研究实验室)
专题命中 幻觉与事实性 :trustworthy(abstract);分类 cs.AI
专题命中 幻觉与事实性 :alignment(abstract);分类 cs.LG
专题命中 安全评测 :alignment(title,abstract);分类 cs.LG
专题命中 安全评测 :alignment(title,abstract)
专题命中 安全评测 :alignment(abstract);safety(abstract);分类 cs.CL、cs.LG
Comments The first two authors (Xiangzhe Xu and Guangyu Shen) contributed equally to this work
机构 * Edinburgh Napier University(爱丁堡纳皮尔大学)
专题命中 安全评测 :alignment(abstract);分类 cs.CL、cs.AI、cs.LG
机构 * Fakulti Komputeran dan Meta-Teknologi (META), Universiti Pendidikan Sultan Idris(计算机与元技术学院(META),苏丹依德里斯教育大学)
专题命中 安全评测 :alignment(abstract);分类 cs.CL、cs.AI
机构 * Independent Researcher(独立研究者)
专题命中 安全评测 :trustworthy(abstract);分类 cs.AI、cs.CY
机构 * Department of Engineering Science, University of Oxford(牛津大学工程科学系) ; Department of Electrical Engineering, Imperial College London(伦敦帝国学院电子工程系)
专题命中 安全评测 :alignment(abstract);分类 cs.CL
Comments 8 pages, 4 figures
机构 * Microsoft Research(微软研究院) ; Lancaster University(兰卡斯特大学) ; University of Washington(华盛顿大学)
专题命中 安全评测 :alignment(abstract);分类 cs.CL
机构 * School of Computer Science Carnegie Mellon University Pittsburgh PA USA ; School of Computer Science Carnegie Mellon University
专题命中 安全评测 :alignment(abstract);分类 cs.AI
Comments This paper has been accepted to UIST 2025. For additional materials and project details, please see: https://www.cs.cmu.edu/~helalaou/publications/stepwrite
机构 * College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China(深圳大学计算机科学与软件工程学院) ; Shenzhen Key Laboratory of Visual Object Detection and Recognition, Harbin Institute of Technology, Shenzhen, 518055, China(视觉对象检测与识别深圳重点实验室) ; Laboratory for Artificial Intelligence in Design, Hong Kong(人工智能设计实验室) ; School of Artificial Intelligence, Shenzhen University, Shenzhen, China(深圳大学人工智能学院)
专题命中 安全评测 :alignment(abstract);分类 cs.AI
机构 * Lenovo Research(联想研究院) ; School of Artificial Intelligence, UCAS(中国科学院大学人工智能学院) ; Institute of Automation, CAS(中国科学院自动化研究所) ; Macau University of Science and Technology(澳门科学理工学院) ; School of Computer Science and Technology, UCAS(中国科学院大学计算机科学与技术学院)
专题命中 安全评测 :trustworthy(abstract);分类 cs.AI
Comments preprint
机构 * School of Automotive Studies, Tongji University(同济大学汽车学院)
专题命中 安全评测 :safety(abstract);分类 cs.AI
Comments arXiv admin note: text overlap with arXiv:2408.04295 by other authors
机构 * Gaoling School of Artificial Intelligence, Renmin University of China, Beijing 100872, China(中国人民大学人工智能学院) ; AI Lab at Lenovo Research, Beijing 100085, China(联想研究院人工智能实验室)
专题命中 安全评测 :trustworthy(abstract);分类 cs.LG
机构 * Department of Imaging, Radboudumc, Nijmegen, the Netherlands(影像部,Radboudumc,尼姆egen,荷兰) ; Institute for Medical Informatics, University of Lübeck, Lübeck, Germany(医学信息研究所,吕贝克大学,吕贝克,德国) ; Department of Nuclear Medicine, Hospital 108, Hanoi, Vietnam(核医学部,108医院,河内,越南) ; Department of Diagnostic Imaging and Interventional Radiology, Thai Nguyen National Hospital, Thai Nguyen, Vietnam(诊断影像和介入放射科,Thai Nguyen国家医院,Thai Nguyen,越南) ; Interventional Radiology Center, Tam Anh Hospital, Hanoi, Vietnam(介入放射科中心,Tam Anh医院,河内,越南) ; FET, Vietnam National University, University of Engineering and Technology, Hanoi, Vietnam(FET,越南国家大学,工程与技术大学,河内,越南)
专题命中 安全评测 :alignment(abstract)
专题命中 安全评测 :safety(abstract)
机构 * College of Intelligence and Computing, Tianjin University(智能与计算学院,天津大学) ; Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院) ; Shenzhen University of Advanced Technology(深圳大学先进技术学院)
专题命中 安全评测 :alignment(abstract)