大模型对齐与安全 - arXivDaily 专题

2408.06273 2024-10-29 cs.CL 70%

FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data

Haoran Sun, Renren Jin, Shaoyang Xu, Leiyu Pan, Supryadi, Menglong Cui, Jiangcun Du, Yikun Lei, Lei Yang, Ling Shi, Juesi Xiao, Shaolin Zhu, Deyi Xiong

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2024 Industry Track

2410.18890 2024-10-25 cs.AI 70%

Improving Small-Scale Large Language Models Function Calling for Reasoning Tasks

Graziano A. Manduzio, Federico A. Galatolo, Mario G. C. A. Cimino, Enzo Pasquale Scilingo, Lorenzo Cominelli

专题命中偏好对齐：RLHF(abstract)；DPO(abstract)；分类 cs.AI

2407.13887 2024-10-25 cs.CL 70%

Learning Goal-Conditioned Representations for Language Reward Models

Vaskar Nath, Dylan Slack, Jeff Da, Yuntao Ma, Hugh Zhang, Spencer Whitehead, Sean Hendryx

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.CL

2405.05008 2024-10-25 cs.CL 70%

ADELIE: Aligning Large Language Models on Information Extraction

Yunjia Qi, Hao Peng, Xiaozhi Wang, Bin Xu, Lei Hou, Juanzi Li

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

Comments Accepted at EMNLP 2024. Camera-ready version

2410.16184 2024-10-22 cs.CL 70%

RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style

Yantao Liu, Zijun Yao, Rui Min, Yixin Cao, Lei Hou, Juanzi Li

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.CL

2409.17534 2024-10-15 cs.AI 70%

Just Say What You Want: Only-prompting Self-rewarding Online Preference Optimization

Ruijie Xu, Zhihan Liu, Yongfei Liu, Shipeng Yan, Zhaoran Wang, Zhi Zhang, Xuming He

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.AI

2406.11370 2024-10-15 cs.CL cs.AI cs.CY cs.LG 70%

Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments

Han Zhou, Xingchen Wan, Yinhong Liu, Nigel Collier, Ivan Vulić, Anna Korhonen

专题命中偏好对齐：alignment(abstract)；分类 cs.CL、cs.AI、cs.CY

Comments EMNLP 2024

2410.05495 2024-10-10 cs.CL 70%

Self-rationalization improves LLM as a fine-grained judge

Prapti Trivedi, Aditya Gulati, Oliver Molenschot, Meghana Arakkal Rajeev, Rajkumar Ramamurthy, Keith Stevens, Tanveesh Singh Chaudhery, Jahnavi Jambholkar, James Zou, Nazneen Rajani

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

2408.08411 2024-10-08 cs.CL 70%

Rater Cohesion and Quality from a Vicarious Perspective

Deepak Pandita, Tharindu Cyril Weerasooriya, Sujan Dutta, Sarah K. Luger, Tharindu Ranasinghe, Ashiqur R. KhudaBukhsh, Marcos Zampieri, Christopher M. Homan

专题命中偏好对齐：safety(abstract)；AI safety(abstract)；分类 cs.CL

Comments Accepted at EMNLP 2024 Findings

2407.01470 2024-10-08 cs.CL 70%

DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging

Tzu-Han Lin, Chen-An Li, Hung-yi Lee, Yun-Nung Chen

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.CL

Comments In the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024). The code for our work is available at: https://github.com/MiuLab/DogeRM

2407.06542 2024-10-04 cs.CL 70%

LIONs: An Empirically Optimized Approach to Align Language Models

Xiao Yu, Qingyang Wu, Yu Li, Zhou Yu

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

2406.19371 2024-10-03 cs.CL 70%

Suri: Multi-constraint Instruction Following for Long-form Text Generation

Chau Minh Pham, Simeng Sun, Mohit Iyyer

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

Comments Accepted to EMNLP'24 (Findings)

2408.14874 2024-08-30 cs.CL 70%

Inverse-Q*: Token Level Reinforcement Learning for Aligning Large Language Models Without Preference Data

Han Xia, Songyang Gao, Qiming Ge, Zhiheng Xi, Qi Zhang, Xuanjing Huang

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.CL

2407.09072 2024-07-15 cs.CL 70%

New Desiderata for Direct Preference Optimization

Xiangkun Hu, Tong He, David Wipf

专题命中偏好对齐：RLHF(abstract)；DPO(abstract)；分类 cs.CL

2406.15568 2024-07-10 cs.LG 70%

Robust Reinforcement Learning from Corrupted Human Feedback

Alexander Bukharin, Ilgee Hong, Haoming Jiang, Zichong Li, Qingru Zhang, Zixuan Zhang, Tuo Zhao

专题命中偏好对齐：RLHF(abstract)；DPO(abstract)；分类 cs.LG

Comments 22 pages, 7 figures

2404.06138 2024-07-09 cs.CL 70%

Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languages

Samuel Cahyawijaya, Holy Lovenia, Fajri Koto, Rifki Afina Putri, Emmanuel Dave, Jhonson Lee, Nuur Shadieq, Wawan Cenggoro, Salsabil Maulana Akbar, Muhammad Ihza Mahendra, Dea Annisayanti Putri, Bryan Wilie, Genta Indra Winata, Alham Fikri Aji, Ayu Purwarianti, Pascale Fung

专题命中偏好对齐：RLHF(abstract)；safety(abstract)；分类 cs.CL

Comments Cendol models are released under Apache 2.0 license and will be made publicly available soon

2406.17923 2024-06-27 cs.CL 70%

PAFT: A Parallel Training Paradigm for Effective LLM Fine-Tuning

Shiva Kumar Pentyala, Zhichao Wang, Bin Bi, Kiran Ramnath, Xiang-Bo Mao, Regunathan Radhakrishnan, Sitaram Asur, Na, Cheng

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

2406.16486 2024-06-25 cs.AI 70%

Towards Comprehensive Preference Data Collection for Reward Modeling

Yulan Hu, Qingyang Li, Sheng Ouyang, Ge Chen, Kaihui Chen, Lijun Mei, Xucheng Ye, Fuzheng Zhang, Yong Liu

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.AI

2311.04155 2024-06-24 cs.CL 70%

Black-Box Prompt Optimization: Aligning Large Language Models without Model Training

Jiale Cheng, Xiao Liu, Kehan Zheng, Pei Ke, Hongning Wang, Yuxiao Dong, Jie Tang, Minlie Huang

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

Comments Accepted to ACL 2024

2312.12999 2024-06-04 cs.CL 70%

Machine Mindset: An MBTI Exploration of Large Language Models

Jiaxi Cui, Liuzhenghao Lv, Jing Wen, Rongsheng Wang, Jing Tang, YongHong Tian, Li Yuan

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

2405.19763 2024-05-31 cs.CL 70%

Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding

Kuo Liao, Shuang Li, Meng Zhao, Liqun Liu, Mengge Xue, Zhenyu Hu, Honglin Han, Chengguo Yin

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.CL

Comments Accept at ACL2024 Main

2405.14490 2024-05-24 cs.CL 70%

Impact of Non-Standard Unicode Characters on Security and Comprehension in Large Language Models

Johan S Daniel, Anand Pal

专题命中偏好对齐：RLHF(abstract)；prompt injection(abstract)；分类 cs.CL

Comments 46 pages

2405.14103 2024-05-24 cs.LG 70%

Online Self-Preferring Language Models

Yuanzhao Zhai, Zhuo Zhang, Kele Xu, Hanyang Peng, Yue Yu, Dawei Feng, Cheng Yang, Bo Ding, Huaimin Wang

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.LG

Comments 20 pages, 9 figures

2405.09747 2024-05-17 q-fin.CP cs.LG 70%

NIFTY Financial News Headlines Dataset

Raeid Saqur, Ken Kato, Nicholas Vinden, Frank Rudzicz

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.LG

2310.16960 2024-05-06 cs.LG cs.CR 70%

Privately Aligning Language Models with Reinforcement Learning

Fan Wu, Huseyin A. Inan, Arturs Backurs, Varun Chandrasekaran, Janardhan Kulkarni, Robert Sim

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.LG

Comments Accepted at ICLR 2024

2404.09220 2024-04-16 cs.CL 70%

Compass: Large Multilingual Language Model for South-east Asia

Sophia Maria

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.CL

2404.02934 2024-04-05 cs.CL cs.AI cs.CY cs.LG 70%

GreedLlama: Performance of Financial Value-Aligned Large Language Models in Moral Reasoning

Jeffy Yu, Maximilian Huber, Kevin Tang

专题命中偏好对齐：alignment(abstract)；分类 cs.CL、cs.AI、cs.CY

Comments 9 pages, 1 figure

2404.01258 2024-04-03 cs.CV cs.AI 70%

Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward

Ruohong Zhang, Liangke Gui, Zhiqing Sun, Yihao Feng, Keyang Xu, Yuanhan Zhang, Di Fu, Chunyuan Li, Alexander Hauptmann, Yonatan Bisk, Yiming Yang

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.AI

2309.16583 2024-04-03 cs.CL 70%

GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond

Shen Zheng, Yuyu Zhang, Yijie Zhu, Chenguang Xi, Pengyang Gao, Xun Zhou, Kevin Chen-Chuan Chang

专题命中偏好对齐：alignment(abstract)；RLHF(abstract)；分类 cs.CL

Comments Accepted by NAACL 2024

2403.04187 2024-03-08 physics.bio-ph cs.AI cs.CE q-bio.BM 70%

Preference optimization of protein language models as a multi-objective binder design paradigm

Pouria Mistani, Venkatesh Mysore

专题命中偏好对齐：alignment(abstract)；DPO(abstract)；分类 cs.AI

Comments Published at the GEM workshop, ICLR 2024. Generative and Experimental Perspectives for Biomolecular Design (https://www.gembio.ai/)

1. 偏好对齐 3273 篇

FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data

Improving Small-Scale Large Language Models Function Calling for Reasoning Tasks

Learning Goal-Conditioned Representations for Language Reward Models

ADELIE: Aligning Large Language Models on Information Extraction

RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style

Just Say What You Want: Only-prompting Self-rewarding Online Preference Optimization

Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments

Self-rationalization improves LLM as a fine-grained judge

Rater Cohesion and Quality from a Vicarious Perspective

DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging

LIONs: An Empirically Optimized Approach to Align Language Models

Suri: Multi-constraint Instruction Following for Long-form Text Generation

Inverse-Q*: Token Level Reinforcement Learning for Aligning Large Language Models Without Preference Data

New Desiderata for Direct Preference Optimization

Robust Reinforcement Learning from Corrupted Human Feedback

Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languages

PAFT: A Parallel Training Paradigm for Effective LLM Fine-Tuning

Towards Comprehensive Preference Data Collection for Reward Modeling

Black-Box Prompt Optimization: Aligning Large Language Models without Model Training

Machine Mindset: An MBTI Exploration of Large Language Models

Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding

Impact of Non-Standard Unicode Characters on Security and Comprehension in Large Language Models

Online Self-Preferring Language Models

NIFTY Financial News Headlines Dataset

Privately Aligning Language Models with Reinforcement Learning

Compass: Large Multilingual Language Model for South-east Asia

GreedLlama: Performance of Financial Value-Aligned Large Language Models in Moral Reasoning

Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward

GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond

Preference optimization of protein language models as a multi-objective binder design paradigm