Controllable Protein Sequence Generation with LLM Preference Optimization
State Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);Medical School, Nanjing University(南京大学医学院);National Institute of Healthcare Data Science, Nanjing University(南京大学国家医疗数据科学研究院)
Designing proteins with specific attributes offers an important solution to address biomedical challenges. Pre-trained protein large language models (LLMs) have shown promising results on protein sequence generation. However, to control sequence generation for specific attributes, existing work still exhibits poor functionality and structural stability. In this paper, we propose a novel controllable protein design method called CtrlProt. We finetune a protein LLM with a new multi-listwise preference optimization strategy to improve generation quality and support multi-attribute controllable generation. Experiments demonstrate that CtrlProt can meet functionality and structural stability requirements effectively, achieving state-of-the-art performance in both single-attribute and multi-attribute protein sequence generation.
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Tencent Inc.(腾讯公司)
Scaffold-Conditioned Preference Triplets for Controllable Molecular Optimization with Large Language Models
National Key Laboratory of Parallel and Distributed Processing(平行与分布式处理国家重点实验室);College of Computer Science and Technology(计算机科学与技术学院);National University of DefenseTechnology(国防科技大学);DP Technology(DP科技)
One Model for All: Multi-Objective Controllable Language Models
Ruhr University Bochum(波鸿鲁尔大学);Eindhoven University of Technology(埃因霍温理工大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Liverpool(利物浦大学)
Adaptive Helpfulness-Harmlessness Alignment with Preference Vectors
National Taiwan University(国立台湾大学);Texas A&M University(德克萨斯A&M大学);Appier AI Research(Appier人工智能研究院);Graduate Institute of Communication Engineering, National Taiwan University(国立台湾大学通信工程研究所)
GraphVF: Controllable Protein-Specific 3D Molecule Generation with Variational Flow
Peking University(北京大学);National Research Council Canada(加拿大国家研究委员会);University of Ottawa(渥太华大学);Mila - Québec AI Institute(Mila - 魁北克人工智能研究所);HEC Montréal(蒙特利尔高等商学院)
ProteinOPD: Towards Effective and Efficient Preference Alignment for Protein Design
Tsinghua University(清华大学);International Digital Economy Academy(国际数字经济学院);Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Nanyang Technological University(南洋理工大学)
Property-driven Protein Inverse Folding With Multi-Objective Preference Alignment
School of Computer Science, Peking University(北京大学计算机科学系);BioGeometry;Mila - Québec AI Institute(魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);HEC Montréal(蒙特利尔HEC商学院);CIFAR AI Research Chair(CIFAR人工智能研究主席)
Improving Protein Sequence Design through Designability Preference Optimization
University of Technology Sydney(技术科技大学);University of Washington(华盛顿大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Zhejiang University(浙江大学)