Reinforcement Learning Guides Generative Protein Language Models
Centre for Genomic Regulation, the Barcelona Institute of Science and Technology(基因组调控中心,巴塞罗那科学技术研究所);Universitat Pompeu Fabra(庞培法布拉大学);Universitat de Barcelona, Facultat de Farmàcia i Ciències de l’Alimentació(巴塞罗那大学,药学与食品科学学院);Stanford University(斯坦福大学);Arc Institute(ARC研究所);Institució Catalana de Recerca i Estudis Avançats (ICREA)(加泰罗尼亚高级研究学院)
Filippo Stocco, Maria Artigues-Lleixa, Andrea Hunklinger, Michele Garibbo, Talal Widatalla, Marc Guell, Noelia Ferruz
备注:
28 pages including main text and supporting information
Protein engineering can optimize molecules for biotechnology and therapeutics, but navigating the high-dimensional sequence landscape remains challenging. Protein language models (pLMs) have shown to to generate functional proteins far from natural sequences, yet their outputs tend to reflect prevalent properties in training data, limiting discovery of rare properties such as high catalytic activity or thermostability. Here, we introduce ProtRL, a reinforcement learning framework for pLMs that iteratively updates model parameters to maximize externally defined reward functions. Across diverse design tasks, ProtRL shifts generation toward specified objectives while maintaining sequence diversity. We demonstrate the optimization of target folds, bounded and continuous fitness predictors, and multi-objective optimization in binder design. As a proof of concept, we applied ProtRL to experimental feedback for the engineering of epidermal growth factor receptor binders. Testing fewer than 100 designed variants across the experimental campaign, ProtRL-guided optimization provided a final round in which 16 of 22 variants bound EGFR. The best variant showed a dissociation constant of 5.5 nM, representing a nine-fold improvement over wild-type EGF and higher affinity than previously reported EGF variants identified through substantially larger screening campaigns. Our code and models are publicly available at github.com/AI4PDLab/ProtRL
Scoring-Assisted Generative Exploration for Proteins (SAGE-Prot): A Framework for Multi-Objective Protein Optimization via Iterative Sequence Generation and Evaluation
MP2D: Constrained Monte Carlo Tree-Guided Diffusion for Multi-Objective Protein Sequence Design
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);School of Mathematical Sciences, Zhejiang University(浙江大学数学科学学院);State Key Laboratory of Transvascular Implantation Devices and TIDRI(血管植入器械国家重点实验室和TIDRI);Zhejiang Key Laboratory of Medical Imaging Artificial Intelligence(浙江省医学影像人工智能重点实验室)
ProteinGuide: On-the-fly property guidance for protein sequence generative models
Department of Electrical Engineering and Computer Sciences, University of California, Berkeley(电气工程与计算机科学系,加州大学伯克利分校);Center for Computational Biology, University of California, Berkeley(计算生物学中心,加州大学伯克利分校);Department of Molecular and Cell Biology, University of California, Berkeley(分子与细胞生物学系,加州大学伯克利分校);Innovative Genomics Institute, University of California, Berkeley(创新基因组研究所,加州大学伯克利分校);Howard Hughes Medical Institute, University of California, Berkeley(霍华德·休斯医学研究所,加州大学伯克利分校)
Token-Level Guided Discrete Diffusion for Membrane Protein Design
University of Pennsylvania(宾夕法尼亚大学);Duke University(杜克大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Duke-NUS Medical School(杜克-新加坡国立大学医学院)
Reinforcement-guided generative protein language models enable de novo design of highly diverse AAV capsids
LASIGE, Faculdade de Ciências da Universidade de Lisboa(里斯本大学科学学院LASIGE实验室);BioISI, Faculdade de Ciências da Universidade de Lisboa(里斯本大学科学学院BioISI实验室);iBET – Instituto de Biologia Experimental e Tecnológica(生物实验与技术研究所)
Molecular dynamics without molecules: searching the conformational space of proteins with generative neural networks
Wayne State University(韦恩州立大学);Univ. of Bari Aldo Moro(巴里大学阿尔多·莫罗分校);National Research Council (CONICET)(国家研究委员会(CONICET));Daruma Institute for Applied Intelligence(达摩应用智能研究所)
Generative power of a protein language model trained on multiple sequence alignments
École Polytechnique Fédérale de Lausanne (EPFL)(洛桑联邦理工学院);Institute of Bioengineering(生物工程研究所);School of Life Sciences(生命科学学院);SIB Swiss Institute of Bioinformatics(瑞士生物信息学研究所)
Generative Modeling of Full-Atom Protein Conformations using Latent Diffusion on Graph Embeddings
Signal Processing Laboratory (LTS2), EPFL, Lausanne, Switzerland(信号处理实验室(LTS2),瑞士洛桑联邦理工学院);Institute of Bioengineering, EPFL, Lausanne, Switzerland(生物工程研究所,瑞士洛桑联邦理工学院);Bioinformatics Group, University & Research Wageningen, The Netherlands(生物信息学组,荷兰瓦赫宁根大学及研究学院);Ludwig Institute for Cancer Research, Lausanne, Switzerland(癌症研究路易斯研究所,瑞士洛桑)
Selection of sequence motifs and generative Hopfield-Potts models for protein familiesilies
进化相关蛋白质家族的统计模型最近引起了人们的兴趣:特别是成对Potts模型,如直接耦合分析所推断的那些,已经能够提取有关折叠蛋白质的三维结构的信息,以及蛋白质中氨基酸取代的影响。这些模型通常被要求再现蛋白质家族中氨基酸使用的单点和两点统计,{ \em,即}~以捕获所谓的残基保守和协变统计的共同进化起源的蛋白质。成对Potts模型是实现这一目标的最大熵模型。虽然是成功的,这些模型依赖于大量的{ \em ad hoc}引入的参数,这些参数必须从有限数量的数据中估计,并且其生物物理解释仍然不清楚。在这里,我们提出了一种方法来减少参数,这是基于选择集体序列基序。它自然导致制定的统计序列模型的Hopfield-Potts模型。这些模型可以准确地推断使用映射到限制玻尔兹曼机和持续的对比发散。我们发现,当应用于蛋白质数据时,即使是20-40个模式也足以获得统计上接近生成的模型。Hopfield模式形成可解释的序列基序,并可用于将氨基酸序列聚类为功能亚家族。然而,这些图案的分布式集体本质上限制了Hopfield-Potts模型在预测接触图的能力,显示出开发超越这里讨论的Hopfield-Potts模型的必要性。
Mask prior-guided denoising diffusion improves inverse protein folding
School of Computer Science, University of Sheffield(谢菲尔德大学计算机科学学院);Biologics Engineering, Oncology R&D, AstraZeneca(阿斯利康生物制药工程与肿瘤研发部);Medicinal Chemistry, Research and Early Development, Cardiovascular, Renal and Metabolism, BioPharmaceuticals R&D, AstraZeneca(阿斯利康医药化学与研发部);School of Biological Sciences, University of Southampton(南安普顿大学生物科学学院);Centre for Machine Intelligence, University of Sheffield(谢菲尔德大学智能中心)
Sparse generative modeling via parameter-reduction of Boltzmann machines: application to protein-sequence families
Universität Basel(巴塞尔大学);Swiss Institute of Bioinformatics(瑞士生物信息学研究所);Politecnico di Torino(都灵理工大学);Italian Institute for Genomic Medicine(意大利基因组医学研究所);Sorbonne Université(索邦大学);Université PSL(巴黎文理研究大学)
Modeling Protein Evolution via Generative Inference From Monte Carlo Chains to Population Genetics
Politecnico di Torino(都灵理工大学);Sorbonne Université(索邦大学);CNRS(法国国家科学研究中心);Laboratory of Computational and Quantitative Biology(计算与定量生物学实验室);École Normale Supérieure(巴黎高等师范学院);PSL Université(巴黎文理研究大学);Université de Paris(巴黎大学);The James Franck Institute(詹姆斯·弗兰克研究所);The University of Chicago(芝加哥大学);Department of Physics, The University of Chicago(芝加哥大学物理系);INFN, Sezione di Torino(意大利国家核物理研究所都灵分部);Italian Institute for Genomic Medicine, IRCCS Candiolo(意大利基因组医学研究所坎迪奥洛医院);Dipartimento di Fisica, Sapienza Università di Roma(罗马大学物理系)