A Fine-tuning Dataset and Benchmark for Large Language Models for Protein Understanding
Toursun Synbio(图森合成生物);Johns Hopkins University(约翰斯·霍普金斯大学);University of Cambridge(剑桥大学);Shanghai Institute for Biomedical and Pharmaceutical Technologies(上海生物医药技术研究院);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);UNSW Syndey(新南威尔士大学悉尼分校)
Yiqing Shen, Zan Chen, Michail Mamalakis, Luhan He, Haiyang Xia, Tianbin Li, Yanzhou Su, Junjun He, Yu Guang Wang
The parallels between protein sequences and natural language in their sequential structures have inspired the application of large language models (LLMs) to protein understanding. Despite the success of LLMs in NLP, their effectiveness in comprehending protein sequences remains an open question, largely due to the absence of datasets linking protein sequences to descriptive text. Researchers have then attempted to adapt LLMs for protein understanding by integrating a protein sequence encoder with a pre-trained LLM. However, this adaptation raises a fundamental question: "Can LLMs, originally designed for NLP, effectively comprehend protein sequences as a form of language?" Current datasets fall short in addressing this question due to the lack of a direct correlation between protein sequences and corresponding text descriptions, limiting the ability to train and evaluate LLMs for protein understanding effectively. To bridge this gap, we introduce ProteinLMDataset, a dataset specifically designed for further self-supervised pretraining and supervised fine-tuning (SFT) of LLMs to enhance their capability for protein sequence comprehension. Specifically, ProteinLMDataset includes 17.46 billion tokens for pretraining and 893,000 instructions for SFT. Additionally, we present ProteinLMBench, the first benchmark dataset consisting of 944 manually verified multiple-choice questions for assessing the protein understanding capabilities of LLMs. ProteinLMBench incorporates protein-related details and sequences in multiple languages, establishing a new standard for evaluating LLMs' abilities in protein comprehension. The large language model InternLM2-7B, pretrained and fine-tuned on the ProteinLMDataset, outperforms GPT-4 on ProteinLMBench, achieving the highest accuracy score.
Structure-Enhanced Protein Instruction Tuning: Towards General-Purpose Protein Understanding with LLMs
School of Artificial Intelligence and Data Science, University of Science and Technology of China(人工智能与数据科学学院,中国科学技术大学);College of Computer Science and Technology, Zhejiang University(计算机科学与技术学院,浙江大学);Alibaba Cloud Computing(阿里云 computing);Thrust of Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou)(人工智能研究所,香港科技大学(广州));Department of Computer Science and Engineering, The Hong Kong University of Science and Technology(计算机科学与工程系,香港科技大学)
EvoLlama: Enhancing LLMs' Understanding of Proteins via Multimodal Structure and Sequence Representations
School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究院(TeleAI));School of Computer Science, Fudan University(复旦大学计算机学院);Xiaohongshu Inc(小红书科技有限公司);Innovation Center for AI and Drug Discovery, School of Pharmacy, East China Normal University(华东师范大学药学院人工智能与药物发现创新中心)
TourSynbio: A Multi-Modal Large Model and Agent Framework to Bridge Text and Protein Sequences for Protein Engineering
Toursun Synbio(拓荪合成生物);Johns Hopkins University(约翰斯·霍普金斯大学);University of Cambridge(剑桥大学);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);City University of Hong Kong(香港城市大学)
A Large-Scale Dataset and Benchmark: Do Protein-Ligand Models Learn Binding Sites or Just Binding Likelihood?
School of Computing Science(计算科学学院);School of Cancer Sciences(癌症科学学院);School of Life Science and Technology(生命科学与技术学院);Institute of Science Tokyo(东京科学研究院);Cancer Research UK Scotland Institute(英国癌症研究会苏格兰研究所);Language Technology Lab(语言技术实验室);Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School(哈佛医学院内科部,布里格斯妇女医院);The Broad Institute of MIT and Harvard(MIT和哈佛大学Broad研究所)
Swarms of Large Language Model Agents for Protein Sequence Design with Experimental Validation
Laboratory for Atomistic and Molecular Mechanics (LAMM), Department of Biological Engineering, Massachusetts Institute of Technology(原子分子力学实验室(LAMM),生物工程系,麻省理工学院);Department of Biomedical Engineering, Tufts University(生物医学工程系,塔夫茨大学);Laboratory for Atomistic and Molecular Mechanics (LAMM), Department of Civil and Environmental Engineering, Department of Mechanical Engineering, Center for Computational Science and Engineering, Schwarzman College of Computing, Massachusetts Institute of Technology(原子分子力学实验室(LAMM),土木与环境工程系,机械工程系,计算科学与工程中心,计算机科学学院,麻省理工学院)
Vision-Language Model Fine-Tuning via Simple Parameter-Efficient Modification
The University of Tokyo(东京大学);University of Southern California(南加州大学);The Chinese University of Hong Kong(香港中文大学);RIKEN Center for Advanced Intelligence Project(理化学研究所先进智能项目中心)
Controllable Protein Sequence Generation with LLM Preference Optimization
State Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);Medical School, Nanjing University(南京大学医学院);National Institute of Healthcare Data Science, Nanjing University(南京大学国家医疗数据科学研究院)
InstructPLM-mu: 1-Hour Fine-Tuning of ESM2 Beats ESM3 in Protein Mutation Predictions
The Chinese University of Hong Kong(香港中文大学);Hangzhou Institute of Medicine, CAS(杭州医学研究所,中国科学院);Hangzhou Institute for Advanced Study, UCAS(杭州先进研究 institute,中国科学院大学);University of Chinese Academy of Sciences(中国科学院大学);Tianjin University(天津大学)